Skip to content

Commit

Permalink
Fix a nit
Browse files Browse the repository at this point in the history
  • Loading branch information
Honry committed Jan 14, 2025
1 parent b8fd31a commit 40ed3d6
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -291,7 +291,7 @@ bool RotaryEmbeddingOpBuilder::IsOpSupportedImpl(const InitializedTensorSet& ini
return false;
}

if (input_size == 4 && num_heads != input_shape[1]) {
if (input_size == 4 && num_heads != 0 && num_heads != input_shape[1]) {
LOGS(logger, VERBOSE) << "RotaryEmbedding: when input has 4 dimensions, num_heads must be 0 or have the same value "
"as the second dimension of the input";
return false;
Expand Down

0 comments on commit 40ed3d6

Please sign in to comment.