Skip to content

Commit

Permalink
Fixed typo (#1458)
Browse files Browse the repository at this point in the history
  • Loading branch information
ilya-lavrenov authored Dec 31, 2024
1 parent afb4ad0 commit 34dc469
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion src/cpp/src/continuous_batching_impl.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -195,7 +195,7 @@ void ContinuousBatchingPipeline::ContinuousBatchingImpl::step() {
step_count++;
#endif

// process generation_config.echo parameetr
// process generation_config.echo parameter
_fill_prompt_log_probs(m_requests, logits);

SamplerOutput sampler_output;
Expand Down
2 changes: 1 addition & 1 deletion src/cpp/src/lm_encoding.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ std::pair<EncodedResults, std::optional<int64_t>> get_lm_encoded_results(

auto logits = m_llm.get_tensor("logits");

// since we have applied `Slice` operationto last MatMul, model output sequence lenght is 1
// since we have applied `Slice` operation to last MatMul, model output sequence lenght is 1
// so, we need to update sequence groups to think that they already have processed all prompt tokens except last ones
// and schedule only `output_sequence_len` ones
int64_t output_sequence_len = logits.get_shape().at(1);
Expand Down

0 comments on commit 34dc469

Please sign in to comment.