Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LLM][NPU] Ported sampler from Stateless to Stateful pipeline #1507

Merged
merged 4 commits into from
Jan 13, 2025
Merged

[LLM][NPU] Ported sampler from Stateless to Stateful pipeline #1507

merged 4 commits into from
Jan 13, 2025

Conversation

AsyaPronina
Copy link
Contributor

  • Ported sampler functionality from Stateless to Stateful pipeline

@github-actions github-actions bot added the category: LLM LLM pipeline (stateful, static) label Jan 8, 2025
ilya-lavrenov
ilya-lavrenov reviewed Jan 9, 2025
View reviewed changes
src/cpp/src/llm_pipeline_static.cpp Outdated Show resolved Hide resolved
src/cpp/src/llm_pipeline_static.cpp Outdated Show resolved Hide resolved
@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Jan 9, 2025
@ilya-lavrenov ilya-lavrenov changed the title Ported sampler from Stateless to Stateful pipeline [LLM][NPU] Ported sampler from Stateless to Stateful pipeline Jan 9, 2025
TolyaTalamanov
TolyaTalamanov reviewed Jan 9, 2025
View reviewed changes
Copy link
Collaborator

@TolyaTalamanov TolyaTalamanov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, could you also enable testing of StatefulLLMPipeline in test_llm_pipeline_static.py?

src/cpp/src/llm_pipeline_static.cpp Outdated Show resolved Hide resolved
@AsyaPronina AsyaPronina force-pushed the multinomial_in_static_stateful_ppl branch from cecbce9 to 01348fe Compare January 10, 2025 19:37
@dmatveev dmatveev added this pull request to the merge queue Jan 13, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Jan 13, 2025
@AsyaPronina AsyaPronina added this pull request to the merge queue Jan 13, 2025
Merged via the queue into openvinotoolkit:master with commit 5146984 Jan 13, 2025
59 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@TolyaTalamanov TolyaTalamanov TolyaTalamanov left review comments

@ilya-lavrenov ilya-lavrenov ilya-lavrenov approved these changes

Assignees

@ilya-lavrenov ilya-lavrenov

@TolyaTalamanov TolyaTalamanov

Labels
category: LLM LLM pipeline (stateful, static) category: NPU
Projects
None yet
Milestone
2025.0
Development

Successfully merging this pull request may close these issues.
3 participants
@AsyaPronina @ilya-lavrenov @TolyaTalamanov