Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move tests on sampling to test_sampling.py #1465

Merged
merged 13 commits into from
Jan 3, 2025

Conversation

ilya-lavrenov
Copy link
Contributor

@ilya-lavrenov ilya-lavrenov commented Jan 2, 2025

  • Move extensive tests on decoding / sampling from test_llm_pipeline.py tests to test_sampling.py
  • Partially refactored common functions in common.py to be more generic (to be continued in next PRs)
  • Dropped partially predefined functions with generation configs and replaced them in tests with dict of generation parameters, so you can better see tests params closer to tests itself and avoid creating numerous get_** for new generation values combinations.
  • Sampling tests are now implemented on top of stateful model for better comparison with optimum-intel

@github-actions github-actions bot added category: visual language Visual language pipeline category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: sampling Sampling / Decoding algorithms category: Python API Python API for GenAI no-match-files labels Jan 2, 2025
@github-actions github-actions bot added category: WWB PR changes WWB category: GHA CI based on Github actions labels Jan 3, 2025
@ilya-lavrenov ilya-lavrenov changed the title Sampler tests Move tests on sampling to test_sampling.py Jan 3, 2025
@ilya-lavrenov ilya-lavrenov added this to the 2025.0 milestone Jan 3, 2025
@ilya-lavrenov ilya-lavrenov marked this pull request as ready for review January 3, 2025 14:32
@github-actions github-actions bot removed the category: WWB PR changes WWB label Jan 3, 2025
tests/python_tests/common.py Outdated Show resolved Hide resolved
@github-actions github-actions bot added the category: WWB PR changes WWB label Jan 3, 2025
@ilya-lavrenov ilya-lavrenov force-pushed the sampler-tests branch 2 times, most recently from 4e86fba to 7e6cdc2 Compare January 3, 2025 19:39
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Jan 3, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Jan 3, 2025
@ilya-lavrenov ilya-lavrenov merged commit 1fd1430 into openvinotoolkit:master Jan 3, 2025
59 checks passed
@ilya-lavrenov ilya-lavrenov deleted the sampler-tests branch January 3, 2025 23:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: continuous batching Continuous batching category: GHA CI based on Github actions category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: sampling Sampling / Decoding algorithms category: visual language Visual language pipeline category: WWB PR changes WWB no-match-files
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants