[8.16] Adds LLM matrix for OSS models (backport #6424) #6461
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fixes #6396 — adds a second matrix to the LLM performance matrix page that describes the performance of open-source models on our tasks. Also flips the existing matrix rows and columns so it can fit better in a browser window (minimize the need to scroll left-right).
Finally, makes a minor addition to the bring your own LLM guide, linking to the performance matrix since it now includes info about open source models.
Previews:
This is an automatic backport of pull request Adds LLM matrix for OSS models #6424 done by Mergify.