Skip to content

Pull requests: mlc-ai/tokenizers-cpp

New pull request New
3 Open 23 Closed
3 Open 23 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix for loading tokenizers using non-utf8 strings
#55 opened Jan 13, 2025 by ThomasProg Loading…
Add a way to force the macos target in case it is set
#52 opened Dec 12, 2024 by ykhrustalev Loading…
Add web binding Tokenizer.tokenToId()
#41 opened Aug 6, 2024 by grf53 Loading…
6
ProTip! Mix and match filters to narrow down what you’re looking for.