Code

VLLM Sampled Tokens#311

Code

Open

AdamBelfki3 wants to merge 3 commits into0.4ndif-team/nnsight:0.4from vllm-samplendif-team/nnsight:vllm-sampleCopy head branch name to clipboard

+99-18

Commits

Commits on Dec 17, 2024

• fix (vllm): narrowing logits correctly for each invoker

  AdamBelfki3

  committed
  4f67ca4

  Copy full SHA for 4f67ca4

• feature (vllm): add proper traceability for the vllm sampled tokens

  AdamBelfki3

  committed
  9c8d7eb

  Copy full SHA for 9c8d7eb

Commits on Jan 13, 2025

• feat (docs): document the patching process

  AdamBelfki3

  committed
  6c3bd18

  Copy full SHA for 6c3bd18