Skip to content

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines #19

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines

[TESTS] Use FP32 inference precision, FP16 KV cache precision for pipelines #19

Annotations

2 errors

LLM bench tests (3.11)

failed Jan 6, 2025 in 6m 12s