You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently the YOLOv4 server lacks API key authorization for it's main inference request endpoint. This needs to be added and should use a similar system to the other servers (see TT-Metal Llama 3.1 70B, and TT-Metal Mistral 7B). This system uses a JWT (JSON Web Token) to encode information in the "Authorization" header.
Currently the YOLOv4 server lacks API key authorization for it's main inference request endpoint. This needs to be added and should use a similar system to the other servers (see TT-Metal Llama 3.1 70B, and TT-Metal Mistral 7B). This system uses a JWT (JSON Web Token) to encode information in the "Authorization" header.
See
tt-inference-server/tt-metal-llama3-70b/src/inference_api_server.py
Line 474 in dddad09
The text was updated successfully, but these errors were encountered: