Merge

fix vllm fork version (#237) #114

Job	Run time
Lint / lint	31s
Tests / getting-started-test (3.9)	3m 7s
Tests / setup-test (3.9)	2m 28s
Tests / getting-started-test (3.10)	2m 42s
Tests / docker-test (3.9)	18m 32s
Tests / bare-test (3.9)	14m 53s
Tests / getting-started-test (3.11)	3m 16s
Tests / setup-test (3.10)	2m 7s
Tests / bare-test (3.10)	15m 15s
Tests / setup-test (3.11)	2m 13s
Tests / bare-test (3.11)	15m 17s
Tests / docker-test (3.10)	17m 16s
Tests / docker-test (3.11)	18m 34s
Inference_Gaudi / inference (llama-2-7b-chat-hf)	1m 6s
Finetune / finetune (EleutherAI/gpt-j-6b)	25m 38s
Inference_Gaudi / inference (llama-2-70b-chat-hf)	2m 8s
Inference / inference (gpt-j-6b)	14m 22s
Finetune / finetune (meta-llama/Llama-2-7b-chat-hf)	14m 50s
Inference_Gaudi / inference (llama-2-7b-chat-hf-vllm)	1m 39s
Inference / inference (mistral-7b-v0.1)	6m 19s
Finetune / finetune (mistralai/Mistral-7B-v0.1)	18m 42s
Inference / inference (mpt-7b-ipex-llm)	7m 28s
Finetune / finetune (google/gemma-2b)	7m 23s
Inference / inference (llama-2-7b-chat-hf-vllm)	2m 28s
Inference / inference (gemma-2b)	6m 14s
Inference / inference (mpt-7b, nathan0/mpt-7b-deltatuner-model)	34m 22s
	4h 18m 50s

Provide feedback