Skip to content

jinymusim/serve-model

Repository files navigation

Serve Model through OpenAI API

This project is desinged to showcase how custom models can be integrated with OpenAI API.

It is desinged to show LLM, Embedding and Audio OpenAI API using the OpenAI Client while running Huggingface Models in background.

Any model in servable as long as it conforms to OpenAI API rules which can be fined at

https://platform.openai.com/docs/api-reference/introduction

About

Serve LLM model

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages