Llama3 Instruct Not working as [INST] tag is unknown to Llama3

[ClaudeStabile]

Hello,

The plugin is working perfectly with Mistral Instruct. Instructions are passed through via [INSTR] tag and behavior looks good.
For Llama3 Instruct, it looks different as [INSTR] tag is not know and this is creating problems and cause Llama to generate strange replys
No clue if plugin can easilly be adapted to Llama3 but could be nice to have.

Llama3 API to try/reproduce it : https://llama3.free-solutions.ch

Might be interesting for Llama3 fans

[deleolajide]

LLaMA 3 uses a different prompt. I will make changes to allow configuration of the prompt prefix and suffix. Can you confirm how to create a prompt for LLaMA 3.

Do you know the prefix and suffix values?

[ClaudeStabile]

Dele,

I have found this @meta https://llama.meta.com/docs/model-cards-and-prompt-formats/meta-code-llama/
Unsure if it is what you needed.

[deleolajide]

Unsure if it is what you needed
👍