Skip to content

Commit

Permalink
πŸ“ make custom edit template docs more clear
Browse files Browse the repository at this point in the history
  • Loading branch information
sestinj committed Feb 4, 2024
1 parent 5677b3d commit a93d9bd
Showing 1 changed file with 3 additions and 7 deletions.
10 changes: 3 additions & 7 deletions docs/docs/model-setup/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -98,9 +98,9 @@ This exact function and a few other default implementations are available in [`c

You also have access to customize the prompt used in the '/edit' slash command. We already have a well-engineered prompt for GPT-4 and sensible defaults for less powerful open-source models, but you might wish to play with the prompt and try to find a more reliable alternative if you are for example getting English as well as code in your output.

To customize the prompt, use the `promptTemplates` property of any model, which is a dictionary, and set the "edit" key to a template string with Mustache syntax. The 'filePrefix', 'fileSuffix', 'codeToEdit', 'language', 'contextItems', and 'userInput' variables are available in the template. Here is an example:
To customize the prompt, use the `promptTemplates` property of any model, which is a dictionary, and set the "edit" key to a template string with Mustache syntax. The 'filePrefix', 'fileSuffix', 'codeToEdit', 'language', 'contextItems', and 'userInput' variables are available in the template. Here is an example of how it can be set in `config.ts`:

```typescript
```typescript title="~/.continue/config.ts"
const codellamaEditPrompt = `\`\`\`{{{language}}}
{{{codeToEdit}}}
\`\`\`
Expand All @@ -109,13 +109,9 @@ const codellamaEditPrompt = `\`\`\`{{{language}}}
Your answer should be given inside of a code block. It should use the same kind of indentation as above.
[/INST] Sure! Here's the rewritten code you requested:
\`\`\`{{{language}}}`;
```

It can then be used like this in `config.ts`:

```typescript title="~/.continue/config.ts"
function modifyConfig(config: Config): Config {
config.models[0].promptTemplates["edit"] = "<INSERT_TEMPLATE_HERE>";
config.models[0].promptTemplates["edit"] = codellamaEditPrompt;
return config;
}
```
Expand Down

0 comments on commit a93d9bd

Please sign in to comment.