From d860ab6b56f081144458cda5440269806ca914dd Mon Sep 17 00:00:00 2001 From: Nate Sesti Date: Thu, 1 Feb 2024 10:52:02 -0800 Subject: [PATCH] =?UTF-8?q?=F0=9F=93=9D=20tab-autocomplete=20setting=20up?= =?UTF-8?q?=20a=20custom=20model?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- docs/docs/walkthroughs/tab-autocomplete.md | 20 +++++++++++++++++++- 1 file changed, 19 insertions(+), 1 deletion(-) diff --git a/docs/docs/walkthroughs/tab-autocomplete.md b/docs/docs/walkthroughs/tab-autocomplete.md index f4116a8edc..5ce2edff5f 100644 --- a/docs/docs/walkthroughs/tab-autocomplete.md +++ b/docs/docs/walkthroughs/tab-autocomplete.md @@ -2,7 +2,7 @@ Continue now provides experimental support for tab autocomplete in VS Code. You can enable it by downloading the pre-release version of the extension, opening VS Code settings, and then checking the box that says "Enable Tab Autocomplete". There is also a button on the bottom/status bar for fast access. We will be greatly improving the experience over the next few releases, and it is always helpful to hear feedback. If you have any problems or suggestions, please let us know in our [Discord](https://discord.gg/vapESyrFmJ). -## Setting up with Ollama +## Setting up with Ollama (default) We recommend setting up tab-autocomplete with a local Ollama instance. To do this, first download the latest version of Ollama from [here](https://ollama.ai). Then, run the following command to download our recommended model: @@ -12,6 +12,24 @@ ollama run deepseek-coder:1.3b-base Once it has been downloaded, you should begin to see completions in VS Code. +## Setting up a custom model + +All of the configuration options available for chat models are available to use for tab-autocomplete. For example, if you wanted to use a remote Ollama instance you would edit your `config.json` like this: + +```json +{ + "tabAutocompleteModel": { + "title": "Tab Autocomplete Model", + "provider": "ollama", + "model": "deepseek-coder:1.3b-base", + "apiBase": "https://" + }, + ... +} +``` + +If you aren't yet familiar with the available options, you can learn more in our [overview](../model-setup/overview.md). + ## Configuration Options The following can be configured in `config.json`: