Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ollama #687

Merged
merged 12 commits into from
Oct 16, 2024
Merged

Add ollama #687

Changes from 6 commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
7d35685
Add ollama
boxabirds May 20, 2024
d84ea80
snippetOllama
mishig25 Oct 15, 2024
032fae2
update displayOnModelPage
mishig25 Oct 15, 2024
5d00eb0
docsUrl: "https://ollama.com",
mishig25 Oct 16, 2024
6c9b5da
snippetOllama with filepath specified
mishig25 Oct 16, 2024
6f4effe
Merge branch 'main' into patch-1
mishig25 Oct 16, 2024
00710be
Merge branch 'main' into patch-1
mishig25 Oct 16, 2024
acae236
dependencies @huggingface/gguf
mishig25 Oct 16, 2024
cbf44d6
displayOnModelPage: isLlamaCppGgufModel,
mishig25 Oct 16, 2024
b34e76b
pnpm add @huggingface/gguf@workspace:^
mishig25 Oct 16, 2024
c2691b0
comment "Support the placeholder {{OLLAMA_TAG}}"
mishig25 Oct 16, 2024
8887e64
Merge branch 'main' into patch-1
mishig25 Oct 16, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions packages/tasks/src/local-apps.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
import type { ModelData } from "./model-data";
import type { PipelineType } from "./pipelines";
import { parseGGUFQuantLabel } from "@huggingface/gguf";

export interface LocalAppSnippet {
/**
Expand Down Expand Up @@ -143,6 +144,15 @@ const snippetNodeLlamaCppCli = (model: ModelData, filepath?: string): LocalAppSn
];
};

const snippetOllama = (model: ModelData, filepath?: string): string => {
if (filepath) {
const quantLabel = parseGGUFQuantLabel(filepath);
const ollamatag = quantLabel ? `:${quantLabel}` : "";
return `ollama run hf.co/${model.id}${ollamatag}`;
}
return `ollama run hf.co/${model.id}{{OLLAMA_TAG}}`;
mishig25 marked this conversation as resolved.
Show resolved Hide resolved
};

const snippetLocalAI = (model: ModelData, filepath?: string): LocalAppSnippet[] => {
const command = (binary: string) =>
["# Load and run the model:", `${binary} huggingface://${model.id}/${filepath ?? "{{GGUF_FILE}}"}`].join("\n");
Expand Down Expand Up @@ -389,6 +399,13 @@ export const LOCAL_APPS = {
displayOnModelPage: (model) => model.library_name === "diffusers" && model.pipeline_tag === "text-to-image",
deeplink: (model) => new URL(`https://models.invoke.ai/huggingface/${model.id}`),
},
ollama: {
prettyLabel: "Ollama",
docsUrl: "https://ollama.com",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Probably have dedicated docs on the hub for this, but we can make a follow-up PR later on

mainTask: "text-generation",
displayOnModelPage: (model) => model.tags.includes("conversational") && isLlamaCppGgufModel(model),
mishig25 marked this conversation as resolved.
Show resolved Hide resolved
snippet: snippetOllama,
},
} satisfies Record<string, LocalApp>;

export type LocalAppKey = keyof typeof LOCAL_APPS;
Loading