Web LLM

Give an AI node a chat model that runs inside your browser: free, private, offline once downloaded, and no API key.

Try it

工作流 · explain-eli5.awf 4 个步骤

Explain Like I'm 5：包含 4 个步骤的工作流，从 Right-click a selection 开始，到 Show the explanation 结束。

1. 1 Right-click a selection（Context Menu — 打开其文档页面） Context Menu
2. 2 Get selected text（页面内操作 — 打开其文档页面） 页面内操作
3. 3 Explain simply（Basic LLM Chain — 打开其文档页面） Basic LLM Chain + Local AI model
4. 4 Show the explanation（Display Markdown — 打开其文档页面） Display Markdown

在 AWFlow 中打开 复制 .awf

What it does

Web LLM is a model you plug into the Model slot of an AI node, such as the Tools Agent or Basic LLM Chain. It does not run on its own and has no output. When the AI node runs, the model answers on your device, using your graphics card through WebGPU.

• The model downloads the first time you use it, then stays in the browser. Installed models start right away.
• It loads and runs in the background, so the page stays responsive. The run log shows the loading progress.
• Temperature is 0.5 by default.
• It works with the Tools Agent: the tools are described in the prompt and the model writes its tool calls in its reply. The common formats (<tool_call>…</tool_call>, [TOOL_CALLS], fenced JSON, or a reply that is only the JSON call) are all understood. Instruct models trained for tool use do this much better than very small ones.

When to use it

• Private text that must not leave your computer.
• Workflows that must work offline, or without paying for an AI service.
• Short, simple jobs: rewrite, tag, extract, short summaries.

For bigger models, use Ollama. On a device without WebGPU, use Transformers Chat.

Inputs and settings

设置项	类型	作用
Model	Model picker	The in-browser model to run. Installed models are ready immediately; others download on first use — or install them from Local Models.
Options	Group	The options to use with the model.
Options › Temperature	Number	The temperature to use for the model. 默认值：0.5

The Model picker shows which models are installed and lets you download one inline. A new node starts with the local model you chose as your default. To install, compare or delete models ahead of time, use the Local Models page.

When you publish or share the workflow, Model is cleared, so whoever installs it picks a model on their own device.

Outputs

This node has no output port. It plugs into a slot on another node instead of passing items along.

• Model slot of Tools Agent, Q&A Agent, RAG Agent, Basic LLM Chain, Indexer, Text Classifier, Sentiment Analysis, Summarization, Information Extractor, Guardrails, Auto-fixing Output Parser

The AI node you connect it to produces the output. Web LLM only decides which model answers.

Dependencies and credentials

None. This node needs no connection and has no slots for other nodes.

Example workflow

1. A Context Menu trigger on selected text.
2. Basic LLM Chain with Prompt Rewrite this to sound more professional: {{ $input.selectionText }}.
3. Web LLM in its Model slot, with an installed model.
4. Clipboard Write with Text {{ $input.response }}.

Common issues

• “Model parameter is required and cannot be empty”. Pick a model in Model.
• “Invalid model ID: …”. The model is not in this browser’s model list, for example after importing a workflow from another device. Pick a model again.
• The first run takes minutes. The model is downloading (often hundreds of MB to a few GB). Install it in advance from Local Models.
• It fails on this computer. Your browser or graphics card has no WebGPU support. Use Transformers Chat or a cloud model.
• The agent never calls a tool. Small models often answer in plain text instead. Use a larger instruct model, and give your tools clear descriptions.

Recipes with this node

Turn highlighted text into a Todoist task 入门 · 6 分钟 需要连接 Explain any highlighted text in plain words 入门 · 4 分钟 设备端 Summarize the page you're reading, on your device 入门 · 5 分钟 设备端 Rewrite rough text in a professional tone 入门 · 4 分钟 设备端

Related nodes

• Transformers Chat: small on-device chat that also works without WebGPU.
• Ollama: larger local models through the Ollama app.
• Chrome AI: the model built into Chrome.
• Tools Agent: an agent that can use tools and memory.