knoten / builtin / ai / aidependencies / llm
Chat Groq
Run open models on Groq for fast, low-latency inference.
Dieser Inhalt ist noch nicht in deiner Sprache verfügbar.
Give an AI node access to open models (such as Llama) running on Groq’s very fast servers, using your own Groq API key.
What it does
Section titled “What it does”Chat Groq is a model you plug into the Model slot of an AI node, such as the Tools Agent or Basic LLM Chain. It does not run on its own and has no output. When the AI node runs, it sends its messages to Groq with your key and gets the reply back.
- Temperature is 0 when you leave it empty, so answers are focused and repeatable.
- Replies are capped at Max Tokens (4096 by default).
- A failed request is retried up to Max Retries times (2 by default). A request that gets no answer within 60 seconds fails.
When to use it
Section titled “When to use it”- Speed matters: a quick reply while you wait, or many items in a loop.
- You want open models such as Llama without running them yourself.
- Classifying or tagging lots of short texts cheaply.
Inputs and settings
Section titled “Inputs and settings”| Einstellung | Typ | Was es bewirkt |
|---|---|---|
| Model (erforderlich) | Text | The Groq model to use, e.g. llama-3.3-70b-versatile. |
| Authentication (erforderlich) | Credential | Use your Groq API key as a Bearer token. |
| Options | Group | The options to use with the model. |
| Options › Temperature | Number | The temperature to use for the model. |
| Options › Max Retries | Number | The maximum number of retries to use for the model. Standard: 2 |
| Options › Max Tokens | Number | The most tokens the model may generate in one reply. Defaults to 4096, which keeps providers from reserving credit for the whole output window. Standard: 4096 |
Type the Model id as Groq lists it, for example llama-3.3-70b-versatile. Groq adds and retires models often, so check its model list if a model stops working.
Outputs
Section titled “Outputs”This node has no output port. It plugs into a slot on another node instead of passing items along.
- Model slot of Tools Agent, Q&A Agent, RAG Agent, Basic LLM Chain, Indexer, Text Classifier, Sentiment Analysis, Summarization, Information Extractor, Guardrails, Auto-fixing Output Parser
The AI node you connect it to produces the output. Chat Groq only decides which model answers.
Dependencies and credentials
Section titled “Dependencies and credentials”- Authentication (connection): required. See Connect Groq.
In Authentication, use a Bearer Token credential that holds your Groq API key. Create the key on the API Keys page of the Groq console. See Create a credential.
Example workflow
Section titled “Example workflow”- A Context Menu trigger on selected text.
- Text Classifier with Text
{{ $input.selectionText }}and Categoriesbug, feature request, question. - Chat Groq in its Model slot, Model
llama-3.3-70b-versatile. - Browser Notification with Message
{{ $input.category }}.
Common issues
Section titled “Common issues”- “Model parameter is required and cannot be empty”. Fill in Model.
- A “model decommissioned” or “model not found” error. Groq retired the model. Pick a current one from its model list.
- A 429 “rate limit” error. You sent too many requests or tokens per minute for your plan. Slow the workflow down (fewer items at once) or upgrade the plan.
- A 401 error. The key is wrong or revoked. Create a new key and update the credential.
Related nodes
Section titled “Related nodes”- Text Classifier: sort text into your categories.
- Basic LLM Chain: send one prompt and get a reply.
- Ollama: run open models on your own computer instead.