Groq

• Supported service: llm
• Key: groq
• Built-in: No. See BYO Keys for more details.
• Supported models: Any listed here

​

Function calling

Many of Groq’s models, including their versions of Llama 3 and 3.1, support function calling using the OpenAI interface. For examples of how to use that approach, see the OpenAI service page.