ToolKiti
Home/大语言模型/Groq API

Groq API

Groq 接口

Ultra-fast inference API for open-source LLMs using LPU inference engine.

基于 LPU 推理引擎的开源大模型极速推理接口。

Pricing

free tier available, pay-as-you-go

Authentication

  • API Key

Rate Limit

30 req/min (free tier)

Typical Latency

<200ms (ultra-fast)

Max Context

128K

Popularity

72/100

Endpoints

https://api.groq.com/openai/v1/chat/completions

SDKs

PythoncurlOpenAI-compatible SDKs

Key Features

Code Examples

Chat Completionbash
curl https://api.groq.com/openai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $GROQ_API_KEY" \
  -d '{
    "model": "llama3-70b-8192",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Tags

llminferencespeed

Last updated: 2026-07-27

Get Started with Groq API

Click below to visit the official website and start using this API.

Visit Groq API