Groq API
Groq 接口
Ultra-fast inference API for open-source LLMs using LPU inference engine.
基于 LPU 推理引擎的开源大模型极速推理接口。
Website
Documentation
Pricing
free tier available, pay-as-you-go
Authentication
- API Key
Rate Limit
30 req/min (free tier)
Typical Latency
<200ms (ultra-fast)
Max Context
128K
Popularity
72/100
Endpoints
https://api.groq.com/openai/v1/chat/completions
SDKs
PythoncurlOpenAI-compatible SDKs
Key Features
- ◆LPU inference engine for blazing speed
- ◆Open-source models: Llama, Mixtral, Gemma
- ◆Free tier for experimentation
- ◆OpenAI-compatible API
- ◆Ideal for real-time applications
Code Examples
Chat Completionbash
curl https://api.groq.com/openai/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $GROQ_API_KEY" \
-d '{
"model": "llama3-70b-8192",
"messages": [{"role": "user", "content": "Hello!"}]
}'Tags
llminferencespeed
Last updated: 2026-07-27
Get Started with Groq API
Click below to visit the official website and start using this API.
Visit Groq API →