Groq

Groq runs open models on its LPU hardware for very low-latency inference behind an OpenAI-compatible API. Supports chat, tool use and fast Whisper speech-to-text; works with the groq SDK or the OpenAI SDK via a base URL.

Website Docs Changelog Compare with others

Groq at a glance

From official pages, checked Nov 15, 2026. Tap the arrow for each source.

Free tier: Yes
Free tier; your exact limits show on the console Limits page. Developer tier needs a payment method.
Starting price: $0.075 per 1M input tokens
GPT-OSS 20B; $0.30 per 1M output tokens. GPT-OSS 120B is $0.15 in, $0.60 out.
Rate limit: 30 requests/min
Developer plan base limits, openai/gpt-oss-120b; 1K requests/day, 8K tokens/min.
Size limit: 131K token context
GPT-OSS 120B (Whisper speech-to-text: 100 MB max file).
Official SDKs: PythonJavaScript / TypeScript
EU hosting: No
Retained customer data is stored in GCP buckets in the United States.
Compliance: SOC 2GDPRHIPAA
Trust Center lists SOC 2 Type II, GDPR and HIPAA, with SOC 2 Type II reports for 2024 and 2025.

What you can build with Groq

GroqPro archiveSnippetPaste

Transcribe audio files with Whisper Large v3 Turbo on Groq

Send an audio file to Groq's whisper-large-v3-turbo with the groq Python SDK and get the transcript back.

Free tier: YesFrom $0.075 per 1M input tokens

Voice

Groq at a glance

What you can build with Groq

Transcribe audio files with Whisper Large v3 Turbo on Groq

Recent updatesAll updates