Amazon Bedrock
Paid
AWS's managed service for using many foundation models through one API.
About Groq
Groq runs language models on its own chips, called LPUs, which are designed for fast inference. The result is very quick responses, which makes a real difference for voice assistants, live chat and agents that make many model calls in a row.
GroqCloud offers popular open models through an API that is compatible with the OpenAI format, so it is easy to switch to for a speed boost. Speech-to-text and other models are available too.
There is a free tier for development and pay as you go pricing for production. It is a great choice when latency matters more than anything else.
Standout features
- Very low latency
- Custom LPU hardware
- OpenAI-compatible API
- Open models
- Speech to text
- Free developer tier
Tags
More in LLM Platforms
View all →
Fireworks AI
Paid
A fast inference platform for open models, with tools to tune and deploy them.
Together AI
Paid
A cloud for running, fine-tuning and training open-source models at scale.
Cohere
Freemium
Enterprise-focused language models for search, retrieval and private deployment.
Mistral AI
Freemium
A European AI lab offering open-weight and hosted language models plus the Le Chat assistant.
Google Gemini API
Freemium
Google's API for Gemini models that handle text, images, audio and video together.
