Anyscale
Paid
The managed platform from the creators of Ray for scaling AI training and inference.
inference AI tools
AI tools tagged inference, newest first.
6 tools
Modal
Freemium
Serverless cloud for running AI workloads, with GPUs available in seconds.
Replicate
Paid
Run open-source and custom AI models in the cloud with a few lines of code.
Fireworks AI
Paid
A fast inference platform for open models, with tools to tune and deploy them.
Groq
Freemium
Extremely fast AI inference running on custom LPU chips.
Together AI
Paid
A cloud for running, fine-tuning and training open-source models at scale.
