DeepInfra

What is DeepInfra?

DeepInfra is a cloud platform that serves machine learning models through an inference API, billing language models by token and other models by execution time. It hosts models from Meta, Google, Mistral, Anthropic and others, and offers custom GPU deployments.

Key capabilities of DeepInfra

• Token-based pricing: language models billed per million input, cached input and output tokens
• Time-based pricing: other model types billed by execution time
• Service tiers: Standard 1x, Priority 1.5x and Flex 0.8x of base price
• Custom GPU deployment: A100, H100 and B300 instances billed per GPU-hour
• Autoscaling: handles demand changes automatically
• Spending limits: and multiple billing options

How DeepInfra works

You call a hosted model through the API and pay per token or per second of execution. Priority tier costs more for faster responses at peak, while Flex is cheaper for asynchronous work. For dedicated capacity, you deploy custom models on rented GPUs.

Who uses DeepInfra?

Developers and teams that want to run open or third-party models without managing GPUs.

DeepInfra pricing

Example rates: Llama 3.3-70B is $0.10 input and $0.32 output per 1M tokens, DeepSeek-V4-Flash is $0.06 and $0.18, and Claude Sonnet 5 is $3.00 and $15.00. GPUs are A100 $0.89, H100 $2.20 and B300 $4.89 per hour.

DeepInfra alternatives

Hyperbolic and Nebius are GPU and inference clouds, Liquid AI builds its own device-native models, and TensorFlow and Keras are frameworks rather than hosted services.