Billing and pricing
Pre-flight launches are free (see Errors and limits). Paid, always-on launches are opening soon; this page describes how they will be priced, which is also what Pricing shows.
From GPU hour to token price
- Output tokens = GPU $/hr ÷ (200 tokens/s × 3600) × 1,000,000 × 1.5.
- Input tokens cost 25% of output tokens.
- Start fee: what the GPU costs during a cold start (about 130 seconds of its hourly price), charged once when the launch succeeds.
Pilot picks the smallest GPU that fits your model, so a smaller model is cheaper per token. GPUs scale to zero when idle, and a launched model nobody calls for 7 days is deleted. Each model’s own per-million-token prices are returned by GET /v1/models. The model pages show the typical GPU tier and price for each popular model.
More from litepod: the free LLM API with free open-source models. ModelDock is a litepod product.