Deploy DeepSeek R1 Distill 7B as an OpenAI-compatible API
ModelDock launches Hugging Face models behind an OpenAI-compatible API. DeepSeek R1 Distill 7B (step-by-step reasoning in a small model) is a 7.6B-parameter model from DeepSeek, released under the mit license. Paste its link in the dashboard and Pilot deploys it as a free 15-minute test, then you call it with any OpenAI SDK.
DeepSeek R1 Distill 7B at a glance
| Hugging Face repo | deepseek-ai/DeepSeek-R1-Distill-Qwen-7B |
|---|---|
| Made by | DeepSeek |
| Parameters | 7.6B |
| License | mit |
| Context length (config.json) | 131,072 tokens |
| Hugging Face downloads | 309K (as of 2026-10-25) |
| Typical GPU | 24 GB: L4 / RTX A5000 / RTX 4090 |
| Output price per 1M tokens | $1.44 – $2.29 |
| Input price per 1M tokens | $0.36 – $0.57 |
| Start fee | $0.025 – $0.040 |
// facts from the Hugging Face model page. GPU tier and prices are Pilot’s typical pick for 16-bit weights using the pricing formula, not a guarantee; Pilot makes the final choice at launch, and paid launches are opening soon.
Launch it in three steps
- Sign in with your litepod account and paste https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B in the dashboard.
- Pilot checks the model, picks a GPU and deploys it. Copy the model id and an API key when it is ready.
- Call it with the code below. The free test lasts 15 minutes or 25 requests.
from openai import OpenAI
client = OpenAI(base_url="https://api.lab.litepod.io/v1", api_key="sk_modeldock_...")
reply = client.chat.completions.create(
model="modeldock/<your-model-id>", # shown in the dashboard after launching deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
messages=[{"role": "user", "content": "Hello!"}],
)
print(reply.choices[0].message.content)More in the quickstart, OpenAI compatibility and limits. See pricing for every GPU tier.
Similar models
- Qwen2.5 7B Instruct
Alibaba Qwen · 7.6B · apache-2.0
- Qwen2.5 Coder 7B Instruct
Alibaba Qwen · 7.6B · apache-2.0
- OLMo 2 7B Instruct
Ai2 · 7.3B · apache-2.0
All models · More from litepod: the free LLM API with free open-source models