Deploy Qwen3 4B as an OpenAI-compatible API

ModelDock launches Hugging Face models behind an OpenAI-compatible API. Qwen3 4B (small, quick and surprisingly capable) is a 4B-parameter model from Alibaba Qwen, released under the apache-2.0 license. Paste its link in the dashboard and Pilot deploys it as a free 15-minute test, then you call it with any OpenAI SDK.

Qwen3 4B at a glance

Hugging Face repoQwen/Qwen3-4B
Made byAlibaba Qwen
Parameters4B
Licenseapache-2.0
Context length (config.json)40,960 tokens
Hugging Face downloads11.3M (as of 2026-10-25)
Typical GPU16 GB: RTX A4000 / A4500 / 4000 Ada
Output price per 1M tokens$1.21
Input price per 1M tokens$0.30
Start fee$0.021

// facts from the Hugging Face model page. GPU tier and prices are Pilot’s typical pick for 16-bit weights using the pricing formula, not a guarantee; Pilot makes the final choice at launch, and paid launches are opening soon.

Launch it in three steps

  1. Sign in with your litepod account and paste https://huggingface.co/Qwen/Qwen3-4B in the dashboard.
  2. Pilot checks the model, picks a GPU and deploys it. Copy the model id and an API key when it is ready.
  3. Call it with the code below. The free test lasts 15 minutes or 25 requests.
Python (openai)
from openai import OpenAI

client = OpenAI(base_url="https://api.lab.litepod.io/v1", api_key="sk_modeldock_...")

reply = client.chat.completions.create(
    model="modeldock/<your-model-id>",  # shown in the dashboard after launching Qwen/Qwen3-4B
    messages=[{"role": "user", "content": "Hello!"}],
)
print(reply.choices[0].message.content)

More in the quickstart, OpenAI compatibility and limits. See pricing for every GPU tier.

Similar models

All models · More from litepod: the free LLM API with free open-source models