From cfc4cb6710374e18ba797d593c23c7be6e2c4897 Mon Sep 17 00:00:00 2001 From: papadopoulos Aggelos-Michael <65830412+aggelos-michael-papadopoulos@users.noreply.github.com> Date: Tue, 24 Jun 2025 18:38:28 +0300 Subject: [PATCH] docs: add manual download instructions --- README.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/README.md b/README.md index 00e8c6d..e6907be 100644 --- a/README.md +++ b/README.md @@ -14,6 +14,15 @@ A lightweight vLLM implementation built from scratch. pip install git+https://github.com/GeeeekExplorer/nano-vllm.git ``` +## Manual download + +If you’d rather fetch the model weights yourself, you can use: +```bash +huggingface-cli download --resume-download Qwen/Qwen3-0.6B \ + --local-dir ~/huggingface/Qwen3-0.6B/ \ + --local-dir-use-symlinks False +``` + ## Quick Start See `example.py` for usage. The API mirrors vLLM's interface with minor differences in the `LLM.generate` method.