docs: add manual download instructions

This commit is contained in:
papadopoulos Aggelos-Michael
2025-06-24 18:38:28 +03:00
committed by GitHub
parent 37eb91f890
commit cfc4cb6710

View File

@@ -14,6 +14,15 @@ A lightweight vLLM implementation built from scratch.
pip install git+https://github.com/GeeeekExplorer/nano-vllm.git
```
## Manual download
If youd rather fetch the model weights yourself, you can use:
```bash
huggingface-cli download --resume-download Qwen/Qwen3-0.6B \
--local-dir ~/huggingface/Qwen3-0.6B/ \
--local-dir-use-symlinks False
```
## Quick Start
See `example.py` for usage. The API mirrors vLLM's interface with minor differences in the `LLM.generate` method.