zijie-tian/nano-vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: add manual download instructions

Browse Source
This commit is contained in:
papadopoulos Aggelos-Michael
2025-06-24 18:38:28 +03:00
committed by GitHub
parent 37eb91f890
commit cfc4cb6710
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@@ -14,6 +14,15 @@ A lightweight vLLM implementation built from scratch.
pip install git+https://github.com/GeeeekExplorer/nano-vllm.git pip install git+https://github.com/GeeeekExplorer/nano-vllm.git
``` ```
## Manual download
If you’d rather fetch the model weights yourself, you can use:
```bash
huggingface-cli download --resume-download Qwen/Qwen3-0.6B \
--local-dir ~/huggingface/Qwen3-0.6B/ \
--local-dir-use-symlinks False
```
## Quick Start ## Quick Start
See `example.py` for usage. The API mirrors vLLM's interface with minor differences in the `LLM.generate` method. See `example.py` for usage. The API mirrors vLLM's interface with minor differences in the `LLM.generate` method.