Zijie Tian d623043a3c [WIP] FIXED decode and prefill NEEDLE test.

2026-01-05 01:51:46 +08:00

..

block_manager.py

simplify

2025-08-31 20:02:51 +08:00

llm_engine.py

[WIP] fixing attention compute error.

2025-12-30 00:31:48 +08:00

model_runner.py

[WIP] FIXED decode and prefill NEEDLE test.

2026-01-05 01:51:46 +08:00

scheduler.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

sequence.py

[test] Added test_align.py and Before change nanovllm attention.

2026-01-04 22:48:01 +08:00