Zijie Tian 5fb0f67295 [WIP] need refactor.

2026-01-22 22:20:34 +08:00

..

comm

[WIP] Added sgDMA operator for scatter kvcache communication.

2025-12-24 23:48:52 +08:00

debug

[refactor] Refactor the kvcache offload.

2026-01-04 19:37:03 +08:00

engine

[WIP] need refactor.

2026-01-22 22:20:34 +08:00

kvcache

[WIP] need refactor.

2026-01-22 22:20:34 +08:00

layers

[WIP] need refactor.

2026-01-22 22:20:34 +08:00

models

[tests] Added test_niah_standalone.py.

2026-01-12 00:16:37 +08:00

ops

✨ feat: add nanovllm.ops module with XAttention estimation kernels

2026-01-22 06:00:42 +08:00

utils

[WIP] need refactor.

2026-01-22 22:20:34 +08:00

__init__.py

better

2025-06-15 10:36:45 +08:00

config.py

[WIP] need refactor.

2026-01-22 22:20:34 +08:00

llm.py

support tensor parallel

2025-06-15 01:31:24 +08:00

sampling_params.py

compile random sampling

2025-08-31 22:55:34 +08:00