Zijie Tian 9e6fdc0650 [WIP] Before plan execute.

2026-01-19 03:30:44 +08:00

..

policies

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

sparse

[WIP] Before plan execute.

2026-01-19 03:30:44 +08:00

__init__.py

[WIP] Before plan execute.

2026-01-19 03:30:44 +08:00

base_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

chunked_attention.py

[WIP] fixing attention compute error.

2025-12-30 00:31:48 +08:00

gpu_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

hybrid_manager.py

[feat] Added Quest Sparsity Policy.

2026-01-07 03:29:21 +08:00

kernels.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

offload_engine.py

[refactor] Cleanup unused code after perf_opt merge

2026-01-07 06:25:21 +08:00