Zijie Tian ca32ea6f93 [WIP] Before refactor the compute)_chunked_prefill.

2026-01-23 03:36:12 +08:00

..

policies

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

sparse

[WIP] Before refactor the compute)_chunked_prefill.

2026-01-23 03:36:12 +08:00

__init__.py

[WIP] Before integrate the xattn operator.

2026-01-19 21:19:21 +08:00

base_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

gpu_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

hybrid_manager.py

🐛 fix: resolve CPU KV cache state leakage between requests

2026-01-21 01:12:21 +08:00

kernels.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

offload_engine.py

🐛 fix: resolve CPU KV cache state leakage between requests

2026-01-21 01:12:21 +08:00