Zijie Tian 60d24f7c12 [feat] Added bench_offload.py and GreedySampler.

2025-12-12 00:24:08 +08:00

..

policies

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

__init__.py

[fix] Fixed kvcache offload bugs.

2025-12-10 22:34:00 +08:00

base_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

chunked_attention.py

[fix] Fixed chunked_attention.py implement.

2025-12-11 22:39:50 +08:00

gpu_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

hybrid_manager.py

[feat] Added bench_offload.py and GreedySampler.

2025-12-12 00:24:08 +08:00

kernels.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

offload_engine.py

[refactor] Translate into english, void Chinese due to claude.

2025-12-11 00:30:24 +08:00