Zijie Tian a6cc703d73 [tests] Added test_niah_standalone.py.

2026-01-12 00:16:37 +08:00

..

policies

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

sparse

[claudesquad] update from 'int-minference-1' on 08 Jan 26 23:22 CST

2026-01-08 23:22:38 +08:00

__init__.py

[tests] Added test_niah_standalone.py.

2026-01-12 00:16:37 +08:00

base_manager.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

chunked_attention.py

[WIP] fixing attention compute error.

2025-12-30 00:31:48 +08:00

gpu_manager.py

[claudesquad] update from 'fix-ga-perf-2' on 09 Jan 26 14:08 CST

2026-01-09 14:08:12 +08:00

hybrid_manager.py

[claudesquad] update from 'lw-offload-2' on 08 Jan 26 20:53 CST

2026-01-08 20:53:08 +08:00

kernels.py

[feat] Added chunked prefill and kvcache offload mechenism.

2025-12-10 03:47:37 +08:00

offload_engine.py

[claudesquad] update from 'int-minference-1' on 08 Jan 26 23:22 CST

2026-01-08 23:22:38 +08:00