Zijie Tian
|
7c41032a2e
|
✨ feat: add configurable stride and chunk_size for XAttention BSA
- Add sparse_chunk_size config option (default: 16384)
- Pass stride, chunk_size, use_triton through factory function
- Add --sparse-stride CLI option to test_ruler.py
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
|
2026-01-23 10:37:04 +08:00 |
|
Zijie Tian
|
b5da802dff
|
[WIP] Before integrate the xattn operator.
|
2026-01-19 21:19:21 +08:00 |
|
Zijie Tian
|
9e6fdc0650
|
[WIP] Before plan execute.
|
2026-01-19 03:30:44 +08:00 |
|
Zijie Tian
|
2a6e0a2c02
|
[feat] Added Quest Sparsity Policy.
|
2026-01-07 03:29:21 +08:00 |
|
Zijie Tian
|
c99a6f3d3f
|
[WIP] Before add Quest policy.
|
2026-01-07 02:32:30 +08:00 |
|
Zijie Tian
|
782437c486
|
[WIP] remove num_prefetch_blocks varible.
|
2025-12-24 18:22:26 +08:00 |
|
Zijie Tian
|
1907b625b6
|
[refactor] Remove legacy mode path.
|
2025-12-22 20:17:56 +08:00 |
|
Zijie Tian
|
e85c2b4776
|
[fix] Fixed kvcache offload bugs.
|
2025-12-10 22:34:00 +08:00 |
|
Zijie Tian
|
0b6f19242d
|
[feat] Added chunked prefill and kvcache offload mechenism.
|
2025-12-10 03:47:37 +08:00 |
|