Zijie Tian 73c9dc46ff ✨ feat: add XAttention BSA support to bench_offload.py ...

- Add --model parameter (default: Llama-3.1-8B-Instruct)
- Add --enable-xattn flag for XAttention BSA sparse prefill
- Add --xattn-threshold and --xattn-stride parameters
- Change default num-gpu-blocks from 6 to 4
- Add benchmark results doc with Full vs XAttn comparison (32K/128K)

Generated with [Claude Code](https://claude.ai/code)
via [Happy](https://happy.engineering)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Happy <yesreply@happy.engineering>

2026-01-27 04:20:16 +08:00

..

architecture_guide.md

✨ feat: add comprehensive RULER benchmark testing

2026-01-18 20:34:06 +08:00

bench_offload_results.md

✨ feat: add XAttention BSA support to bench_offload.py

2026-01-27 04:20:16 +08:00

block_sparse_attn_interface.md

📝 docs: add BSA interface documentation and cleanup temp files

2026-01-20 04:27:19 +08:00

chunked_attention_solutions.md

📝 docs: add chunked attention solutions guide and update doc index

2026-01-20 04:48:20 +08:00

cpu_scheduling_latency_analysis.md

📝 docs: add CPU scheduling latency analysis for chunked attention

2026-01-27 03:42:12 +08:00

cuda_graph_memory_guide.md

📝 docs: add CUDA Graph memory mechanism guide

2026-01-21 02:59:21 +08:00

cuda_graph_offload_guide.md

[docs] Added cuda_graph_guide.md

2026-01-21 21:56:24 +08:00

debugging_guide.md

✨ feat: add comprehensive RULER benchmark testing

2026-01-18 20:34:06 +08:00

known_issues.md

✨ feat: add comprehensive RULER benchmark testing

2026-01-18 20:34:06 +08:00

nsys_wrong_event_order_bug.md

📝 docs: add nsys wrong event order bug investigation

2026-01-24 04:32:05 +08:00

optimization_guide.md

✨ feat: add comprehensive RULER benchmark testing

2026-01-18 20:34:06 +08:00

ruler_32k_chunked_offload_issue.md

🐛 fix: resolve CPU KV cache state leakage between requests

2026-01-21 01:12:21 +08:00

ruler_benchmark_results_32k.md

✨ feat: add comprehensive RULER benchmark testing

2026-01-18 20:34:06 +08:00

sparse_attention_guide.md

📝 docs: add XAttention algorithm guide based on COMPASS implementation

2026-01-20 02:50:03 +08:00

sparse_policy_architecture.md

♻️ refactor: remove cross-layer pipeline and rename compute_chunked_prefill

2026-01-20 02:10:40 +08:00

sparse_policy_implementation_guide.md

📝 docs: add SparsePolicy implementation guide and update rules

2026-01-20 02:25:46 +08:00

xattention_algorithm_guide.md

📝 docs: add XAttention algorithm guide based on COMPASS implementation

2026-01-20 02:50:03 +08:00

xattention_bsa_test_report.md

[WIP] Before integrate the xattn operator.

2026-01-19 21:19:21 +08:00

xattn_bsa_policy_design.md

📝 docs: update XAttention BSA Policy with benchmarks and memory management

2026-01-23 09:35:18 +08:00

xattn_chunked_prefill.md

feat: add xattn_estimate_chunked for chunked prefill support

2026-01-22 01:13:17 +08:00

xattn_kernels_guide.md

docs: add XAttention kernels guide

2026-01-23 03:22:25 +08:00