Zijie Tian
|
0b6f19242d
|
[feat] Added chunked prefill and kvcache offload mechenism.
|
2025-12-10 03:47:37 +08:00 |
|
Zijie Tian
|
204fe2b38f
|
[feat] Added metric into tqdm bar.
|
2025-12-10 00:52:13 +08:00 |
|
GeeeekExplorer
|
cde3fc22c2
|
simplify
|
2025-06-21 17:19:15 +08:00 |
|
Xingkai Yu
|
326b121fad
|
Merge pull request #10 from MARD1NO/refine_return_hint_in_schedule
|
2025-06-15 10:39:51 +08:00 |
|
MARD1NO
|
98bbbefb68
|
schedule return bool args
|
2025-06-15 10:15:05 +08:00 |
|
cheunglei
|
53b3ef2e32
|
support tensor parallel
|
2025-06-15 01:31:24 +08:00 |
|
GeeeekExplorer
|
f16adb729e
|
refactor
|
2025-06-12 09:41:12 +08:00 |
|
GeeeekExplorer
|
386290d69e
|
refactor
|
2025-06-11 21:12:57 +08:00 |
|
GeeeekExplorer
|
b98e1ca305
|
fix
|
2025-06-10 21:25:54 +08:00 |
|
GeeeekExplorer
|
a5a4909e6a
|
init commit
|
2025-06-10 00:27:01 +08:00 |
|