Zijie Tian
|
b8b6478506
|
[feat] Need to optimized with async prefetch.
|
2025-12-15 06:58:40 +08:00 |
|
Zijie Tian
|
babfa17354
|
[refactor] Translate into english, void Chinese due to claude.
|
2025-12-11 00:30:24 +08:00 |
|
Zijie Tian
|
e85c2b4776
|
[fix] Fixed kvcache offload bugs.
|
2025-12-10 22:34:00 +08:00 |
|
Zijie Tian
|
190df5f70d
|
[refactor] Refactor current gpu and cpu block allocation strategy.
|
2025-12-10 21:23:31 +08:00 |
|
Zijie Tian
|
0a247ccb1b
|
[feat] Added num_gpu_blocks limit gpu blocks.
|
2025-12-10 20:17:42 +08:00 |
|
Zijie Tian
|
0b6f19242d
|
[feat] Added chunked prefill and kvcache offload mechenism.
|
2025-12-10 03:47:37 +08:00 |
|
GeeeekExplorer
|
658520b788
|
warmup and allocate
|
2025-06-27 01:51:57 +08:00 |
|
GeeeekExplorer
|
fc778a4da9
|
better
|
2025-06-15 10:36:45 +08:00 |
|
cheunglei
|
53b3ef2e32
|
support tensor parallel
|
2025-06-15 01:31:24 +08:00 |
|
GeeeekExplorer
|
f16adb729e
|
refactor
|
2025-06-12 09:41:12 +08:00 |
|
GeeeekExplorer
|
386290d69e
|
refactor
|
2025-06-11 21:12:57 +08:00 |
|
GeeeekExplorer
|
b98e1ca305
|
fix
|
2025-06-10 21:25:54 +08:00 |
|
GeeeekExplorer
|
a5a4909e6a
|
init commit
|
2025-06-10 00:27:01 +08:00 |
|