PeterDing
|
f5b4840276
|
fix(model_runner): correct position indexing to be 0-based
- Change position calculation from len(seq) to len(seq) - 1
|
2025-07-04 14:29:12 +08:00 |
|
GeeeekExplorer
|
cb0b3dec3f
|
remove rng state
|
2025-06-27 22:50:33 +08:00 |
|
GeeeekExplorer
|
1caeec8dfa
|
same as vllm
|
2025-06-27 18:50:56 +08:00 |
|
GeeeekExplorer
|
658520b788
|
warmup and allocate
|
2025-06-27 01:51:57 +08:00 |
|
GeeeekExplorer
|
03cfc13bb3
|
faster pickle
|
2025-06-23 00:51:52 +08:00 |
|
GeeeekExplorer
|
cde3fc22c2
|
simplify
|
2025-06-21 17:19:15 +08:00 |
|
jinghuan-Chen
|
ffafaeb133
|
Release CUDA Graphs resource before exit.
|
2025-06-18 16:17:31 +08:00 |
|
GeeeekExplorer
|
bc0ad5a116
|
better
|
2025-06-17 23:33:38 +08:00 |
|
GeeeekExplorer
|
7e42fa6f63
|
fix
|
2025-06-15 13:28:29 +08:00 |
|
GeeeekExplorer
|
fc778a4da9
|
better
|
2025-06-15 10:36:45 +08:00 |
|
cheunglei
|
53b3ef2e32
|
support tensor parallel
|
2025-06-15 01:31:24 +08:00 |
|
GeeeekExplorer
|
b6136383c9
|
support fast pickle
|
2025-06-14 13:36:57 +08:00 |
|
GeeeekExplorer
|
4a8aa090a7
|
fix
|
2025-06-14 00:56:07 +08:00 |
|
GeeeekExplorer
|
98a1551a7d
|
support CUDA_VISIBLE_DEVICES
|
2025-06-12 23:14:01 +08:00 |
|
GeeeekExplorer
|
fee58d44e4
|
fix
|
2025-06-12 01:00:31 +08:00 |
|
GeeeekExplorer
|
08c84ec08d
|
multi file loader
|
2025-06-12 01:00:09 +08:00 |
|
GeeeekExplorer
|
386290d69e
|
refactor
|
2025-06-11 21:12:57 +08:00 |
|
GeeeekExplorer
|
b98e1ca305
|
fix
|
2025-06-10 21:25:54 +08:00 |
|
GeeeekExplorer
|
a5a4909e6a
|
init commit
|
2025-06-10 00:27:01 +08:00 |
|