PeterDing f5b4840276 fix(model_runner): correct position indexing to be 0-based ...

- Change position calculation from len(seq) to len(seq) - 1

2025-07-04 14:29:12 +08:00

..

engine

fix(model_runner): correct position indexing to be 0-based

2025-07-04 14:29:12 +08:00

layers

remove assert shape

2025-06-27 23:00:30 +08:00

models

remove assert shape

2025-06-27 23:00:30 +08:00

utils

simplify

2025-06-21 17:19:15 +08:00

__init__.py

better

2025-06-15 10:36:45 +08:00

config.py

warmup and allocate

2025-06-27 01:51:57 +08:00

llm.py

support tensor parallel

2025-06-15 01:31:24 +08:00

sampling_params.py

init commit

2025-06-10 00:27:01 +08:00