zijie-tian/nano-vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #10 from MARD1NO/refine_return_hint_in_schedule

Browse Source
This commit is contained in:
Xingkai Yu
2025-06-15 10:39:51 +08:00
committed by GitHub
parent ba96387043 98bbbefb68
commit 326b121fad
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
nanovllm/engine/scheduler.py
View File

@@ -21,7 +21,7 @@ class Scheduler:
def add(self, seq: Sequence): def add(self, seq: Sequence):
self.waiting.append(seq) self.waiting.append(seq)
def schedule(self) -> tuple[list[Sequence], SequenceStatus]: def schedule(self) -> tuple[list[Sequence], bool]:
# prefill # prefill
scheduled_seqs = [] scheduled_seqs = []
num_seqs = 0 num_seqs = 0