Zijie Tian 0550a64339 feat: add dynamic port allocation from tzj/vs_offload ...

- Import os and socket modules
- Add _find_free_port() function for automatic port detection
- Use NANOVLLM_DIST_PORT env var if set, otherwise auto-assign
- Enables running multiple model instances without port conflicts

Co-Authored-By: Claude <noreply@anthropic.com>

2026-01-18 19:51:56 +08:00

31 KiB

Raw Blame History

View Raw