Profile(v2.1.4) physics-aware optimizer for vLLM (31→470 tok/s on A100)

 (github.com)

2 points | by jungledesh 1 hour ago

1 comments