News
Newest
Ask
Show
Jobs
Open on GitHub
Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium
(github.com)
13 points | by
sanchitmonga22
1 hour ago
1 comments
bookernath
19 minutes ago
Tokens per minute is a strange metric, I usually see tok/s. A per-second figure would be more accessible in comparing this to alternatives.
1 comments