How to Write a Fast Matrix Multiplication from Scratch with Tensor Cores (2024)

2 comments

• light_hue_1 54 minutes ago
  Closely related to this if you're interested in the topic if Deep Mind's guide on how to scale your model.

  https://jax-ml.github.io/scaling-book/roofline/