Modern GPU Programming for MLSys

(mlc.ai)

52 points | by crowwork 3 days ago

3 comments

  • throwaw12 18 minutes ago
    So many frameworks are being built.

    What are the state of the art frameworks in ML programming area? Similar to what React is for web and tailwind for CSS

    Triton, ONNX, JAX, PyTorch, cublass, .....

    I know they might be for different purposes, but having some idea what is for what and when to use would be helpful

    • mathisfun123 11 minutes ago
      > ONNX, JAX, PyTorch

      these are model-level frameworks

      > Triton

      this is a kernel DSL

      > [cublas]

      this is a BLAS library built atop CUDA

      > I know they might be for different purposes, but having some idea what is for what and when to use would be helpful

      when people ask this question i always ask: who are you and what is your job? if you're not an ML/DL/AI person then you knowing the specifics is about as useful as me knowing the specifics of react/express/angular/tailwind/django/whatever as an ML person. this is not meant to be condescending, this is meant to allay your anxiety, ie that if you ever find yourself in the position where you have to know these things for your job, it won't be that hard to figure out (just like it isn't that hard to figure out the difference between react and express and django if you're a webdev).

  • hazard 3 hours ago
    This looks great, but I'd really like to see associated exercises (and solutions) to make it useful for self-study
  • mathisfun123 5 hours ago
    "Modern [NVIDIA GPU] Programming for ..."

    Everything after "Pipelining GEMM with TMA" (inclusive) is specific to NVIDIA. Which is fine but the title (of the guide itself) is clearly misleading.

    • nh23423fefe 2 hours ago
      > Our main target is the Blackwell generation,

      misleading?

      • mathisfun123 2 hours ago
        what is it with hn people where they willfully misinterpret the simplest observations;

        > the title (of the guide itself) is clearly misleading.

        ...

        > title: the distinguishing name of a written, printed, or filmed production

        do you understand now? or do i need to also define for you the word misleading?