Implementation of GPT-2 in pure CMake

(github.com)

54 points | by porridgeraisin 6 hours ago

10 comments

  • voxelghost 3 minutes ago
    Using python as a build tool, and Cmake as the programming language, now all that is missing is a bit of config in ASM
  • ahartmetz 5 hours ago
    FWIW, this is most likely not even fast enough to laugh at how slow it is - for that, you need to see something happening in less than an hour or so.

    It can only use one core at a time, but that is not the worst thing: CMake is interpreted and stringly typed, so every number will have to be converted string -> number and usually back on every use.

    • voxelghost 4 hours ago
      We just need to find a way to extend Moores law into the 4th dimension, and hardware will catch up to this.
      • ahartmetz 4 hours ago
        Btw, I just realized that "cannot use all cores" has become a similar performance handicap to "is interpreted". So many cores now!
  • inoffensivename 8 minutes ago
    To quote April Ludgate: Gross. I love it.
  • paaloeye 3 hours ago
  • edg5000 30 minutes ago
    It's surprisingly tiny when you exclude the data
  • avilay 3 hours ago
    Why? Just...why?

    I get that sometimes we like to build useless things because they are elegant, or beautiful, or "cool" in some sense of the word. But CMake is not cool in any sense of the word! I can barely use it to write build files, and that too I have gladly offloaded to AI. Sometimes when looking at CMake files in a large project, I become nostalgic about Makefiles, but then I think about what the rewrite would entail, and I resign myself to my fate.

    • voxelghost 2 hours ago
      Sometimes these little endevors, are like art, they don't have to mean something, they just has to make you feel something.

      Feeling Queasy, is still a feeling, mind you.

  • _menelaus 3 hours ago
    AI is gonna keep us around because it would never think to do this kinda stuff
  • paaloeye 3 hours ago
    Somebody has more time than sense
  • sirsinsalot 4 hours ago
    A hellscape.
  • pkilgore 4 hours ago
    disgusting (complementary)