Artificial Analysis Intelligence Index v4.2

 (artificialanalysis.ai)

27 points | by nojs 1 hour ago

4 comments

  • redox99 19 minutes ago
    They realized Astra having the same score as Sol was silly so they rushed to update the index so it fits what people expect.

    The old index was clearly bad (Astra is way better than Sol) but it's also unscientific to tweak it like this.

  • nthypes 23 minutes ago
    What version the intelligence vs cost graph is using? they didn't ran v4.2 to all models.
  • 6thbit 26 minutes ago
    Why have they not included ARC-Agi-3 on their index?

    Clearly that would move things around.

  • lousken 24 minutes ago
    How to view the previous version to compare?