Honey, I shrunk the embeddings: Matryoshka vs. PCA

(dylancastillo.co)

40 points | by dcastm 6 days ago

2 comments

  • softwaredoug 11 minutes ago
    Thanks for doing this benchmarking Dylan. I wanted to teach people PCA in my original article, but had no idea it would stack up this well against Matroyshka!

    Feels like a “just use logistic regression” moment :)

  • stephantul 1 hour ago
    Nice! I’ve been working on something similar and found similar results.

    In my experiments, I used lots of embedding models and the results were not nearly as uniform as this curve, just FYI. I didn’t use any of the API-based models though

    I also wrote about this exact comparison when using PCA and MRL to quantize static models, see: https://stephantul.github.io/blog/mrl-pca/

    • dcastm 24 minutes ago
      Thank you! Will take a look at your results.

      I couldn't find much when I first looked into this, which is why I ended up writing the article.

      • stephantul 22 minutes ago
        Ah I meant more to say that I was working on this as well. I haven’t published the results for this comparison specifically yet.