I think their point is the size/performance tradeoff rather than outright performance. The point of TurboQuant is the size savings, while still giving high accuracy.
It's been a while, but I do recall some high-performing vector matching indexes being very large.
Wow! 4GB for 10 million documents. This means one could build a reverse index much faster than before and devx processes like debugging, performance testing would become much smoother. Can't wait for the sqlite bindings to come out!
Interestingly, while we don't fine-tune generative models for Louie.ai, we found fine-tuning embedding models to be a major $ saver. Instead of 1K-2K wide frontier embedding vector lens... Just 64. Huge savings on vector DB $$$.
I'm curious how that works with something like turboquant. Not needed any more, still dominant, better together, ... .
This looks perfect for local, privacy first search, but since it's built in Rust, has anyone tried compiling it to WASM to run directly inside a browser extension?
If anyone is looking to retrofit to an existing pipeline, I use similar ideas to compress vectors for job search, getting roughly 8x compression with about a 3.5% drop in quality. My experiment: https://corvi.careers/blog/vector-search-embedding-compressi...
Bloviating nonsense, 3rd time I’ve seen something like this in HN since TurboQuant came out. You don’t need float32, never did. Source: I’ve been writing on device embedding code for 4 years.
https://ann-benchmarks.com/index.html https://vector-index-bench.github.io/ https://big-ann-benchmarks.com/neurips23.html
It's been a while, but I do recall some high-performing vector matching indexes being very large.
I'm curious how that works with something like turboquant. Not needed any more, still dominant, better together, ... .
There's an oxirs-wasm with RDF and SPARQL bindings with a query budget. Tantivy-wasm says that the release WASM bundle is 1.5 MB.
cool-japan/oxirs: https://github.com/cool-japan/oxirs
oxirs-wasm: https://crates.io/crates/oxirs-wasm
tantivy-wasm: https://github.com/phiresky/tantivy-wasm
Is there an advantage to adding an MCP local memory interface over agent instructions on how to use a rust CLI?
And then write Markdown documents with Google OKF-like frontmatter YAML metadata for agents that work with tokens not linked data graphs; https://github.com/GoogleCloudPlatform/knowledge-catalog/blo...
Next Prompt: remove t@t and force commit.