2 comments

  • avaer 1 hour ago
    There's also the Prompt API, currently in Origin Trial, which supports this api surface for sites:

    https://developer.chrome.com/docs/ai/prompt-api

    I just checked the stats:

      Model Name: v3Nano
      Version: 2025.06.30.1229
      Backend Type: GPU (highest quality)
      Folder size: 4,072.13 MiB
    
    Different use case but a similar approach.

    I expect that at some point this will become a native web feature, but not anytime soon, since the model download is many multiples the size of the browser itself. Maybe at some point these APIs could use LLMs built into the OS, like we do for graphics drivers.

  • Morpheus_Matrix 40 minutes ago
    [dead]