Fable created novel 4D splat format

(adamraudonis.github.io)

75 points | by adamraudonis 7 hours ago

6 comments

  • delichon 1 hour ago
    A gaussian gif. Coming to porn sites soon. The file format name works for them. But imagine whole movies shot in this format. The fly-on-the-wall fantasy of movies, without being locked in place for the whole shot. Narrative possibilities like being able to examine just how close the Tyrannosaurus Rex is to your rear view mirror. Clues in a mystery only visible on rotation. Hidden bonus scenes.

    I hope this catches on just to be able to watch the evolution of cameras to capture it.

    • orbital-decay 17 minutes ago
      >imagine whole movies shot in this format. The fly-on-the-wall fantasy of movies, without being locked in place for the whole shot.

      That would be terrible. Framing is the major expressive feature in cinematography, and any interactive format needs a lot more thought put into it than just having a free camera. Literally the worst of both worlds.

      Light field video streaming is a thing, however it's pretty niche. OTOY pioneered light field videos with some degree of freedom and a sense of depth more than a decade ago.

      • jayd16 12 minutes ago
        Not terrible, per se, but not a movie. There are other formats that fit the task better like immersive theater and theater in the round.

        This has been extensively explored with VR and games, though.

    • andybak 41 minutes ago
      Ok but you're commenting on the general concept of animated gaussian splats. That's existed for a while and it's unrelated to what this actual post is about which is a new compression method.
      • delichon 32 minutes ago
        I suppose it's the difficulty in recording them rather than the file size that has kept them experimental. But that's not a problem for AI generated splats. GenAI sites could have a toggle from image to video to splat4d.
  • gcr 1 hour ago
    Something’s way off with these numbers. The page says it encodes video at 640MB/s which is quite large even for 4D data and doesn’t match the filesize of the demo splat (7.4MB / 2sec, or ≈3.4MB/s).

    In fact they say the raw file size of the demo splat was only 427MB, so maybe the 640MB/s was a statement about encode speed? Why write it that way instead of “this demo splat was encoded in 0.6sec” or even just “the time to produce the original splat took longer than the time to encode this video format”?

    • danielheath 38 minutes ago
      “encodes video at 640MB/s” is the common way for codec authors to talk about performance
  • Lucasoato 2 hours ago
    Doesn’t with for me, iOS Safari :/
    • nomel 2 hours ago
      Works on my old iPhone. The video is a splat. Click the interact button to change perspective.
    • skybrian 17 minutes ago
      Works on my iPad using Chrome or Safari.
    • oldsecondhand 37 minutes ago
      Me neither on Chrome on Win10. "WEBGPU initialization failed".
  • mistahchris 1 hour ago
    wow… this is seriously cool.
  • adamraudonis 7 hours ago
    See repo for prompt. Feel free to contribute to format or benchmarking. MIT Open Source.
    • diimdeep 3 hours ago
      Publish full session md, you can export them with `uvx claude-code-log@latest --tui`
      • tjuene 1 hour ago
        warning: don't just run random commands in your terminal
        • thehamkercat 1 hour ago
          specially not npm/python related packages with @latest

          Yes please give me the latest supply-chain attacks.

  • xiaoyin903 6 hours ago