Very interesting discrepancy in the attached example:
- "removing the kettlebell" led to removing the visual representation of the kettlebell as well the deformation it makes on the pillow
- "removing the hands" removed the childs hands from the tops, but did not then lead to the tops falling over!
Others like the colliding cars are in some weird gray area between the two.
One should note as these tools proliferate, there is a lot of artistic expression that we are giving up to these imprecise natural language parsing engines.
I think we'll regain the artistic expression/control in the future if the tools become popular.
We saw this with StableDiffusion. First it was just text-to-image. Now we have controlnets which can control the precise placement of objects. We've got depth maps, body positioning, all kinds of things. I can even sketch on my tablet and tunr that into an image.
I'm sure we can add options for what this physically affects or doesn't affect.
Would make economic sense for a ton more of "Choose your own Adventure" content
I can imagine watching Bandersnatch and getting rid of the game developer in frame 1. The remaining 90 minutes, his dad having a quiet, stress-free Tuesday.
Woah, this is absolutely sick! 10 years ago me would have been surprised something so small can encode all the world knowledge necessary to make this plausible. That they'd make this openly available is a dream.
Really weird comments here. It's a VFX technique for cinematography, one of many of that kind (e.g. supporting wire removal). Cinematography in general is about showing something that doesn't exist, unless it's a documentary. Your only reaction is apparently calling censorship. Says a lot about the current Overton window and I think it's something you should reflect on.
No, I get it, and the benefits of putting what would have required a professional VFX team at (eventually) the fingertips of every amateur filmmaker are amazing.
It’s also alarming what’s possible when reassembling photons en masse becomes commoditized.
To be honest, if that's what we see in open access, then there must already be something in existence that is closed. I don't want to create another conspiracy theory - I just want to point out the theoretical possibility - but if it was created, it has probably already been tested and possibly even used widely. So, in conclusion, if a government or agency wanted to use that technique for censorship, they would most likely already have tried it.
It's kind of late to ring the bells once the city walls have been taken. In other (shorter) words, if someone wanted to use this for censorship, they would already have tried it, so... it's either too late or too early; although being interesting (but not good or fun) probability, it's probability only.
...I hope one day everyone, just everyone will finally learn that most of the technologies are not evil or good, they're neutral, they're just tools. And most (no, not all) of them were also created with good intentions.
You don't really need AI to do this, it can be done just fine with traditional techniques, just labor intensive. Hell you can probably find a dude on fiverr to do it right now for a couple hundred, YMMV.
The act of editing existing footage to mask reality with non-reality is just that—the action of making something real less real. It can be used for filmmaking (and obviously often is), but it can be used for anything else too.
The issue is how easily these tools can (and will) enable the worst faith actors and actions. It's not controversial (or shocking) to think the current situation for deep-fakes or deceptive edits is historically awful. It's equally reasonable to think these tools are going to do less good for VFX houses in Hollywood, and more evil in authoritarian regimes or chaotic social media networks. You're right that the Overton window has moved—but we ought to blame a White House that disseminates deepfakes, not commenters on HackerNews.
Tools aren't just tools, nothing exists in a vacuum. A plane is a useful means of transportation, but that doesn't mean everyone should be rushing into the cockpit. It's pretty plain to me how a tool that streamlines doctoring footage to such a useful (and deceptive) degree is just a recipe for disaster. Considering the benefit to society is...slightly eased CGI work (?), I'll easily label this a net-negative for us all.
> Given the current situation in the world why do you not think about technology can be misused, especially if it’s VFX.
I think the point of the parent was that while you need to think about how this technology can be misused, that's not the only thing you need to and can think about.
Yes but why are we required to imagine only this? With this logic, why won't we try to imagine how bad Stalin's (or Hitler's, or anyone's) reign of terror would be with state-controlled social media? With state-censored Internet (that's about current Russia, by the way)? With modern communication technologies et al. and so on?
Hell yeah, let's go back to the caves just because science, technology and progress can actually empower everyone, including dictators, maniacs, psychopaths, predators and "bad people et al.", not just "good" (the definition of "good" varies, but let's assume we're using common principles of goodness) people.
Netflix:
13 Reasons Why: Following concerns from mental health professionals, Netflix edited the first-season finale in 2019 to remove a graphic scene depicting the main character’s suicide.
Back to the Future Part II: In May 2020, it was discovered that a scene involving an adult magazine cover was censored in certain regions. Netflix stated they had received an edited foreign version from the studio and later restored the original scene.
Bird Box: Following public outcry in 2018, Netflix agreed to remove footage from the 2013 Lac-Mégantic rail disaster used in the film's scenes, as it was deemed insensitive.
The Devil Next Door: In 2019, Netflix added extra text to a map in this documentary series after complaints from the Polish Prime Minister regarding the portrayal of Nazi death camps.
Patriot Act with Hasan Minhaj: An episode critical of the Saudi Arabian government was removed in Saudi Arabia in 2019 after a government takedown request.
Removing film crew, boom mics, and missed props from a scene would surely be useful to studios. It may even enable some shots that previously would have been impossible due to the positioning of cameras, etc.
I can see this being one of many AI tools for video editors. Combined with a handful of other tricks an SFX shop should have a tremendously higher productivity.
- "removing the kettlebell" led to removing the visual representation of the kettlebell as well the deformation it makes on the pillow
- "removing the hands" removed the childs hands from the tops, but did not then lead to the tops falling over!
Others like the colliding cars are in some weird gray area between the two.
One should note as these tools proliferate, there is a lot of artistic expression that we are giving up to these imprecise natural language parsing engines.
We saw this with StableDiffusion. First it was just text-to-image. Now we have controlnets which can control the precise placement of objects. We've got depth maps, body positioning, all kinds of things. I can even sketch on my tablet and tunr that into an image.
I'm sure we can add options for what this physically affects or doesn't affect.
I can imagine watching Bandersnatch and getting rid of the game developer in frame 1. The remaining 90 minutes, his dad having a quiet, stress-free Tuesday.
Enjoying 5 seasons of chemistry lessons
It’s also alarming what’s possible when reassembling photons en masse becomes commoditized.
Photons Be Free?
It's kind of late to ring the bells once the city walls have been taken. In other (shorter) words, if someone wanted to use this for censorship, they would already have tried it, so... it's either too late or too early; although being interesting (but not good or fun) probability, it's probability only.
...I hope one day everyone, just everyone will finally learn that most of the technologies are not evil or good, they're neutral, they're just tools. And most (no, not all) of them were also created with good intentions.
The issue is how easily these tools can (and will) enable the worst faith actors and actions. It's not controversial (or shocking) to think the current situation for deep-fakes or deceptive edits is historically awful. It's equally reasonable to think these tools are going to do less good for VFX houses in Hollywood, and more evil in authoritarian regimes or chaotic social media networks. You're right that the Overton window has moved—but we ought to blame a White House that disseminates deepfakes, not commenters on HackerNews.
Tools aren't just tools, nothing exists in a vacuum. A plane is a useful means of transportation, but that doesn't mean everyone should be rushing into the cockpit. It's pretty plain to me how a tool that streamlines doctoring footage to such a useful (and deceptive) degree is just a recipe for disaster. Considering the benefit to society is...slightly eased CGI work (?), I'll easily label this a net-negative for us all.
I guess I have seen more AI generated spam ads than content created for the intended purpose.
I think the point of the parent was that while you need to think about how this technology can be misused, that's not the only thing you need to and can think about.
Hell yeah, let's go back to the caves just because science, technology and progress can actually empower everyone, including dictators, maniacs, psychopaths, predators and "bad people et al.", not just "good" (the definition of "good" varies, but let's assume we're using common principles of goodness) people.
Presumably Netflix wants to erase smoking from its back catalog or some other bit of papier-mâché Stalinism.
Oh well, neat bit of auto-regressive theater.
VPN sometime if you have doubts about that in western media, including US
I see this being used in many countries, especially in the West.
We've crashed head straight into a dystopian future. But worry not! The crash can be edited out of reality.
Netflix: 13 Reasons Why: Following concerns from mental health professionals, Netflix edited the first-season finale in 2019 to remove a graphic scene depicting the main character’s suicide. Back to the Future Part II: In May 2020, it was discovered that a scene involving an adult magazine cover was censored in certain regions. Netflix stated they had received an edited foreign version from the studio and later restored the original scene. Bird Box: Following public outcry in 2018, Netflix agreed to remove footage from the 2013 Lac-Mégantic rail disaster used in the film's scenes, as it was deemed insensitive. The Devil Next Door: In 2019, Netflix added extra text to a map in this documentary series after complaints from the Polish Prime Minister regarding the portrayal of Nazi death camps. Patriot Act with Hasan Minhaj: An episode critical of the Saudi Arabian government was removed in Saudi Arabia in 2019 after a government takedown request.