I got some amazing photos through a set of eclipse viewing glasses on my Vivo x300 pro. If I'd been a bit more organized and set up a stand and taped the glasses onto the phone I think I could have taken a video of the whole thing in incredible quality. But I just held the glasses in front of the lens and it worked.
What I found though was that I had to use the pro mode (which I use for basically everything anyway, to avoid exactly the kind of issues this article is talking about).
I did try on normal photo mode and I think what was happening was that as soon as I covered one lens with the glasses it switched to another.
The year is 2036, when dialed up to maximum space saving, the latest generation of smart phones now turn camera pictures to a textual description and later when you want to view them, re-generate them on the fly using a text2image model. Not that "saving space" really means something, the phones refuse to unlock if they don't have an internet connection and store all your data on multiple cloud servers anyway (one for each five eye country).
With the rise of AI-generated content I would actually love a camera with no post-processing by default and a watermarking system that proves the picture is authentic. I can see Apple going that way eventually.
Every dedicated camera is like this, more so if you shoot in raw.
There's also a lot of confusion around the processing here. The iPhone is mostly just taking multiple pictures and stacking them on top of each other to make up for the poor performance of the small hardware, denoising, and then applying a mask to subjects to lift shadows and adjust skin tones. This is the same kind of edit a photographer would do in Lightroom. It's not straight up AI generating content in the image.
Sadly Android phones are willing to pull cheap tricks to show better numbers or look better in some comparative youtube video so they pull this stuff.
This is a feature a lot of companies are looking in to right now. It's less about reducing processing and more about proving something is real and not AI generated. The iphone processing doesn't straight up generate things that aren't real.
It's also something I've been looking into. I've completely broken Google's implementation and I can sign any file as if it were real, more details will be public in the coming weeks.
Signatures are nice, but the contents of the image still matter. Any signs of manipulation should still be treated with suspicion, even if they're "legitimate" edits. The best way to avoid such signs is to have the bare minimum processing.
This is also my opinion. However, I still think it's worth raising the bar for plausible fakes. Minimising processing is another way to raise that bar (or at least, lower the floor). It's also not something you can do by default, because consumers demand image processing.
Well, they do their best, they don't do any userspace post-processing. They can't really help whatever the firmware in the camera and/or the camera driver are already doing.
It's not really possible to have zero processing of an image. At some point you have to interpret the sensor data and turn it in to a JPEG. The line people decide an image is "processed" is pretty subjective though. It's somewhere between the camera deciding what the white balance / exposure is, and AI replacing the sun with a moon.
There was a post on HN a few months ago showing the stages of post-processing on a photo of a Christmas tree in a room - the original photo was unrecognisable.
I would find the link, but I’m balancing my phone on my knee while trying to eat dinner and pretend I’m not playing with my phone while eating dinner…
I am wondering if the AI enhancement should be opt-in rather than the default and saving the original as well. Even if you want AI enhancement, future models are likely to be better.
Interestingly, one of their AI filters is actually called "Super Moon":
4.14.3 Camera Image Optimization
The camera image optimization AI algorithm is mainly used in the following camera features: Super Moon, AI Camera, Document Mode, Front Portrait Mode with Background Blurring, and Beautify.
I still struggle with the idea that the chinese olympics had both CGI fireworks and real firework footage mixed together.
I cant fathom how this was a "if they know it doesnt matter at all" situation.
A complete acceptance of real / fake, who cares its about stuff looking great.
I mean I can be told it but I cant understand why you would waste millions on real works just to have fake ones, why not just go all fake? If its a half way house then does no one care what is real?
IE on linkedin somany AI videos with thousands of comments and likes and I become lost on ... do most poeple just not care if its real or not? I dont think they do at all. Am I mad to care?
Its very easy to say well everyone uses filters and they are not real. And its true! But somewhere and I have no idea where, there seems tobe a line for me where I say no, thats not cricket, you cant just replace part of an image with a template of something else. I have no idea tho any thoughts appreciated.
Perhaps they needed some real fireworks for those there in person, and to be able to claim that there really was a fireworks show, but wanted to amp it up for those viewing the event virtually (most of the world).
From what I have seen, the attitude towards AI in China is entirely different. The population largely believes it's a positive technology that will help improve their lives. While in America there is a seething hatred towards AI where people believe the benefits will all go to the billionaires while they are put out of a job.
If you look at the way Chinese AI companies act compared to American ones, it's easy to see how people feel this way.
What I found though was that I had to use the pro mode (which I use for basically everything anyway, to avoid exactly the kind of issues this article is talking about).
I did try on normal photo mode and I think what was happening was that as soon as I covered one lens with the glasses it switched to another.
There's also a lot of confusion around the processing here. The iPhone is mostly just taking multiple pictures and stacking them on top of each other to make up for the poor performance of the small hardware, denoising, and then applying a mask to subjects to lift shadows and adjust skin tones. This is the same kind of edit a photographer would do in Lightroom. It's not straight up AI generating content in the image.
Sadly Android phones are willing to pull cheap tricks to show better numbers or look better in some comparative youtube video so they pull this stuff.
Signatures are nice, but the contents of the image still matter. Any signs of manipulation should still be treated with suspicion, even if they're "legitimate" edits. The best way to avoid such signs is to have the bare minimum processing.
It's fascinating to see how much post-processing gets done.
I would find the link, but I’m balancing my phone on my knee while trying to eat dinner and pretend I’m not playing with my phone while eating dinner…
4.14.3 Camera Image Optimization
The camera image optimization AI algorithm is mainly used in the following camera features: Super Moon, AI Camera, Document Mode, Front Portrait Mode with Background Blurring, and Beautify.
https://trust.mi.com/docs/miui-privacy-white-paper-global/4/...
I cant fathom how this was a "if they know it doesnt matter at all" situation.
A complete acceptance of real / fake, who cares its about stuff looking great.
I mean I can be told it but I cant understand why you would waste millions on real works just to have fake ones, why not just go all fake? If its a half way house then does no one care what is real?
IE on linkedin somany AI videos with thousands of comments and likes and I become lost on ... do most poeple just not care if its real or not? I dont think they do at all. Am I mad to care?
Its very easy to say well everyone uses filters and they are not real. And its true! But somewhere and I have no idea where, there seems tobe a line for me where I say no, thats not cricket, you cant just replace part of an image with a template of something else. I have no idea tho any thoughts appreciated.
Perhaps they needed some real fireworks for those there in person, and to be able to claim that there really was a fireworks show, but wanted to amp it up for those viewing the event virtually (most of the world).
If you look at the way Chinese AI companies act compared to American ones, it's easy to see how people feel this way.
https://www.theverge.com/2023/3/13/23637401/samsung-fake-moo...