The iPhone 7 Plus Dual Cameras Work Together During Every Shot

Matthew Panzarino:

Every time you take a picture with the iPhone 7, both the wide angle and telephoto fire off. Yes, two 12 megapixel pictures for every shot. This could be a prime driver behind the increase of the iPhone 7 Plus’ memory to 3GB.

Both images are needed due to an Apple technique it is calling “fusion” internally. Fusion takes data from both sensors and merges them into the best possible picture for every condition. If, for instance, there is a low-light scene that has some dark areas, the image-processing chip could choose to pick up some image data (pixels or other stuff like luminance) from the brighter f1.8 wide angle and mix it in with the data from the f2.8 telephoto, creating a composite image on the fly without any input from the user. This fusion technique is available to every shot coming from the camera, which means that the iPhone 7 Plus is mixing and matching data every time that trigger is tapped.
This technique is made possible because the optics, coatings, sensors, perspectives and color balances of the two cameras are perfectly matched.

The fusion technique also comes in handy when using the new zoom functions of the iPhone 7 Plus.

This is extremely intruiging if true — I know this technique was used on the previous iPhones but thought it impossible to do with two different focal lenghts. I would love a more detailed exaplanation of what the ISP does exactly.