Future iPhones may include 3D-sensing rear camera to boost AR
15 November 2017 | 0
A new report has shed some light on a new feature that’s due not for next year’s iPhone but the 2019 model. According to Bloomberg, Apple is working on bringing 3D-sensing to the rear camera to turn the iPhone into an augmented reality powerhouse.
Called TrueDepth, it relies on sensors that project thousands of dots onto your face to learn and adapt to the unique geometry of your face. But Bloomberg said Apple is working on something much more advanced for the iPhone’s rear camera.
“The planned rear-facing sensor would instead use a time-of-flight approach that calculates the time it takes for a laser to bounce off surrounding objects to create a three-dimensional picture of the environment,” the publication said.
Time of flight cameras use advanced algorithms for distance mapping and range imaging, meaning it would track the whole scene, not just your face.
The most obvious use for such a camera would be augmented reality. Tim Cook has repeatedly expressed excitement in the technology, and a recent rumor claims that Apple is also working on an AR wearable due to be unveiled in 2019, which fits this timeline nicely. Back in 2016, Cook said this about AR: “AR is going to take a while, because there are some really hard technology challenges there. But it will happen, it will happen in a big way, and we will wonder when it does, how we ever lived without it.”
This isn’t the first batch of rumours about a laser-based rear camera. Before iPhone X was released, Fast Company reported that Apple was working on a 3D vertical-cavity surface-emitting laser system for the main camera aimed at improving depth detection and autofocus.
IOS 11 has impressive AR features built into it, and iPhones are already able to virtually place furniture in a room or dominoes on a table, but a time-of-flight camera would take it to a new level, letting objects recognise the world around them and react accordingly.
Bloomberg says the technology is still in the early stages of development and might not appear in the phone at all.
Now that Apple has finally released its home button-less OLED iPhone, we can start focusing on what’s inside the phone. The iPhone X is packed with tech, but the rear camera is essentially the same as the one you’ll find on iPhone 8 Plus. There’s nothing wrong with it but Apple will focus on improving it in future models, both in its ability to take pictures and with its AR capabilities. A 3D rear camera would open up iPhone X to a new world of augmented reality, and mixed with AI and machine learning, it could rival what Google is doing with real-world identification in Lens.
IDG News Service