RSS Google AI Blog
Follow
It's all about the angle: Your photos, re-composed
Imagine wishing you could retake a photo from a slightly different angle. The new Google Photos Auto frame feature addresses this with advanced image editing. It uses machine learning to understand a photo as a 3D scene, considering spatial layout. The system essentially repositions a virtual camera within the 3D space of the image. This generates a new, authentic perspective by creating previously unseen content. This differs from traditional editing, which is limited by the original fixed viewpoint. The process involves two key stages: 3D scene estimation and generative inpainting. 3D point maps are created, followed by using a generative model to fill in missing areas. ML automatically detects subject faces and orientations to determine ideal framing. This also corrects perspective distortion in wide-angle photos. This technique is now available in Google Photos, enhancing portraits through the Auto frame feature. Users can easily access the re-composed images as an alternative photo rendition. The development was a collaborative effort between Google DeepMind and Google Platforms & Devices teams.