US 2022/0012896 A1 · PLACING AUGMENTED REALITY OBJECTS IN AN IMAGE BASED ON DEVICE POSITION

Abstract

An electronic device places an augmented reality object in an image of a real environment based on a pose of the electronic device and based on image segmentation. The electronic device includes a camera that captures images of the real environment and sensors, such as an inertial measurement unit (IMU), that capture a pose of the electronic device. The electronic device selects an augmented reality (AR) object from a memory, segments a captured image of the real environment into foreground pixels and background pixels, and composites an image for display wherein the AR object is placed between the foreground pixels and the background pixels. As the pose of the electronic device changes, the electronic device maintains the relative position of the AR object with respect to the real environment in images for display.

Claims20

Dependent claims

A method comprising:

segmenting, at a processor of an electronic device, a first image of a real environment of the electronic device captured at a camera of the electronic device into foreground pixels and background pixels;
combining, at the processor, the first image with an augmented reality (AR) object based on the segmenting to generate a first combined image;
and
displaying, at a display of the electronic device, the first combined image.

1 more element

A method, comprising:

capturing, at an image sensor of an electronic device, a first image of a real environment of the electronic device;
segmenting, at a processor of the electronic device, the first image into foreground pixels and background pixels;
rendering, at the processor, the first image;
rendering, at the processor, an augmented reality (AR) object over the first image;
rendering, at the processor, the foreground pixels of the first image over the AR object to generate a first combined image in which at least part of the AR object is occluded by the foreground pixels;
and
displaying, at a display of the electronic device, the first combined image.

4 more elements

An electronic device, comprising:

a processor configured to:
segment a first image of a real environment of the electronic device captured at a camera of the electronic device into foreground pixels and background pixels;
and
combine the first image with an augmented reality (AR) object based on the segmenting to generate a first combined image;
and
a display configured to display the first combined image.

3 more elements

Dependencies are inferred from the claim text.

Placing augmented reality objects in an image based on device position

Life of this patent

Placing augmented reality objects in an image based on device position

Life of this patent

Abstract

Claims20