# US 2021/0084233 A1 · Generating and rendering motion graphics effects based on recognized content in camera view finder

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0084233 A1
- Document ID: US20210084233A1
- Status: Published application
- Kind: A1
- Application number: 16/948,384
- Filed: 2020-09-16
- Published: 2021-03-18
- Earliest claimed: 2019-09-18
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Alexander James Faaborg; Kankan Meng; Joost Korngold
- Web page: https://patentgrep.com/patent/US20210084233A1

## CPC

- G06T 13/00: Animation
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are described for providing co-presence in an augmented reality environment. The method may include receiving a visual scene within a viewing window depicting a multi-frame real-time visual scene captured by a camera onboard an electronic device associated with the augmented reality environment, identifying a plurality of elements of the visual scene, detecting at least one graphic indicator associated with at least one of the plurality of elements, detecting at least one boundary associated with the at least one element, and generating, in the viewing window and based on the detection of the at least one graphic indicator, Augmented Reality (AR) motion graphics within the detected boundary. In response to determining that content related to the at least one element is available, the method may include retrieving the content and visually indicating an AR tracked control on the at least one element within the viewing window.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving, by an electronic device, a visual scene within a viewing window depicting a multi-frame real-time visual scene captured by a camera onboard the electronic device;
identifying, by the electronic device, a plurality of elements of the visual scene;
detecting, by the electronic device and based on the plurality of elements identified in the visual scene, at least one graphic indicator associated with at least one of the plurality of elements;
detecting, by the electronic device, at least one boundary associated with the at least one element;
generating, in the viewing window and based on the detection of the at least one graphic indicator, Augmented Reality (AR) motion graphics within the detected boundary; and
in response to determining that content related to the at least one element is available, retrieving the content and visually indicating an AR tracked control on the at least one element within the viewing window.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in response to determining that content related to the at least one element is unavailable, dissipating the AR motion graphics.

### Claim 3 (depends on 1)

The method of claim 1, wherein the AR motion graphics include animated effects initiated at a location of the at least one graphic indicator and expanded to the boundary, the animated effects including moving elements presented within the detected boundary.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the AR tracked control is a play button configured to initiate, in the viewing window, an immersive AR experience with the content; and
receiving, from a user accessing the electronic device, input at the play button triggers execution of the immersive AR experience.

### Claim 5 (depends on 1)

The method of claim 1, wherein the detected boundary defines an edge of the at least one element, the defined edge configured to contain the AR motion graphics to a portion of the visual scene.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the graphic indicator is a logo; and
the AR motion graphics include a plurality of animated and non-overlapping shapes presented within the detected boundary.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one element is a virtual object; and
the detected boundary defines a surface of the virtual object.

### Claim 8 (depends on 1)

The method of claim 1, wherein the at least one element is a virtual object; and
the detected boundary defines a volume of the virtual object.

### Claim 9 (depends on 1)

The method of claim 1, wherein the retrieved content is based on a geographic location of the electronic device.

### Claim 10

A computer program product tangibly embodied on a non-transitory computer-readable storage medium and comprising instructions that, when executed by at least one computing device, are configured to cause the at least one computing device to:
receive, by an electronic device, a visual scene within a viewing window depicting a multi-frame real-time visual scene captured by a camera onboard the electronic device;
identify, by the electronic device, a plurality of elements of the visual scene;
detect, by the electronic device and based on the plurality of elements identified in the visual scene, at least one graphic indicator associated with at least one of the plurality of elements;
detect, by the electronic device, at least one boundary associated with the at least one element;
generate, in the viewing window and based on the detection of the at least one graphic indicator, Augmented Reality (AR) motion graphics within the detected boundary; and
in response to determining that content related to the at least one element is available, retrieve the content and visually indicating an AR tracked control on the at least one element within the viewing window.

### Claim 11 (depends on 10)

The computer program product of claim 10, further comprising:
in response to determining that content related to the at least one element is unavailable, dissipating the AR motion graphics.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein the AR motion graphics include animated effects initiated at a location of the at least one graphic indicator and expanded to the boundary, the animated effects including moving elements presented within the detected boundary.

### Claim 13 (depends on 10)

The computer program product of claim 10, wherein the detected boundary defines an edge of the at least one element, the defined edge configured to contain the AR motion graphics to a portion of the visual scene.

### Claim 14 (depends on 10)

The computer program product of claim 10, wherein:
the graphic indicator is a logo; and
the AR motion graphics include a plurality of animated and non-overlapping shapes presented within the detected boundary.

### Claim 15

A system comprising:
at least one processor;
memory storing instructions that, when executed by the at least one processor, cause the system to perform operations including:
receiving a visual scene within a viewing window depicting a multi-frame real-time visual scene captured by a camera associated with the at least one processor;
identifying a plurality of elements of the visual scene;
detecting, based on the plurality of elements identified in the visual scene, at least one graphic indicator associated with at least one of the plurality of elements;
detecting at least one boundary associated with the at least one element;
generating, in the viewing window and based on the detection of the at least one graphic indicator, Augmented Reality (AR) motion graphics within the detected boundary; and
in response to determining that content related to the at least one element is available, retrieving the content and visually indicating an AR tracked control on the at least one element within the viewing window.

### Claim 16 (depends on 15)

The system of claim 15, further comprising:
in response to determining that content related to the at least one element is unavailable, dissipating the AR motion graphics.

### Claim 17 (depends on 15)

The system of claim 15, wherein the AR motion graphics include animated effects initiated at a location of the at least one graphic indicator and expanded to the boundary, the animated effects including moving elements presented within the detected boundary.

### Claim 18 (depends on 15)

The system of claim 15, wherein the detected boundary defines an edge of the at least one element, the defined edge configured to contain the AR motion graphics to a portion of the visual scene.

### Claim 19 (depends on 15)

The system of claim 15, wherein:
the graphic indicator is a logo; and
the AR motion graphics include a plurality of animated and non-overlapping shapes presented within the detected boundary.

### Claim 20 (depends on 15)

The system of claim 15, wherein the at least one element is a virtual object; and
the detected boundary defines a volume of the virtual object.
