US 10,375,313 B1Granted

Creative camera

AssigneeApple Inc.

InventorsMarcel Van Os, Jessica Aboukasm, David R. Black, Robert Chinn, Gregory L. Dudey, Katherine K. Ernst, Grant Paul, William A. Sorrentino, III, Brian E. Walsh, Jean-Francois Albouze, Jae Woo Chang, Aurelio Guzman, Christopher J. Moulios, Joanna M. Newman, Nicolas Scapel, Joseph-Alexander P. Weil, Christopher Wilson

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

The present disclosure generally relates to displaying visual effects in image data. In some examples, visual effects include an avatar displayed on a user's face. In some examples, visual effects include stickers applied to image data. In some examples, visual effects include screen effects. In some examples, visual effects are modified based on depth data in the image data.

Claims48

Dependent claims

An electronic device, comprising:

a camera;
a display apparatus;
one or more processors;
and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display apparatus, a camera user interface, the camera user interface including:
a camera display region including a representation of image data captured via the camera, wherein the representation includes a representation of a subject and a representation of a background, and the image data corresponds to depth data for the subject;
and
a first affordance associated with a first camera display mode;
identifying the subject based on the depth data;
while the subject is positioned within a field of view of the camera and the representation of the subject and the representation of the background are displayed in the camera display region, detecting a gesture directed to the first affordance;
in response to detecting the gesture directed to the first affordance, activating the first camera display mode, wherein activating the first camera display mode includes:
displaying an avatar selection region including a plurality of avatar options;
and
in response to detecting a selection of one of the plurality of avatar options, displaying a representation of the selected avatar option over a first portion of the representation of the identified subject in the camera display region and while maintaining display of at least a second portion of the representation of the identified subject;
while the first camera display mode is active, detecting a change in pose of the subject;
in response to detecting the change in pose of the subject, changing an appearance of the displayed representation of the selected avatar option based on the detected change in pose of the subject while maintaining display of the second portion of the representation of the identified subject and at least a portion of the representation of the background;
while displaying the representation of the selected avatar option over the first portion of the representation of the identified subject in the camera display region and while maintaining display of at least the second portion of the representation of the identified subject, detecting a gesture directed to a filter affordance that is concurrently displayed on the display with the representation of the selected avatar;
and
in response to detecting the gesture directed to the filter affordance, activating a filter mode, wherein activating the filter mode includes:
changing an appearance of the displayed representation of the selected avatar option based on the selected filter;
and
changing an appearance of at least a portion of the representation of the background based on the selected filter.

20 more elements

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a camera and a display apparatus, the one or more programs including instructions for:

displaying, via the display apparatus, a camera user interface, the camera user interface including:
a camera display region including a representation of image data captured via the camera, wherein the representation includes a representation of a subject and a representation of a background, and the image data corresponds to depth data for the subject;
and
a first affordance associated with a first camera display mode;
identifying the subject based on the depth data;
while the subject is positioned within a field of view of the camera and the representation of the subject and the representation of the background are displayed in the camera display region, detecting a gesture directed to the first affordance;
in response to detecting the gesture directed to the first affordance, activating the first camera display mode, wherein activating the first camera display mode includes:
displaying an avatar selection region including a plurality of avatar options;
and
in response to detecting a selection of one of the plurality of avatar options, displaying a representation of the selected avatar option over a first portion of the representation of the identified subject in the camera display region and while maintaining display of at least a second portion of the representation of the identified subject;
while the first camera display mode is active, detecting a change in pose of the subject;
in response to detecting the change in pose of the subject, changing an appearance of the displayed representation of the selected avatar option based on the detected change in pose of the subject while maintaining display of the second portion of the representation of the identified subject and at least a portion of the representation of the background;
while displaying the representation of the selected avatar option over the first portion of the representation of the identified subject in the camera display region and while maintaining display of at least the second portion of the representation of the identified subject, detecting a gesture directed to a filter affordance that is concurrently displayed on the display with the representation of the selected avatar;
and
in response to detecting the gesture directed to the filter affordance, activating a filter mode, wherein activating the filter mode includes:
changing an appearance of the displayed representation of the selected avatar option based on the selected filter;
and
changing an appearance of at least a portion of the representation of the background based on the selected filter.

15 more elements

A method comprising:

at an electronic device having a camera and a display apparatus:
displaying, via the display apparatus, a camera user interface, the camera user interface including:
a camera display region including a representation of image data captured via the camera, wherein the representation includes a representation of a subject and a representation of a background, and the image data corresponds to depth data for the subject;
and
a first affordance associated with a first camera display mode;
identifying the subject based on the depth data;
while the subject is positioned within a field of view of the camera and the representation of the subject and the representation of the background are displayed in the camera display region, detecting a gesture directed to the first affordance;
in response to detecting the gesture directed to the first affordance, activating the first camera display mode, wherein activating the first camera display mode includes:
displaying an avatar selection region including a plurality of avatar options;
and
in response to detecting a selection of one of the plurality of avatar options, displaying a representation of the selected avatar option over a first portion of the representation of the identified subject in the camera display region and while maintaining display of at least a second portion of the representation of the identified subject;
while the first camera display mode is active, detecting a change in pose of the subject;
in response to detecting the change in pose of the subject, changing an appearance of the displayed representation of the selected avatar option based on the detected change in pose of the subject while maintaining display of the second portion of the representation of the identified subject and at least a portion of the representation of the background;
while displaying the representation of the selected avatar option over the first portion of the representation of the identified subject in the camera display region and while maintaining display of at least the second portion of the representation of the identified subject, detecting a gesture directed to a filter affordance that is concurrently displayed on the display with the representation of the selected avatar;
and
in response to detecting the gesture directed to the filter affordance, activating a filter mode, wherein activating the filter mode includes:
changing an appearance of the displayed representation of the selected avatar option based on the selected filter;
and
changing an appearance of at least a portion of the representation of the background based on the selected filter.

16 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/110,514Filed 23 Aug 2018 · us provisional application
Priority: 7 May 2018
Granted: 6 Aug 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification32 codes

H04N 23/632
Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters: for displaying or modifying preview…
G06F 3/017
Input arrangements or combined input and output arrangements for interaction between user and computer: gesture based interaction, e.g. based on a…
G06F 3/0304
Arrangements for converting the position or the displacement of a member into a coded form: detection arrangements using opto-electronic means
G06T 13/40
Three-dimensional [3D] animation: of characters, e.g. humans, animals or virtual beings

Family

Application62/668,227Us provisional application · filed 7 May 2018
Application62/679,934Us provisional application · filed 3 Jun 2018
US 10,375,313 B1This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key