# US 2019/0317593 A1 · Image editing with audio data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0317593 A1
- Document ID: US20190317593A1
- Status: Published application
- Kind: A1
- Application number: 16/400,973
- Filed: 2019-05-01
- Published: 2019-10-17
- Earliest claimed: 2014-07-29
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Thomas Binder; Ronald Frank Wotzlaw
- Web page: https://patentgrep.com/patent/US20190317593A1

## CPC

- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- G03G 2215/0426: Editing of the image, e.g. adding or deleting
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G03G: ELECTROGRAPHY; ELECTROPHOTOGRAPHY; MAGNETOGRAPHY

## Abstract

Image editing on a wearable device includes a system which obtains sensor data via the wearable device. The sensor data includes a representation of hand movement, head movement or voice command associated with a user. The system executes an application for editing an image based on the obtained sensor data. The system provides for display a list of image adjustment types associated with the application. The system selects an image adjustment type based on one or more of the hand movement, the head movement or the voice command. The system provides for display a prompt having options to adjust a property of the selected image adjustment type. The system selects one of the options included in the prompt. The system modifies an image based on the selected option. The system then provides the modified image for storage in a data structure of a memory unit in the wearable device.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A computer-implemented method, comprising:
receiving, at a processor unit of a wearable device, first audio data from a sensor unit of the wearable device, the first audio data being associated with first audio input of a user;
providing for display, on a display unit of the wearable device, a user interface of an application for editing an image based on the first audio data;
providing for display, on the display unit via the user interface, a list of image adjustment types;
selecting at least one image adjustment type of the list of image adjustment types based on second audio data from the sensor unit, the second audio data being associated with second audio input of the user;
providing for display, on the display unit via the user interface, a prompt including a plurality of levels of adjustment for the selected at least one image adjustment type;
selecting a level of adjustment from the plurality of levels of adjustment based on third audio data from the sensor unit, third audio data being associated with third audio input of the user; and
providing an image modified by the level of adjustment for display on the display unit.

### Claim 22 (depends on 21)

The method of claim 21, wherein at least one of the first audio input, the second audio input or the third audio input includes a word, phrase or statement.

### Claim 23 (depends on 21)

The method of claim 21, further comprising:
modifying the image based on the level of adjustment, wherein modifying the level of adjustment includes an action to increase or decrease a strength of the selected at least one image adjustment type.

### Claim 24 (depends on 21)

The method of claim 21, further comprising:
determining that the first audio data includes a first voice command associated with the first audio input of the user; and
determining a match between the first voice command and a first predetermined voice command.

### Claim 25 (depends on 21)

The method of claim 21, further comprising:
determining that the second audio data includes a second voice command associated with the second audio input of the user; and
determining a match between the second voice command and a second predetermined voice command.

### Claim 26 (depends on 21)

The method of claim 21, wherein the third audio data includes data representing a frequency value of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the frequency value of the at least a portion of the third audio input.

### Claim 27 (depends on 21)

The method of claim 21, wherein the third audio data includes data representing volume of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the volume of the at least a portion of the third audio input.

### Claim 28

A non-transitory machine-readable medium embodying instructions, which when executed by one or more processors, cause a computing device to perform operations, the operations comprising:
receiving, at a processor unit of a computing device, first audio data from a sensor unit of the computing device, the first audio data being associated with first audio input of a user;
providing for display, on a display unit of the computing device, a user interface of an application for editing an image based on the first audio data;
providing for display, on the display unit via the user interface, a list of image adjustment types;
selecting at least one image adjustment type of the list of image adjustment types based on second audio data from the sensor unit, the second audio data being associated with second audio input of the user;
providing for display, on the display unit via the user interface, a prompt including a plurality of levels of adjustment for the selected at least one image adjustment type;
selecting a level of adjustment from the plurality of levels of adjustment based on third audio data from the sensor unit, third audio data being associated with third audio input of the user; and
providing an image modified by the level of adjustment for display on the display unit.

### Claim 29 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein at least one of the first audio input, the second audio input or the third audio input includes a word, phrase or statement.

### Claim 30 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein the operations comprise:
modifying the image based on the level of adjustment, wherein modifying the level of adjustment includes an action to increase or decrease a strength of the selected at least one image adjustment type.

### Claim 31 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein the operations comprise:
determining that the first audio data includes a first voice command associated with the first audio input of the user; and
determining a match between the first voice command and a first predetermined voice command.

### Claim 32 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein the operations comprise:
determining that the second audio data includes a second voice command associated with the second audio input of the user; and
determining a match between the second voice command and a second predetermined voice command.

### Claim 33 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein the third audio data includes data representing a frequency value of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the frequency value of the at least a portion of the third audio input.

### Claim 34 (depends on 28)

The non-transitory machine-readable medium of claim 28, wherein the third audio data includes data representing volume of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the volume of the at least a portion of the third audio input.

### Claim 35

An apparatus, comprising:
a display unit;
one or more sensor units;
one or more memory units; and
one or more processor units configured to execute executable instructions to perform operations to:
receive, at a processor unit of a wearable device, first audio data from a sensor unit of the wearable device, the first audio data being associated with first audio input of a user;
provide for display, on a display unit of the wearable device, a user interface of an application for editing an image based on the first audio data;
provide for display, on the display unit via the user interface, a list of image adjustment types;
select at least one image adjustment type of the list of image adjustment types based on second audio data from the sensor unit, the second audio data being associated with second audio input of the user;
provide for display, on the display unit via the user interface, a prompt including a plurality of levels of adjustment for the selected at least one image adjustment type;
select a level of adjustment from the plurality of levels of adjustment based on third audio data from the sensor unit, third audio data being associated with third audio input of the user; and
provide an image modified by the level of adjustment for display on the display unit.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the one or more processing units are configured to execute the executable instructions to perform further operations to modify the image based on the level of adjustment, wherein modifying the level of adjustment includes an action to increase or decrease a strength of the selected at least one image adjustment type.

### Claim 37 (depends on 35)

The apparatus of claim 35, wherein the one or more processing units are configured to execute the executable instructions to perform further operations to
determine that the first audio data includes a first voice command associated with the first audio input of the user; and
determine a match between the first voice command and a first predetermined voice command.

### Claim 38 (depends on 35)

The apparatus of claim 35, wherein the one or more processing units are configured to execute the executable instructions to perform further operations to
determine that the second audio data includes a second voice command associated with the second audio input of the user; and
determine a match between the second voice command and a second predetermined voice command.

### Claim 39 (depends on 35)

The apparatus of claim 35, wherein the third audio data includes data representing a frequency value of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the frequency value of at least a portion of the third audio input.

### Claim 40 (depends on 35)

The apparatus of claim 35, wherein the third audio data includes data representing volume of at least a portion of the third audio input and wherein selecting the level of adjustment is based, at least in part, on the data representing the volume of the at least a portion of the third audio input.
