# US 9,519,355 B2 · Mobile device event control with digital images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,519,355 B2
- Document ID: US9519355B2
- Status: Granted
- Kind: B2
- Application number: 13/840,120
- Filed: 2013-03-15
- Published: 2014-09-18
- Granted: 2016-12-13
- Earliest claimed: 2013-03-15
- Applicants: Derek A Devries
- Inventors: Derek A Devries
- Web page: https://patentgrep.com/patent/US9519355B2

## CPC

- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/033: Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041)
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one exemplary embodiment, a method includes receiving a digital image from a mobile device. A first element of the digital image and a second element of the digital image is identified. The first element of the digital image includes a user-selected content. The second element includes a depiction of a user action. An event trigger identified by the first element and the second element is determined. The event trigger includes a mobile device operating system command. A mobile device command is generated according to the event trigger. The mobile device command is communicated to a mobile operating system.

## Claims

### Claim 1

A server system for mobile device event control with digital images comprising:
a processor configured to execute instructions;
a memory containing instructions when executed on the processor, causes the processor to perform operations that: receiving a digital image from a mobile device;
identifying a first element of the digital image and a second element of the digital image, wherein the first element of the digital image comprises a user-selected content, and wherein the second element comprises a depiction of a user action;
determining an event trigger identified by the first element and the second element, wherein the event trigger comprises a mobile device operating system command, and wherein the mobile device operating system command comprises a command, to execute an image search with an online image search engine accessed by a web browser operating in the mobile device;
generating a mobile device command according to the event trigger;
communicating the mobile device command to a mobile operating system; decomposing the first element into a set of attributes with an object recognition functionality operating in at least one computer processor;
matching an attribute of the set of attributes with a term;
composing a search query of the image search with the term derived from the set of attribute of the first element;
projecting the digital image with a projecting device onto a flat surface;
displaying the digital image on a display of the mobile device,
wherein a user interface on the display of the mobile device enables the user to manipulate the digital image according to the user action, wherein the user action comprises multi-touch user gestures,
wherein the user interface on the display of the mobile device enables the user to assign a kinetic motion attribute to the digital image according to the multi-touch user gestures, and
wherein the kinetic motion attribute comprises a spinning of the digital image around a user designated axis.

### Claim 2 (depends on 1)

The server system of claim 1, wherein the server system comprises a graphics editing application available to the user via a web page dashboard.

### Claim 3 (depends on 1)

The server system of claim 1, wherein the user-selected content comprises a digital photograph of a physically published image.