# US 2014/0192211 A1 · Pictures using voice commands and automatic upload

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192211 A1
- Document ID: US20140192211A1
- Status: Published application
- Kind: A1
- Application number: 14/203,129
- Filed: 2014-03-10
- Published: 2014-07-10
- Earliest claimed: 2005-10-17
- Assignees: Cutting Edge Vision LLC
- Inventors: Jeffrey C. Konicek
- Web page: https://patentgrep.com/patent/US20140192211A1

## CPC

- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- G03B 13/02: Viewfinders
- G03B 17/02: Bodies
- G03B 29/00: Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects (combinations with flash apparatus G03B15/03)
- G03B 31/06: in which sound track is associated with successively-shown still pictures
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 17/22: Interactive procedures; Man-machine interfaces
- H04M 3/42204: {Arrangements at the exchange for service or number selection by voice (at the terminal H04M1/27)}
- H04N 1/00095: {Systems or arrangements for the transmission of the picture signal}
- H04N 1/00204: {with a digital computer or a digital computer system, e.g. an internet server (programmed control between transmitter and receiver or between image input and image output device H04N1/32561)}
- H04N 1/00209: {Transmitting or receiving image data, e.g. facsimile data, via a computer, e.g. using e-mail, a computer network, the internet, I-fax}
- H04N 1/00212: {Attaching image data to computer messages, e.g. to e-mails}
- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/2112: {using still video cameras}
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N 2201/0084: Digital still camera
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A system and method is disclosed for enabling user friendly interaction with a camera system. Specifically, the inventive system and method has several aspects to improve the interaction with a camera system, including voice recognition, gaze tracking, touch sensitive inputs and others. The voice recognition unit is operable for, among other things, receiving multiple different voice commands, recognizing the vocal commands, associating the different voice commands to one camera command and controlling at least some aspect of the digital camera operation in response to these voice commands. The gaze tracking unit is operable for, among other things, determining the location on the viewfinder image that the user is gazing upon. One aspect of the touch sensitive inputs provides that the touch sensitive pad is mouse-like and is operable for, among other things, receiving user touch inputs to control at least some aspect of the camera operation. Another aspect of the disclosed invention provides for gesture recognition to be used to interface with and control the camera system.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A camera system comprising:
(a) a camera that is operable to take and store pictures, and that includes: (i) a lens, (ii) an image sensor, (iii) at least one microphone, (iv) a voice recognizer, (v) a camera controller, (vi) a wireless network interface, and (vii) a touch sensitive display;
(b) the camera controller including a control program having instructions to control and respond to the voice recognizer;
(c) the voice recognizer coupled to the microphone and the camera controller, and configured to receive and process sounds, including:
(i) a first human sound received and recognized by the voice recognizer as a first human spoken word, the recognized first human spoken word being assigned by the control program to be a command for the camera to take a picture, and
(ii) a second human sound received and recognized by the voice recognizer as a second human spoken word, the recognized second human spoken word being different from the first human spoken word and also assigned by the control program to take a picture; and
(d) the camera controller configured to:
(i) cause the camera to take a picture in response to the voice recognizer recognizing either the first or second human spoken word and to store the picture in a local memory in the camera; and
(ii) automatically upload the picture stored in the local memory of the camera via the wireless network interface and an internet connection to a location at an internet picture hosting website as instructed by a user of the camera.

### Claim 22 (depends on 21)

The camera system of claim 21 wherein the camera controller is configured to cause pictures stored in the local memory to be uploaded over the internet for storage at a website and to be transmitted to another party.

### Claim 23 (depends on 21)

The camera system of claim 21 wherein the camera controller is configured to enable the user to select specific pictures stored in the local memory to be uploaded to the internet picture hosting website.

### Claim 24 (depends on 21)

The camera system of claim 21 wherein the camera controller is configured to allow a user to launch a browser on the camera to connect to and use the services at the internet picture hosting website at which the picture is uploaded.

### Claim 25 (depends on 21)

The system of claim 21 wherein the camera controller is configured to automatically cause at least one of the pictures stored in local memory to be sent to a location associated with an email account.

### Claim 26 (depends on 21)

The system of claim 21 wherein the camera systems includes:
(e) two microphones oriented differently on the camera and configured to receive and detect sound signals emanating from around the camera; and
(f) a detector coupled to the microphones and configured to receive, process and combine sounds signals detected at the microphones, and to input the combined sounds to the voice recognizer.

### Claim 27 (depends on 21)

The camera system of claim 21 further including a gaze tracking system coupled to the camera controller and configured to track a user's eye to control use of the camera.

### Claim 28 (depends on 21)

The camera system of claim 21 wherein the camera is integrated with a cell phone, and the voice recognizer is configured to recognize at least one spoken word to control dialing of the cell phone.

### Claim 29 (depends on 28)

The camera system of claim 28 wherein the voice recognizer is configured to recognize spoken words in association with text messaging over the cell phone.

### Claim 30 (depends on 21)

The camera system of claim 21 wherein the touch sensitive display is configured so that a user may control zoom operations by sliding a finger on the display.

### Claim 31 (depends on 21)

The camera system of claim 21 wherein the camera controller is configured with picture editing programming that enables a user to edit pictures stored in the local memory.

### Claim 32 (depends on 31)

The camera of claim 31 wherein the camera controller is configured to enable a user to edit pictures by accessing with the camera and downloading content from the internet.

### Claim 33 (depends on 21)

The camera system of claim 21 wherein the touch sensitive display is detachable from the camera and configured to enable wireless communication with the camera controller for remote control of the camera system.

### Claim 34 (depends on 33)

The camera system of claim 33 wherein the detachable touch sensitive display is configured to serve the purposes of a remote input terminal and a display for the camera system.

### Claim 35 (depends on 34)

The camera system of claim 34 wherein the detachable touch sensitive display includes a microphone configured to receive and transmit to the controller voice command for input to the voice recognition unit.

### Claim 36 (depends on 35)

The camera system of claim 35 wherein the detachable touch sensitive display further includes a microphone and a voice recognizer, the microphone configured to transduce a human sound and provide a signal corresponding to the sound to the voice recognizer in the display and further wherein the voice recognizer is configured to process the signal and determine a word corresponding to the human sound and to cause a command associated with the recognized word to be transmitted to the camera.

### Claim 37 (depends on 35)

The camera system of claim 35 wherein the detachable touch sensitive display includes a power source that is charged when the display is docked to the camera.

### Claim 38

A system comprising:
(a) a camera that is operable to take and store pictures, and that includes: (i) a lens, (ii) an image sensor, (iii) at least two microphones, (iv) a voice recognizer, (v) a camera controller, and (vi) a touch sensitive display;
(b) the camera controller including a control program having instructions to control and respond to the voice recognizer;
(c) the two microphones oriented differently on the camera and configured to receive and detect sound signals emanating from around the camera;
(d) a detector coupled to the microphones and configured to receive, process and combine sounds signals detected at the microphones, and to input the sounds to the voice recognizer;
(e) wherein the controller is configured to:
(i) cause the system to take a picture and store the picture in local memory in the camera;
(ii) automatically upload a picture stored in the local memory to a user-instructed location at an internet picture hosting website via the wireless network interface, but only if predetermined conditions are met, the predetermined conditions including at least:
(1) an indication from the wireless network interface that the system can make an internet connection via the wireless network interface; and
(2) an indication from the local memory that a user has elected an option to designate at least one picture stored in local memory to be uploaded to the internet picture hosting website; and
(iii) launch a browser to connect to and use the services at the internet picture hosting website.

### Claim 39 (depends on 38)

The camera system of claim 38 wherein the camera is integrated with a cell phone, and the voice recognizer is configured to recognize at least one spoken word to control dialing of the cell phone.

### Claim 40 (depends on 39)

The camera system of claim 39 wherein the voice recognizer is configured to recognize spoken words in association with text messaging over the cell phone.

### Claim 41 (depends on 38)

The camera system of claim 38 wherein the touch sensitive display is detached from the camera and configured to enable wireless communication with the camera controller for remote control of the camera system.

### Claim 42

A system comprising:
(a) a camera that is operable to take and store pictures, and that includes: (i) a lens, (ii) an image sensor, (iii) at least one microphone, (iv) a voice recognizer, and (v) a camera controller,
(b) the camera controller including a control program having instructions to control and respond to the voice recognizer;
(c) the voice recognizer coupled to the microphone and the camera controller, and configured to receive and process human sound that is recognized as a defined command assigned by the control program for the camera to take a picture; and
(d) the camera controller configured to automatically determine an appropriate delay period, the appropriate delay period selected by the camera, after the human sound is recognized as a command and before the controller performs the command to take a picture.

### Claim 43 (depends on 42)

The system of claim 42 further wherein the selected delay period depends on the defined command associated with the recognized human sound.

### Claim 44 (depends on 42)

The system of claim 42 further comprising at least two microphones oriented differently on the camera and configured to receive and detect sounds emanating from different locations around the camera.

### Claim 45 (depends on 44)

The system of claim 44 further comprising the camera controller configured to determine an approximate direction relative to the camera of a source of the sound by comparing the received signals at the at least two microphones, and wherein the selected delay period depends on the determined direction.

### Claim 46 (depends on 42)

The system of claim 42 wherein the voice recognizer is configured to receive and process:
(e) a first human sound that is recognized by the voice recognizer as a first word that is assigned by the control program to be a first command for the camera, and
(f) a second human sound that is recognized by the voice recognizer as a second word that is different from the first word and is also assigned by the control program to be the first command for the camera.

### Claim 47 (depends on 46)

The system of claim 46 where the first command is to take a picture.

### Claim 48 (depends on 42)

The system of claim 42, further comprising:
(e) at least two microphones oriented differently on the camera and configured to receive and detect sounds emanating from different locations around the camera, and
(f) wherein the voice recognizer is configured to receive and process:
(i) a first human sound that is recognized by the voice recognizer as a first word that is assigned by the control program to be a command for the camera to take a picture, and
(ii) a second human sound that is recognized by the voice recognizer as a second word that is different from the first word and is also assigned by the control program to be a command for the camera to take a picture.
