# US 2019/0098225 A1 · Imaging Processing Device, Imaging Processing Method And Storage Medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0098225 A1
- Document ID: US20190098225A1
- Status: Published application
- Kind: A1
- Application number: 16/132,007
- Filed: 2018-09-14
- Published: 2019-03-28
- Earliest claimed: 2017-09-27
- Assignees: Casio Computer Co., Ltd.
- Applicants: Casio Computer Co., Ltd.
- Inventors: Kazuhisa KITAMURA
- Web page: https://patentgrep.com/patent/US20190098225A1

## CPC

- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- G02B 13/06: Panoramic objectives; So-called "sky lenses" {including panoramic objectives having reflecting surfaces}
- G10L 17/26: Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
- H04N 23/60: Control of cameras or camera modules
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 2420/01: Input selection or mixing for amplifiers or loudspeakers
- H04R 2430/20: Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An object is to clarify a relation between a partial area on an image and a voice corresponding to the area when providing them to a user. A control section acquires an image such as a fisheye moving image stored in a storage section and a voice corresponding to this image from the storage section, specifies a partial area on a plane of the entire area of the acquired image, acquires a voice from a direction corresponding to the specified partial area among all acquired voices and outputs this voice from a loudspeaker section.

## Claims

### Claim 1

An image processing device comprising:
a memory; and
a CPU,
wherein the CPU performs, based on a program stored in the memory, processing including:
acquiring at least one image;
acquiring voices corresponding to the image;
specifying a partial area in an entire area of the acquired image;
clipping the specified partial area from the image; and
acquiring a voice corresponding to an image of the clipped partial area from all the acquired voices.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein the CPU selects a microphone which collects a voice from a direction corresponding to the specified partial area from among all voices inputted from a plurality of microphones, and acquires the voice inputted from the microphone as the voice from the direction corresponding to the partial area.

### Claim 3 (depends on 1)

The image processing device according to claim 1, wherein the CPU acquires at least one captured and stored image as a replay target, and
wherein the CPU acquires, as a replay target, voices collected and stored in synchronization with capturing and storage of the image.

### Claim 4 (depends on 2)

The image processing device according to claim 2, wherein the CPU acquires at least one captured and stored image as a replay target, and
wherein the CPU acquires, as a replay target, voices collected and stored in synchronization with capturing and storage of the image.

### Claim 5 (depends on 3)

The image processing device according to claim 3, wherein the captured and stored image is a fisheye image captured by using a fisheye lens, and
wherein the voices collected and stored in synchronization with the capturing and storage of the image are voices inputted from a plurality of microphones arranged in different areas around the fisheye lens.

### Claim 6 (depends on 4)

The image processing device according to claim 4, wherein the captured and stored image is a fisheye image captured by using a fisheye lens, and
wherein the voices collected and stored in synchronization with the capturing and storage of the image are voices inputted from the plurality of microphones arranged in different areas around the fisheye lens.

### Claim 7 (depends on 2)

The image processing device according to claim 2, wherein the CPU selects, when two or more microphones are present which collect voices corresponding to the image of the specified partial area among all the voices collected and stored for each of the plurality of microphones, the two or more microphones and acquires a voice from the direction corresponding to the partial area by combining the voices from the two or more microphones.

### Claim 8 (depends on 1)

The image processing device according to claim 1, wherein the CPU excludes, from output targets, voices other than a voice from a direction corresponding to the specified partial area among all the acquired voices, and acquires the voice from the direction corresponding to the partial area.

### Claim 9 (depends on 1)

The image processing device according to claim 1, wherein the CPU acquires orientation information when the image is captured, and
wherein the CPU specifies a partial area on a plane of the entire area of the acquired image in accordance with the acquired orientation information during image capturing.

### Claim 10 (depends on 1)

The image processing device according to claim 1, wherein the CPU specifies, as the partial area, a clipping area arbitrarily specified by a user operation from the acquired image.

### Claim 11 (depends on 1)

The image processing device according to claim 1, wherein the CPU specifies, as the partial area, an area of the image including a subject detected by image analysis being performed on the acquired image.

### Claim 12 (depends on 1)

The image processing device according to claim 1, wherein the CPU displays on a display section the image of the specified partial area while displaying the acquired image.

### Claim 13 (depends on 12)

The image processing device according to claim 12, wherein the acquired image is a fisheye image captured by a fisheye lens, and
wherein the CPU displays on the display section an image acquired by distortion correction being performed on the image of the specified partial area.

### Claim 14 (depends on 1)

The image processing device according to claim 1, wherein the CPU outputs the acquired voice from an output section, and
wherein the CPU displays the image of the specified partial area and outputs the acquired voice.

### Claim 15 (depends on 1)

The image processing device according to claim 1, wherein the CPU stores the acquired voice and the image of the specified partial area in a storage section in association with each other.

### Claim 16 (depends on 15)

The image processing device according to claim 15, wherein the CPU stores the acquired voice and the image of the specified partial area in a same file in the storage section.

### Claim 17

An image processing method for an image processing device, comprising:
acquiring at least one image;
acquiring voices corresponding to the image;
specifying a partial area in an entire area of the acquired image;
clipping the partial area from the image; and
acquiring a voice corresponding to an image of the clipped partial area from all the acquired voices.

### Claim 18 (depends on 17)

The image processing method according to claim 17, wherein a microphone is selected which collects a voice from a direction corresponding to the specified partial area from among all voices inputted from a plurality of microphones, and the voice inputted from the microphone is acquired as the voice from the direction corresponding to the partial area.

### Claim 19 (depends on 17)

The image processing method according to claim 17, wherein at least one captured and stored image is acquired as a replay target, and
wherein voices collected and stored in synchronization with capturing and storage of the image is acquired as a replay target.

### Claim 20

A non-transitory computer-readable storage medium having stored thereon a program that is executable by a computer in an image processing device to actualize functions comprising:
acquiring at least one image;
acquiring voices corresponding to the image;
specifying a partial area in an entire area of the acquired image;
clipping the partial area from the image; and
acquiring a voice corresponding to an image of the clipped partial area from all the acquired voices.
