# US 8,570,397 B2 · Image pickup device and method of picking up image using the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,570,397 B2 - Document ID: US8570397B2 - Status: Granted - Kind: B2 - Application number: 13/272,353 - Filed: 2011-10-13 - Published: 2012-06-14 - Granted: 2013-10-29 - Earliest claimed: 2010-12-13 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Soo-man Jeong; Dae-gyu Kang - Inventors: Soo-man Jeong; Dae-gyu Kang - Web page: https://patentgrep.com/patent/US8570397B2 ## CPC - H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 23/531: {being rotatable or detachable} - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An image pickup device includes an image processing unit which processes an image input through the plurality of image pickup units, a plurality of microphones which are spaced apart from each other, an audio processing unit which senses a voice of a photographer using the plurality of microphones, and a control unit which, when the voice of a photographer is sensed through the audio processing unit, controls the image processing unit to combine an image of an image pickup unit corresponding to a location of the photographer with an image of an image pickup unit currently performing photographing. ## Claims ### Claim 1 An image pickup device including a plurality of image pickup units, comprising: an image processing unit which processes an image input through the plurality of image pickup units; a plurality of microphones which are spaced apart from each other; an audio processing unit which senses a voice of a photographer using the plurality of microphones; and a control unit which, if the voice of the photographer is sensed through the audio processing unit, controls the image processing unit to combine an image of an image pickup unit corresponding to a location of a photographer with an image of an image pickup unit currently performing photographing. ### Claim 2 (depends on 1) The device as claimed in claim 1, wherein the audio processing unit senses the voice of the photographer using a phase difference of the voice sensed through the plurality of microphones. ### Claim 3 (depends on 1) The device as claimed in claim 1, wherein the audio processing unit compares the voice input from a microphone corresponding to an image pickup unit currently performing photographing with the voice input from another microphone, and removes noise from the voice input from a microphone corresponding to the image pickup unit currently performing photographing. ### Claim 4 (depends on 1) The device as claimed in claim 1, wherein the audio processing unit converts the voice input from the plurality of microphones into a text, wherein the image processing unit adds the converted text to the combined image as a subtitle. ### Claim 5 (depends on 1) The device as claimed in claim 1, wherein the image processing unit combines an image of an image pickup unit corresponding to a location of the photographer with an image of an image pickup unit currently performing photographing in a form of a Picture-In-Picture (PIP) image. ### Claim 6 (depends on 1) The device as claimed in claim 1, further comprising: a multiplexer which combines an image synthesized in the image processing unit with the voice input from at least one microphone from among the plurality of microphones; and a storage unit which stores the combined image and voice. ### Claim 7 (depends on 1) The device as claimed in claim 1, wherein the plurality of image pickup units includes a first image pickup unit and a second image pickup unit, wherein the plurality of microphones includes a first microphone corresponding to the first image pickup unit and a second microphone corresponding to the second image pickup unit, wherein the audio processing unit determines that the voice of the photographer is sensed if the second microphone senses the voice before the first microphone, wherein the control unit controls the image processing unit to combine an image photographed through the second image pickup unit with an image photographed through the first image pickup unit. ### Claim 8 (depends on 7) The device as claimed in claim 7, wherein the image processing unit combines an image photographed from the second image pickup unit on an image photographed from the first image pickup unit in a form of a PIP image. ### Claim 9 (depends on 8) The device as claimed in claim 8, further comprising: a manipulation unit which receives a command to change a form of synthesis in the image processing unit, wherein the image processing unit changes an order of disposing an image of the first image pickup unit and an image of the second image pickup unit according to the command. ### Claim 10 (depends on 7) The device as claimed in claim 7, further comprising: a multiplexer which, if an image photographed from the first image pickup unit is a main image, combines the voice from the first microphone with an image synthesized in the image processing unit, and if an image photographed from the second image pickup unit is a main image, combines the voice from the second microphone with an image synthesized in the image processing unit; and a storage unit which stores the combined image and voice. ### Claim 11 An image pickup method of an image pickup device including a plurality of image pickup units, the method comprising: performing photographing using at least one image pickup unit from among the plurality of image pickup units; sensing a voice of a photographer through a plurality of microphones which are disposed spaced apart; and when the voice of the photographer is sensed, combining an image of an image pickup unit corresponding to a location of a photographer with an image of an image pickup unit currently performing photographing. ### Claim 12 (depends on 11) The method as claimed in claim 11, wherein the sensing the voice of the photographer comprises sensing the voice of the photographer using a phase difference of the voice sensed through the plurality of microphones. ### Claim 13 (depends on 11) The method as claimed in claim 11, further comprising: comparing the voice input from a microphone corresponding to an image pickup unit currently performing photographing with the voice input from another microphone, and removing noise from the voice input from a microphone corresponding to the image pickup unit currently performing photographing. ### Claim 14 (depends on 11) The method as claimed in claim 11, further comprising: converting the voice input from the plurality of microphones into a text; and adding the converted text to the combined image as a subtitle. ### Claim 15 (depends on 11) The method as claimed in claim 11, wherein the combining comprises combining an image of an image pickup unit corresponding to a location of the photographer with an image of an image pickup unit currently performing photographing in a form of a PIP image. ### Claim 16 (depends on 11) The method as claimed in claim 11, further comprising: combining an image synthesized in the image processing unit with voice input from at least one microphone from among the plurality of microphones; and storing the combined image and voice. ### Claim 17 (depends on 11) The method as claimed in claim 11, wherein the plurality of image pickup units includes a first image pickup unit and a second image pickup unit, wherein the plurality of microphones includes a first microphone corresponding to the first image pickup unit and a second microphone corresponding to the second image pickup unit, wherein the sensing comprises determining that the voice of the photographer is sensed if the second microphone senses the voice before the first microphone, wherein the combining comprises combining an image photographed through the second image pickup unit with an image photographed through the first image pickup unit. ### Claim 18 (depends on 17) The method as claimed in claim 17, wherein the combining comprises combining an image photographed from the second image pickup unit on an image photographed from the first image pickup unit in a form of a PIP image. ### Claim 19 (depends on 18) The method as claimed in claim 18, further comprising: receiving a command to change a form of synthesis, wherein the combining comprises changing an order of disposing an image of the first image pickup unit and an image of the second image pickup unit according to the command. ### Claim 20 (depends on 17) The method as claimed in claim 17 further comprising: if an image photographed from the first image pickup unit is a main image, combining the voice from the first microphone with an image synthesized in the image processing unit, and if an image photographed from the second image pickup unit is a main image, combining the voice from the second microphone with an image synthesized in the image processing unit; and storing the combined image and voice.