# US 10,455,074 B2 · Information processing system, information processing terminal, and control method and control program of information processing terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,074 B2
- Document ID: US10455074B2
- Status: Granted
- Kind: B2
- Application number: 16/087,153
- Filed: 2017-01-18
- Published: 2019-04-04
- Granted: 2019-10-22
- Earliest claimed: 2016-03-23
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Mitsunori Morisaki
- Web page: https://patentgrep.com/patent/US10455074B2

## CPC

- H04M 1/72448: with means for adapting the functionality of the device according to specific conditions
- H04M 1/00: Substation equipment, e.g. for use by subscribers (subscriber services or facilities provided at exchanges H04M3/00; prepayment telephone coin boxes H04M17/00; current supply arrangements H04M19/08)
- H04M 1/72415: for remote control of appliances
- H04M 1/72439: for image or video messaging
- H04M 11/00: Telephonic communication systems specially adapted for combination with other electrical systems
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04M 2203/252: where a voice mode is enhanced with visual information
- H04M 2250/52: including functional features of a camera
- H04M 2250/74: with voice recognition means
- H04N 2007/145: {Handheld terminals}
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing system includes first and second terminals for acquiring a desired image captured actively using a speech communication partner's apparatus during speech communication. The first terminal includes a first microphone, a first transmitter that transmits voice data to the second terminal, and a first receiver that receives voice data from the second terminal. The second terminal includes a camera, a second microphone, a second transmitter that transmits the voice data to the first terminal, and a second receiver that receives the voice data from the first terminal. During speech communication, the first transmitter transmits, together with the voice data, an operation command for operating the camera. The second receiver receives the operation command and operates the camera. During speech communication with the first terminal, the second transmitter transmits, together with the voice data, the image data captured by the camera.

## Claims

### Claim 1

An information processing system comprising a first information processing terminal and a second information processing terminal,
said first information processing terminal including
a first microphone that generates voice data by receiving a voice,
a first transmitter that transmits the voice data acquired from said first microphone by specifying said second information processing terminal as a speech communication partner terminal, and
a first receiver that receives voice data from said second information processing terminal, and
said second information processing terminal including
a camera that generates image data by performing image capturing,
a second microphone that generates voice data by receiving a voice,
a second transmitter that transmits, during speech communication with said first information processing terminal, the voice data acquired from said second microphone to said first information processing terminal, and
a second receiver that receives the voice data from said first information processing terminal,
wherein during normal speech communication with said second information processing terminal, said first transmitter transmits, to said second information processing terminal, together with the voice data, an operation command for operating said camera incorporated in said second information processing terminal,
said second receiver receives the operation command from said first information processing terminal, and operates said camera, and
during normal speech communication with said first information processing terminal, said second transmitter transmits, to said first information processing terminal, together with the voice data acquired from said second microphone, the image data acquired by performing image capturing using said camera.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein said first information processing terminal further includes a display unit that displays information representing a speech communication partner, an operation icon for operating said camera, and the image data received from said second transmitter.

### Claim 3 (depends on 2)

The information processing system according to claim 2, wherein
said second transmitter transmits, together with the voice data, moving image data captured by said camera,
said first receiver receives the moving image data, and
said display unit implements speech communication by video phone communication by displaying the received moving image data.

### Claim 4 (depends on 3)

The information processing system according to claim 3, wherein
when the operation icon is operated, said first transmitter transmits the operation command for operating at least one of a shutter, a zoom magnification, brightness, white balance, and a resolution of said camera.

### Claim 5 (depends on 1)

The information processing system according to claim 1, wherein said first information processing terminal further includes a display unit that displays, during speech communication with said second information processing terminal, the image data transmitted from said second transmitter.

### Claim 6

A control method of an information processing terminal including
a first microphone that generates voice data by receiving a voice,
a first transmitter that transmits the voice data acquired from the first microphone by specifying another information processing terminal as a speech communication partner terminal, and
a first receiver that receives voice data from the other information processing terminal,
the method comprising:
during normal speech communication with the other information processing terminal including
a camera that generates image data by performing image capturing,
a second microphone that generates voice data by receiving a voice,
a second transmitter that transmits, during normal speech communication with the information processing terminal, the voice data acquired from the second microphone to the information processing terminal, and
a second receiver that receives the voice data from the information processing terminal,
transmitting, to the other information processing terminal, together with the voice data, an operation command for operating the camera incorporated in the other information processing terminal; and
receiving, from the other information processing terminal, together with the voice data, the image data acquired by performing image capturing using the camera.

### Claim 7

A control method of an information processing terminal capable of communicating with another information processing terminal including
a first microphone that generates voice data by receiving a voice,
a first transmitter that transmits the voice data acquired from the first microphone by specifying the information processing terminal as a speech communication partner terminal, and
a first receiver that receives voice data from the information processing terminal,
the information processing terminal including
a camera that generates image data by performing image capturing,
a second microphone that generates voice data by receiving a voice,
a second transmitter that transmits, during normal speech communication with the other information processing terminal, the voice data acquired from the second microphone to the other information processing terminal, and
a second receiver that receives the voice data from the other information processing terminal,
the method comprising:
operating the camera by receiving, together with the voice data, an operation command for operating the camera from the other information processing terminal; and
transmitting, during normal speech communication with the other information processing terminal, together with the voice data acquired from the second microphone, the image data acquired by performing image capturing using the camera to the other information processing terminal.