# US 2001/0027398 A1 · Communication system for communicating voice and image data, information processing apparatus and method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0027398 A1
- Document ID: US20010027398A1
- Status: Published application
- Kind: A1
- Application number: 08/975,214
- Filed: 1997-11-20
- Published: 2001-10-04
- Earliest claimed: 1996-11-29
- Assignees: Canon Kabushiki Kaisha
- Inventors: AKIHIRO KOHNO
- Web page: https://patentgrep.com/patent/US20010027398A1

## CPC

- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An object of the present invention is to perform, in a communication system or apparatus which can communicate an image and a voice, image displaying and voice outputting which are convenient to an operator or a user, and concretely to provide technique which can conveniently or easily direct or teach to the operator importance of the image and the voice to be communicated. In order to achieve the object, it is provided in the present invention a communication system comprising a transmission apparatus for transmitting an image and a voice to be added to the image, and a reception apparatus for receiving the image and the voice, wherein the transmission apparatus comprises a transmission means capable of selectively transmitting the image and the voice to the reception apparatus, and the reception apparatus comprises a control means for controlling the image received from the transmission apparatus and causing a predetermined display means to display the controlled image, on the basis of the voice transmitted by the transmission apparatus.

## Claims

### Claim 1

A communication system comprising a transmission apparatus for transmitting an image and a voice to be added to the image, and a reception apparatus for receiving the image and the voice, wherein
said transmission apparatus comprises transmission means capable of selectively transmitting the image and the voice to said reception apparatus; and
said reception apparatus comprises control means for controlling the image received from said transmission apparatus and causing predetermined display means to display the controlled image, on the basis of the voice transmitted by said transmission apparatus.

### Claim 2 (depends on 1)

A system according to claim 1, wherein said one reception apparatus is connected to said plural transmission apparatuses to be able to selectively receive the image or the voice.

### Claim 3 (depends on 2)

A system according to claim 2, wherein said control means causes said predetermined display means to display each of the images transmitted from said plural transmission apparatuses.

### Claim 4 (depends on 1)

A system according to claim 1, wherein said reception apparatus comprises said predetermined display means.

### Claim 5 (depends on 1)

A system according to claim 1, wherein said control means emphasizes the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 6 (depends on 5)

A system according to claim 5, wherein the emphasizing is to enlarge the image.

### Claim 7 (depends on 5)

A system according to claim 5, wherein the emphasizing is to emphasize an outer frame of the image.

### Claim 8 (depends on 1)

A system according to claim 1, wherein said reception apparatus comprises a speaker for outputting the voice.

### Claim 9 (depends on 1)

A system according to claim 1, wherein said control means controls a voice level of the voice transmitted from the predetermined transmission apparatus, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 10 (depends on 1)

A system according to claim 1, wherein said control means controls resolution of the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted by said transmission apparatus.

### Claim 11

A communication system comprising a transmission apparats for transmitting an image and a voice to be added to the image, and a reception apparatus for receiving the image and the voice, wherein
said transmission apparatus comprises transmission means capable of selectively transmitting the image and the voice to said reception apparatus, and
said reception apparatus comprises,
control means for controlling the image receiving from said transmission apparatus on the basis of the voice transmitted from said transmission apparatus, and
display control means for receiving the image transmitted from said transmission apparatus and causing predetermined display means to display the received image.

### Claim 12 (depends on 11)

A system according to claim 11, wherein said control means performs, in accordance with contents of the voice transmitted from said transmission apparatus, the controlling such that the different kinds of images are received from said transmission apparatus from which the voice was received.

### Claim 13 (depends on 12)

A system according to claim 12, wherein the different kinds of images include a still image and a moving image.

### Claim 14 (depends on 11)

A system according to claim 11, wherein said control means selects whether or not the image is to be received from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 15 (depends on 11)

A system according to claim 11, wherein said one reception apparatus is connected to said plural transmission apparatuses and can selectively receive the image or the voice.

### Claim 16 (depends on 15)

A system according to claim 15, wherein said control means controls a voice level of the voice transmitted from predetermined one of said plural transmission apparatuses, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 17 (depends on 16)

A system according to claim 16, wherein said predetermined transmission apparatus is one of said plural transmission apparatuses transmitting the voices, and is the transmission apparatus which transmitted the voice most satisfying a predetermined condition.

### Claim 18 (depends on 15)

A system according to claim 15, wherein said control means controls voice levels of the voices transmitted from said transmission apparatuses other than a predetermined transmission apparatus, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 19 (depends on 11)

A system according to claim 11, wherein said reception apparatus further comprises a speaker for outputting the voice.

### Claim 20 (depends on 11)

A system according to claim 11, wherein said control means controls resolution of the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 21

A communication system comprising a transmission apparatus for transmitting an image and a voice to be added to the image, and a reception apparatus for receiving the image and the voice, wherein
said transmission apparatus comprises,
transmission means capable of selectively transmitting the image and the voice to said reception apparatus, and
image pickup equipment control means for controlling a predetermined image pickup equipment to capture the image, and
said reception apparatus comprises allocation means for allocating a control right to control an operation of said predetermined image pickup equipment, on the basis of the voice transmitted from said transmission apparatus.

### Claim 22 (depends on 21)

A system according to claim 21, wherein
said one reception apparatus is connected to said plural transmission apparatuses and can selectively receive the image or the voice, and
said allocation means allocates the control right such that the operation of said image pickup equipment corresponding to predetermined one of said plural transmission apparatuses, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 23 (depends on 21)

A system according to claim 21, wherein said transmission apparatus comprises said image pickup equipment.

### Claim 24

An information process apparatus which can receive an image and a voice to be added to the image, from a transmission apparatus, said information process apparatus comprising:
reception means capable of receiving the image and the voice to be added to the image; and
control means for controlling the image received by said reception means and displaying the controlled image on predetermined display means, on the basis of the voice received by said reception means.

### Claim 25 (depends on 24)

An apparatus according to claim 24, wherein said information process apparatus is connected to said plural transmission apparatuses and can selectively receive the image or the voice.

### Claim 26 (depends on 25)

An apparatus according to claim 25, wherein said control means can cause said predetermined display means to display each of the images transmitted from said plural transmission apparatuses.

### Claim 27 (depends on 24)

An apparatus according to claim 24, wherein said information process apparatus comprises said predetermined display means.

### Claim 28 (depends on 24)

An apparatus according to claim 24, wherein said control means emphasizes the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 29 (depends on 28)

An apparatus according to claim 28, wherein the emphasizing is to enlarge the image.

### Claim 30 (depends on 28)

An apparatus according to claim 28, wherein the emphasizing is to emphasize an outer frame of the image.

### Claim 31 (depends on 24)

An apparatus according to claim 24, further comprising a speaker for outputting the voice.

### Claim 32 (depends on 25)

An apparatus according to claim 25, wherein said control means controls a voice level of the voice transmitted from predetermined one of said plural transmission apparatuses, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 33 (depends on 24)

An apparatus according to claim 24, wherein said control means controls resolution of the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 34

An information process apparatus which can receive an image and a voice to be added to the image, from a transmission apparatus, said information process apparatus comprising:
reception means capable of receiving the image and the voice to be added to the image;
control means for controlling the image receiving of said reception means, on the basis of the voice received by said reception means; and
display control means for causing predetermined display means to display the image received by said reception means.

### Claim 35 (depends on 34)

An apparatus according to claim 34, wherein said control means performs the controlling such that the different kinds of the images are received from said transmission apparatus from which the voice was received, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 36 (depends on 35)

An apparatus according to claim 35, wherein the different kinds of the images include a still image and a moving image.

### Claim 37 (depends on 34)

An apparatus according to claim 34, wherein, said control means selects whether the image is to be received from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 38 (depends on 34)

An apparatus according to claim 34, wherein said information process apparatus is connected to said plural transmission apparatuses and can selectively receive the image or the voice.

### Claim 39 (depends on 38)

An apparatus according to claim 38, wherein said control means controls a voice level of the voice transmitted from predetermined one of said plural transmission apparatuses, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 40 (depends on 39)

An apparatus according to claim 39, wherein said predetermined transmission apparatus is one of said plural transmission apparatuses transmitting the voices, and is the transmission apparatus which transmitted the voice most satisfying a predetermined condition.

### Claim 41 (depends on 38)

An apparatus according to claim 38, wherein said control means controls voice levels of the voices transmitted from said transmission apparatuses other than a predetermined transmission apparatus, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 42 (depends on 34)

An apparatus according to claim 34, wherein said information process apparatus further comprises a speaker for outputting the voice.

### Claim 43 (depends on 34)

An apparatus according to claim 34, wherein said control means controls resolution of the image transmitted from said transmission apparatus, in accordance with contents of the voice transmitted from said transmission apparatus.

### Claim 44

An information process apparatus which can communicate with a transmission apparatus having a predetermined image pickup equipment for capturing an image, said information process apparatus comprising:
reception means capable of receiving the image and a voice to be added to the image; and
allocation means for allocating a control right to control operation of said image pickup equipment, on the basis of the voice received by said reception means.

### Claim 45 (depends on 44)

An apparatus according to claim 44, wherein
said information process apparatus is connected to said plural transmission apparatuses and can selectively receive the image or the voice, and
said allocation means allocates the control right such that the operation of said image pickup equipment corresponding to predetermined one of said plural transmission apparatuses can be controlled, in accordance with contents of the voices transmitted from said plural transmission apparatuses.

### Claim 46

An information process method which can receive an image and a voice to be added to the image, from a transmission apparatus, said method comprising:
a reception step of receiving the image and the voice to be added to the image; and
a control step of controlling the image received in said reception step and causing a predetermined display means to display the controlled image, on the basis of the voice received in said reception step.

### Claim 47

An information process method which can receive an image and a voice to be added to the image, from a transmission apparatus, said method comprising:
a reception step of receiving the image and the voice to be added to the image;
a control step of controlling the image receiving in said reception step, on the basis of the voice received in said reception step; and
a display control step of causing a predetermined display means to display the image received in said reception step.

### Claim 48

An information process method which can communicate with a transmission apparatus having a predetermined image pickup equipment for capturing an image, said method comprising:
a reception step of receiving the image and a voice to be added to the image; and
an allocation step of allocating a control right to control operation of the image pickup equipment, on the basis of the voice received in said reception step.

### Claim 49

A storage medium which stores, in a computer readable state, a program supplied to an apparatus which can receive an image and a voice to be added to the image, from a transmission apparatus, said program comprising:
a reception step of receiving the image and the voice to be added to the image; and
a control step of controlling the image received in said reception step and causing a predetermined display means to display the controlled image, on the basis of the voice received in said reception step.

### Claim 50

A storage medium which stores, in a computer readable state, a program supplied to an apparatus which can receive an image and a voice to be added to the image, from a transmission apparatus, said program comprising:
a reception step of receiving the image and the voice to be added to the image;
a control step of controlling the image receiving in said reception step, on the basis of the voice received in said reception step; and
a display control step of causing a predetermined display means to display the image received in said reception step.

### Claim 51

A storage medium which stores, in a computer readable state, a program supplied to an apparatus which can communicate with a transmission apparatus having a predetermined image pickup equipment for capturing an image, said program comprising:
a reception step of receiving the image and a voice to be added to the image; and
an allocation step of allocating a control right to control operation of the image pickup equipment, on the basis of the voice received in said reception step.

### Claim 52 (depends on 1)

A system according to claim 1, wherein the controlling by said control means is performed on the basis of a voice level of the voice.

### Claim 53

A communication system comprising a transmission apparatus for transmitting an image and a voice to be added to the image, and a reception apparatus for receiving the image and the voice, wherein
said transmission apparatus comprises,
data amount control means for controlling a data amount of the image on the basis of a level of the voice to be added to the image, and
transmission means for transmitting the image of which data amount was controlled by said data amount control means, and
said reception apparatus comprises,
reception means for receiving the image transmitted by said transmission means, and
display control means for causing predetermined display means to display the image received by said reception means.

### Claim 54 (depends on 53)

A system according to claim 53, wherein said reception apparatus further comprises image control means for controlling the image received by said reception means, in accordance with the level of the voice.

### Claim 55 (depends on 53)

A system according to claim 53, wherein said data amount control means controls the data amount of the image on the basis of plural threshold values.

### Claim 56 (depends on 54)

A system according to claim 54, wherein said image control means controls the image received by said reception means, on the basis of plural threshold values.

### Claim 57 (depends on 54)

A system according to claim 54, wherein the controlling by said image control means is to emphasize the image.

### Claim 58 (depends on 57)

A system according to claim 57, wherein the emphasizing of the image is to emphasize an outer frame of the image.

### Claim 59 (depends on 53)

A system according to claim 53, wherein said communication system comprises the plural transmission apparatuses, said reception means receives the plural images transmitted from said transmission means of said plural transmission apparatuses, and said display control means causes said predetermined display means to simultaneously display the plural images.

### Claim 60

An information process apparatus which connects a reception apparatus receiving an image and a voice and transmits the image and the voice to be added to the image, comprising:
data amount control means for controlling a data amount of the image, on the basis of a level of the voice to be added to the image; and
transmission means for transmitting the image controlled by said data amount control means.

### Claim 61

An information process method which transmits an image and a voice to be added to the image, to a reception apparatus, comprising:
a data amount control step of controlling a data amount of the image, on the basis of a level of the voice to be added to the image; and
a transmission step of transmitting the image controlled in said data amount control step.

### Claim 62

A storage medium which stores, in a computer readable state, an information process program which is used to transmit an image and a voice to be added to the image, to a reception apparatus, said program comprising:
a data amount control step of controlling a data amount of the image, on the basis of a level of the voice to be added to the image; and
a transmission step of transmitting the image controlled in said data amount control step.

### Claim 63

An information process apparatus which is connected to a transmission apparatus capable of transmitting an image and a voice to be added to the image, and controlling a data amount at a time when the image is transmitted, said information process apparatus comprising:
reception means for receiving the image and the voice transmitted by said transmission apparatus; and
output means for outputting instruction information for controlling the data amount of the image transmitted by said transmission apparatus, on the basis of a level of the voice received by said reception means.

### Claim 64 (depends on 63)

An apparatus according to claim 63, further comprising display control means for displaying the image received by said reception means, on a monitor.

### Claim 65 (depends on 63)

An apparatus according to claim 63, further comprising a monitor for displaying the image received by said reception means.

### Claim 66 (depends on 64)

An apparatus according to claim 64, wherein
said information process apparatus is connected to plural transmission apparatuses including said transmission apparatus,
said reception means receives the plural images and the voices transmitted from said plural transmission apparatuses, and
said display control means simultaneously displays the plural images and the voices received by said reception means, on said monitor.

### Claim 67

A method for controlling a reception apparatus which is connected to a transmission apparatus capable of transmitting an image and a voice to be added to the image, and of controlling a data amount at a time when the image is transmitted, said method comprising:
a reception step of receiving the image and the voice transmitted by the transmission apparatus; and
an output step of outputting instruction information for controlling the data amount of the image transmitted by the transmission apparatus, on the basis of a level of the voice received in said reception step.

### Claim 68

A storage medium which stores, in a computer readable state, a control program for controlling a reception apparatus which is connected to a transmission apparatus capable of transmitting an image and a voice to be added to the image, and of controlling a data amount at a time when the image is transmitted, said program comprising:
a reception step of receiving the image and the voice transmitted by the transmission apparatus; and
an output step of outputting instruction information for controlling the data amount of the image transmitted by the transmission apparatus, on the basis of a level of the voice received in said reception step.

### Claim 69

A communication system which comprises a transmission apparatus for transmitting an image photographed by predetermined image pickup means, and a reception apparatus for receiving the transmitted image, wherein
said transmission apparatus comprises transmission means for transmitting the image, and
said reception apparatus comprises,
reception means for receiving the image transmitted by said transmission means,
image control means for controlling the image received by said reception means, in accordance with an environment in which the image is photographed, and
display control means for causing predetermined display means to display the image controlled by said image control means.

### Claim 70 (depends on 69)

A system according to claim 69, wherein the environment in which the image is photographed is either one of a pan angle, a tilt angle and zooming magnification of said image pickup means in case of photographing.

### Claim 71 (depends on 69)

A system according to claim 69, wherein the environment in which the image is photographed is a temperature.

### Claim 72 (depends on 71)

A system according to claim 71, wherein said transmission apparatus comprises a sensor for detecting the temperature.

### Claim 73

A communication system which comprises a transmission apparatus for transmitting an image photographed by predetermined image pickup means, and a reception apparatus for receiving the transmitted image, wherein
said transmission apparatus comprises,
data amount control means for controlling a data amount of the image in accordance with an environment in which the image is photographed, and
transmission means for transmitting the image controlled by said data amount control means, and
said reception apparatus comprises,
reception means for receiving the image transmitted by said transmission means, and
display control means for causing predetermined display means to display the image received by said reception means.

### Claim 74 (depends on 73)

A system according to claim 73, wherein the environment in which the image is photographed is either one of a pan angle, a tilt angle and zooming magnification of said image pickup means in case of photographing.

### Claim 75 (depends on 73)

A system according to claim 73, wherein the environment in which the image is photographed is a temperature.

### Claim 76 (depends on 75)

A system according to claim 75, wherein said transmission apparatus comprises a sensor for detecting the temperature.
