# US 2010/0142683 A1 · Method and apparatus for providing video relay service assisted calls with reduced bandwidth

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0142683 A1
- Document ID: US20100142683A1
- Status: Published application
- Kind: A1
- Application number: 12/316,070
- Filed: 2008-12-09
- Published: 2010-06-10
- Earliest claimed: 2008-12-09
- Inventors: Stuart Owen Goldman; Mark A. Walter
- Web page: https://patentgrep.com/patent/US20100142683A1

## CPC

- G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- H04N 19/90: using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N 19/94: Vector quantisation
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The bandwidth use for Video Relay Service (VRS) assisted calls for hearing impaired individuals is reduced by transmitting a sequence of corresponding sign identification (ID) numbers rather than a video of the signing itself. The signs may be captured by a video camera and recognized by a previously trained sign recognition algorithm, which advantageously converts the signs to sign ID numbers for transmission. Then, at the receiving end, the sequence of ID numbers may be advantageously re-converted back into signs, which may, for example, be displayed on a video screen with use of an artificially created (e.g., a “cartoon”) image comprising (at least) a pair of hands.

## Claims

### Claim 1

A method for providing a telecommunications service for use by a hearing impaired individual, the method comprising the steps of:
capturing a sequence of signs produced by a signing person in accordance with a predetermined sign language;
identifying each of said signs in said sequence of signs produced by the signing person as corresponding to a particular sign in said predetermined sign language, thereby generating a sequence of identified signs in said predetermined sign language;
determining a sequence of numerical indicia representative of said sequence of identified signs in said predetermined sign language, each of said numerical indicia corresponding to one or more of said signs in said sequence of identified signs; and
transmitting the sequence of numerical indicia across a communications channel for use in said telecommunications service.

### Claim 2 (depends on 1)

The method of claim 1 wherein the signing person comprises the hearing impaired individual.

### Claim 3 (depends on 1)

The method of claim 1 wherein the signing person comprises an operator in a Video Relay Service assisted call.

### Claim 4 (depends on 1)

The method of claim 1 wherein the step of capturing the sequence of signs produced by the signing person is performed with use of a video camera.

### Claim 5 (depends on 1)

The method of claim 1 wherein the step of identifying each of said signs in said sequence of signs produced by the signing person is performed by comparing each of said signs produced by the signing person as captured with a plurality of entries in a sign recognition database in order to locate a best match thereto, wherein the sign recognition database was previously created with use of a training technique, wherein the training technique comprised one or more signing persons providing known signs thereto.

### Claim 6 (depends on 1)

The method of claim 1 wherein said numerical indicia comprise sign ID numbers, each sign ID number corresponding to one or more of said signs in said sequence of identified signs.

### Claim 7 (depends on 1)

The method of claim 1 further comprising the steps of:
receiving the transmitted sequence of numerical indicia from the communications channel;
selecting, for each of said received numerical indicia in said sequence, one or more corresponding images and/or video segments for display, wherein each of said images and/or video segments comprises an illustration of at least a pair of hands, and wherein each of said images and/or video segments shows a particular one of said signs in said predetermined sign language being produced by said pair of hands, said particular one of said signs in said predetermined sign language corresponding to said received numerical indicia representative thereof; and
displaying each of said selected images and/or video segments in sequence, thereby generating a display of a sequence of images and/or video signals corresponding to the received sequence of numerical indicia.

### Claim 8

A method for providing a telecommunications service for use by a hearing impaired individual, the method comprising the steps of:
receiving a sequence of numerical indicia from a communications channel, the sequence of numerical indicia being representative of a sequence of signs in a predetermined sign language;
selecting, for each of said received numerical indicia in said sequence, one or more corresponding images and/or video segments for display, wherein each of said images and/or video segments comprises an illustration of at least a pair of hands, and wherein each of said images and/or video segments shows a particular one of said signs in said predetermined sign language being produced by said pair of hands, said particular one of said signs in said predetermined sign language corresponding to said received numerical indicia representative thereof; and
displaying each of said selected images and/or video segments in sequence, thereby generating a display of a sequence of images and/or video signals corresponding to the received sequence of numerical indicia.

### Claim 9 (depends on 8)

The method of claim 8 wherein said numerical indicia comprise sign ID numbers, each sign ID number corresponding to one or more signs in a predetermined sign language.

### Claim 10 (depends on 8)

The method of claim 8 wherein said illustrations comprise cartoon drawings of said particular ones of said signs in said predetermined sign language being produced by said pair of hands.

### Claim 11

An apparatus for providing a telecommunications service for use by a hearing impaired individual, the apparatus comprising:
a scanner, which captures a sequence of signs produced by a signing person in accordance with a predetermined sign language;
a processor, which
(a) identifies each of said signs in said sequence of signs produced by the signing person as corresponding to a particular sign in said predetermined sign language, thereby generating a sequence of identified signs in said predetermined sign language, and
(b) determines a sequence of numerical indicia representative of said sequence of identified signs in said predetermined sign language, each of said numerical indicia corresponding to one or more of said signs in said sequence of identified signs; and
a transmitter, which transmits the sequence of numerical indicia across a communications channel for use in said telecommunications service.

### Claim 12 (depends on 11)

The apparatus of claim 11 wherein the signing person comprises the hearing impaired individual.

### Claim 13 (depends on 11)

The apparatus of claim 11 wherein the signing person comprises an operator in a Video Relay Service assisted call.

### Claim 14 (depends on 11)

The apparatus of claim 11 wherein the scanner comprises a video camera.

### Claim 15 (depends on 11)

The apparatus of claim 11 further comprising a sign recognition database, wherein the processor identifies each of said signs in said sequence of signs produced by the signing person by comparing each of said signs produced by the signing person as captured by said scanner with a plurality of entries in the sign recognition database in order to locate a best match thereto, wherein the sign recognition database was previously created with use of a training technique, wherein the training technique comprised one or more signing persons providing known signs thereto.

### Claim 16 (depends on 11)

The apparatus of claim 11 wherein said numerical indicia comprise sign ID numbers, each sign ID number corresponding to one or more of said signs in said sequence of identified signs.

### Claim 17 (depends on 1)

The apparatus of claim 1 further comprising:
the communications channel;
a receiver, which receives the transmitted sequence of numerical indicia from the communications channel;
a second processor, which selects, for each of said received numerical indicia in said sequence, one or more corresponding images and/or video segments for display, wherein each of said images and/or video segments comprises an illustration of at least a pair of hands, and wherein each of said images and/or video segments shows a particular one of said signs in said predetermined sign language being produced by said pair of hands, said particular one of said signs in said predetermined sign language corresponding to said received numerical indicia representative thereof; and
a display, which displays each of said selected images and/or video segments in sequence, thereby generating a display of a sequence of images and/or video signals corresponding to the received sequence of numerical indicia.

### Claim 18

An apparatus for providing a telecommunications service for use by a hearing impaired individual, the apparatus comprising:
a receiver, which receives a sequence of numerical indicia from a communications channel, the sequence of numerical indicia being representative of a sequence of signs in a predetermined sign language;
a processor, which selects, for each of said received numerical indicia in said sequence, one or more corresponding images and/or video segments for display, wherein each of said images and/or video segments comprises an illustration of at least a pair of hands, and wherein each of said images and/or video segments shows a particular one of said signs in said predetermined sign language being produced by said pair of hands, said particular one of said signs in said predetermined sign language corresponding to said received numerical indicia representative thereof; and
a display, which displays each of said selected images and/or video segments in sequence, thereby generating a display of a sequence of images and/or video signals corresponding to the received sequence of numerical indicia.

### Claim 19 (depends on 18)

The apparatus of claim 18 wherein said numerical indicia comprise sign ID numbers, each sign ID number corresponding to one or more signs in a predetermined sign language.

### Claim 20 (depends on 18)

The apparatus of claim 18 wherein said illustrations comprise cartoon drawings of said particular ones of said signs in said predetermined sign language being produced by said pair of hands.
