# US 2019/0315227 A1 · Vehicle including communication system for disabled person and control method of communication system for disabled person

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0315227 A1
- Document ID: US20190315227A1
- Status: Published application
- Kind: A1
- Application number: 16/155,294
- Filed: 2018-10-09
- Published: 2019-10-17
- Earliest claimed: 2018-04-17
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Jong Won Kim; Seong Hyeon Lee; Oh Sol Kwon; Joo Hwan Lee; Hyeong Jun Park; Ji In Jung; Jun Young Kwon
- Web page: https://patentgrep.com/patent/US20190315227A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/265: {Voice}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/65: Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
- B60K 35/654: {the user being the driver}
- B60K 35/656: {the user being a passenger}
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/90: Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)}
- B60K 35/20: Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K 2360/146: Instrument input by gesture
- B60K 2360/1464: 3D-gesture
- B60K 2360/148: Instrument input by voice
- B60K 2360/741: Instruments adapted for user detection
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

A vehicle including a communication system for a disabled person may include: a motion capture unit that recognizes sign language of a passenger of the vehicle; an input unit that receives a voice or characters from the passenger; a database that stores sign language information; a control unit that is communicatively coupled to the motion capture unit and the input unit, the control unit being configured to translate the sign language recognized by the motion capture unit using the sign language information stored in the database, and to convert a voice received through the input unit into characters; and an output unit that is communicatively coupled to the control unit, the output unit being configured to output the sign language translated by the control unit as a voice or characters, and to output the voice converted by the control unit as characters.

## Claims

### Claim 1

A vehicle including a communication system for a disabled person, the vehicle comprising:
a motion capture unit that recognizes sign language of a passenger of the vehicle;
an input unit that receives a voice or characters from the passenger;
a database that stores sign language information;
a control unit that is communicatively coupled to the motion capture unit and the input unit, the control unit being configured to translate the sign language recognized by the motion capture unit using the sign language information stored in the database, and to convert a voice received through the input unit into characters; and
an output unit that is communicatively coupled to the control unit, the output unit being configured to output the sign language translated by the control unit as a voice or characters, and to output the voice converted by the control unit as characters.

### Claim 2 (depends on 1)

The vehicle of claim 1, further comprising a terminal including: a terminal motion capture unit that recognizes the sign language of the passenger, a terminal input unit that receives the voice or characters from the passenger, and a terminal output unit that outputs the voice or characters.

### Claim 3 (depends on 2)

The vehicle of claim 2, wherein the terminal is a mobile terminal of the passenger and is communicatively coupled to the control unit.

### Claim 4 (depends on 3)

The vehicle of claim 3, wherein the control unit translates sign language recognized by the terminal using the sign language information stored in the database and converts a voice input through the terminal into characters.

### Claim 5 (depends on 4)

The vehicle of claim 4, wherein the control unit outputs sign language recognized and translated by the terminal as a voice or characters through the output unit.

### Claim 6 (depends on 4)

The vehicle of claim 4, further comprising a plurality of terminals,
wherein the control unit controls the output unit so as to output sign language recognized and translated by one terminal among the plurality of terminals as a voice or characters.

### Claim 7 (depends on 4)

The vehicle of claim 4, wherein the control unit controls the terminal so as to output a voice or characters input through the input unit as characters.

### Claim 8 (depends on 4)

The vehicle of claim 4, further comprising a plurality of terminals,
wherein the control unit controls the output unit so as to output a voice recognized and converted by one terminal among the plurality of terminals as a voice or characters.

### Claim 9 (depends on 3)

The vehicle of claim 3, further comprising a plurality of terminals,
wherein the control unit communicates with one or more specific terminals among the plurality of terminals.

### Claim 10 (depends on 1)

The vehicle of claim 1, further comprising a malfunction sensing unit that senses whether there is a malfunction in the vehicle.

### Claim 11 (depends on 10)

The vehicle of claim 10, wherein, when the malfunction sensing unit senses the malfunction, the control unit controls the output unit so as to visually output information of the malfunction.

### Claim 12

A method of controlling a communication system for a disabled person in a vehicle, the method comprising:
recognizing, by a motion capture unit of the vehicle or a mobile terminal of the passenger, sign language of a passenger of the vehicle;
receiving, by an input unit of the vehicle or the mobile terminal, a voice or characters from the passenger;
translating, by a control unit of the vehicle, the sign language using sign language information stored in a database;
converting, by the control unit, the received voice into characters;
outputting, by an output unit of the vehicle or the mobile terminal, the translated sign language as a voice or characters; and
outputting, by the output unit or the mobile terminal, the converted voice as characters.
