# US 2026/0245556 A1 · Display-based communication system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0245556 A1
- Document ID: US20260245556A1
- Status: Published application
- Kind: A1
- Application number: 18/872,276
- Filed: 2023-09-04
- Published: 2026-08-20
- Earliest claimed: 2022-09-05
- Assignees: Batoners Inc.
- Applicants: Batoners Inc.
- Inventors: Jun Soo JANG; Ji Su LEE
- Web page: https://patentgrep.com/patent/US20260245556A1

## CPC

- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06V 10/765: {using rules for classification or partitioning the feature space}
- G06V 40/113: {Recognition of static hand signs}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G09B 21/00: Teaching, or communicating with, the blind, deaf or mute (audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B)
- G09B 21/009: {Teaching or communicating with deaf persons (G09B21/04 takes precedence)}
- G10L 15/10: using distance or distortion measures between unknown speech and reference templates
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

The present disclosure provides a communication assist device for communication using a sign language that includes a sign language recognition module for extracting a sign language sentence from an analyzed motion of a user in image data and a transparent display for displaying the extracted sign language sentence.

## Claims

### Claim 1

A communication assist device for communication using a sign language, the communication assist device comprising:
a sign language recognition module for extracting a sign language sentence from an analyzed motion of a user in image data; and
a display for displaying the extracted sign language sentence.

### Claim 2 (depends on 1)

The communication assist device of claim 1, further comprising:
an STT module for converting voice data into text data; and
a sign language generation module for converting voice data into sign language data.

### Claim 3 (depends on 1)

The communication assist device of claim 1, further comprising a word card selection module for providing a word card selectable for the user to the display,
wherein the sign language recognition module extracts the sign language sentence based on the selected word card.

### Claim 4 (depends on 1)

The communication assist device of claim 1, further comprising a text input module for providing a user interface for the user to input a text to the display,
wherein the text input module is activated when the sign language recognition module fails to extract the sign language sentence.

### Claim 5 (depends on 1)

The communication assist device of claim 1, further comprising a communication module for controlling the communication assist device to be communicatively connected with external device,
wherein the communication module controls the communication assist device to be connected with the external device when the sign language recognition module fails to extract the sign language sentence.

### Claim 6 (depends on 1)

The communication assist device of claim 1, wherein the sign language recognition module is configured to:
partition the image data into a plurality of segments,
determine a recognition accuracy of each gloss of the plurality of segments, and
extract a sign language sentence based on a gloss with the recognition accuracy greater than a predetermined value among glosses of the plurality of segments.

### Claim 7 (depends on 6)

The communication assist device of claim 6, wherein the recognition accuracy is determined based on a similarity between a gloss of a segment and a similar gloss, and the similar gloss is a gloss that is most similar to the gloss of the segment.

### Claim 8 (depends on 7)

The communication assist device of claim 7, wherein the sign language recognition module extracts skeleton information for tracking a motion of the user by detecting a joint part of the user from the image data and compares a gloss of the user according to the skeleton information and the similar gloss.

### Claim 9 (depends on 6)

The communication assist device of claim 6, wherein the display displays a message for requesting retransmission of a sign language sentence, when every recognition accuracy of the glosses of the plurality of segments is smaller than the predetermined value.

### Claim 10 (depends on 6)

The communication assist device of claim 6, wherein the sign language recognition module extracts a sign language sentence based on a gloss with the recognition accuracy greater than the predetermined value and a previous conversation content.

### Claim 11 (depends on 6)

The communication assist device of claim 6, wherein, when the glosses of the plurality of segments include a first gloss with a recognition accuracy greater than the predetermined value and a second gloss with a recognition accuracy smaller than the predetermined value, the sign language recognition module determines a plurality of gloss candidates replacing the second gloss based on the first gloss and extracts a sign language sentence based on a gloss candidate selected from the plurality of gloss candidates and the first gloss.

### Claim 12 (depends on 6)

The communication assist device of claim 6, wherein, when the glosses of the plurality of segments include a first gloss with a recognition accuracy greater than the predetermined value and a second gloss with a recognition accuracy smaller than the predetermined value, the sign language recognition module determines a plurality of gloss candidates replacing the second gloss based on the first gloss and a previous conversation content and extracts a sign language sentence based on a gloss candidate selected from the plurality of gloss candidates and the first gloss.

### Claim 13 (depends on 11)

The communication assist device of claim 11, wherein the sign language recognition module determines a priority order for the plurality of gloss candidates according to a similarity to the second gloss, and
wherein the display displays the plurality of gloss candidates according to the priority order.

### Claim 14 (depends on 1)

The communication assist device of claim 1, wherein the display is a transparent display.
