# US 2024/0265909 A1 · Text-to-speech device, method of controlling text-to-speech device, and computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0265909 A1
- Document ID: US20240265909A1
- Status: Published application
- Kind: A1
- Application number: 18/433,497
- Filed: 2024-02-06
- Published: 2024-08-08
- Earliest claimed: 2023-02-07
- Assignees: JVCKENWOOD Corporation
- Applicants: JVCKENWOOD Corporation
- Inventors: Daisuke Ogoshi; Hiroshi Takeshita; Yuta Arai; Yuki Momma; Takayuki Kasahara; Reina Takaya
- Web page: https://patentgrep.com/patent/US20240265909A1

## CPC

- G10L 13/04: Details of speech synthesis systems, e.g. synthesiser structure or memory management
- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G01C 21/3629: {Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00)}
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/63: {Scene text, e.g. street names}
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A text-to-speech device includes: a video data acquisition unit configured to acquire video data including a video of a region around a user; a positional information acquisition unit configured to acquire positional information indicating a position of a user; a category identification unit configured to identify a category of a location where the user is positioned, based on the acquired positional information and map information related to an area including the position of the user indicated by the positional information; a text extraction unit configured to extract text information representing text included in video data of a region around the user; a priority setting unit configured to set degrees of priority for the extracted text information; and a voice output unit configured to convert the extracted text information into voice, and outputs the voice, in descending order of the set degrees of priority.

## Claims

### Claim 1

A text-to-speech device, comprising:
a video data acquisition unit configured to acquire video data including a video of a region around a user;
a positional information acquisition unit configured to acquire positional information indicating a position of the user;
a category identification unit configured to identify a category of a location where the user is positioned, based on the positional information acquired by the positional information acquisition unit and map information related to an area including the position of the user indicated by the positional information;
a text extraction unit configured to extract pieces of text information representing pieces of text included in the video data, based on the video data acquired by the video data acquisition unit;
a priority setting unit configured to set degrees of priority for the pieces of text information extracted by the text extraction unit; and
a voice output unit configured to convert the pieces of text information extracted by the text extraction unit into voice, and outputs the voice, in descending order of the degrees of priority set by the priority setting unit, wherein
the higher relevance of the pieces of text information to the category of the location identified by the category identification unit, the higher the degrees of priority set by the priority setting unit for the pieces of text information.

### Claim 2 (depends on 1)

The text-to-speech device according to claim 1, wherein the priority setting unit is configured to set the degrees of priority for the pieces of text information extracted by the text extraction unit, based on at least one of positions of the pieces of text information in the video data, sizes of the pieces of text information in the video data, and degrees of contrast between the pieces of text information and a background in the video data.

### Claim 3 (depends on 1)

The text-to-speech device according to claim 1, wherein the priority setting unit is configured to set the degrees of priority for the pieces of text information extracted by the text extraction unit, based on preset degrees of priority for respective pieces of text that have been set per user beforehand.

### Claim 4

A method of controlling a text-to-speech device, comprising:
acquiring video data including a video of a region around a user;
acquiring positional information indicating a position of the user;
identifying a category of a location where the user is positioned, based on the positional information acquired and map information related to an area including the position indicated by the positional information;
extracting pieces of text information representing pieces of text included in the video data, based on the acquired video data;
setting degrees or priority for the extracted pieces of text information; and
converting the extracted pieces of text information into voice and outputting the voice, in descending order of the set degrees of priority, wherein
the higher relevance of the pieces of text information to the identified category of the location, the higher the set degrees of priority at the setting the degrees of priority.

### Claim 5

A non-transitory computer-readable storage medium storing a program causing a computer to execute:
acquiring video data including a video of a region around a user;
acquiring positional information indicating a position of the user;
identifying a category of a location where the user is positioned, based on the positional information acquired and map information related to an area including the position indicated by the positional information;
extracting pieces of text information representing pieces of text included in the video data, based on the acquired video data;
setting degrees or priority for the extracted pieces of text information; and
converting the extracted pieces of text information into voice and outputting the voice, in descending order of the set degrees of priority, wherein
the higher relevance of the pieces of text information to the identified category of the location, the higher the set degrees of priority at the setting the degrees of priority.
