# US 2024/0257422 A1 · Object-to-text conversion method and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257422 A1
- Document ID: US20240257422A1
- Status: Published application
- Kind: A1
- Application number: 18/423,400
- Filed: 2024-01-26
- Published: 2024-08-01
- Earliest claimed: 2019-07-19
- Assignees: Semiconductor Energy Laboratory Co., Ltd.
- Applicants: Semiconductor Energy Laboratory Co., Ltd.
- Inventors: Kengo AKIMOTO; Junpei MOMO; Takahiro FUKUTOME
- Web page: https://patentgrep.com/patent/US20240257422A1

## CPC

- G06F 40/56: Natural language generation
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06T 7/73: using feature-based methods
- G06T 11/26: Drawing of charts or graphs
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/20072: Graph-based image processing
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Text is generated from an object. Text is generated from a first object. The first object includes a second object and a third object. A step of detecting coordinate data of the second object is included. A step of detecting coordinate data of the third object is included. A step of extracting positional relation between the second object and the third object from coordinate data is included. A step of converting the extracted positional relation into graph data is included. A step of generating text about the positional relation between the second object and the third object from graph data is included.

## Claims

### Claim 1

A text generation system comprising a graph generation unit, a text generation unit, and a GUI,
wherein the GUI is configured to display a first object on a display device,
wherein the graph generation unit is configured to display graph data on the GUI displayed on the display device,
wherein the text generation unit is configured to display a text on the GUI displayed on the display device,
wherein the graph data comprises positional relation data of each of objects comprising the first object, and
wherein the text comprises a text describing a positional relation data of the first object.

### Claim 2 (depends on 1)

The text generation system according to claim 1, further comprising a database in which a plurality of objects are registered,
wherein any one of the plurality of objects registered in the database is configured to be selected via the GUI, and
wherein the selected object is configured to display on the GUI as the first object.

### Claim 3 (depends on 1)

The text generation system according to claim 1,
wherein the text describing the positional relation data comprises any one or more pieces of data that one of the objects is on the left, right, upper, or lower side of the other object, one of the objects is included in the other object, or one of the objects is in contact or not in contact with the other object.

### Claim 4 (depends on 1)

The text generation system according to claim 1,
wherein the GUI is configured to be designated as a reference object,
wherein the graph data is configured to be generated from the positional relation data relative to the reference object.
