# US 2026/0288813 A1 · System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0288813 A1
- Document ID: US20260288813A1
- Status: Published application
- Kind: A1
- Application number: 19/567,080
- Filed: 2026-03-14
- Published: 2026-09-24
- Earliest claimed: 2025-03-19
- Assignees: SoftBank Group Corp.
- Applicants: SoftBank Group Corp.
- Inventors: Kei NISHIKAWA
- Web page: https://patentgrep.com/patent/US20260288813A1

## CPC

- G06F 16/33295: {in dialogue systems}
- G06V 30/10: Character recognition
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 2015/025: {Phonemes, fenemes or fenones being the recognition units}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system includes a processor that is configured to obtain audio information and convert the audio information into character data by using a speech recognition technique, obtain image information and extract character data from the image information by using an image recognition technique, and generate a prompt for instructing automatic generation of a document based on the obtained character data and input the prompt to a generative AI model.

## Claims

### Claim 1

A system comprising:
a communication interface coupled to a packet-switched network; and
circuitry configured to:
acquire audio information and image information from recording information received via the communication interface;
convert the audio information into first character information by executing a speech recognition process, and convert the image information into second character information by executing an image recognition process;
associate the first character information and the second character information with each other based on time information to generate integrated text information;
generate a prompt defining instruction content comprising a document type, structural elements, and a description style based on the integrated text information, and input the prompt and the integrated text information to a generative neural network model to cause the generative neural network model to generate document information; and
structure the document information into document data according to a predetermined format, store the document data in a storage device, and transmit the document data to a terminal device via the packet-switched network.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the speech recognition process comprises converting the audio information into a sequence of phoneme representations, applying a language model to decode the phoneme representations into word sequences, and generating timestamped text segments each associated with a time interval.

### Claim 3 (depends on 2)

The system according to claim 2, wherein the image recognition process comprises extracting frames from the image information at predetermined intervals, applying optical character recognition to each extracted frame to generate frame-level character data, and associating the frame-level character data with corresponding time intervals.

### Claim 4 (depends on 3)

The system according to claim 3, wherein associating the first character information and the second character information comprises aligning the timestamped text segments with the frame-level character data based on overlapping time intervals to produce time-synchronized text-image pairs in the integrated text information.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the circuitry is further configured to detect speaker transitions in the audio information based on voice characteristic changes and to annotate the integrated text information with speaker identifiers corresponding to each timestamped text segment.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the prompt comprises a structured template format including fields for document type specification, section heading definitions, formatting constraints, and a style parameter indicating at least one of formal, instructional, or summary description modes.

### Claim 7 (depends on 6)

The system according to claim 6, wherein the circuitry is further configured to extract key terms and topic labels from the integrated text information using natural language processing comprising named-entity recognition and keyword extraction, and to embed the extracted key terms and topic labels into the prompt as contextual parameters.

### Claim 8 (depends on 7)

The system according to claim 7, wherein the generative neural network model generates the document information comprising a plurality of document sections each including a section heading, body text, and cross-references to related sections, and wherein the circuitry validates that each section includes non-empty heading and body text fields.

### Claim 9 (depends on 8)

The system according to claim 8, wherein the circuitry is further configured to apply post-processing to the document information comprising consistency checking between cross-references, formatting normalization, and insertion of figure references corresponding to extracted image frames.

### Claim 10 (depends on 1)

The system according to claim 1, wherein the circuitry is further configured to assign classification information to the document data based on metadata extracted from the recording information comprising at least meeting identifiers, participant identifiers, and topic keywords.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the circuitry is further configured to generate sharing identification information based on the classification information, and to transmit notification information including the sharing identification information and an access link to one or more terminal devices via the packet-switched network.

### Claim 12 (depends on 1)

The system according to claim 1, wherein the recording information comprises a recording from a communication platform, and wherein the circuitry acquires the recording information by retrieving a stored recording file from the communication platform via an application programming interface.

### Claim 13 (depends on 1)

The system according to claim 1, wherein the circuitry is further configured to receive feedback information from a terminal device indicating corrections or modifications to the document data, construct an update prompt incorporating the feedback information and the document data, and input the update prompt to the generative neural network model to generate revised document information.

### Claim 14 (depends on 13)

The system according to claim 13, wherein the circuitry is further configured to compare the revised document information with the prior document data to identify modified sections, and to store a version record associating the prior document data and the revised document information with respective version identifiers.

### Claim 15 (depends on 1)

The system according to claim 1, wherein the circuitry is further configured to perform emotion estimation on the audio information by analyzing prosodic features comprising pitch contour, speaking rate, and energy variation, and to annotate the integrated text information with emotional-state labels for each timestamped segment.

### Claim 16 (depends on 1)

The system according to claim 1, wherein the document data comprises a procedure manual generated from the recording information, and wherein the structural elements comprise sequential step descriptions, prerequisite conditions, and expected outcomes.

### Claim 17 (depends on 16)

The system according to claim 16, wherein the circuitry is further configured to calculate a completeness score for the document data by comparing extracted step descriptions against a reference checklist stored in the storage device, and to flag incomplete sections for supplementary generation.

### Claim 18

A system comprising:
a communication interface coupled to a packet-switched network; and
circuitry configured to:
acquire recording information via the communication interface, the recording information comprising audio information and image information with associated time information;
convert the audio information into timestamped text segments by executing speech recognition comprising phoneme decoding and language model application, and convert the image information into frame-level character data by executing optical character recognition on frames extracted at predetermined intervals;
associate the timestamped text segments and the frame-level character data based on overlapping time intervals to generate integrated text information, and extract key terms and topic labels from the integrated text information using named-entity recognition;
generate a prompt comprising a structured template format including document type specification, section heading definitions, formatting constraints, style parameters, and the extracted key terms as contextual parameters, and input the prompt and the integrated text information to a generative neural network model to generate document information comprising a plurality of document sections;
structure the document information into document data according to a predetermined format, assign classification information based on metadata from the recording information, and store the document data in a storage device; and
generate sharing identification information and transmit the document data and notification information to terminal devices via the packet-switched network.

### Claim 19 (depends on 18)

The system according to claim 18, wherein the circuitry is further configured to receive feedback information from a terminal device, construct an update prompt incorporating the feedback information and the document data, and input the update prompt to the generative neural network model to generate revised document information with version tracking.

### Claim 20

A method comprising:
acquiring, by circuitry coupled to a packet-switched network, audio information and image information from recording information;
converting the audio information into first character information by executing a speech recognition process, and converting the image information into second character information by executing an image recognition process;
associating the first character information and the second character information based on time information to generate integrated text information;
generating a prompt defining instruction content comprising a document type, structural elements, and a description style based on the integrated text information, and inputting the prompt and the integrated text information to a generative neural network model to generate document information;
structuring the document information into document data according to a predetermined format, storing the document data in a storage device, and transmitting the document data to a terminal device via the packet-switched network.
