Back to results
US 2026/0288813 A1Published application
System
AssigneeSoftBank Group Corp.
InventorKei NISHIKAWA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to obtain audio information and convert the audio information into character data by using a speech recognition technique, obtain image information and extract character data from the image information by using an image recognition technique, and generate a prompt for instructing automatic generation of a document based on the obtained character data and input the prompt to a generative AI model.
Claims20
A system comprising:
- a communication interface coupled to a packet-switched network;
- and
- circuitry configured to:
- acquire audio information and image information from recording information received via the communication interface;
- convert the audio information into first character information by executing a speech recognition process, and convert the image information into second character information by executing an image recognition process;
- associate the first character information and the second character information with each other based on time information to generate integrated text information;
- generate a prompt defining instruction content comprising a document type, structural elements, and a description style based on the integrated text information, and input the prompt and the integrated text information to a generative neural network model to cause the generative neural network model to generate document information;
- and
- structure the document information into document data according to a predetermined format, store the document data in a storage device, and transmit the document data to a terminal device via the packet-switched network.
6 more elements
A system comprising:
- a communication interface coupled to a packet-switched network;
- and
- circuitry configured to:
- acquire recording information via the communication interface, the recording information comprising audio information and image information with associated time information;
- convert the audio information into timestamped text segments by executing speech recognition comprising phoneme decoding and language model application, and convert the image information into frame-level character data by executing optical character recognition on frames extracted at predetermined intervals;
- associate the timestamped text segments and the frame-level character data based on overlapping time intervals to generate integrated text information, and extract key terms and topic labels from the integrated text information using named-entity recognition;
- generate a prompt comprising a structured template format including document type specification, section heading definitions, formatting constraints, style parameters, and the extracted key terms as contextual parameters, and input the prompt and the integrated text information to a generative neural network model to generate document information comprising a plurality of document sections;
- structure the document information into document data according to a predetermined format, assign classification information based on metadata from the recording information, and store the document data in a storage device;
- and
- generate sharing identification information and transmit the document data and notification information to terminal devices via the packet-switched network.
7 more elements
A method comprising:
- acquiring, by circuitry coupled to a packet-switched network, audio information and image information from recording information;
- converting the audio information into first character information by executing a speech recognition process, and converting the image information into second character information by executing an image recognition process;
- associating the first character information and the second character information based on time information to generate integrated text information;
- generating a prompt defining instruction content comprising a document type, structural elements, and a description style based on the integrated text information, and inputting the prompt and the integrated text information to a generative neural network model to generate document information;
- structuring the document information into document data according to a predetermined format, storing the document data in a storage device, and transmitting the document data to a terminal device via the packet-switched network.
2 more elements
Dependencies are inferred from the claim text.