System
AssigneeSoftBank Group Corp.
InventorHiroyuki HAYAKAWA
Life of this patent
Estimating the term…
Abstract
A system comprising a processor, wherein the processor is configured to: acquire a sports broadcast video, extract an audio signal from the sports broadcast video, and convert the extracted audio signal into text by using a speech recognition technique, detect a sudden change in volume in the audio signal and identify a highlight portion of a game based on the detected sudden change in volume, obtain game information from an external database, and generate a prompt sentence for instructing a generative AI model to generate a text based on the obtained game information and the identified highlight portion of the game.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, a video input signal comprising broadcast video data, and separate an audio signal from the video input signal to generate audio data;
- execute speech recognition processing on the audio data to generate character information associated with time information, and calculate a temporal change of an acoustic quantity based on the audio data;
- detect a change of the acoustic quantity satisfying a predetermined condition to specify time information of an excitement event, and acquire event information, group information, and participant information from an external data source;
- associate the acquired event information, group information, and participant information with the time information and the character information to generate structured data, and generate a prompt sentence based on the structured data, the prompt sentence including instructions relating to an event situation, an event content, and an output format;
- execute inference processing using a generative neural network model with the prompt sentence as input to generate a natural language document, and record the natural language document as related information in association with the time information of the excitement event;
- and
- synchronize the natural language document with the time information, superimpose the natural language document on distribution data, and continuously distribute the broadcast video data together with the related information to a terminal device via the communication interface.
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, a video input signal, and separate an audio signal from the video input signal to generate audio data;
- execute speech recognition processing on the audio data using a speech recognition model to generate character information associated with time stamps, and calculate a temporal change of an acoustic quantity in at least one of a time domain and a frequency domain;
- detect a change of the acoustic quantity exceeding a threshold value to specify time information of an excitement event, and acquire event information and participant information from an external data source;
- generate structured data by associating the event information, the participant information, and the time information with the character information, construct a prompt sentence embedding event type information, participant attribute information, and a temporal context window, and execute inference processing using a generative neural network model to generate a natural language document;
- and
- synchronize the natural language document with the time information of the excitement event, superimpose the natural language document on distribution data, and transmit the distribution data together with the natural language document to the terminal device via the communication interface.
A method comprising:
- receiving, via a communication interface coupled to a packet-switched network, a video input signal comprising broadcast video data, and separating an audio signal from the video input signal to generate audio data;
- executing speech recognition processing on the audio data to generate character information associated with time information, and calculating a temporal change of an acoustic quantity based on the audio data;
- detecting a change of the acoustic quantity satisfying a predetermined condition to specify time information of an excitement event, and acquiring event information, group information, and participant information from an external data source;
- associating the acquired event information, group information, and participant information with the time information and the character information to generate structured data, and generating a prompt sentence based on the structured data;
- executing inference processing using a generative neural network model with the prompt sentence as input to generate a natural language document, and recording the natural language document as related information in association with the time information of the excitement event;
- and
- synchronizing the natural language document with the time information, superimposing the natural language document on distribution data, and continuously distributing the broadcast video data together with the related information to a terminal device via the communication interface.
Dependencies are inferred from the claim text.