Back to results
US 2024/0406518 A1Published application
Tracking content with artifical intelligence as it is consumed
AssigneeSony Group Corporation
InventorBrant Candelore
Life of this patent
Estimating the term…
Abstract
A user starts playback of an audio or AV program, which starts up a large language model (LLM) such as a generative pre-trained transformer. The LLM follows the program with the user as the program is being watched. Audio is converted to text and video is converted to text-based description. The LLM essentially trains on the resulting “corpus” so that should the user subsequently want to access part of the program using a simple conversational query about the program, the LLM can provide the answer.
Claims20
An apparatus, comprising:
- at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor assembly to:
- receive a command to present audio and/or audio video (AV) content on a display;
- responsive to the command, start to play the content;
- responsive to the command, start at least one machine learning (ML) model to receive audio and/or video being played in the content;
- use the audio and/or video in the content to train at least one large language model (LLM);
- receive at least one query related to the content;
- input the query to the LLM;
- receive from ML model a response to the query;
- and
- present the response on at least one output device.
7 more elements
A method, comprising:
- playing content using a content player;
- as the content is being played, using the content to train at least one machine learning (ML) model;
- and
- using the ML model to return at least one response to at least one query about the content.
1 more element
An apparatus comprising:
- at least one processor assembly configured to:
- invoke at least one machine learning (ML) model to consume information related to content as the content is being played on at least one output device to train the ML model;
- and
- use the ML model to respond to at least one query about the content.
1 more element
Dependencies are inferred from the claim text.