System architecture for live user interaction during video playback
AssigneeSamsung Electronics Co., Ltd.
InventorSeongnam Oh
Life of this patent
Estimating the term…
Abstract
A system architecture for live user interaction during video playback is capable of detecting one or more visual objects in a video concurrently with playing the video on a screen of a device. The visual objects are stored within a physical memory of the device. The visual objects are discarded from the physical memory after a predetermined window of time. In response to receiving an input from a user specifying a user query, the visual objects stored in the physical memory are searched for a match to the user query. In response to matching a selected visual object from the physical memory with the user query, the selected visual object is submitted with the user query to a large language model system. A result from the large language model system is provided to the user.
Claims20
A method, comprising:
- detecting visual objects in a video concurrently with playing the video on a screen of a device;
- storing the visual objects within a physical memory of the device and discarding the visual objects from the physical memory after a predetermined window of time;
- in response to receiving an input from a user specifying a user query, searching the visual objects stored in the physical memory for a match to the user query;
- in response to matching a selected visual object from the physical memory with the user query, submitting the selected visual object with the user query to a large language model system;
- and
- providing a result from the large language model system to the user.
A device, comprising:
- a screen;
- a video player capable of playing a video on the screen;
- a vision object analyzer capable of detecting visual objects in the video concurrently with playing the video on the screen;
- a detected object manager capable of storing the visual objects within a physical memory of the device and discarding the visual objects from the physical memory after a predetermined window of time;
- an image search manager that, in response to receiving an input from a user specifying a user query, is capable of searching the visual objects stored in the physical memory for a match to a user query, matching a selected visual object from the physical memory with the user query, and submitting the selected visual object with the user query to a large language model system;
- and
- a user interaction manager capable of receiving the input and providing a result from the large language model system to the user.
A device, comprising:
- a screen;
- a physical memory;
- and
- a hardware processor capable of performing operations including:
- detecting visual objects in a video concurrently with playing the video on the screen of the device;
- storing the visual objects within a physical memory of the device and discarding the visual objects from the physical memory after a predetermined window of time;
- in response to receiving an input from a user specifying a user query, searching the visual objects stored in the physical memory for a match to the user query;
- in response to matching a selected visual object from the physical memory with the user query, submitting the selected visual object with the user query to a large language model system;
- and
- providing a result from the large language model system to the user.
Dependencies are inferred from the claim text.