# US 12,217,771 B2 · System and method for representing long video sequences > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,771 B2 - Document ID: US12217771B2 - Status: Granted - Kind: B2 - Application number: 18/097,695 - Filed: 2023-01-17 - Published: 2023-09-07 - Granted: 2025-02-04 - Earliest claimed: 2008-04-18 - Assignees: Adeia Media Holdings LLC - Applicants: Adeia Media Holdings LLC - Inventors: Erik Van de Pol - Web page: https://patentgrep.com/patent/US12217771B2 ## CPC - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames} - G11B 27/105: {of operating discs} - H04N 5/783: Adaptations for reproducing at a rate different from the recording rate - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and procedures for transforming video into a condensed visual representation. An example procedure may include receiving video comprised of a plurality of frames. For each frame, the example procedure may create a first representation, reduced in one dimension, wherein a visual property of each pixel of the first representation is assigned by aggregating a visual property of the pixels of the frame having the same position in the unreduced dimension. The example procedure may further form a condensed visual representation including the first representations aligned along the reduced dimension according to an order of the frames in the video. ## Claims ### Claim 1 A method comprising: generating for display on a computing device a user interface including a visual representation of: content comprising a plurality of frames; a first insertion point in the content determined based on timing information retrieved from an information source; a second insertion point determined based on a condensed visual representation; an insertion error identified based on the first insertion point and the second insertion point; and information about the insertion error. ### Claim 2 (depends on 1) The method of claim 1, wherein the first insertion point is an actual insertion point, and the second insertion point is an intended insertion point. ### Claim 3 (depends on 1) The method of claim 1, wherein the insertion error is determined based on a difference between the first insertion point and the second insertion point. ### Claim 4 (depends on 1) The method of claim 1, wherein the information about the insertion error comprises at least one of an insertion time, a frame number, a delay between the first insertion point and the second insertion point, or a preview of the condensed visual representation. ### Claim 5 (depends on 1) The method of claim 1, wherein the generating for display on the computing device the user interface including the visual representation includes: a condensed visual representation and metadata for each frame of the plurality of frames determined by condensing the content. ### Claim 6 (depends on 5) The method of claim 5, wherein the generating for display on the computing device the user interface including the visual representation includes: for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame, wherein the first representation of each frame is aligned according to an order of the plurality of frames in the content to determine the condensed visual representation. ### Claim 7 (depends on 6) The method of claim 6, wherein the visual property of each of the plurality of pixels is based on averaging a color of each of the plurality of pixels. ### Claim 8 (depends on 1) The method of claim 1, wherein the generating for display on the computing device the user interface including the visual representation includes: a record of one or more insertion errors based on identifying the one or more insertion errors occurring during a particular period of time, wherein the record comprises a graph illustrating the one or more insertion errors during the particular period of time for a selected content provider network. ### Claim 9 (depends on 8) The method of claim 8, wherein the generating for display on the computing device the user interface including the visual representation includes: based on the record, an identification of at least one of an inaccuracy at a content provider network, an inaccuracy in a transport path, an inaccuracy in a configuration of one or more devices, or an inaccuracy of a configuration parameter; and a representation of corrective measures to the one or more insertion errors determined based on at least one of the inaccuracy at the content provider network, the inaccuracy in the transport path, the inaccuracy in the configuration of the one or more devices, or the inaccuracy of the configuration parameter. ### Claim 10 (depends on 1) The method of claim 1, wherein the generating for display on the computing device the user interface including the visual representation includes: a representation bar with an identifier indicating the insertion error within the condensed visual representation, wherein the condensed visual representation is scaled to fit in the representation bar. ### Claim 11 A system comprising: circuitry configured to: generate for display on a computing device a user interface including a visual representation of: content comprising a plurality of frames; a first insertion point in the content determined based on timing information retrieved from an information source; a second insertion point determined based on a condensed visual representation; an insertion error identified based on the first insertion point and the second insertion point; and information about the insertion error. ### Claim 12 (depends on 11) The system of claim 11, wherein the first insertion point is an actual insertion point, and the second insertion point is an intended insertion point. ### Claim 13 (depends on 11) The system of claim 11, wherein the insertion error is determined based on a difference between the first insertion point and the second insertion point. ### Claim 14 (depends on 11) The system of claim 11, wherein the information about the insertion error comprises at least one of an insertion time, a frame number, a delay between the first insertion point and the second insertion point, or a preview of the condensed visual representation. ### Claim 15 (depends on 11) The system of claim 11, wherein the visual representation includes: a condensed visual representation and metadata for each frame of the plurality of frames determined by condensing the content. ### Claim 16 (depends on 15) The system of claim 15, wherein visual representation includes: for each frame, a visual property of each of a plurality of pixels in at least one of a horizontal row and a vertical column to form a first representation of each frame, wherein the first representation of each frame is aligned according to an order of the plurality of frames in the content to determine the condensed visual representation. ### Claim 17 (depends on 16) The system of claim 16, wherein the visual property of each of the plurality of pixels is based on averaging a color of each of the plurality of pixels. ### Claim 18 (depends on 11) The system of claim 11, wherein the visual representation includes: a record of one or more insertion errors based on identifying the one or more insertion errors occurring during a particular period of time, wherein the record comprises a graph illustrating the one or more insertion errors during the particular period of time for a selected content provider network. ### Claim 19 (depends on 18) The system of claim 18, wherein the visual representation includes: based on the record, an identification of at least one of an inaccuracy at a content provider network, an inaccuracy in a transport path, an inaccuracy in a configuration of one or more devices, or an inaccuracy of a configuration parameter; and a representation of corrective measures to the one or more insertion errors determined based on at least one of the inaccuracy at the content provider network, the inaccuracy in the transport path, the inaccuracy in the configuration of the one or more devices, or the inaccuracy of the configuration parameter. ### Claim 20 (depends on 11) The system of claim 11, wherein the visual representation includes: a representation bar with an identifier indicating the insertion error within the condensed visual representation, wherein the condensed visual representation is scaled to fit in the representation bar.