# US 11,451,877 B2 · Optimizing media fingerprint retention to improve system resource utilization > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,451,877 B2 - Document ID: US11451877B2 - Status: Granted - Kind: B2 - Application number: 16/854,048 - Filed: 2020-04-21 - Published: 2020-10-08 - Granted: 2022-09-20 - Earliest claimed: 2015-07-16 - Assignees: Inscape Data, Inc. - Applicants: Inscape Data, Inc. - Inventors: Zeev Neumeier; Michael Collette - Web page: https://patentgrep.com/patent/US11451877B2 ## CPC - G06F 16/7847: {using low-level visual features of the video content} - G06V 10/40: Extraction of image or video features - G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching} - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04N 21/845: Structuring of content, e.g. decomposing content into time segments - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Provided are devices, computer-program products, and methods related to removing redundant data associated with frames. For example, a method can include storing a plurality of reference data sets in a reference database, where a reference data set is associated with a media segment. The method can further include receiving, by a server, cue data for a frame. The cue data includes a plurality of pixel data samples from the frame, and the frame is associated with an unidentified media segment. The method can further include identifying an absence of a pixel data sample from the cue data for the frame, and matching the cue data for the frame to a reference data set. The matching can include using a previous pixel data sample from a previous frame. The previous pixel data sample corresponds to the pixel data sample absent from the frame, and the reference data set is associated with a media segment. The method can further include determining the unidentified media segment is the media segment. ## Claims ### Claim 1 A computer-implemented method comprising: receiving initial cue data, wherein the initial cue data includes a plurality of initial pixel data samples associated with first pixel data of an initial frame; and receiving updated new cue data, the updated new cue data including new cue data determined from a new frame including second pixel data that is different from the first pixel data, the new cue data including a plurality of new pixel data samples associated with the second pixel data of the new frame, wherein a pixel value difference between at least one initial pixel data sample from the initial frame and at least one new pixel data sample from the new cue data is within a pixel value range, and wherein the new cue data is updated to generate the updated new cue data by removing the at least one new pixel data sample from the new cue data in response to the pixel value difference being within the pixel value range. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving a flag indicating that the at least one new pixel data sample is removed from the new cue data. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the at least one new pixel data sample is included in the row. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: identifying that the at least one new pixel data sample is removed from the new cue data. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, further comprising using a flag to identify the at least one new pixel data sample. ### Claim 8 A system comprising: one or more processors; and a non-transitory computer-readable medium containing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including: receiving initial cue data, wherein the initial cue data includes a plurality of initial pixel data samples associated with first pixel data of an initial frame; and receiving updated new cue data, the updated new cue data including new cue data determined from a new frame including second pixel data that is different from the first pixel data, the new cue data including a plurality of new pixel data samples associated with the second pixel data of the new frame, wherein a pixel value difference between at least one initial pixel data sample from the initial frame and at least one new pixel data sample from the new cue data is within a pixel value range, and wherein the new cue data is updated to generate the updated new cue data by removing the at least one new pixel data sample from the new cue data in response to the pixel value difference being within the pixel value range. ### Claim 9 (depends on 8) The system of claim 8, further comprising: receiving a flag indicating that the at least one new pixel data sample is removed from the new cue data. ### Claim 10 (depends on 8) The system of claim 8, further comprising: receiving a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the at least one new pixel data sample is included in the row. ### Claim 11 (depends on 8) The system of claim 8, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame. ### Claim 12 (depends on 11) The system of claim 11, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch. ### Claim 13 (depends on 8) The system of claim 8, further comprising: identifying that the at least one new pixel data sample is removed from the new cue data. ### Claim 14 (depends on 13) The system of claim 13, further comprising using a flag to identify the at least one new pixel data sample. ### Claim 15 A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions that, when executed by one or more processors, cause the one or more processors to: receive initial cue data, wherein the initial cue data includes a plurality of initial pixel data samples associated with first pixel data of an initial frame; and receive updated new cue data, the updated new cue data including new cue data determined from a new frame including second pixel data that is different from the first pixel data, the new cue data including a plurality of new pixel data samples associated with the second pixel data of the new frame, wherein a pixel value difference between at least one initial pixel data sample from the initial frame and at least one new pixel data sample from the new cue data is within a pixel value range, and wherein the new cue data is updated to generate the updated new cue data by removing the at least one new pixel data sample from the new cue data in response to the pixel value difference being within the pixel value range. ### Claim 16 (depends on 15) The computer-program product of claim 15, further comprising: receiving a flag indicating that the at least one new pixel data sample is removed from the new cue data. ### Claim 17 (depends on 15) The computer-program product of claim 15, further comprising: receiving a flag indicating that a row of pixel data samples are removed from the new cue data, wherein the at least one new pixel data sample is included in the row. ### Claim 18 (depends on 15) The computer-program product of claim 15, wherein a pixel data sample is computed from a pixel patch, and wherein the pixel patch includes an array of pixels of a frame. ### Claim 19 (depends on 18) The computer-program product of claim 18, wherein the pixel data sample is computed by taking an average of pixel values of pixels in the pixel patch. ### Claim 20 (depends on 15) The computer-program product of claim 15, further comprising: identifying that the at least one new pixel data sample is removed from the new cue data.