# US 2021/0243388 A1 · Optimized video review using motion recap images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243388 A1 - Document ID: US20210243388A1 - Status: Published application - Kind: A1 - Application number: 17/235,929 - Filed: 2021-04-20 - Published: 2021-08-05 - Earliest claimed: 2019-03-29 - Assignees: Cisco Technology, Inc. - Applicants: Cisco Technology, Inc. - Inventors: Nathaniel Webster Storer - Web page: https://patentgrep.com/patent/US20210243388A1 ## CPC - G06T 11/60: Creating or editing images; Combining images with text - G06F 16/735: Filtering based on additional data, e.g. user or group profiles - G06F 16/738: Presentation of query results - G06F 16/739: {in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames} - G06T 7/194: involving foreground-background segmentation - G06T 7/215: Motion-based segmentation - G06T 7/254: involving subtraction of images - G06T 7/50: Depth or shape recovery - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06T 2207/10016: Video; Image sequence - G06T 2207/20021: Dividing image into blocks, subimages or windows - G06T 2207/20024: Filtering details - G06T 2207/20224: Image subtraction - G06T 2207/30232: Surveillance - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods provide for optimizing video review using motion recap images. A video review system can identify background image data of a video clip including an amount of motion satisfying a motion threshold. The video review system can generate foreground mask data segmenting foreground image data, representing a moving object in the video clip, from the background image data. The video review system can select a set of instances of the moving object represented in the foreground image data. The video review system can generate a motion recap image by superimposing the set of instances of the moving object represented in the foreground image data onto the background data. ## Claims ### Claim 1 A method comprising: detecting one or more motions in a video feed; generating metadata describing each of the one or more motions; associating the metadata with the video feed; receiving a query; and identifying, from the metadata, at least a portion of the video feed that includes a motion of the one or more motions corresponding to the query. ### Claim 2 (depends on 1) The method of claim 1, wherein the video feed includes at least a plurality of frames of a predefined pixel area. ### Claim 3 (depends on 2) The method of claim 2, further comprising: partitioning the plurality of frames into a plurality of blocks of pixels; ### Claim 4 (depends on 3) The method of claim 3, wherein each motion of the one or more motions is associated with at least one block of pixels of the plurality of blocks of pixels. ### Claim 5 (depends on 3) The method of claim 3, wherein each block of pixels of the plurality of blocks of pixels includes a subset of the predefined pixel area of a corresponding frame of the plurality of frames. ### Claim 6 (depends on 3) The method of claim 3, wherein the metadata is associated with one or more blocks of pixels of the plurality of blocks of pixels that correspond with at least one of the one or more motions that occurred across one or more frames of the plurality of frames. ### Claim 7 (depends on 2) The method of claim 2, wherein the portion of the video feed includes at least one of the plurality of frames. ### Claim 8 (depends on 2) The method of claim 2, wherein the query includes at least a portion of the predefined pixel area. ### Claim 9 (depends on 8) The method of claim 8, the identifying further comprising: searching the metadata at the predefined pixel area for one or more frames of the video feed and block pairs that include a motion of the one or more motions corresponding to the query. ### Claim 10 (depends on 1) The method of claim 1, further comprising: identifying background image data of the portion of the video feed; generating foreground mask data by segmenting foreground image data from the background image data; selecting a set of instances of the one or more motions from the foreground image data; and generating a motion recap image. ### Claim 11 (depends on 10) The method of claim 10, wherein the foreground image data represents the one or more motions. ### Claim 12 (depends on 10) The method of claim 10, wherein the motion recap image is generated by superimposing the set of instances of the one or more motions onto the background image data. ### Claim 13 A system comprising: at least one processor; and a memory storing instructions, which when executed by the at least one processor, causes the at least one processor to: detect one or more motions in a video feed; generate metadata describing each of the one or more motions; associate the metadata with the video feed; receive a query; and identify, from the metadata, at least a portion of the video feed that includes a motion of the one or more motions corresponding to the query. ### Claim 14 (depends on 13) The system of claim 13, wherein the video feed includes at least a plurality of frames of a predefined pixel area. ### Claim 15 (depends on 14) The system of claim 14, wherein the metadata is associated with one or more blocks of pixels that correspond with at least one of the one or more motions that occurred across one or more frames of the video feed. ### Claim 16 (depends on 15) The system of claim 15, further comprising instructions, which when executed by the at least one processor, causes the at least one processor to: search the metadata at the predefined pixel area for one or more frames of the video feed and block pairs that include a motion of the one or more motions corresponding to the query. ### Claim 17 (depends on 13) The system of claim 13, further comprising instructions, which when executed by the at least one processor, causes the at least one processor to: identify background image data of the portion of the video feed; generate foreground mask data by segmenting foreground image data from the background image data; select a set of instances of the one or more motions from the foreground image data; and generate a motion recap image. ### Claim 18 At least one non-transitory computer readable medium storing instructions, which when executed by at least one processor, causes the at least one processor to: detect one or more motions in a video feed; generate metadata describing each of the one or more motions; associate the metadata with the video feed; receive a query; and identify, from the metadata, at least a portion of the video feed that includes a motion of the one or more motions corresponding to the query. ### Claim 19 (depends on 18) The at least one non-transitory computer readable medium of claim 18, wherein the metadata is associated with one or more blocks of pixels that correspond with at least one of the one or more motions that occurred across one or more frames of the video feed. ### Claim 20 (depends on 18) The at least one non-transitory computer readable medium of claim 18, further comprising instructions, which when executed by the at least one processor, causes the at least one processor to: identify background image data of the portion of the video feed; generate foreground mask data by segmenting foreground image data from the background image data; select a set of instances of the one or more motions from the foreground image data; and generate a motion recap image.