# US 10,375,452 B2 · Apparatus and methods for thumbnail generation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,452 B2 - Document ID: US10375452B2 - Status: Granted - Kind: B2 - Application number: 14/686,584 - Filed: 2015-04-14 - Published: 2016-10-20 - Granted: 2019-08-06 - Earliest claimed: 2015-04-14 - Assignees: Time Warner Cable Enterprises LLC - Applicants: Time Warner Cable Enterprises LLC - Inventors: Glen Hardin; Eric Manchester - Web page: https://patentgrep.com/patent/US10375452B2 ## CPC - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06) - H04L 65/612: for unicast - H04L 65/70: Media network packetisation - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04N 21/440218: {by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 (conversion of standards in analogue television systems H04N7/01)} - H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} - G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Apparatus and methods for thumbnail generation. In one embodiment, a thumbnail stream is generated where one or more bits are assigned to key frames and minimizes the number of bits assigned to delta frames. Each key frame may be used to extract a still image for use in thumbnails during trick mode operation (e.g., fast forward, rewind, pause, or random seek operation). When the encoded video file is given to a Just in Time Packager (JITP), the JITP extracts the image files (via the key frames). Information regarding how to reference these files is stored in generated manifest file and may be reformatted by the JITP to fit the needs of the current product. In a variant, the JITP reformats the image files extracted from the encoded video for operation on a number of devices. ## Claims ### Claim 1 A packager apparatus comprising: a first interface configured for data communication with a content delivery network; a storage apparatus; and a processor apparatus configured to execute at least one computer program, said at least one computer program stored on said storage apparatus and comprising a plurality of instructions which are configured to, when executed by said processor apparatus, cause said packager apparatus to: receive a thumbnail digital data stream previously generated from a video digital data stream, said video digital data stream comprising a first plurality of digitally rendered key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digitally rendered key frames each separated by one or more null frames, each of said one or more null frames comprising non-content data; receive, from a user device via said content delivery network, data indicative of a user request for digital content, said digital content associated with said thumbnail digital data stream; based at least in part on said receipt of said data indicative of said user request for said digital content, extract a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during trick mode operation of said user device; and based at least in part on said extraction of said plurality of digitally rendered thumbnail images, generate a manifest file comprising a digital data structure configured for storage of a first plurality of addresses, each of said first plurality of addresses corresponding to a location of one or more of said plurality of digitally rendered thumbnail images. ### Claim 2 (depends on 1) The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to: receive an encoded video digital data stream; and segment said encoded video digital data stream into a plurality of segmented portions for delivery to said user device via said content delivery network. ### Claim 3 (depends on 2) The packager apparatus of claim 2, wherein said digital data structure of said manifest file is further configured for storage of a second plurality of addresses, each of said second plurality of addresses corresponding to a location of one or more of said plurality of segmented portions of said encoded video digital data stream. ### Claim 4 (depends on 1) The packager apparatus of claim 1, wherein said extraction of said plurality of digitally rendered thumbnail images comprises automatic skip of said each of said one or more null frames in said thumbnail digital data stream. ### Claim 5 (depends on 1) The packager apparatus of claim 1, wherein said data indicative of said user request for digital content at least in part comprises data indicative of a user request for trick mode operation of said user device during content playback. ### Claim 6 (depends on 1) The packager apparatus of claim 1, wherein said generation of said manifest file is based at least in part on data indicative of a device type of said user device. ### Claim 7 (depends on 1) The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to remove said plurality of digitally rendered thumbnail images from said user device. ### Claim 8 (depends on 1) The packager apparatus of claim 1, wherein said plurality of instructions are further configured to, when executed by said processor apparatus, cause said packager apparatus to resize at least a portion of said plurality of digitally rendered thumbnail images based at least in part on data indicative of a device type of said user device. ### Claim 9 (depends on 1) The packager apparatus of claim 1, wherein: said first interface is further configured for data communication with an encoder apparatus, and said receipt of said thumbnail digital data stream previously generated from said video digital data stream comprises receipt of said thumbnail digital data stream from said encoder apparatus. ### Claim 10 A method of operating a network packager apparatus for generation of a plurality of digitally rendered thumbnail images, said network packager apparatus in data communication with a content delivery network, said method comprising: receiving a thumbnail digital data stream previously generated from a video digital data stream, said video digital data stream comprising a first plurality of digitally rendered key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digitally rendered key frames each separated by one or more null frames, each of said one or more null frames comprising metadata relative to said transitional video data; receiving, via said content delivery network, data indicative of a user request for trick mode operation of a user device during playback of digital content; based at least in part on said receiving of said data indicative of said user request, extracting a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during said trick mode operation of said user device; and based at least in part on said extracting of said plurality of digitally rendered thumbnail images, storing a first plurality of addresses in a manifest file comprising a digital data structure, each of said first plurality of addresses corresponding to a location of one or more of said plurality of digitally rendered thumbnail images. ### Claim 11 (depends on 10) The method of claim 10, further comprising: receiving an encoded video digital data stream; segmenting said encoded video digital data stream into a plurality of segmented portions for delivery to said user device via said content delivery network; and based at least in part on said segmenting of said encoded video digital data stream, storing a second plurality of addresses in said manifest file, each of said second plurality of addresses corresponding to a data storage location of one or more of said plurality of segmented portions of said encoded video digital data stream. ### Claim 12 (depends on 11) The method of claim 11, further comprising: obtaining data indicative of a device type of said user device; and based at least in part on said data indicative of said device type, formatting said plurality of segmented portions of said encoded video digital data stream to be compatible with said device type. ### Claim 13 (depends on 10) The method of claim 10, further comprising: obtaining data indicative of a device type of said user device; and based at least in part on said data indicative of said device type, formatting said plurality of digitally rendered thumbnail images to be compatible with said device type. ### Claim 14 (depends on 10) The method of claim 10, further comprising: obtaining data indicative of a device type of said user device; and based at least in part on said data indicative of said device type, resizing said plurality of digitally rendered thumbnail images to be compatible with said device type. ### Claim 15 (depends on 10) The method of claim 10, wherein said extracting of said plurality of digitally rendered thumbnail images from said at least a portion of said second plurality of digitally rendered key frames in said thumbnail digital data stream at least in part comprises automatic skipping of said each of said one or more null frames. ### Claim 16 (depends on 10) The method of claim 10, further comprising, at or after expiration of a user session, removing said plurality of digitally rendered thumbnail images from said user device. ### Claim 17 A packager apparatus comprising: a first data interface configured for data communication with a content delivery network; data storage apparatus; and data processor apparatus configured to execute at least one computer program thereon, said at least one computer program stored on said data storage apparatus and comprising a plurality of instructions which are configured to, when executed by said data processor apparatus, cause said packager apparatus to: receive, via said content delivery network, data indicative of a user request for digital content generated by a computerized user device; based at least in part on said receipt of said data indicative of said user request for said digital content: access a thumbnail digital data stream previously generated from a video digital data stream, said digital content associated with said thumbnail digital data stream, said video digital data stream comprising a first plurality of digital key frames each separated by transitional video data, said thumbnail digital data stream comprising a second plurality of digital key frames each separated by one or more null frames, each of said one or more null frames comprising metadata relative to said transitional video data; extract a plurality of digitally rendered thumbnail images from at least a portion of said second plurality of digital key frames in said thumbnail digital data stream, said plurality of digitally rendered thumbnail images configured for use during trick mode operation of said computerized user device; and based at least in part on said extraction of said plurality of digitally rendered thumbnail images, generate a manifest file comprising a digital data structure configured for storage of a first plurality of addresses, each of said first plurality of addresses corresponding to a data storage location of one or more of said plurality of digitally rendered thumbnail images; and wherein said generation of said manifest file is based at least in part on data indicative of a device type of said computerized user device. ### Claim 18 (depends on 17) The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to resize at least a portion of said plurality of digitally rendered thumbnail images based at least in part on said data indicative of said device type of said computerized user device. ### Claim 19 (depends on 17) The packager apparatus of claim 17, wherein said extraction of said plurality of digitally rendered thumbnail images at least in part comprises automatic skip of said each of said one or more null frames in said thumbnail digital data stream. ### Claim 20 (depends on 17) The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to: receive an encoded video digital data stream; and segment said encoded video digital data stream into a plurality of portions for delivery to said computerized user device via said content delivery network. ### Claim 21 (depends on 20) The packager apparatus of claim 20, wherein said digital data structure of said manifest file is further configured for storage of a second plurality of addresses, each of said second plurality of addresses corresponding to a data storage location of one or more of said plurality of segmented portions of said encoded video digital data stream. ### Claim 22 (depends on 17) The packager apparatus of claim 17, wherein said plurality of instructions are further configured to, when executed by said data processor apparatus, cause said packager apparatus to, based at least on said data indicative of said device type, format said plurality of digitally rendered thumbnail images to be compatible with said device type.