# US 2019/0356928 A1 · Adaptive Streaming Systems and Methods for Performing Trick Play

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356928 A1
- Document ID: US20190356928A1
- Status: Published application
- Kind: A1
- Application number: 16/525,073
- Filed: 2019-07-29
- Published: 2019-11-21
- Earliest claimed: 2011-01-05
- Assignees: Divx, LLC
- Applicants: Divx, LLC
- Inventors: Jason Braness; Auke Sjoerd van der Schaar; Kourosh Soroushian
- Web page: https://patentgrep.com/patent/US20190356928A1

## CPC

- H04N 19/593: involving spatial prediction techniques
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- G11B 27/11: by using information not detectable on the record carrier
- G11B 27/322: {used signal is digitally coded}
- H04L 65/612: for unicast
- H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637)
- H04L 65/70: Media network packetisation
- H04N 19/172: the region being a picture, frame or field
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/40: using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
- H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment}
- H04N 21/23439: {for generating different versions}
- H04N 21/2387: Stream processing in response to a playback request from an end-user, e.g. for trick-play
- H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/42607: {for processing the incoming bitstream}
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/44004: {involving video buffer management, e.g. video decoder buffer or video display buffer}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44209: {Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network (arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896)}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/8455: {involving pointers to the content, e.g. pointers to the I-frames of the video stream}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04N 21/8543: using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] {(information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80)}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods for performing trick play functionality using trick play streams during adaptive bitrate streaming in accordance with embodiments of the invention are disclosed. One embodiment includes requesting a video container index from a video container file containing a video stream from a plurality of alternative streams of video; requesting at least one portion of the video stream using at least one entry from the video container index; decoding the at least one portion of the video stream; receiving at least one user instruction to perform a visual search of the media; requesting a trick play container index from a trick play container file containing a trick play stream; requesting at least one frame of video from the at least one trick play stream; and decoding and displaying the at least one frame of video from the trick play stream.

## Claims

### Claim 1

A playback device, comprising:
a set of one or more processors; and
a non-volatile storage containing an application for causing the set of one or more processors to perform the steps of:
obtaining a top level index file identifying a plurality of alternative streams of video, an audio stream, and at least one trick play stream, where:
each frame of the at least one trick play stream is an IDR picture; and
the at least one trick play stream is encoded at a lower frame rate than the frame rates of the plurality of alternative streams of video;
requesting portions of video from at least one of the alternative streams of video;
decoding the portions of video;
receiving at least one user instruction to perform a visual search of the media;
requesting portions of video from the at least one trick play stream; and
decoding and displaying the portions of video from the at least one trick play stream.

### Claim 2 (depends on 1)

The playback device of claim 1, wherein the at least one trick play stream comprises a plurality of trick play streams.

### Claim 3 (depends on 1)

The playback device of claim 1, wherein the trick play stream is encoded at a lower bit rate than the plurality of alternative streams.

### Claim 4 (depends on 1)

The playback device of claim 1, wherein the application is further for causing the set of processors to perform the step of performing adaptive streaming with respect to the plurality of trick play streams.

### Claim 5 (depends on 1)

The playback device of claim 1, wherein the application is further for causing the set of processors to perform the steps of:
manipulating timecodes assigned to the frames of the trick play stream prior to providing the frames of the trick play stream to a decoder on the playback device, where the timecodes are manipulated in order to achieve a rate of playback based on a desired rate for the visual search; and
decoding and presenting the frames of the trick play stream in accordance with the manipulated timecodes.

### Claim 6 (depends on 1)

The playback device of claim 1, wherein the application is further for causing the set of processors to perform the steps of:
detecting streaming conditions for the playback device;
selecting a stream from the plurality of alternative streams of video based on the detected streaming conditions; and
requesting portions of video from the selected stream.

### Claim 7 (depends on 6)

The playback device of claim 6, wherein:
the application is further for causing the set of processors to perform the step of obtaining a container index that provides byte ranges for portions of the selected stream within an associated container file; and
the step of requesting portions of the selected stream further comprises the step of generating byte range requests for portions of the selected stream using the container index.

### Claim 8

A method of playing back content on a playback device, comprising:
obtaining a top level index file identifying a plurality of alternative streams of video, an audio stream, and at least one trick play stream, where:
each frame of the at least one trick play stream is an IDR picture; and
the at least one trick play stream is encoded at a lower frame rate than the frame rates of the plurality of alternative streams of video;
requesting portions of video from at least one of the alternative streams of video;
decoding the portions of video;
receiving at least one user instruction to perform a visual search of the media;
requesting portions of video from the at least one trick play stream; and
decoding and displaying the portions of video from the at least one trick play stream.

### Claim 9 (depends on 8)

The method of claim 8, wherein the at least one trick play stream comprises a plurality of trick play streams.

### Claim 10 (depends on 8)

The method of claim 8, wherein the trick play stream is encoded at a lower bit rate than the plurality of alternative streams.

### Claim 11 (depends on 8)

The method of claim 8, further comprising performing adaptive streaming with respect to the plurality of trick play streams.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
manipulating timecodes assigned to the frames of the trick play stream prior to providing the frames of the trick play stream to a decoder on the playback device, wherein the timecodes are manipulated in order to achieve a rate of playback based on a desired rate for the visual search; and
decoding and presenting the frames of the trick play stream in accordance with the manipulated timecodes.

### Claim 13 (depends on 8)

The method of claim 8, further comprising:
detecting streaming conditions for the playback device;
selecting a stream from the plurality of alternative streams of video based on the detected streaming conditions; and
requesting portions of video from the selected stream.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
obtaining a container index that provides byte ranges for portions of the selected stream within an associated container file; and
generating byte range requests for portions of the selected stream using the container index.
