US 10,432,930 B2Granted

Multi-video decoding with input switching

AssigneeGoogle Inc.

InventorsAndrew Benedict Lewis, Richard Zarek Cohen

Life of this patent

Estimating the term…

Loading patent…

Abstract

In some aspects, methods and systems described herein provide for preparing component videos for combining into a bitstream. An example system may receive a source video. The system may also receive data representing a compression format. The system may encode a reference frame as an intra-coded picture that is sub-divided into intra-coded units. The system may encode the sequence of source frames as a sequence of predictive-coded pictures conforming to the compression format. The sequence may be divided into groups of pictures that include a first predictive-coded picture followed by one or more second predictive-coded pictures. The first predictive-coded picture may be sub-divided into intra-coded units that represent respective portions of a source frame by describing the pixels of the portion so as to simulate intra-coded pictures. The system may concatenate the sequence of predictive-coded pictures after the intra-coded picture so as to produce a bitstream.

Claims20

Dependent claims

A method comprising:

receiving, by one or more processors, a first bitstream that includes, in sequence, a first setoff comprising an intra-coded frame followed by an offset of predictive-coded frames and a first sequence of frames that represents a first video, wherein the first sequence of frames is divided into groups of frames that include a first predictive-coded frame followed by one or more second predictive-coded frames, and wherein the first predictive-coded frames are sub-divided into intra-coded units to simulate intra-coded frames;
receiving, by one or more processors, a second bitstream that includes, in sequence, a second setoff comprising of an intra-coded frame and a second sequence of frames that represents a second video, wherein the second sequence of frames is divided into groups of frames that include a third predictive-coded frame followed by one or more fourth predictive-coded frames, and wherein the third predictive-coded frames are sub-divided into intra-coded units to simulate intra-coded frames;
combining, by the one or more processors, the intra-coded frame of the first setoff with the intra-coded frame of the second setoff as a first output frame in a bitstream of output frames;
combining, by the one or more processors, one or more of the predictive-coded frames of the first setoff with respective predictive-coded frames of the second sequence of frames as second output frames that follow the first output frame in the bitstream of output frames such that the one or more predictive-coded frames of the first setoff delay the first sequence of frames relative to the second sequence of frames within the bitstream;
combining in sequence, by the one or more processors, the predictive-coded frames of the first sequence of frames with respective predictive-coded frames of the second sequence of frames as third output frames that follow the second output frames in the bitstream of output frames;
and
sending, by one or more processors, the bitstream of output frames to a decoder.

4 more elements

A computing system comprising:

one or more processors;
data storage configured to store instructions, that when executed by the one or more processors, cause the computing system to:
receive a first bitstream that includes, in sequence, a first setoff comprising an intra-coded frame followed by an offset of predictive-coded frames and a first sequence of frames that represents a first video, wherein the first sequence of frames is divided into groups of frames that include a first predictive-coded frame followed by one or more second predictive-coded frames, and wherein the first predictive-coded frames are sub-divided into intra-coded units to simulate intra-coded frames;
receive a second bitstream that includes, in sequence, a second setoff comprising of an intra-coded frame and a second sequence of frames that represents a second video, wherein the second sequence of frames is divided into groups of frames that include a third predictive-coded frame followed by one or more fourth predictive-coded frames, and wherein the third predictive-coded frames are sub-divided into intra-coded units to simulate intra-coded frames;
combine the intra-coded frame of the first setoff with the intra-coded frame of the second setoff as a first output frame in a bitstream of output frames;
combine one or more of the predictive-coded frames of the first setoff with respective predictive-coded frames of the second sequence of frames as second output frames that follow the first output frame in the bitstream of output frames such that the one or more predictive-coded frames of the first setoff delay the first sequence of frames relative to the second sequence of frames within the bitstream;
combine in sequence the predictive-coded frames of the first sequence of frames with respective predictive-coded frames of the second sequence of frames as third output frames that follow the second output frames in the bitstream of output frames;
and
send the bitstream of output frames to a decoder.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/924,686Filed 19 Mar 2018 · continuation
Priority: 31 Oct 2014
Published: US 2018/0213226 A126 Jul 2018
Granted: 1 Oct 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification10 codes

H04N 19/114
Selection of coding mode or of prediction mode: adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
H04N 19/107
Selection of coding mode or of prediction mode: between spatial and temporal predictive coding, e.g. picture refresh
H04N 19/157
Characterised by the element, parameter or criterion affecting or controlling the adaptive coding: assigned coding mode, i.e. the coding mode…
H04N 19/172
The unit being an image region, e.g. an object: the region being a picture, frame or field

Family

Application14/529,245Parent of this continuation · filed 31 Oct 2014
US 2018/0213226 A1Pre-grant publication · published 26 Jul 2018
US 9,955,159 B2Parent of this continuation
US 2016/0127709 A1Published application
US 10,432,930 B2This patent

From the US filing history. Foreign family members aren’t listed.