# US 11,122,325 B1 · Multiscreen experience for parallel playback of time shifted live stream content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,325 B1 - Document ID: US11122325B1 - Status: Granted - Kind: B1 - Application number: 17/107,249 - Filed: 2020-11-30 - Granted: 2021-09-14 - Earliest claimed: 2020-11-30 - Assignees: Rovi Guides, Inc. - Applicants: Rovi Guides, Inc. - Inventors: Ashish Gupta; Vaibhav Gupta; Rohit Dhiman - Web page: https://patentgrep.com/patent/US11122325B1 ## CPC - H04N 21/2187: Live feed - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 20/42: {of sport video content} - H04N 21/231: Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion - H04N 21/234381: {by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping} - H04N 21/2407: {Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14)} - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)} - H04N 21/440245: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment} - H04N 21/44209: {Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network (arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896)} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The present disclosure is generally directed to media systems configured to receive and play live media content. In particular, methods and systems are provided for a multi-screen content playback experience for time shifted live stream content. Systems and methods are provided herein for generating for display a catch-up video (e.g., a segment of a live stream stored as URLs on a local device during the time the live stream was interrupted) in a picture-in-picture (PIP) window, and generating the PIP catch-up window and the live window for simultaneous display. ## Claims ### Claim 1 A method for generating a picture-in-picture (“PIP) catch-up window displaying a catch-up video with a live video window displaying a live video, the method comprising: determining that a disruption has occurred to the live video; in response to determining that the disruption has occurred to the live video, initiating determining a period of disruption from the occurrence of the disruption until it is determined that the disruption has elapsed; in response to determining that the period of disruption has elapsed, storing a disrupted content segment of the live video that a user missed during the period of disruption; generating, if not already generated, the PIP catch-up window displaying the catchup video displaying the disrupted content segment for simultaneous display with the live video window displaying the live video; detecting that the catch-up video has finished displaying the stored disrupted content segment; and in response to detecting that the catch-up video has finished displaying the stored disrupted content segment, discontinuing the generating for display of the PIP catch-up window; analyzing the disrupted content segment being displayed in the catch-up video; searching a database of importance levels based on the disrupted content segment to determine an importance level of the disrupted content segment; and in response to determining that the importance level exceeds a first importance threshold, increasing the size of the PIP catch-up window and/or decreasing the catch-up playback speed of the catch-up video. ### Claim 2 (depends on 1) The method of claim 1, wherein the step of determining the disruption has occurred comprises detecting that a connection to the live video has disconnected and wherein the step of determining that the disruption has elapsed comprises detecting that the connection to the live video has reconnected. ### Claim 3 (depends on 1) The method of claim 1, wherein the determining of the period of disruption is initiated after a threshold period of time. ### Claim 4 (depends on 1) The method of claim 1, wherein the simultaneous display of the live video window comprises displaying a latest timeframe of the live video. ### Claim 5 (depends on 1) The method of claim 1, wherein the step of storing the disrupted content segment of the live video comprises populating a HashMap of URLs associated with the disrupted content segment. ### Claim 6 (depends on 5) The method of claim 5, further comprising a step of removing from the HashMap the associated URLs of the displayed disrupted content segment. ### Claim 7 (depends on 1) The method of claim 1, wherein the step of displaying the catch-up video comprises displaying an earliest disrupted content segment first when there is a plurality of disrupted content segments. ### Claim 8 (depends on 1) The method of claim 1, wherein the PIP catch-up window and the live window are of equal size generated side-by-side or wherein the PIP catch-up window is superimposed on top of the live window, the PIP catch-up window being smaller than the live window. ### Claim 9 (depends on 1) The method of claim 1, wherein the size and/or dimensions of the PIP catch-up window is adjustable automatically and/or manually. ### Claim 10 (depends on 1) The method of claim 1, wherein the step of generating the PIP catch-up window further comprises playing the catch-up video at a catch-up playback speed equal to or greater than a playing speed of the live video. ### Claim 11 (depends on 1) The method of claim 1, further comprising: searching for a mobile device associated with the user; and sending the catch-up video and/or a textual summary of the catch-up video to the mobile device. ### Claim 12 A system for generating a picture-in-picture (“PIP) catch-up window displaying a catch-up video with a live video window displaying a live video, the system comprising: memory and at least one processor to execute instructions to: determining that a disruption has occurred to the live video; in response to determining that the disruption has occurred to the live video, initiating determining a period of disruption from the occurrence of the disruption until it is determined that the disruption has elapsed; in response to determining that the period of disruption has elapsed, storing a disrupted content segment of the live video that a user missed during the period of disruption; generating, if not already generated, the PIP catch-up window displaying the catch-up video displaying the disrupted content segment for simultaneous display with the live video window displaying the live video; detecting that the catch-up video has finished displaying the stored disrupted content segment; and in response to detecting that the catch-up video has finished displaying the stored disrupted content segment, discontinuing the generating for display of the PIP catch-up window; analyzing the disrupted content segment being displayed in the catch-up video; searching a database of importance levels based on the disrupted content segment to determine an importance level of the disrupted content segment; and in response to determining that the importance level exceeds a first importance threshold increasing the size of the PIP catch-up window and/or decreasing the catch-up playback speed of the catch-up video. ### Claim 13 (depends on 12) The system of claim 12, wherein the determining the disruption has occurred comprises detecting that a connection to the live video has disconnected and wherein the step of determining that the disruption has elapsed comprises detecting that the connection to the live video has reconnected. ### Claim 14 (depends on 12) The system of claim 12, wherein the determining of the period of disruption is initiated after a threshold period of time. ### Claim 15 (depends on 12) The system of claim 12, wherein the simultaneous display of the live video window comprises displaying a latest timeframe of the live video. ### Claim 16 (depends on 12) The system of claim 12, wherein the step of storing the disrupted content segment of the live video comprises populating a HashMap of URLs associated with the disrupted content segment. ### Claim 17 (depends on 16) The system of claim 16, further comprising means for removing from the HashMap the associated URLs of the displayed disrupted content segment. ### Claim 18 (depends on 12) The system of claim 12, wherein the means for displaying the catch-up video comprises displaying an earliest disrupted content segment first when there is a plurality of disrupted content segments. ### Claim 19 (depends on 12) The system of claim 12, wherein the PIP catch-up window and the live window are of equal size generated side-by-side or wherein the PIP catch-up window is superimposed on top of the live window, the PIP catch-up window being smaller than the live window.