# US 9,066,061 B2 · Video information reproduction method and system, and video information content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,066,061 B2 - Document ID: US9066061B2 - Status: Granted - Kind: B2 - Application number: 13/498,243 - Filed: 2010-04-14 - Published: 2012-08-16 - Granted: 2015-06-23 - Earliest claimed: 2009-11-27 - Assignees: Mitsubishi Electric Corporation - Applicants: Tomoaki Ryu; Satoshi Minami - Inventors: Tomoaki Ryu; Satoshi Minami - Web page: https://patentgrep.com/patent/US9066061B2 ## CPC - H04N 9/8042: {involving data reduction} - G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)} - H04N 9/80: Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback - H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)} - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip} - H04N 21/6332: directed to client - H04N 21/8547: involving timestamps for synchronizing content - G09G 2340/02: Handling of images in compressed format, e.g. JPEG, MPEG - G09G 2370/10: Use of a protocol of communication by packets in interfaces along the display data pipeline - G11B 2020/10759: {content data} - G11B 2020/10805: {involving specific measures to prevent a buffer overflow} - G11B 2020/10814: {involving specific measures to prevent a buffer underrun} - H04N 9/8063: {using time division multiplex of the PCM audio and PCM video signals} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 21/2401: {Monitoring of the client buffer} - H04N 21/4302: {Content synchronisation processes, e.g. decoder synchronisation} - H04N 21/6405: Multicasting {(data broadcast and multicast in packet switching networks H04L12/18)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A plurality of I- or P-pictures for displaying video images with the same data as the last frame of the main data of the content are added as reproduction synchronization adjustment frames after the last frame of the main data; when reproduction leads a reference reproducing device, more synchronization adjustment frames are reproduced (ST11); when reproduction lags, fewer synchronization adjustment frames are reproduced (ST9). Reproduction can be synchronized among a plurality of reproducing devices (42) that read data from a storage medium and reproduce the data, or receive data by network delivery and reproduce the data, under conditions where system clock correction by use of PCR is impossible. ## Claims ### Claim 1 A video information reproduction method for receiving content formed by a sequence including at least intra-frame encoded image information and inter-frame forward prediction encoded image information, and including time stamp information, from a content server connected by a network or from storage media, at a plurality of video information reproducing devices and decoding and reproducing the content at the video information reproducing devices, the video information reproduction method comprising: selecting a video information reproducing device from among the plurality of video information reproducing devices as a reproduction time reference and detecting a reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device; and for at least one of the video information reproducing devices, adjusting a number of frames to be reproduced such that: when a detected reproduction time difference indicates that the reproduction of content by a corresponding video information reproducing device is lagging the reference video information reproducing device, decreasing a number of frames of encoded content to be reproduced relative to a number of frames to be reproduced by the reference video information reproducing device according to the lag time, and when the detected reproduction time difference indicates that the reproduction of content by the corresponding video information reproducing device is leading the reference video information reproducing device, increasing the number of frames of encoded content to be reproduced relative to the number of frames to be reproduced by the reference video information reproducing device according to the lead time, wherein a prescribed number of frames of duplicative or dummy image information are inserted in a predetermined location of the sequence to be distributed or read from the storage media, wherein the reference video information reproducing device is configured to reproduce a certain number of the frames of duplicative or dummy image information from reproduction, the certain number being less than the prescribed number, and wherein, for the at least one video information reproducing device, the number of frames of encoded content to be reproduced is increased or decreased relative to the number of frames to be reproduced by the reference video information reproducing device by causing the at least one video information reproducing device to reproduce a smaller or larger number of the frames of duplicative or dummy image information than the certain number. ### Claim 2 (depends on 1) The video information reproduction method of claim 1 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with a reproduction time closest to an average value to be the reference. ### Claim 3 (depends on 1) The video information reproduction method of claim 1 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with the most delayed reproduction time to be the reference. ### Claim 4 (depends on 1) The video information reproduction method of claim 1 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with the most advanced reproduction time to be the reference. ### Claim 5 (depends on 1) The video information reproduction method of claim 1, further comprising: deciding whether the detected reproduction time difference is within a range synchronizable by the adjustment; when the difference is decided not to be within the synchronizable range, suspending reproduction of the content currently being reproduced and discarding the data of the content stored in a buffer memory; in the video information reproducing device in which the reproduction is suspended, beginning when the next content is received, storing the data of the content in the buffer memory; and when the video information reproducing device in which the reproduction is suspended is notified by the content server of a timing at which the reference video information reproducing device has started reproduction of the next content, starting reproduction of the next content on reception of such notification. ### Claim 6 (depends on 1) The video information reproduction method of claim 1, wherein the intra-frame encoded image information and inter-frame forward encoded image information are MPEG-2 or H.264 encoded information. ### Claim 7 A video information reproduction system for synchronizing the decoding and reproduction of content formed by a sequence including at least intra-frame encoded image information and inter-frame forward prediction encoded image information, and including time stamp information, received via a network or read from storage media by a plurality of video information reproducing devices, the video information reproduction system comprising: a content server connected to the plurality of video information reproducing devices via the network, the content server comprising a processor programmed to select a video information reproducing device from among the plurality of video information reproducing devices as a reproduction time reference and detect a reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device; and a processor for at least one of the video information reproducing devices programmed to, upon receiving notification from the content server of the detected reproduction time difference of the corresponding video information reproducing device adjust a number of frames to be reproduced by the corresponding video information reproducing device such that: when the notified reproduction time difference indicates that the reproduction of content by the corresponding video information reproducing device is lagging the reference video information reproducing device, decrease a number of frames of encoded content to be reproduced relative to a number of frames to be reproduced by the reference video information reproducing device according to the lag time, and when the notified reproduction time difference indicates that the reproduction of content by the corresponding video information reproducing device is leading the reference video information reproducing device, increase a number of frames of encoded content to be reproduced relative to the number of frames to be reproduced by the reference video information reproducing device according to the lead time, wherein a prescribed number of frames of duplicative or dummy image information are inserted in a predetermined location of the sequence to be distributed or read from the storage media, wherein the reference video information reproducing device is configured to reproduce a certain number of the frames of duplicative or dummy image information from reproduction, the certain number being less than the prescribed number, and wherein the processor for the at least one video information reproducing device increases or decreases the number of frames of encoded content to be reproduced relative to the number of frames to be reproduced by the reference video information reproducing device by causing the at least one video information reproducing device to reproduce a larger number or a smaller number of the frames of duplicative or dummy image information than the certain number. ### Claim 8 (depends on 7) The video information reproduction system of claim 7 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with a reproduction time closest to an average value to be the reference. ### Claim 9 (depends on 7) The video information reproduction system of claim 7 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with the most delayed reproduction time to be the reference. ### Claim 10 (depends on 7) The video information reproduction system of claim 7 wherein, in detecting the reproduction time difference between each of the video information reproducing devices and the reference video information reproducing device, the content server collates reproduction times reported from each of the video information reproducing devices and selects a video information reproducing device with the most advanced reproduction time to be the reference. ### Claim 11 (depends on 7) The video information reproduction system of claim 7, wherein a decision is made by the system as to whether the detected reproduction time difference for a particular video information reproducing device is within a range synchronizable by the adjustment of the number of frames to be reproduced, and wherein a processor for the particular video information reproducing device is further programmed to: when the difference is decided not to be within the synchronizable range, suspend reproduction of the content currently being reproduced and discard the data of the content stored in a buffer memory; store the data of the next content in the buffer memory, beginning when the next content is received, in the particular video information reproducing device in which the reproduction is suspended; and when notified by the content server of a timing at which the reference video information reproducing device has started reproduction of the next content, start reproduction of the next content on reception of such notification. ### Claim 12 (depends on 7) The video information reproduction system of claim 7, wherein the intra-frame encoded image information and inter-frame forward encoded image information are MPEG-2 or H.264 encoded information.