# US 2019/0172492 A1 · In-band data recognition and synchronization system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172492 A1
- Document ID: US20190172492A1
- Status: Published application
- Kind: A1
- Application number: 16/188,494
- Filed: 2018-11-13
- Published: 2019-06-06
- Earliest claimed: 2006-06-22
- Assignees: TiVo Solutions Inc.
- Applicants: TiVo Solutions Inc.
- Inventors: Kevin P. Smith; Paul Stevens; Adam Feder; James Barton
- Web page: https://patentgrep.com/patent/US20190172492A1

## CPC

- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04H 20/31: using in-band signals, e.g. subsonic or cue signal
- H04H 60/73: using meta-information
- H04N 5/76: Television signal recording
- H04N 21/2353: {specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata}
- H04N 21/236: Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/4135: {external recorder (interface circuits between an apparatus for recording television signals and a television receiver H04N5/775)}
- H04N 21/4147: PVR [Personal Video Recorder] (H04N5/76 takes precedence {; arrangements for broadcast with accumulation-type receivers H04H20/40})
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/4314: {for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid}
- H04N 21/434: Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream {(demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)}
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/458: Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules {; time-related management operations (arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10)}
- H04N 21/47214: {for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market (stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224)}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04H 60/13: Arrangements for device control affected by the broadcast information
- H04H 60/27: Arrangements for recording or accumulating broadcast information or broadcast-related information
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 5/85: on discs or drums
- H04N 5/907: using static stores, e.g. storage tubes or semiconductor memories (H04N5/91 takes precedence)
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)

## Abstract

A method and apparatus for recognizing and synchronizing to in-band data at a multimedia device is provided. A content stream includes in-band data. The in-band data is processed and in-band data pattern data associated with the content stream are created. Metadata are attached to the event identification data. The event identification data are provided to multimedia devices which receive broadcasted multimedia content streams containing video programs with in-band data. The in-band data are processed and compared to the event identification data. If a match occurs, the multimedia device uses the metadata to perform specified actions.

## Claims

### Claim at position 1

1-30. (canceled)

### Claim 31

A method comprising:
receiving first event identification data and instructions for performing one or more actions;
receiving closed-caption data associated with a content stream, wherein the closed -caption data is displayed in one of a plurality of closed-caption modes;
determining the closed-caption mode of the plurality of closed-caption modes in which the closed-caption data is displayed;
computing, based on the closed-caption data and the determined closed-caption mode, second event identification data;
determining whether the received first event identification data matches the computed second event identification data; and
in response to determining that the received first event identification data matches the computed second event identification data, performing the one or more actions, wherein the one or more actions include at least skipping over a segment of the multimedia content stream.

### Claim 32 (depends on 31)

The method of claim 31, wherein the segment corresponds to one or more commercials.

### Claim 33 (depends on 31)

The method of claim 31, further comprising inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions.

### Claim 34 (depends on 31)

The method of claim 31, further comprising:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the content stream, storing the content stream for later playback.

### Claim 35 (depends on 31)

The method of claim 31, further comprising:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the content stream:
sending the content stream to a second device;
playing, by the second device, the multimedia content stream;
processing, by the second device, the one or more in-band tags during playback; and
responsive to processing the one or more in-band tags during playback, the second device performing the one or more actions.

### Claim 36 (depends on 31)

The method of claim 31, further comprising:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions
subsequent to inserting the one or more in-band tags into the content stream, removing the closed-caption data from the content stream.

### Claim 37 (depends on 33)

The method of claim 33, wherein inserting the one or more in-band tags comprises inserting one or more data objects representing one or more in-band tags into the content stream corresponding to the location in the content stream.

### Claim 38 (depends on 31)

The method of claim 31, wherein the first event identification data comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.

### Claim 39

One or more non-transitory computer readable media storing instructions, which when executed by a processor, perform:
receiving first event identification data and instructions for performing one or more actions;
receiving closed-caption data associated with a content stream, wherein the closed -caption data is displayed in one of a plurality of closed-caption modes;
determining the closed-caption mode of the plurality of closed-caption modes in which the closed-caption data is displayed;
computing, based on the closed-caption data and the determined closed-caption mode, second event identification data;
determining whether the received first event identification data matches the computed second event identification data; and
in response to determining that the received first event identification data matches the computed second event identification data, performing the one or more actions, wherein the one or more actions include at least skipping over a segment of the multimedia content stream.

### Claim 40 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the segment corresponds to one or more commercials.

### Claim 41 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the instructions, when executed by the processor, further perform inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions.

### Claim 42 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the multimedia content stream and comprising command and control information for performing the one or more actions; and
subsequent to inserting the one or more in-band tags into the content stream, storing the content stream for later playback.

### Claim 43 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the content stream:
sending the content stream to a second device;
playing, by the second device, the content stream;
processing, by the second device, the one or more in-band tags during playback; and
responsive to processing the one or more in-band tags during playback, the second device performing the one or more actions.

### Claim 44 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the instructions, when executed by the processor, further perform:
inserting one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions; and
subsequent to inserting the one or more in-band tags into the content stream, removing the closed-caption data from the content stream.

### Claim 45 (depends on 41)

The one or more non-transitory computer readable media of claim 41, wherein inserting one or more in-band tags comprises inserting one or more data objects representing the one or more in-band tags into the content stream corresponding to the location in the multimedia content stream.

### Claim 46 (depends on 39)

The one or more non-transitory computer readable media of claim 39, wherein the event identification data comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.

### Claim 47

An apparatus, comprising:
control circuitry configured to:
receive first event identification data and instructions for performing one or more actions;
receive closed-caption data associated with a content stream, wherein the closed -caption data is displayed in one of a plurality of closed-caption modes;
determine the closed-caption mode of the plurality of closed-caption modes in which the closed-caption data is displayed;
compute, based on the closed-caption data and the determined closed-caption mode, second event identification data;
determine whether the received first event identification data matches the computed second event identification data; and
in response to determining that the received first event identification data matches the computed second event identification data, perform the one or more actions, wherein the one or more actions include at least skipping over a segment of the multimedia content stream.

### Claim 48 (depends on 47)

The apparatus of claim 47, wherein the segment corresponds to one or more commercials.

### Claim 49 (depends on 47)

The apparatus of claim 47, wherein the control circuitry is further configured to:
insert one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions.

### Claim 50 (depends on 47)

The apparatus of claim 47, wherein the control circuitry is further configured to:
insert one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions; and
subsequent to inserting the one or more in-band tags into the content stream, store the content stream for later playback.

### Claim 51 (depends on 47)

The apparatus of claim 47, wherein the control circuitry is further configured to:
insert one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions;
subsequent to inserting the one or more in-band tags into the content stream, send the content stream to a second device;
play, by the second device, the content stream;
process, by the second device, the one or more in-band tags during playback; and
responsive to processing the one or more in-band tags during playback, perform the one or more actions.

### Claim 52 (depends on 47)

The apparatus of claim 47, wherein the control circuitry is further configured to:
insert one or more in-band tags into the content stream, the one or more in-band tags corresponding to a location in the content stream and comprising command and control information for performing the one or more actions; and
subsequent to inserting the one or more in-band tags into the content stream, remove the closed-caption data from the content stream.

### Claim 53 (depends on 49)

The apparatus of claim 49, wherein the control circuitry, when inserting one or more in-band tags, is configured to:
insert one or more data objects representing the one or more in-band tags into the content stream corresponding to the location in the multimedia content stream.

### Claim 54

The apparatus of 47, wherein the event identification comprises:
a first hash value associated with a first time offset; and
a second hash value associated with a second time offset.
