Back to results
US 11,917,323 B2Granted
System and method for modifying media streams using metadata
AssigneeTiVo Inc.
InventorTodd Stiers
Life of this patent
Estimating the term…
Abstract
Real-time metadata tracks recorded to media streams allow search and analysis operations in a variety of contexts. Search queries can be performed using information in real-time metadata tracks such as closed captioning, sub-title, statistical tracks, miscellaneous data tracks. Media streams can also be augmented with additional tracks. The metadata tracks not only allow efficient searching and indexing, but also allow insertion of content specific advertising during appropriate portions of a media stream based on the content of the metadata tracks.
Claims21
A method comprising:
- selecting, a content server among a plurality of content servers;
- establishing a media streaming session between the content server and a mobile device;
- obtaining, after establishing the media streaming session, one or more of a temperature or battery condition of the mobile device from the mobile device by the content server;
- streaming a media stream from the content server to the mobile device using RTP (Real Time Transport Protocol), the media stream including a video track, an audio track, and a metadata track;
- analyzing metadata content in the metadata track of the media stream;
- analyzing the one or more of the temperature or battery condition of the mobile device;
- indexing metadata content in the metadata track to allow for later retrieval of the metadata content and corresponding video content in the video track, wherein the indexing is performed via entering the metadata content and the one or more of the temperature or battery condition of the mobile device into a search engine;
- selecting targeted advertising for the media stream based on the metadata content and the one or more of the temperature or battery condition of the mobile device, wherein the advertising is maintained in a database;
- modifying, by the content server, the media stream using the one or more of the temperature or battery condition of the mobile device to include selected advertising, wherein modifying includes:
- maintaining a current sequence number for the media stream,
- removing RTP packets with sequence numbers subsequent to the current sequence number from the media stream,
- inserting new RTP packets with modified sequence numbers subsequent to the current sequence number, the new RTP packets corresponding to the selected advertising being inserted into the media stream, and
- updating sequence numbers of original RTP packets of the media stream that are transmitted to the mobile device after transmitting the inserted new RTP packets, the updated sequence numbers of the original RTP packets being subsequent to the modified sequence numbers of the new RTP packets;
- and
- transmitting the modified media stream to the mobile device.
12 more elements
A system comprising:
- a database configured to maintain advertising;
- a content server connected to the database, the content server configured to:
- establish a media streaming session between the content server and a mobile device;
- obtain, after establishing the media streaming session, one or more of a temperature or battery condition of the mobile device from the mobile device;
- stream a media stream to the mobile device using RTP (Real Time Transport Protocol), the media stream including a video track, an audio track, and a metadata track;
- analyze metadata content in the metadata track of the media stream;
- analyze the one or more of the temperature or battery condition of the mobile device;
- index metadata content in the metadata track to allow for later retrieval of the metadata content and corresponding video content in the video track, wherein the indexing is performed via entering the metadata content and the one or more of the temperature or battery condition of the mobile device into a search engine;
- select targeted advertising for the media stream based on the metadata content and the one or more of the temperature or battery condition of the mobile device, wherein the advertising is maintained in the database;
- modify the media stream using the one or more of the temperature or battery condition of the mobile device to include selected advertising, wherein modifying includes:
- maintaining a current sequence number for the media stream,
- removing RTP packets with sequence numbers subsequent to the current sequence number from the media stream,
- inserting new RTP packets with modified sequence numbers subsequent to the current sequence number, the new RTP packets corresponding to the selected advertising being inserted into the media stream, and
- updating sequence numbers of original RTP packets of the media stream that are transmitted to the mobile device after transmitting the inserted new RTP packets, the updated sequence numbers of the original RTP packets being subsequent to the modified sequence numbers of the new RTP packets;
- and
- transmit the modified media stream to the mobile device.
13 more elements
A non-transitory computer readable medium comprising instructions to execute a method, the method comprising:
- selecting a content server among a plurality of content servers;
- establishing a media streaming session between the content server and a mobile device;
- obtaining, after establishing the media streaming session, one or more of a temperature or battery condition of the mobile device from the mobile device by the content server;
- streaming a media stream from the content server to the mobile device using RTP (Real Time Transport Protocol), the media stream including a video track, an audio track, and a metadata track;
- analyzing metadata content in the metadata track of the media stream;
- analyzing the one or more of the temperature or battery condition of the mobile device;
- indexing metadata content in the metadata track to allow for later retrieval of the metadata content and corresponding video content in the video track, wherein the indexing is performed via entering the metadata content and the one or more of the temperature or battery condition of the mobile device into a search engine;
- selecting targeted advertising for the media stream based on the metadata content and the one or more of the temperature or battery condition of the mobile device, wherein the advertising is maintained in a database;
- modifying, by the content server, the media stream using the one or more of the temperature or battery condition of the mobile device to include selected advertising, wherein modifying includes:
- maintaining a current sequence number for the media stream,
- removing RTP packets with sequence numbers subsequent to the current sequence number from the media stream,
- inserting new RTP packets with modified sequence numbers subsequent to the current sequence number, the new RTP packets corresponding to the selected advertising being inserted into the media stream, and
- updating sequence numbers of original RTP packets of the media stream that are transmitted to the mobile device after transmitting the inserted new RTP packets, the updated sequence numbers of the original RTP packets being subsequent to the modified sequence numbers of the new RTP packets;
- and
- transmitting the modified media stream to the mobile device.
12 more elements
Dependencies are inferred from the claim text.