# US 10,455,286 B2 · Protected media decoding system supporting metadata > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,455,286 B2 - Document ID: US10455286B2 - Status: Granted - Kind: B2 - Application number: 16/296,924 - Filed: 2019-03-08 - Published: 2019-07-04 - Granted: 2019-10-22 - Earliest claimed: 2014-12-23 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Yongjun Wu; Balachandar Sivakumar; Shyam Sadhwani - Web page: https://patentgrep.com/patent/US10455286B2 ## CPC - H04N 21/4627: Rights management {associated to the content (security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08)} - G06F 21/10: Protecting distributed programs or content, e.g. vending or licensing of copyrighted material (protection in video systems or pay television H04N7/16) {; Digital rights management [DRM]} - H04N 21/4353: {involving decryption of additional data (arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23)} - H04N 21/43853: {involving multiplex stream decryption (arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23)} - H04N 21/4408: involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Video content is protected using a digital rights management (DRM) mechanism, the video content having been previously encrypted and compressed for distribution, and also including metadata such as closed captioning data, which might be encrypted or clear. The video content is obtained by a system of a computing device, the metadata is extracted from the video content and provided to a video decoder, and the video content is provided to a secure DRM component. The secure DRM component decrypts the video content and provides the decrypted video content to a secure decoder component of a video decoder. As part of the decryption, the secure DRM component drops the metadata that was included in the obtained video content. However, the video decoder receives the extracted metadata in a non-protected environment and thus is able to provide the extracted metadata and the decoded video content to a content playback application. ## Claims ### Claim 1 A method implemented in a computing device, the method comprising: obtaining video content from a media source, the video content including metadata as well as protected video content; extracting the metadata from the video content to obtain extracted metadata, the extracting the metadata including removing the metadata from the video content; providing the extracted metadata to a video decoder without providing the video content to the video decoder for processing by the video decoder; providing the video content with the metadata removed from the extracting to a secure digital rights management component; receiving, from the secure digital rights management component, a re-encrypted version of the video content, the re-encrypted version of the video content comprising a version of the video content from which the protected video content has been decrypted and re-encrypted based on a key of the computing device; providing the re-encrypted version of the video content to the video decoder for decoding of the re-encrypted version of the video content to yield decoded video content rather than decoding of the video content including metadata; and providing the extracted metadata and the decoded video content to an application for playback. ### Claim 2 (depends on 1) The method of claim 1, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder only if the metadata is clear data. ### Claim 3 (depends on 1) The method of claim 1, the metadata comprising closed captioning data. ### Claim 4 (depends on 1) The method of claim 1, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder from a media source component that obtains the video content. ### Claim 5 (depends on 1) The method of claim 1, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder from a digital rights management decryptor component that provides the video content to the secure digital rights management component. ### Claim 6 (depends on 1) The method of claim 1, the providing the video content with the metadata removed from the extracting to the secure digital rights management component comprising: providing, by a digital rights management decryptor component, the video content with the metadata removed from the extracting to the secure digital rights management component, the digital rights management decryptor component being implemented in an unsecure layer of the computing device and the secure digital rights management component being implemented in a secure layer of the computing device, components in the secure layer having access to a key to decrypt the protected video content, and components in the unsecure layer having no access to the key to decrypt the protected video content. ### Claim 7 A method implemented in a computing device, the method comprising: obtaining video content from a media source, the video content including metadata as well as protected video content; extracting the metadata from the video content to obtain extracted metadata, the extracting the metadata including removing the metadata from the video content; providing the extracted metadata to a video decoder without providing the video content to the video decoder for processing by the video decoder; providing the video content with the metadata removed from the extracting to a secure digital rights management component, the secure digital rights management component decrypting the protected video content and providing decrypted video content to a secure decoder component for decoding of the decrypted video content to yield decoded video content rather than decoding of the video content including metadata; and providing the extracted metadata and the decoded video content to an application for playback. ### Claim 8 (depends on 7) The method of claim 7, the secure digital rights management component and the secure decoder component being implemented as part of a secure layer of the computing device, only components in the secure layer having access to one or more keys to decrypt the protected video content, the providing the video content with the metadata removed from the extracting to the secure digital rights management component comprising storing the decrypted video content in memory of the computing device that is accessible only to the components in the secure layer. ### Claim 9 (depends on 7) The method of claim 7, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder only if the metadata is clear data. ### Claim 10 (depends on 7) The method of claim 7, the metadata comprising closed captioning data. ### Claim 11 (depends on 7) The method of claim 7, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder from a media source component that obtains the video content. ### Claim 12 (depends on 7) The method of claim 7, the providing the extracted metadata to the video decoder comprising providing the extracted metadata to the video decoder from a digital rights management decryptor component that provides the video content with the metadata removed from the extracting to the secure digital rights management component. ### Claim 13 A computing device comprising: a media source component configured to obtain video content from a media source, the video content including metadata as well as protected video content; an extraction component configured to extract the metadata from the video content to obtain extracted metadata, extracting the metadata including removing the metadata from the video content, and provide the extracted metadata to a video decoder without providing the video content to the video decoder for processing by the video decoder; a secure digital rights management component configured to receive the video content with the metadata removed from the extracting and provide the protected video content to the video decoder for decoding of the protected video content to yield decoded video content rather than decoding of the video content including metadata; and a video decoder component configured to provide the extracted metadata and the decoded video content to an application for playback. ### Claim 14 (depends on 13) The computing device of claim 13, the secure digital rights management component being further configured to: decrypt the protected video content to obtain decrypted video content; and provide, to the video decoder as the protected video content, the decrypted video content. ### Claim 15 (depends on 13) The computing device of claim 13, the secure digital rights management component being further configured to provide, to the video decoder as the protected video content, the protected video content in the video content as well as one or more keys, and the video decoder component being further configured to decrypt the protected video content. ### Claim 16 (depends on 13) The computing device of claim 13, the extraction component and the media source component comprising the same component. ### Claim 17 (depends on 13) The computing device of claim 13, the extraction component comprising a digital rights management decryptor component that is further configured to receive the video content from the media source component and provide the video content with the metadata removed from the extracting to the secure digital rights management component. ### Claim 18 (depends on 13) The computing device of claim 13, the secure digital rights management component being further configured to decrypt the protected video content to obtain decrypted video content and re-encrypt the decrypted video content based on a key of the computing device prior to providing the decrypted video content to the video decoder. ### Claim 19 (depends on 13) The computing device of claim 13, the secure digital rights management component being implemented in a secure layer, the extraction component being implemented in an unsecure layer, and only components in the secure layer having access to one or more keys to decrypt the protected video content. ### Claim 20 (depends on 19) The computing device of claim 19, the secure digital rights management component being implemented at least partially in hardware.