# US 10,771,863 B2 · Automated media publishing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,771,863 B2 - Document ID: US10771863B2 - Status: Granted - Kind: B2 - Application number: 16/041,970 - Filed: 2018-07-23 - Published: 2020-01-02 - Granted: 2020-09-08 - Earliest claimed: 2018-07-02 - Assignees: Avid Technology, Inc. - Applicants: Avid Technology, Inc. - Inventors: Shailendra Mathur - Web page: https://patentgrep.com/patent/US10771863B2 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - H04N 21/854: Content authoring - G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) - G06F 40/117: Tagging; Marking up (details of markup languages G06F40/143); Designating a block; Setting of attributes (style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154) - G06Q 10/103: {Workflow collaboration or project management} - H04N 21/845: Structuring of content, e.g. decomposing content into time segments - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract The described methods, systems, and computer program products enable media composition editors to tag compositional objects with editorial rendition rules that specify how rendering decisions are to be made and how source media assets are to be selected and processed to generate an output rendering of a media composition that adheres to the editor's rendition-related choices. The editorially-specified rendition rules include spatial-type rules, temporal-type rules, and color-type rules, and generally pertain to the spatial, temporal, and color ranges and resolutions to be included within a rendition. When a rendition of a media composition is to be generated, a rendition engine interprets and applies the editorial rendition rules to generate and output the rendition in accordance with rendition parameters supplied to the rendition engine by a rendition profile, and, in some cases, by the media composition and the source media assets. ## Claims ### Claim 1 A method of generating a rendition of a media composition, the method comprising: receiving the media composition, wherein: the media composition includes a compositional object that references a source media asset; the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter; receiving a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and generating from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter. ### Claim 2 (depends on 1) The method of claim 1, wherein the media composition has a plurality of versions, and the rendition profile further specifies a version of the plurality of versions of the media composition that is to be used to generate the rendition of the composition. ### Claim 3 (depends on 1) The method of claim 1, wherein the editorial rendition rule is a spatial editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a spatial rendition parameter. ### Claim 4 (depends on 3) The method of claim 3, wherein the spatial rendition parameter is a framing box that defines a portion of a video frame of the compositional object of the media composition, and wherein a first portion of the source media asset of the composition that lies within the framing box is prioritized for inclusion within the rendition. ### Claim 5 (depends on 4) The method of claim 4, wherein an aspect ratio of a target display for the rendition is larger than an aspect ratio of the framing box, and wherein a second portion of the source media asset of the composition outside the framing box is also prioritized for inclusion within the rendition, wherein the second portion of the source media asset of the media composition includes media essence data. ### Claim 6 (depends on 1) The method of claim 1, wherein the editorial rendition rule is a temporal editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a temporal rendition parameter. ### Claim 7 (depends on 6) The method of claim 6, wherein the temporal rendition parameter includes a temporal framing range that defines a temporal range within the source media asset of the composition, and wherein a temporal portion of the source media asset of the media composition that lies within the temporal framing range is prioritized for inclusion within the rendition. ### Claim 8 (depends on 1) The method of claim 1, wherein the editorial rendition rule is a dynamic range editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a dynamic range rendition parameter. ### Claim 9 (depends on 8) The method of claim 8, wherein the source media asset of the composition is a video asset, and the dynamic range rendition parameter is a legal dynamic range that defines a range of pixel brightness values within the source media asset of the composition, and wherein pixels of the source media asset of the composition having brightness values that lie within the legal range are prioritized for inclusion within the rendition. ### Claim 10 (depends on 8) The method of claim 8, wherein the source media asset of the composition is an audio asset, and the dynamic range rendition parameter is a legal dynamic range that defines a range of audio sample intensity values within the source media asset of the composition, and wherein audio samples of the source media asset of the composition having intensity values that lie within the legal range are prioritized for inclusion within the rendition. ### Claim 11 (depends on 1) The method of claim 1, wherein the editorial rendition rule is a color editorial rendition rule and the media essence encoding parameter specified by the rendition profile is a color gamut rendition parameter. ### Claim 12 (depends on 11) The method of claim 11, wherein: the source media asset of the composition is one of a graphics asset and a video asset; the color gamut rendition parameter includes a legal color range that defines a multi-dimensional region within a multi-dimensional color space; and pixels of the source media asset of the composition having color values that lie within the legal color range are prioritized for inclusion within the rendition. ### Claim 13 (depends on 1) The method of claim 1, wherein: the editorial rendition rule is a spatial editorial rendition rule for layout of title text on a frame of the rendition; the media essence encoding parameter is a spatial framing box; the source media asset of the composition is a text titling effect; and text of the text titling effect is rendered within the framing box on the frame of the rendition. ### Claim 14 (depends on 1) The method of claim 1, wherein: the editorial rendition rule is a compositing editorial rendition rule; the media essence encoding parameter is a spatial framing box; the source media asset of the composition is a compositing effect; and a frame of the rendition with a composited image within the framing box is rendered. ### Claim 15 (depends on 1) The method of claim 1, wherein the generating step includes interpreting the editorial rendition rule using generic logic for executing rules. ### Claim 16 (depends on 1) The method of claim 1, wherein the generating step includes executing logic that is learned using deep learning methods from captured editorial rendition decisions of a cohort of editors working with a range of media content, source media types, and rendition requirements. ### Claim 17 A computer program product comprising: non-transitory computer-readable storage with computer program instructions stored thereon, wherein the computer program instructions, when processed by a computing system, instruct the computing system to perform a method of generating a rendition of a media composition, the method comprising: receiving the media composition, wherein: the media composition includes a compositional object that references a source media asset; the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter; receiving a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and generating from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter. ### Claim 18 (depends on 17) The computer program product of claim 17, wherein the computing system is remote from a location from which the media composition is received. ### Claim 19 (depends on 17) The computer program product of claim 17, wherein the computing system is implemented in the cloud. ### Claim 20 A media composition rendition engine comprising: a memory for storing computer-readable instructions; and a processor connected to the memory, wherein the processor, when executing the computer-readable instructions, causes the media composition rendition engine to: receive the media composition, wherein: the media composition includes a compositional object that references a source media asset; the compositional object is associated with an editorial rendition rule specified by an editor of the media composition using a media composition application; and the editorial rendition rule specifies how the compositional object is to be rendered for each value of a plurality of values of an essence encoding parameter; receive a rendition profile that specifies a given value of a media essence encoding parameter for the rendition of the media composition; and generate from the source media asset the rendition of the compositional object of the media composition in accordance with the editorial rendition rule as it applies to the compositional object for the given value of the media essence encoding parameter. ### Claim 21 (depends on 20) The media composition rendition engine of claim 20, wherein the media composition rendition engine is located remotely from a location from which the media composition is received. ### Claim 22 (depends on 20) The media composition rendition engine of claim 20, wherein the media composition rendition engine is implemented in the cloud.