# US 9,870,128 B1 · Rule-based presentation of related content items > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,870,128 B1 - Document ID: US9870128B1 - Status: Granted - Kind: B1 - Application number: 13/770,983 - Filed: 2013-02-19 - Granted: 2018-01-16 - Earliest claimed: 2013-02-19 - Assignees: Audible, Inc. - Applicants: Audible, Inc. - Inventors: Guy Ashley Story, Jr.; Ajay Arora; Douglas Scott Goldstein; Douglas Cho Hwang - Web page: https://patentgrep.com/patent/US9870128B1 ## CPC - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 16/9574: {of access to content, e.g. by caching} - G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Features are disclosed for presenting multiple content items based on one or more rules defining how the multiple content items are to be presented. One content item may be a primary content item, and any number of additional content items may be related to or supplement the primary content item in some way. Rules may define which related content items may be presented and, in the case of multimedia content (e.g., content with both audio and video elements), which elements of the primary content may be overridden by or mixed with related content, and which may not. References to related content may be embedded in the primary content item, or references may be accessed at a content management system or service. ## Claims ### Claim 1 A system for combining related content, the system comprising: a data store configured to store computer-executable instructions and presentation rules; a computing device having at least one processor and in communication with the data store, the computing device, when executing the computer-executable instructions, configured to: receive a first request for presentation of combined content, wherein the first request identifies an audio content item to include in the combined content as a primary content item; obtain a complete textual version of the audio content item; determine, from the complete textual version of the audio content item, an attribute of the audio content item; determine, based at least in part on a first presentation rule, that a visual content item is associated with the attribute of the audio content item; determine a first presentation configuration for the audio content item and the visual content item, the first presentation configuration specifying a presentation for the visual content item relative to the audio content item in accordance with a second presentation rule that changes a presentation aspect of the visual content item; cause presentation of the audio content item and the visual content item as the combined content according to the first presentation configuration; receive a second request to designate the visual content item as the primary content item; determine a second presentation configuration for the visual content item and at least one secondary content item, wherein the at least one secondary content item relates to the visual content item, and wherein the second presentation configuration differs from the first presentation configuration; and update the presentation of the combined content according to the second presentation configuration. ### Claim 2 (depends on 1) The system of claim 1, wherein the audio content item comprises audio narration of text from at least one of a book, a newspaper, a magazine, and a web page. ### Claim 3 (depends on 2) The system of claim 2, wherein the visual content item comprises an image from at least one of the book, the newspaper, the magazine, and the web page. ### Claim 4 (depends on 2) The system of claim 2, wherein the complete textual version of the audio content item comprises the text from at least one of the book, the newspaper, the magazine, and the web page. ### Claim 5 (depends on 1) The system of claim 1, wherein the visual content item comprises a video from a publicly accessible repository of videos. ### Claim 6 (depends on 1) The system of claim 1, wherein the audio content item comprises an unscripted audio recording, and the complete textual version of the audio content item comprises a transcript of the recording generated by at least one of manual transcription and automated voice recognition. ### Claim 7 (depends on 1) The system of claim 1, wherein to determine the attribute of the audio content item from the complete textual version of the audio content item, the computing device, when executing the computer-executable instructions, is configured to: identify a word in the complete textual version of the audio content item; determine that the word corresponds to a person, place, thing, event, genre, mood, location, historical setting, language, or period of time; and identify the person, place, thing, event, genre, mood, location, historical setting, language, or period of time as the attribute of the audio content item. ### Claim 8 (depends on 1) The system of claim 1, wherein the primary content item comprises a content item that is presented in a default presentation configuration, and wherein the second presentation configuration overrides presentation of at least a portion of the primary content item. ### Claim 9 A computer-implemented method for combining related content, the computer-implemented method comprising: under control of one or more computing devices configured with specific computer-executable instructions, receiving a first request for presentation of combined content, wherein the first request identifies a first content item to include in the combined content as a primary content item; obtaining a complete textual version of the first content item; determining, from the complete textual version of the first content item, an attribute of the first content item; determining, based at least in part on a first presentation rule, that a related content item is associated with the attribute of the first content item; determining a first presentation configuration for a portion of the first content item and a portion of the related content item according to a second presentation rule that changes a presentation aspect of at least one of the portion of the first content item and the portion of the related content item; causing presentation of the portion of the first content item and the portion of the related content item as the combined content according to the first presentation configuration; receiving a second request to designate the related content item as the primary content item; determining a second presentation configuration for the related content item and at least one additional content item, wherein the at least one additional content item relates to the related content item, and wherein the second presentation configuration differs from the first presentation configuration; and updating the presentation of the combined content according to the second presentation configuration. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein at least one of the first content item and the related content item are part of a larger content item. ### Claim 11 (depends on 9) The computer-implemented method of claim 9, wherein the attribute comprises at least one of a genre of the first content item, a mood of the primary first content item, a location of the first content item, a historical setting of the first content item, a time of day of the first content item, a language of the first content item, a person associated with the first content item, a place associated with the first content item, an object associated with the first content item, an event associated with the first content item, and a time associated with the first content item. ### Claim 12 (depends on 9) The computer-implemented method of claim 9, wherein at least one of the first presentation rule and the second presentation rule is user-definable. ### Claim 13 (depends on 9) The computer-implemented method of claim 9, wherein at least one of the first presentation rule and the second presentation rule is received from a network-accessible server. ### Claim 14 (depends on 9) The computer-implemented method of claim 9, wherein the first presentation configuration specifies a presentation for at least one of the portion of the first content item and the portion of the related content item. ### Claim 15 (depends on 9) The computer-implemented method of claim 9, wherein the first presentation configuration specifies at least one of: one or more spatial dimensions for a visual element of at least one of the portion of the first content item and the portion of the related content item; a position for a visual element of at least one of the portion of the first content item and the portion of the related content item; and a volume level for an audio element of at least one of the portion of the first content item and the portion of the related content item. ### Claim 16 (depends on 9) The computer-implemented method of claim 9, wherein the first presentation configuration specifies at least one of: a change in volume level over time for an audio element of at least one of the portion of the first content item and the portion of the related content item; a change in one or more spatial dimensions over time for a visual element of at least one of the portion of the first content item and the portion of the related content item; and a change in position over time for a visual element of at least one of the portion of the first content item and the portion of the related content item. ### Claim 17 (depends on 9) The computer-implemented method of claim 9, wherein causing presentation according to the first presentation configuration requires combining at least one of an audio element and a visual element of the portion of the first content item with at least one of an audio element and a visual element of the portion of the related content item. ### Claim 18 (depends on 9) The computer-implemented method of claim 9, wherein the primary content item comprises a content item that is presented in a default presentation configuration, and wherein the first presentation configuration overrides presentation of at least a portion of the primary content item. ### Claim 19 A non-transitory computer readable medium comprising executable code that, when executed by a processor, causes a computing device to perform a process comprising: receiving a request for presentation of combined content, the request identifying a first content item as a primary content item; obtaining a complete textual version of the first content item; determining, from the complete textual version of the first content item, an attribute from the first content item; determining, based at least in part on a first presentation rule, that a related content item is associated with the attribute from the first content item; determining a first presentation configuration for a portion of the first content item and a portion of the related content item according to a second presentation rule that changes a presentation aspect of at least one of the portion of the first content item and the portion of the related content item; causing presentation of the portion of the first content item and the portion of the related content item as combined content according to the first presentation configuration; receiving a request to designate the related content item as the primary content item; determining a second presentation configuration for at least a portion of the related content item and at least a portion of an additional content item, wherein the additional content item relates to the related content item, and wherein the second presentation configuration differs from the first presentation configuration; and updating the presentation of the combined content according to the second presentation configuration. ### Claim 20 (depends on 19) The non-transitory computer readable medium of claim 19, wherein at least one of the first content item and the related content item are part of a larger content item. ### Claim 21 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the attribute comprises at least one of a genre of the first content item, a mood of the first content item, a location of the first content item, a historical setting of the first content item, a time of day of the first content item, a language of the first content item, a person associated with the first content item, a place associated with the first content item, an object associated with the first content item, an event associated with the first content item, and a time associated with the first content item. ### Claim 22 (depends on 19) The non-transitory computer readable medium of claim 19, wherein at least one of the first presentation rule and the second presentation rule is user-definable. ### Claim 23 (depends on 19) The non-transitory computer readable medium of claim 19, wherein at least one of the first presentation rule and the second presentation rule is received from a network-accessible server. ### Claim 24 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the first presentation configuration specifies a presentation for at least one of the portion of the first content item and the portion of the related content item. ### Claim 25 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the first presentation configuration specifies at least one of: one or more spatial dimensions for a visual element of at least one of the portion of the first content item and the portion of the related content item; and a position for a visual element of at least one of the portion of the first content item and the portion of the related content item; and a volume level for an audio element of at least one of the portion of the first content item and the portion of the related content item. ### Claim 26 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the first presentation configuration specifies at least one of: a change in volume level over time for an audio element of at least one of the portion of the first content item and the portion of the related content item; a change in size over time for a visual element of at least one of the portion of the first content item and the portion of the related content item; and a change in position over time for a visual element of at least one of the portion of the first content item and the portion of the related content item. ### Claim 27 (depends on 19) The non-transitory computer readable medium of claim 19, wherein causing presentation according to the first presentation configuration requires combining at least one of an audio element and a visual element of the portion of the first content item with at least one of an audio element and a visual element of the portion of the related content item. ### Claim 28 (depends on 19) The non-transitory computer readable medium of claim 19, wherein the primary content item comprises a content item that is presented in a default presentation configuration, and wherein at least one of the first and second presentation configurations overrides presentation of at least a portion of the primary content item.