# US 10,770,112 B2 · Aggregation of related media content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,770,112 B2 - Document ID: US10770112B2 - Status: Granted - Kind: B2 - Application number: 16/266,522 - Filed: 2019-02-04 - Published: 2019-06-06 - Granted: 2020-09-08 - Earliest claimed: 2012-01-30 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Yossi Matias; Matthew Sharifi; Thomas Bugnon; Dominik Roblek; Annie Chen - Web page: https://patentgrep.com/patent/US10770112B2 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G06F 16/447: {Temporal browsing, e.g. timeline} - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - G11B 27/3081: {used signal is a video-frame or a video-field (P.I.P)} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for media aggregation are disclosed herein. The system includes a media system that can transform media items into one aggregated media item. A synchronization component synchronizes media items with respect to time. The synchronized media items can be analyzed and transformed into an aggregated media item for storage and/or display. In one implementation, the aggregated media item is capable of being displayed in multiple ways to create an enhanced and customizable viewing and/or listening experience. ## Claims ### Claim 1 A media system, comprising: a memory; and a processor that executes computer-executable instructions stored in the memory that cause the processor to: receive first metadata associated with a first video item captured by a first user device and second metadata associated with a second video item captured by a second user device; determine, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with each other; determine a timeline such that a first time in the first video item is synchronized with a second time in the second video item; aggregate the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline; cause the composite video item to be presented on a third user device in which the first video item and the second video item are simultaneously played back based on the synchronization, wherein the composite video item is a mosaic in which the first video item and the second video item are concurrently displayed; and modify presentation of the composite video item at a third time on the third user device by modifying a visual characteristic with which the first video item is presented within the mosaic based on a user preference indicated by a user of the first user device. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor is further configured to receive first audio data corresponding to the first video item and second audio data corresponding to the second video item, wherein the composite video includes a combination of the first audio data at a first loudness level and the second audio data at a second loudness level, and wherein the first loudness level and the second loudness level are indicated by the user preference. ### Claim 3 (depends on 1) The system of claim 1, wherein the processor is further configured to rank respective segments of the first video item and the second video item as a function of at least one of a frequency of appearance of an entity in the respective segments, respective viewing angles of an object captured in the respective segments, respective video qualities of the respective segments, or respective audio qualities of the respective segments, and wherein the respective segments include the first segment and the second segment. ### Claim 4 (depends on 1) The system of claim 1, wherein the processor is further configured to rank respective segments of the first video item and the second video item based at least in part on the user preference. ### Claim 5 (depends on 1) The system of claim 1, wherein the processor is further configured to modify the aggregation of the first video item and the second video item based at least in part on the user preference. ### Claim 6 (depends on 1) The system of claim 1, wherein the processor is further configured to: receive a request during the presentation of the composite video that includes a request to pan the composite video item; and cause the composite video item to switch from presenting the first video item to the second video item based on a first field of view associated with the first video item and a second field of view associated with the second video item. ### Claim 7 (depends on 1) The system of claim 1, wherein the composite media item is caused to be presented on the third user device via at least one of broadcasting, streaming, or uploading of the composite media item. ### Claim 8 (depends on 1) The system of claim 1, wherein modifying the visual characteristic with which the first video item is presented comprises modifying a focus of the first video item. ### Claim 9 A method, comprising: receiving, at a server, first metadata associated with a first video item captured by a first user device and second metadata associated with a second video item captured by a second user device; determining, by the server, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with each other; determining, by the server, a timeline such that a first time in the first video item is synchronized with a second time in the second video item; aggregating, by the server, the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline; causing, by the server, the composite video item to be presented on a third user device in which the first video item and the second video item are simultaneously played back based on the synchronization, wherein the composite video item is a mosaic in which the first video item and the second video item are concurrently displayed; and modifying presentation of the composite video item at a third time on the third user device by modifying a visual characteristic with which the first video item is presented within the mosaic based on a user preference indicated by a user of the first user device. ### Claim 10 (depends on 9) The method of claim 9, further comprising receiving first audio data corresponding to the first video item and second audio data corresponding to the second video item, wherein the composite video includes a combination of the first audio data at a first loudness level and the second audio data at a second loudness level, and wherein the first loudness level and the second loudness level are indicated by the user preference. ### Claim 11 (depends on 9) The method of claim 9, further comprising ranking respective segments of the first video item and the second video item as a function of at least one of a frequency of appearance of an entity in the respective segments, respective viewing angles of an object captured in the respective segments, respective video qualities of the respective segments, or respective audio qualities of the respective segments, and wherein the respective segments include the first segment and the second segment. ### Claim 12 (depends on 9) The method of claim 9, further comprising ranking respective segments of the first video item and the second video item based at least in part on the user preference. ### Claim 13 (depends on 9) The method of claim 9, further comprising modifying the aggregation of the first video item and the second video item based at least in part on the user preference. ### Claim 14 (depends on 9) The method of claim 9, further comprising: receive a request during the presentation of the composite video includes a request to pan the composite video item; and causing the composite video item to switch from presenting the first video item to the second video item based on a first field of view associated with the first video item and a second field of view associated with the second video item. ### Claim 15 (depends on 9) The method of claim 9, wherein the composite media item is caused to be presented on the third user device via at least one of broadcasting, streaming, or uploading of the composite media item. ### Claim 16 (depends on 9) The method of claim 9, wherein modifying the visual characteristic with which the first video item is presented comprises modifying a focus of the first video item. ### Claim 17 A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by a processor, cause the processor to perform a method, the method comprising: receiving first metadata associated with a first video item captured by a first user device and second metadata associated with a second video item captured by a second user device; determining, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with each other; determining a timeline such that a first time in the first video item is synchronized with a second time in the second video item; aggregating the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline; causing the composite video item to be presented on a third user device in which the first video item and the second video item are simultaneously played back based on the synchronization, wherein the composite video item is a mosaic in which the first video item and the second video item are concurrently displayed; and modifying presentation of the composite video item at a third time on the third user device by modifying a visual characteristic with which the first video item is presented within the mosaic based on a user preference indicated by a user of the first user device.