# US 2019/0172495 A1 · Aggregation of related media content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0172495 A1 - Document ID: US20190172495A1 - Status: Published application - Kind: A1 - Application number: 16/266,522 - Filed: 2019-02-04 - Published: 2019-06-06 - Earliest claimed: 2012-01-30 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Yossi Matias; Matthew Sharifi; Thomas Bugnon; Dominik Roblek; Annie Chen - Web page: https://patentgrep.com/patent/US20190172495A1 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G06F 16/447: {Temporal browsing, e.g. timeline} - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - G11B 27/3081: {used signal is a video-frame or a video-field (P.I.P)} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56) - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for media aggregation are disclosed herein. The system includes a media system that can transform media items into one aggregated media item. A synchronization component synchronizes media items with respect to time. The synchronized media items can be analyzed and transformed into an aggregated media item for storage and/or display. In one implementation, the aggregated media item is capable of being displayed in multiple ways to create an enhanced and customizable viewing and/or listening experience. ## Claims ### Claim 1 A media system, comprising: a memory; and a processor that executes computer-executable instructions stored in the memory that cause the processor to: receive first metadata associated with a first video item and second metadata associated with a second video item; determine, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with a common event; determine, based on at least one common feature between the first metadata and the second metadata, a timeline associated with the common event such that a first time in the first video item is synchronized with a second time in the second video item; aggregate the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline, and wherein the first time in the first video item and the second time in the second video item both correspond to a third time in the timeline; and cause the composite video item to be presented on a user device in which the first video item and the second video item are simultaneously played back at the third time, wherein the composite video item switches, during the third time in the timeline, from presenting the composite video to the first video item at the first time or the second video at the second time. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor is further configured to receive first audio data corresponding to the first video item and second audio data corresponding to the second video item, wherein the timeline is determined based on at least one common feature between the first audio data and the second audio data. ### Claim 3 (depends on 1) The system of claim 1, wherein the composite video is presented in response to a request that is received during the presentation of the composite video in which the first video item and the second video item are simultaneously played back at the third time. ### Claim 4 (depends on 1) The system of claim 1, wherein the processor is further configured to rank respective segments of the first video item and the second video item as a function of at least one of a frequency of appearance of an entity in the respective segments, respective viewing angles of an object captured in the respective segments, respective video qualities of the respective segments, or respective audio qualities of the respective segments, and wherein the respective segments include the first segment and the second segment. ### Claim 5 (depends on 1) The system of claim 1, wherein the processor is further configured to rank respective segments of the first video item and the second video item based at least in part on a preference of a user. ### Claim 6 (depends on 1) The system of claim 1, wherein the processor is further configured to modify the aggregation of the first video item and the second video item based at least in part on information received from a user. ### Claim 7 (depends on 1) The system of claim 1, wherein the request that is received during the presentation of the composite video includes a request to pan the composite video item, and wherein the processor is further configured to cause the composite video item to switch from presenting the first video item to the second video item based on a first field of view of the common event associated with the first video item and a second field of view of the common event associated with the second video item. ### Claim 8 (depends on 1) The system of claim 1, wherein the composite media item is caused to be presented on the user device via at least one of broadcasting, streaming, or uploading of the composite media item. ### Claim 9 (depends on 1) The system of claim 1, wherein the first video item and the second video item are aggregated into the composite video item by stitching at least a portion of the respective segments, based at least in part on the ranking, to form a mosaic media item. ### Claim 10 (depends on 1) The system of claim 1, wherein the first video item and the second video item are aggregated into the composite video item by stitching at least the first segment and the second segment, based at least in part on relative locations of the first segment and the second segment with respect to the common event, to form a panoramic media item. ### Claim 11 A method, comprising: receiving first metadata associated with a first video item and second metadata associated with a second video item; determining, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with a common event; determining, based on at least one common feature between the first metadata and the second metadata, a timeline associated with the common event such that a first time in the first video item is synchronized with a second time in the second video item; aggregating the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline, and wherein the first time in the first video item and the second time in the second video item both correspond to a third time in the timeline; and causing the composite video item to be presented on a user device in which the first video item and the second video item are simultaneously played back at the third time, wherein the composite video item switches, during the third time in the timeline, from presenting the composite video to the first video item at the first time or the second video at the second time. ### Claim 12 (depends on 11) The method of claim 11, further comprising receiving first audio data corresponding to the first video item and second audio data corresponding to the second video item, wherein the timeline is determined based on at least one common feature between the first audio data and the second audio data. ### Claim 13 (depends on 11) The method of claim 11, wherein the composite video is presented in response to a request that is received during the presentation of the composite video in which the first video item and the second video item are simultaneously played back at the third time. ### Claim 14 (depends on 11) The method of claim 11, further comprising ranking respective segments of the first video item and the second video item as a function of at least one of a frequency of appearance of an entity in the respective segments, respective viewing angles of an object captured in the respective segments, respective video qualities of the respective segments, or respective audio qualities of the respective segments, and wherein the respective segments include the first segment and the second segment. ### Claim 15 (depends on 11) The method of claim 11, further comprising ranking respective segments of the first video item and the second video item based at least in part on a preference of a user. ### Claim 16 (depends on 11) The method of claim 11, further comprising modifying the aggregation of the first video item and the second video item based at least in part on information received from a user. ### Claim 17 (depends on 11) The method of claim 11, wherein the request that is received during the presentation of the composite video includes a request to pan the composite video item, and wherein the method further comprises causing the composite video item to switch from presenting the first video item to the second video item based on a first field of view of the common event associated with the first video item and a second field of view of the common event associated with the second video item. ### Claim 18 (depends on 11) The method of claim 11, wherein the composite media item is caused to be presented on the user device via at least one of broadcasting, streaming, or uploading of the composite media item. ### Claim 19 (depends on 11) The method of claim 11, wherein the first video item and the second video item are aggregated into the composite video item by stitching at least a portion of the respective segments, based at least in part on the ranking, to form a mosaic media item. ### Claim 20 (depends on 11) The method of claim 11, wherein the first video item and the second video item are aggregated into the composite video item by stitching at least the first segment and the second segment, based at least in part on relative locations of the first segment and the second segment with respect to the common event, to form a panoramic media item. ### Claim 21 A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by a processor, cause the processor to perform a method, the method comprising: receiving first metadata associated with a first video item and second metadata associated with a second video item; determining, based at least on the first metadata and the second metadata, that the first video item and the second video item are associated with a common event; determining, based on at least one common feature between the first metadata and the second metadata, a timeline associated with the common event such that a first time in the first video item is synchronized with a second time in the second video item; aggregating the first video item and the second video item into a composite video item that includes at least a first segment from the first video item and a second segment from the second video item, wherein the first segment and the second segment are arranged in the composite video in synchronization with the determined timeline, and wherein the first time in the first video item and the second time in the second video item both correspond to a third time in the timeline; and causing the composite video item to be presented on a user device in which the first video item and the second video item are simultaneously played back at the third time, wherein the composite video item switches, during the third time in the timeline, from presenting the composite video to the first video item at the first time or the second video at the second time.