Enhance virtual audio capture in augmented reality (AR) experience recordings
AssigneeSnap Inc.
InventorsDaniel Harris, Mykola Marynin
Life of this patent
Estimating the term…
Abstract
A method to enhance virtual audio capture in Augmented Reality (AR) experience recordings starts with a processor receiving a video from a camera that includes images of a real-world scene and an AR content item. Processor receives acoustic signals from microphones generate acoustic signals using real-world audio and speaker output that including AR audio of the AR content item. Processor receives an audio file associated with the AR audio of the AR content item and generates an enhanced audio using the acoustic signals and the audio file. Processor generates an enhanced video using the video and the enhanced audio. Other examples are described herein.
Claims20
A system comprising:
- a camera to capture a video that includes images of a real-world scene and an augmented reality (AR) content item;
- a speaker to generate speaker output including AR audio of the AR content item;
- a plurality of microphones that generate acoustic signals using real-world audio and the speaker output;
- a processor
- to receive the acoustic signals from the plurality of microphones,
- to receive an audio file including the AR audio of the AR content item,
- to generate an enhanced audio using the acoustic signals and the audio file, wherein generating the enhanced audio comprises:
- selecting the AR audio from the audio file or the AR audio from the speaker output based on a metadata associated with the AR content item, wherein the metadata includes a timing for the AR audio that indicates the timing at which the processor selects the AR audio from the audio file, and
- mixing the acoustic signals with the selected AR audio, and to generate an enhanced video using the video and the enhanced audio.
A method comprising:
- receiving, by a processor, a video from a camera, the video including images of a real-world scene and an augmented reality (AR) content item;
- receiving acoustic signals from a plurality of microphones that generate acoustic signals using real-world audio and a speaker output, the speaker output including AR audio of the AR content item;
- receiving an audio file including the AR audio of the AR content item;
- generating an enhanced audio using the acoustic signals and the audio file, wherein generating the enhanced audio comprises:
- selecting the AR audio from the audio file or the AR audio from the speaker output based on a metadata associated with the AR content item, wherein the metadata includes a timing for the AR audio that indicates the timing at which the processor selects the AR audio from the audio file, and
- mixing the acoustic signals with the selected AR audio, and
- generating an enhanced video using the video and the enhanced audio.
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:
- receiving a video from a camera, the video including images of a real-world scene and an augmented reality (AR) content item;
- receiving acoustic signals from a plurality of microphones that generate the acoustic signals using real-world audio and a speaker output, the speaker output including AR audio of the AR content item;
- receiving an audio file including the AR audio of the AR content item;
- generating an enhanced audio using the acoustic signals and the audio file, wherein generating the enhanced audio comprises:
- selecting the AR audio from the audio file or the AR audio from the speaker output based on a metadata associated with the AR content item, wherein the metadata includes a timing for the AR audio that indicates the timing at which the processor selects the AR audio from the audio file, and
- mixing the acoustic signals with the selected AR audio;
- and
- generating an enhanced video using the video and the enhanced audio.
Dependencies are inferred from the claim text.