Augmented reality speech balloon system
AssigneeSnap Inc.
InventorsPiers Cowburn, Qi Pan, Eitan Pilipski
Life of this patent
Estimating the term…
Abstract
Disclosed is an augmented reality system to generate and cause display of an augmented reality interface at a client device. Various embodiments may detect speech, identify a source of the speech, transcribe the speech to a text string, generate a speech bubble based on properties of the speech and that includes a presentation of the text string, and cause display of the speech bubble at a location in the augmented reality interface based on the source of the speech.
Claims20
A system comprising:
- a memory;
- and
- at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
- causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features;
- detecting ambient sound containing speech;
- extracting speech properties from the ambient sound containing speech;
- detecting movement of one or more facial features from the set of facial features;
- determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties;
- selecting a speech bubble from a speech bubble library based on the emotional effect of the speech;
- and
- causing display of the speech bubble within the presentation of the image data.
A method comprising:
- causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features;
- detecting ambient sound containing speech;
- extracting speech properties from the ambient sound containing speech;
- detecting movement of one or more facial features from the set of facial features;
- determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties;
- selecting a speech bubble from a speech bubble library based on the emotional effect of the speech;
- and
- causing display of the speech bubble within the presentation of the image data.
A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations including:
- causing display at a client device of a presentation of image data, the presentation of the image data comprising a depiction of a set of facial features;
- detecting ambient sound containing speech;
- extracting speech properties from the ambient sound containing speech;
- detecting movement of one or more facial features from the set of facial features;
- determining an emotional effect of the speech based on the movement of the one or more facial features and the speech properties;
- selecting a speech bubble from a speech bubble library based on the emotional effect of the speech;
- and
- causing display of the speech bubble within the presentation of the image data.
Dependencies are inferred from the claim text.