Enhanced representations based on sensor data
AssigneeMotorola Mobility LLC
InventorsRahul B. Desai, Amit Kumar Agrawal
Life of this patent
Estimating the term…
Abstract
Techniques for generating enhanced representations based on sensor data are described and are implementable in a video conference setting. Generally, the described implementations enable an enhanced representation of a focal individual, for instance a speaker, to be generated based on sensor data, for instance audio and visual sensor data. The audio data can identify an individual as the speaker or determine a general location of a source of audio. Visual sensors can detect gestures of individuals located in the general location of the source of audio to identify gestures which indicate that one or more individuals are speaking or are about to speak.
Claims20
A method, comprising:
- identifying, by a first device, at least one focal individual in a viewable region of a video capture device based on positional audio data and gesture information obtained from one or more sensors of the first device;
- generating an enhanced representation of the at least one focal individual by processing content associated with the at least one focal individual, the enhanced representation containing enhanced visual content and enhanced audial content pertaining to the at least one focal individual and further including an orientation tag indicating a display orientation for the enhanced representation based on a spatial position of the at least one focal individual in relation to the first device;
- and
- communicating the enhanced representation of the at least one focal individual for display in a user interface of a second device.
An apparatus comprising:
- a processing system implemented at least in part in hardware of the apparatus;
- and
- a video conference module implemented at least in part in hardware of the apparatus and executable by the processing system to:
- receive, by an audio sensor of a first device, positional audio data indicating a location of a source of audio from one or more individuals;
- detect, by the first device, facial gestures of the one or more individuals positioned in the location;
- identify, by the first device, at least one focal individual as speaking based on the positional audio data and detected facial gestures;
- generate an enhanced representation of the at least one focal individual, containing visual and audial content, a display orientation of the enhanced representation based in part on a spatial position of the at least one focal individual;
- and
- communicate the enhanced representation of the at least one focal individual for display in a user interface of a second device.
A system comprising:
- one or more processors;
- and
- one or more computer-readable storage media storing instructions that are executable by the one or more processors to:
- identify at least one focal individual as speaking within a viewable region of a video capture device of a first device;
- determine a spatial position of the at least one focal individual in relation to the first device;
- generate an enhanced representation of the at least one focal individual based on the spatial position, the enhanced representation containing enhanced visual content that simulates a perspective view of the at least one focal individual in relation to the first device and enhanced audial content to simulate an audial perspective relative to the first device;
- and
- communicate the enhanced representation of the at least one focal individual for display in a user interface of a second device.
Dependencies are inferred from the claim text.