Back to results
US 2019/0320135 A1Published application
Telepresence device
AssigneeMicrosoft Technology Licensing, LLC
InventorRoss Garrett CUTLER
Life of this patent
Estimating the term…
Abstract
A telepresence device is disclosed, which includes a display and a camera array including cameras configured to capture images of a local subject through the display and output a plurality of local captured images. The telepresence device also includes a local tile selector configured to select a plurality of tiles from the plurality of local captured images based on remote subject point of view (POV) data received from a remote device. The local tile selector outputs local image data that comprises the plurality of selected tiles. The local image data is sent to the remote device to composite an image of the local subject.
Claims34
A telepresence device comprising:
- a display;
- a camera array comprising a plurality of cameras;
- a processor;
- and
- a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the processor to control the telepresence device to perform functions of:
- capturing, using the camera array, a local subject to generate a plurality of local subject capture images;
- receiving, via a communication network from a remote device, remote subject point of view (POV) data comprising an estimated future POV of a remote subject;
- based on the received remote subject POV data, selecting, from the plurality of local subject capture images, a plurality of candidate local tiles for further selection by the remote device based on the remote subject POV data;
- and
- sending, via the communication network to the remote device, local image data comprising the plurality of candidate local tiles.
7 more elements
A telepresence device comprising:
- a display;
- a camera array comprising a plurality of cameras;
- a processor;
- and
- a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the processor to control the telepresence device to perform functions of:
- tracking, using the camera array, a point of view (POV) of a local subject;
- generating, based on the POV of the local subject, local subject POV data comprising an estimated future POV of the local subject;
- sending, via a communication network to a remote device, the local subject POV data;
- receiving, via the communication network from the remote device, remote image data comprising a plurality of candidate remote tiles selected by the remote device based the local subject POV data;
- based on the local subject POV data, selecting, from the plurality of candidate remote tiles, a plurality of remote tiles;
- compositing an image of a remote subject based on the plurality of selected remote tiles;
- and
- displaying, on the display, the composited image of the remote subject.
10 more elements
(canceled)
A telepresence device comprising:
- a display;
- a camera array comprising a plurality of cameras;
- a processor;
- and
- a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the processor to control the telepresence device to perform functions of:
- capturing, using the camera array, a local subject to generate a plurality of local subject capture images;
- receiving, via a communication network form the remote device, remote subject point of view (POV) data comprising an estimated future POV of a remote subject;
- based on the remote subject POV data, selecting, from the plurality of local subject capture images, a plurality of candidate local tiles for further selection by the remote device based on the remote subject POV data;
- sending, via a communication network to the remote device, local image data comprising the plurality of candidate local tiles;
- tracking a POV of the local subject and generating local subject POV data;
- sending, via the communication network to the remote device, the local POV data comprising an estimate future POV of the local subject;
- receiving, via the communication network from the remote device, remote image data comprising a plurality of candidate remote tiles selected by the remote device based on the local POV data;
- based on the local subject POV data, selecting, from the plurality of candidate remote tiles, a plurality of remote tiles;
- compositing an image of the remote subject based on the plurality of selected remote tiles;
- and
- displaying the composited image of the remote subject on the display.
13 more elements
(canceled)
21-30. (canceled)
A method of operating a telepresence device comprising a camera array, the method comprising:
- capturing, using the camera array, a local subject to generate a plurality of local subject capture images;
- receiving, via a communication network from a remote device, remote subject point of view (POV) data comprising an estimated future POV of a remote subject;
- based on the received remote subject POV data, selecting, from the plurality of local subject capture images, a plurality of candidate local tiles for further selection by the remote device based on the remote subject POV data;
- and
- sending, via the communication network to the remote device, local image data comprising the plurality of candidate local tiles.
2 more elements
A method of operating a telepresence device comprising a display and camera array, the method comprising:
- tracking, using the camera array, a point of view (POV) of a local subject;
- generating, based on the POV of the local subject, local subject POV data comprising an estimated future POV of the local subject;
- sending, via a communication network to a remote device, the local subject POV data;
- receiving, via the communication network from the remote device, remote image data comprising a plurality of candidate remote tiles selected by the remote device based the local subject POV data;
- based on the local subject POV data, selecting, from the plurality of candidate remote tiles, a plurality of remote tiles;
- compositing an image of a remote subject based on the plurality of remote tiles;
- and
- displaying, on the display, the composited image of the remote subject.
5 more elements
(canceled)
Dependencies are inferred from the claim text.