# US 2019/0246066 A1 · Methods and System for Simulated 3D Videoconferencing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246066 A1
- Document ID: US20190246066A1
- Status: Published application
- Kind: A1
- Application number: 16/391,055
- Filed: 2019-04-22
- Published: 2019-08-08
- Earliest claimed: 2011-03-14
- Assignees: Polycom, Inc.
- Applicants: Polycom, Inc.
- Inventors: Yaakov Moshe Rosenberg
- Web page: https://patentgrep.com/patent/US20190246066A1

## CPC

- H04N 7/15: Conference systems
- G02B 30/00: Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images (in microscopes G02B21/22)
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- H04N 2213/006: Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method for manipulating images in a videoconferencing session provides users with a 3-D-like view of one or more presented sites, without the need for 3-D equipment. A plurality of cameras may record a room at a transmitting endpoint, and the receiving endpoint may select one of the received video streams based upon a point of view of a conferee at the receiving endpoint. The conferee at the receiving endpoint will thus experience a 3-D-like view of the presented site.

## Claims

### Claim 1

A non-transitory computer readable medium storing instructions executable by one or more processors, the instructions comprising instructions to:
determine a gaze of a user relative to a display of a communication device associated with the user;
make a selection responsive to the gaze of the user; and
build, based on the selection, an image for presentation to the user on the display.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the instructions to determine a gaze of a user relative to the display further comprise instructions to:
receive image data from one or more cameras adjacent the display; and
determine the gaze of the user based at least in part on the image data.

### Claim 3 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the instructions to determine the gaze of the user relative to the display further comprise instructions to determine which of a plurality of segments of a layout is looked at by the user.

### Claim 4 (depends on 3)

The non-transitory computer readable medium of claim 3, wherein the instructions further comprise instructions to:
detect a change in the gaze of the user;
make a different selection responsive to the change in the gaze of the user; and
build a new image for presentation to the user on the display based on the different selection.

### Claim 5 (depends on 4)

The non-transitory computer readable medium of claim 4, wherein the instructions further comprise instructions to periodically check for a change in the gaze of the user.

### Claim 6 (depends on 4)

The non-transitory computer readable medium of claim 4, wherein the instructions further comprise instructions to:
determine whether the change in gaze of the user exceeds a predetermined threshold; and
maintain the selection when the change in gaze of the user does not exceed the predetermined threshold.

### Claim 7 (depends on 4)

The non-transitory computer readable medium of claim 4, wherein the instructions to build the new image for presentation to the user on the display comprise instructions to smoothly transition between the image for presentation to the user on the display and the new image for presentation to the user on the display.

### Claim 8 (depends on 7)

The non-transitory computer readable medium of claim 7, wherein the instructions to smoothly transition between the image for presentation to the user on the display and the new image for presentation to the user on the display comprise instructions to morph the image for presentation to the user on the display and the new image for presentation to the user on the display.

### Claim 9

A teleconferencing endpoint, comprising:
a display;
one or more cameras;
a processor coupled to the display and the one or more cameras;
a non-transitory computer readable medium storing instructions executable by the processor, the instructions comprising instructions to:
determine a gaze of a user relative to the display;
make a selection responsive to the gaze of the user; and
build, based on the selection, an image for presentation to the user on the display.

### Claim 10 (depends on 9)

The teleconferencing endpoint of claim 9, wherein the instructions to determine a gaze of a user relative to the display further comprise instructions to:
receive image data from one or more cameras adjacent the display; and
determine the gaze of the user based at least in part on the image data.

### Claim 11 (depends on 10)

The teleconferencing endpoint of claim 10, wherein the instructions to determine the gaze of the user relative to the display further comprise instructions to determine which of a plurality of segments of a layout is looked at by the user.

### Claim 12 (depends on 11)

The teleconferencing endpoint of claim 11, wherein the instructions further comprise instructions to:
detect a change in the gaze of the user;
make a different selection responsive to the change in the gaze of the user; and
build a new image for presentation to the user on the display based on the different selection.

### Claim 13 (depends on 12)

The teleconferencing endpoint of claim 12, wherein the instructions further comprise instructions to periodically check for a change in the gaze of the user.

### Claim 14 (depends on 12)

The teleconferencing endpoint of claim 12, wherein the instructions further comprise instructions to:
determine whether the change in gaze of the user exceeds a predetermined threshold; and
maintain the selection when the change in gaze of the user does not exceed the predetermined threshold.

### Claim 15 (depends on 12)

The teleconferencing endpoint of claim 12, wherein the instructions to build the new image for presentation to the user on the display comprise instructions to smoothly transition between the image for presentation to the user on the display and the new image for presentation to the user on the display.

### Claim 16 (depends on 15)

The teleconferencing endpoint of claim 15, wherein the instructions to smoothly transition between the image for presentation to the user on the display and the new image for presentation to the user on the display comprise instructions to morph the image for presentation to the user on the display and the new image for presentation to the user on the display.

### Claim 17

A computer-implemented method of simulating a three-dimensional presence in a teleconferencing environment, the method comprising:
determining, using a processor, a gaze of a user relative to a display of a communication device associated with the user;
making, using the processor, a selection responsive to the gaze of the user; and
building, using the processor, an image for presentation to the user on the display based on the selection.

### Claim 18 (depends on 17)

The computer-implemented method of claim 17, further comprising:
receiving, at the processor, image data from one or more cameras adjacent the display; and
determining, using the processor, the gaze of the user based at least in part on the image data.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, wherein determining the gaze of the user relative to the display further comprises determining which of a plurality of segments of a layout is looked at by the user.

### Claim 20 (depends on 19)

The computer-implemented method of claim 19, further comprising:
detecting, using the processor, a change in the gaze of the user;
making, using the processor, a different selection responsive to the change in the gaze of the user; and
building a new image for presentation to the user on the display based on the different selection.
