# US 12,114,099 B2 · Dynamic camera views in a virtual environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,114,099 B2
- Document ID: US12114099B2
- Status: Granted
- Kind: B2
- Application number: 17/515,495
- Filed: 2021-10-31
- Published: 2023-05-04
- Granted: 2024-10-08
- Earliest claimed: 2021-10-31
- Assignees: Zoom Video Communications, Inc.
- Applicants: Zoom Video Communications, Inc.
- Inventors: Jordan Thiel
- Web page: https://patentgrep.com/patent/US12114099B2

## CPC

- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G06T 15/20: Perspective computation
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing dynamic camera views in a virtual environment. The system may provide a video conference session in a virtual environment. The system may provide a plurality of individual virtual cameras for capturing individual video streams of one or more 3D avatars and an environment virtual camera for capturing an environment video stream. The system may display the individual video streams and environment video stream in a video conference application.

## Claims

### Claim 1

A method comprising:
providing a video conference session in a virtual environment including respective digital representations of one or more users;
providing a plurality of individual virtual cameras in the virtual environment, each individual virtual camera is associated with one of the respective digital representations and captures an individual video stream that includes the one of the respective digital representations and a portion of the virtual environment that is in a viewport of the each individual virtual camera;
providing an environment virtual camera in the virtual environment, the environment virtual camera capturing an environment video stream that includes a plurality of the respective digital representations, the environment virtual camera placed at a location within the virtual environment and having a facing direction, and the environment virtual camera not associated with any of the respective digital representations;
providing the plurality of individual video streams and the environment video stream in the video conference session; and
providing for display the plurality of individual video streams and the environment video stream in a video conference application.

### Claim 2 (depends on 1)

The method of claim 1, wherein the virtual environment comprises a virtual reality (VR) environment.

### Claim 3 (depends on 1)

The method of claim 1, wherein the virtual environment comprises an augmented reality (AR) environment comprising one or more AR holograms.

### Claim 4 (depends on 1)

The method of claim 1, wherein each individual virtual camera is locked to the associated respective digital representation.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
providing in the virtual environment a video stream of a video conference participant.

### Claim 6 (depends on 1)

The method of claim 1, wherein the environment virtual camera is located in the virtual environment at the location of a display of a video stream of a video conference participant.

### Claim 7 (depends on 1)

The method of claim 1, wherein the plurality of individual video streams are captured on one or more AR or VR devices and the environment video stream is captured on a server hosting a backend of the virtual environment.

### Claim 8

A non-transitory computer readable medium that stores executable program instructions that when executed by one or more computing devices configure the one or more computing devices to perform operations comprising:
providing a video conference session in a virtual environment including respective digital representations of one or more users;
providing a plurality of individual virtual cameras in the virtual environment, each individual virtual camera is associated with one of the respective digital representations and captures an individual video stream that includes the one of the respective digital representations and a portion of the virtual environment that is in a viewport of the each individual virtual camera;
providing an environment virtual camera in the virtual environment, the environment virtual camera capturing an environment video stream that includes a plurality of the respective digital representations, the environment virtual camera placed at a location within the virtual environment and having a facing direction, and the environment virtual camera not associated with any of the respective digital representations;
providing the plurality of individual video streams and the environment video stream in the video conference session; and
providing for display the plurality of individual video streams and the environment video stream in a video conference application.

### Claim 9 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the virtual environment comprises a VR environment.

### Claim 10 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the virtual environment comprises an AR environment comprising one or more AR holograms.

### Claim 11 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein each individual virtual camera is locked to the associated respective digital representation.

### Claim 12 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the executable program instructions further configure the one or more computing devices to perform operations comprising:
providing in the virtual environment a video stream of a video conference participant.

### Claim 13 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the environment virtual camera is located in the virtual environment at the location of a display of a video stream of a video conference participant.

### Claim 14 (depends on 8)

The non-transitory computer readable medium of claim 8, wherein the plurality of individual video streams are captured on one or more AR or VR devices and the environment video stream is captured on a server hosting a backend of the virtual environment.

### Claim 15

A system comprising one or more processors configured to perform the operations of:
providing a video conference session in a virtual environment including respective digital representations of one or more users;
providing a plurality of individual virtual cameras in the virtual environment, each individual virtual camera is associated with one of the respective digital representations and captures an individual video stream that includes the one of the respective digital representations and a portion of the virtual environment that is in a viewport of the each individual virtual camera;
providing an environment virtual camera in the virtual environment, the environment virtual camera capturing an environment video stream that includes a plurality of the respective digital representations, the environment virtual camera placed at a location within the virtual environment and having a facing direction, and the environment virtual camera not associated with any of the respective digital representations;
providing the plurality of individual video streams and the environment video stream in the video conference session; and
providing for display the plurality of individual video streams and the environment video stream in a video conference application.

### Claim 16 (depends on 15)

The system of claim 15, wherein each individual virtual camera is locked to the associated respective digital representation.

### Claim 17 (depends on 15)

The system of claim 15, wherein the processors are further configured to perform the operations of:
providing in the virtual environment a video stream of a video conference participant.

### Claim 18 (depends on 15)

The system of claim 15, wherein the plurality of individual video streams are captured on one or more AR or VR devices and the environment video stream is captured on a server hosting a backend of the virtual environment.

### Claim 19 (depends on 15)

The system of claim 15, wherein the video conference session and the virtual environment communicate via a software development kit (SDK).

### Claim 20 (depends on 15)

The system of claim 15, wherein the plurality of individual video streams are provided through an application programming interface (API).
