# US 2019/0379861 A1 · Audiovisual transmissions adjustments via omindirectional cameras

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379861 A1
- Document ID: US20190379861A1
- Status: Published application
- Kind: A1
- Application number: 16/344,747
- Filed: 2016-12-05
- Published: 2019-12-12
- Earliest claimed: 2016-12-05
- Assignees: Hewlett-Packard Development Company, L.P.
- Applicants: Hewlett-Packard Development Company, L.P.
- Inventors: Alexander Wayne Clark; Kent E. Biggs; Michael James PESCETTO
- Web page: https://patentgrep.com/patent/US20190379861A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G06T 7/593: from stereo images
- G06V 40/161: {Detection; Localisation; Normalisation}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30201: Face
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In one example method, a computing device scans an environment via an omnidirectional camera, detects objects in the environment, and captures depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera. The computing device makes adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects.

## Claims

### Claim 1

A method comprising:
scanning an environment via an omnidirectional camera;
detecting objects in the environment;
capturing depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera; and
making adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
capturing the depth information of the environment comprises differentiating between a foreground and a background of the environment, and
making the adjustments to the AV transmissions comprises removing the background of the environment from the AV transmissions.

### Claim 3 (depends on 1)

The method of claim 1, comprising:
using facial detection to identify the objects in the environment as users, and
wherein making the adjustments to the AV transmissions comprises:
eliminating video feeds in the AV transmissions between the users; and
stitching video feeds in the AV transmissions of the users together.

### Claim 4 (depends on 3)

The method of claim 3, comprising:
detecting gestures to be performed by the users, and
wherein the AV transmissions are to be adjusted based on the detected gestures.

### Claim 5 (depends on 3)

The method of claim 3, wherein making the adjustments to the AV transmissions comprises adjusting audio transmissions based on depth information captured of the users.

### Claim 6 (depends on 1)

The method of claim 1, wherein making the adjustments to the AV transmissions comprises adjusting audio transmissions to fit the environment, wherein the adjustments to the audio transmissions are to be based on the depth information of the environment.

### Claim 7 (depends on 1)

The method of claim 1, wherein making the adjustments to the AV transmissions comprises correcting visual distortions captured by the omnidirectional camera, wherein the adjustments are to be based on the depth information of the environment.

### Claim 8 (depends on 1)

The method of claim 1, comprising:
providing feedback to other devices to make adjustments based on the captured depth information of the environment.

### Claim 9

A computing device comprising:
an omnidirectional camera;
a processor to:
scan an environment via the omnidirectional camera;
detect objects in the environment;
capture depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera;
use facial detection to identify the objects in the environment as users;
detect gestures to be performed by the users, and
make adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects, wherein the AV transmissions are to be adjusted based on the detected gestures.

### Claim 10 (depends on 9)

The computing device of claim 9, wherein:
the processor to capture the depth information of the environment comprises differentiating between a foreground and a background of the environment, and
the processor to make the adjustments to the AV transmissions comprises removing the background of the environment from the AV transmissions.

### Claim 11 (depends on 9)

The computing device of claim 9, wherein the processor to make the adjustments to the AV transmissions comprises:
eliminating video feeds in the AV transmissions between the users; and
stitching video feeds in the AV transmissions of the users together.

### Claim 12 (depends on 9)

The computing device of claim 9, wherein the processor to make the adjustments to the AV transmissions comprises adjusting audio transmissions to fit the environment, wherein the adjustments to the audio transmissions are to be based on the depth information of the environment.

### Claim 13

A non-transitory computer-readable storage medium comprising program instructions which, when executed by a processor, to cause the processor to:
scan an environment via an omnidirectional camera;
detect objects in the environment;
capture depth information of the environment and the objects in the environment via 3D imaging of the omnidirectional camera;
make adjustments to audiovisual (AV) transmissions based on the detected objects and the depth information captured of the environment and the objects; and
provide feedback to other devices to make adjustments based on the captured depth information of the environment.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instruction to make the adjustments to the AV transmissions causes the processor to adjust audio transmissions to fit the environment, wherein the adjustments to the audio transmissions are to be based on the depth information of the environment.

### Claim 15 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions to make the adjustments to the AV transmissions causes the processor to correct visual distortions captured by the omnidirectional camera, wherein the adjustments are to be based on the depth information of the environment.
