# US 12,192,605 B2 · Systems and methods for implementing privacy filters with variable obfuscation for video communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,605 B2
- Document ID: US12192605B2
- Status: Granted
- Kind: B2
- Application number: 17/725,466
- Filed: 2022-04-20
- Published: 2023-10-26
- Granted: 2025-01-07
- Earliest claimed: 2022-04-20
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Company, Ltd.
- Inventors: Dean N. Reading; Marc Estruch Tena; Lin Sun; Fulya Yilmaz; Cathy Kim; Hanna Fuhrmann; Catherine S. Kim; Jun Yeon Cho; Imran Mohammed; Curtis D. Aumiller
- Web page: https://patentgrep.com/patent/US12192605B2

## CPC

- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- G02B 5/28: Interference filters
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 21/83: input devices, e.g. keyboards, mice or controllers thereof
- G06T 7/75: {involving models}
- G06V 40/176: {Dynamic expression}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In one embodiment, a method includes maintaining a video communication between two or more client devices with each client device comprising cameras and being associated with a respective video stream in the video communication, determining scene data within a field of view in a real-world environment captured by one or more of the cameras of a first client device of the two or more client devices, determining a privacy filter to apply to a first video stream associated with the first client device based on the scene data, and providing instructions to apply the privacy filter to the first video stream in the video communication.

## Claims

### Claim 1

A method comprising, by an electronic device:
maintaining a video communication between two or more client devices, wherein each client device comprises one or more cameras, and wherein each client device is associated with a respective video stream in the video communication;
determining scene data within a field of view in a real-world environment captured by one or more of the cameras of a first client device of the two or more client devices;
determining, based at least in part on the scene data, a level of engagement, with respect to the video communication, of a participant shown in a first video stream associated with the first client device;
determining, based on the level of engagement of the participant shown in the first video stream with the video stream, a privacy filter, which intentionally obfuscates at least a portion of the participant shown in the first video stream, to apply to the participant shown in the first video stream; and
providing instructions to apply the privacy filter to the first video stream in the video communication.

### Claim 2 (depends on 1)

The method of claim 1, wherein the privacy filter is a physical camera privacy filter comprising one or more of a movable element with transparency gradient, a semi-transparent layer, a movable patterned element with transparency gradient, a displacement of lenses associated with a camera, or two or more sheets with polarizing filters.

### Claim 3 (depends on 1)

The method of claim 1, wherein the privacy filter is a physical element placed in an optical path associated with a camera, and wherein the physical element is operable to change its transparency to at least four different transparency levels.

### Claim 4 (depends on 1)

The method of claim 1, wherein on the scene data comprises one or more of:
a level of activity;
a sound in the real-world environment;
a presence of a person within the field of view;
an absence of a person within the field of view;
a location of the real-world environment;
an engagement of a person with respect to the video communication;
a facial expression of a person within the field of view;
a gesture of a person within the field of view;
a pose of a person within the field of view;
a time at the real-world environment; or
weather at the real-world environment.

### Claim 5 (depends on 1)

The method of claim 1, wherein the privacy filter is a presence visualization based on one or more of a shape, a motion, a shade, or an animation.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
detecting, based on a person detection model, one or more people within the field of view;
determining, based on a pose detection model, one or more poses of one or more of the detected people; and
determining the scene data based on the determined poses of one or more of the detected people.

### Claim 7 (depends on 1)

The method of claim 1, wherein applying the privacy filter results in an obfuscation of the field of view based on one or more of:
a transformation of the field of view;
an overlay to the field of view;
a manipulation of the one or more of the cameras to obfuscate the field of view; or
a partial or complete replacement of the first video stream with one or more virtual elements.

### Claim 8

An electronic device comprising:
one or more displays;
one or more non-transitory computer-readable storage media including instructions; and
one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
maintain a video communication between two or more client devices, wherein each client device comprises one or more cameras, and wherein each client device is associated with a respective video stream in the video communication;
determine scene data within a field of view in a real-world environment captured by one or more of the cameras of a first client device of the two or more client devices;
determine, based at least in part on the scene data, a level of engagement, with respect to the video communication, of a participant shown in a first video stream associated with the first client device;
determine, based on the level of engagement of the participant shown in the first video stream with the video stream, a privacy filter, which intentionally obfuscates at least a portion of the participant shown in the first video stream, to apply to the participant shown in the first video stream; and
provide instructions to apply the privacy filter to the first video stream in the video communication.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the privacy filter is a physical camera privacy filter comprising one or more of a movable element with transparency gradient, a semi-transparent layer, a movable patterned element with transparency gradient, a displacement of lenses associated with a camera, or two or more sheets with polarizing filters.

### Claim 10 (depends on 8)

The electronic device of claim 8, wherein the privacy filter is a physical element placed in an optical path associated with a camera, and wherein the physical element is operable to change its transparency to at least four different transparency levels.

### Claim 11 (depends on 8)

The electronic device of claim 8, wherein on the scene data comprises one or more of:
a level of activity;
a sound in the real-world environment;
a presence of a person within the field of view;
an absence of a person within the field of view;
a location of the real-world environment;
an engagement of a person with respect to the video communication;
a facial expression of a person within the field of view;
a gesture of a person within the field of view;
a pose of a person within the field of view;
a time at the real-world environment; or
weather at the real-world environment.

### Claim 12 (depends on 8)

The electronic device of claim 8, wherein the privacy filter is a presence visualization based on one or more of a shape, a motion, a shade, or an animation.

### Claim 13 (depends on 8)

The electronic device of claim 8, wherein the processors are further configured to execute the instructions to:
detect, based on a person detection model, one or more people within the field of view;
determine, based on a pose detection model, one or more poses of one or more of the detected people; and
determine the scene data based on the determined poses of one or more of the detected people.

### Claim 14 (depends on 8)

The electronic device of claim 8, wherein applying the privacy filter results in an obfuscation of the field of view based on one or more of:
a transformation of the field of view;
an overlay to the field of view;
a manipulation of the one or more of the cameras to obfuscate the field of view; or
a partial or complete replacement of the first video stream with one or more virtual elements.

### Claim 15

A computer-readable non-transitory storage media comprising instructions executable by a processor to:
maintain a video communication between two or more client devices, wherein each client device comprises one or more cameras, and wherein each client device is associated with a respective video stream in the video communication;
determine scene data within a field of view in a real-world environment captured by one or more of the cameras of a first client device of the two or more client devices;
determine, based at least in part on the scene data, a level of engagement, with respect to the video communication, of a participant shown in a first video stream associated with the first client device;
determine, based on the level of engagement of the participant shown in the first video stream with the video stream, a privacy filter, which intentionally obfuscates at least a portion of the participant shown in the first video stream, to apply to the participant shown in the first video stream; and
provide instructions to apply the privacy filter to the first video stream in the video communication.

### Claim 16 (depends on 15)

The media of claim 15, wherein the privacy filter is a physical camera privacy filter comprising one or more of a movable element with transparency gradient, a semi-transparent layer, a movable patterned element with transparency gradient, a displacement of lenses associated with a camera, or two or more sheets with polarizing filters.

### Claim 17 (depends on 15)

The media of claim 15, wherein the privacy filter is a physical element placed in an optical path associated with a camera, and wherein the physical element is operable to change its transparency to at least four different transparency levels.

### Claim 18 (depends on 15)

The media of claim 15, wherein on the scene data comprises one or more of:
a level of activity;
a sound in the real-world environment;
a presence of a person within the field of view;
an absence of a person within the field of view;
a location of the real-world environment;
an engagement of a person with respect to the video communication;
a facial expression of a person within the field of view;
a gesture of a person within the field of view;
a pose of a person within the field of view;
a time at the real-world environment; or
weather at the real-world environment.

### Claim 19 (depends on 15)

The media of claim 15, wherein the privacy filter is a presence visualization based on one or more of a shape, a motion, a shade, or an animation.

### Claim 20 (depends on 15)

The media of claim 15, wherein the instructions are further executable by the processor to:
detect, based on a person detection model, one or more people within the field of view;
determine, based on a pose detection model, one or more poses of one or more of the detected people; and
determine the scene data based on the determined poses of one or more of the detected people.

### Claim 21

A method comprising, by an electronic device:
maintaining a video communication between two or more client devices, wherein each client device comprises one or more cameras, and wherein each client device is associated with a respective video stream in the video communication;
determining scene data within a field of view in a real-world environment captured by one or more of the cameras of a first client device of the two or more client devices;
determining, based at least in part on the scene data, a level of engagement, with respect to the video communication, of a participant shown in a first video stream associated with the first client device;
determining, based on the level of engagement of the participant shown in the first video stream with the video stream, a privacy filter, which intentionally obfuscates at least a portion of the participant shown in the first video stream, to apply to the participant shown in the first video stream; and
providing instructions to change a transparency of the privacy filter associated with a first camera of the one or more cameras associated with the first client device of the two or more client devices in response to an electrical signal, wherein the privacy filter comprises a physical element placed in on optical path associated with the first camera, and wherein the physical element is operable to change the transparency of the privacy filter to at least four different transparency levels.

### Claim 22 (depends on 21)

The method of claim 21, wherein the privacy filter is a physical camera privacy filter comprising one or more of a movable element with transparency gradient, a semi-transparent layer, a movable patterned element with transparency gradient, a displacement of lenses associated with a camera, or two or more sheets with polarizing filters.
