# US 2018/0323992 A1 · User-Configurable Interactive Region Monitoring

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0323992 A1
- Document ID: US20180323992A1
- Status: Published application
- Kind: A1
- Application number: 16/040,438
- Filed: 2018-07-19
- Published: 2018-11-08
- Earliest claimed: 2015-08-21
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Company, Ltd.
- Inventors: Brian Harms; Pol Pla; Yedan Qian; Olivier Bau
- Web page: https://patentgrep.com/patent/US20180323992A1

## CPC

- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/33: for indoor environments, e.g. buildings
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04L 2012/2841: {Wireless}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In one embodiment, one or more systems may receive input from a user identifying an interactive region of a physical environment. The one or more systems may determine a location of the interactive region relative to a depth sensor and monitor, at least in part by the depth sensor, the interactive region for a predetermined event. The one or more systems may detect, at least in part by the depth sensor, the predetermined event. In response to detecting the predetermined event, the one or more systems may initiate a predetermined action associated with the predetermined event.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

An apparatus comprising:
a depth sensor;
one or more computer-readable non-transitory storage media embodying instructions; and
one or more processors configured to execute the instructions to:
monitor, at least in part based on output of the depth sensor, a physical environment comprising a user-defined interactive region for a predetermined event, wherein the user-defined interactive region is configured at least in part based on user input;
detect, at least in part based on the output of the depth sensor, the predetermined event in the interactive region; and
in response to detection of the predetermined event, initiate a predetermined action associated with the predetermined event.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein the predetermined event includes a touch by the user with respect to an object in the interactive region.

### Claim 23 (depends on 22)

The apparatus of claim 22, wherein the predetermined action associated with the predetermined event includes displaying information associated with the object.

### Claim 24 (depends on 23)

The apparatus of claim 23, wherein:
the object includes a product; and
the predetermined action associated with the predetermined event includes displaying a price associated with the product.

### Claim 25 (depends on 23)

The apparatus of claim 23, wherein the predetermined action associated with the predetermined event includes displaying a video associated with the object.

### Claim 26 (depends on 23)

The apparatus of claim 23, wherein the information associated with the object is displayed by a display device near the interactive region.

### Claim 27 (depends on 21)

The apparatus of claim 21, wherein the user input is provided by at least one of: a voice command, a gesture, or an instrument.

### Claim 28

A method comprising:
monitoring, at least in part based on output from a depth sensor, a physical environment comprising a user-defined interactive region for a predetermined event, wherein the user-defined interactive region is configured at least in part based on user input;
detecting, at least in part based on the output of the depth sensor, the predetermined event in the interactive region; and
in response to detecting the predetermined event, initiating a predetermined action associated with the predetermined event.

### Claim 29 (depends on 28)

The method of claim 28, wherein the predetermined event includes a touch by the user with respect to an object in the interactive region.

### Claim 30 (depends on 29)

The method of claim 29, wherein the predetermined action associated with the predetermined event includes displaying information associated with the object.

### Claim 31 (depends on 30)

The method of claim 30, wherein:
the object includes a product; and
the predetermined action associated with the predetermined event includes displaying a price associated with the product.

### Claim 32 (depends on 30)

The method of claim 30, wherein the predetermined action associated with the predetermined event includes displaying a video associated with the object.

### Claim 33 (depends on 30)

The method of claim 30, wherein the information associated with the object is displayed by a display device near the interactive region.

### Claim 34 (depends on 28)

The method of claim 28, wherein the user input is provided by at least one of:
a voice command, a gesture, or an instrument.

### Claim 35

One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
monitor, at least in part based on output of the depth sensor, a physical environment comprising a user-defined interactive region for a predetermined event, wherein the user-defined interactive region is configured at least in part based on user input;
detect, at least in part based on the output of the depth sensor, the predetermined event in the interactive region; and
in response to detection of the predetermined event, initiate a predetermined action associated with the predetermined event.

### Claim 36 (depends on 35)

The media of claim 35, wherein the predetermined event includes a touch by the user with respect to an object in the interactive region.

### Claim 37 (depends on 36)

The media of claim 36, wherein the predetermined action associated with the predetermined event includes displaying information associated with the object.

### Claim 38 (depends on 37)

The media of claim 37, wherein:
the object includes a product; and
the predetermined action associated with the predetermined event includes displaying a price associated with the product.

### Claim 39 (depends on 37)

The media of claim 37, wherein the predetermined action associated with the predetermined event includes displaying a video associated with the object.

### Claim 40 (depends on 37)

The media of claim 37, wherein the information associated with the object is displayed by a display device near the interactive region.
