# US 2018/0158244 A1 · Virtual sensor configuration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0158244 A1
- Document ID: US20180158244A1
- Status: Published application
- Kind: A1
- Application number: 15/368,006
- Filed: 2016-12-02
- Published: 2018-06-07
- Earliest claimed: 2016-12-02
- Assignees: Ayotle
- Applicants: Ayotle
- Inventors: José Alonso Ybanez Zepeda; Gisèle Belliot
- Web page: https://patentgrep.com/patent/US20180158244A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06T 7/74: {involving reference images or patches}
- G06T 19/003: {Navigation within 3D models or images}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for configuring a virtual sensor in a real scene, the method comprising: obtaining at least one first three dimensional (3D) representation of the real scene, analyzing said at least one first 3D representation to detect a beacon in the real scene and computing from said at least one first 3D representation a position of the beacon in the real scene; generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing a volume area having a predefined positioning with respect to the beacon, at least one virtual sensor trigger condition associated with the volume area, and at least one operation to be triggered when said at least one virtual sensor trigger condition is fulfilled.

## Claims

### Claim 1

A method for configuring a virtual sensor in a real scene, the method comprising:
obtaining at least one first three dimensional (3D) representation of the real scene, wherein said at least one first 3D representation comprises points representing objects in the real scene and respective associated positions in the real scene;
analyzing said at least one first 3D representation to detect a beacon in the real scene, and computing a position of the beacon in the real scene from at least one position associated to a least one point of a set of points representing the beacon in said at least one first 3D representation;
generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing:
a volume area having a predefined positioning, with respect to the beacon;
at least one virtual sensor trigger condition associated with the volume area, and
at least one operation to be triggered when said at least one virtual sensor trigger condition is fulfilled.

### Claim 2 (depends on 1)

The method according to claim 1, wherein analyzing said at least one first 3D representation to detect a beacon in the real scene comprises:
obtaining beacon description data that specifies at least one identification element of the beacon and
executing a processing function to detect points of the 3D representation that represents an object having said identification element.

### Claim 3 (depends on 1)

The method according to claim 1, wherein analyzing said at least one 3D representation to detect a beacon in the real scene comprises:
obtaining beacon description data that specifies at least one property of the beacon and
executing a processing function to detect points of said at least one 3D representation that represents an object having said property.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the beacon comprises an emitter for emitting at least one optical signal, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing an origin of the optical signal.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the beacon comprises at least one identification element, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing said identification element.

### Claim 6 (depends on 5)

The method according to claim 5, wherein said at least one identification element comprises at least one element from the group consisting of a reflective surface, a surface with a predefined pattern, an element having a predefined shape, an element having a predefined color, an element having a predefined size, an element having predefined reflective properties.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the beacon has a predefined property, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing the beacon with the predefined property.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising.
obtaining at least one second 3D representation of the real scene,
making a determination from a portion of said at least one second 3D representation of the real scene that falls into the volume area of the virtual sensor that said at least one virtual sensor trigger condition is fulfilled;
triggering an execution of said at least one operation upon determination that said at least one virtual sensor trigger condition is fulfilled.

### Claim 9 (depends on 1)

The method according to claim 1, further comprising detecting at least one data signal coming from the beacon, wherein the data signal encodes additional configuration data, wherein the virtual sensor configuration data are generated on the basis of the additional configuration data.

### Claim 10 (depends on 9)

A method according to claim 9, wherein said at least one data signal is emitted by the beacon upon activation of an actuator of the beacon.

### Claim 11 (depends on 9)

A method according to claim 9, further comprising:
emitting a source signal towards the beacon,
wherein said at least one data signal comprise at least one response signal produced by the beacon in response to the receipt of the source signal.

### Claim 12 (depends on 9)

A method according to claim 9, wherein said at least one data signal comprises several elementary signals and wherein the generation of virtual sensor configuration data is performed in dependence upon a number of elementary signals in said at least one data signal or a rate at which said elementary signals are emitted.

### Claim 13 (depends on 9)

The method according to claim 9, wherein the method further comprises determining a virtual sensor type from a set of predefined virtual sensor types on the basis of said additional configuration data, wherein the virtual sensor configuration data are generated on the basis of predefined virtual sensor configuration data stored in association with the virtual sensor type.

### Claim 14 (depends on 9)

The method according to claim 9, wherein the method further comprises identifying in a repository a predefined virtual sensor configuration data set on the basis of said additional configuration data.

### Claim 15 (depends on 14)

The method according to claim 14, further comprising,
storing in a repository the predefined virtual sensor configuration data set in association with a configuration data set identifier, wherein the predefined virtual sensor configuration data comprise at least one predefined volume area, at least one predefined trigger condition and at least one predefined operation,
extracting the configuration data set identifier from the additional configuration data,
retrieving, on the basis of the extracted configuration data set identifier, the predefined virtual sensor configuration data set stored in the repository,
generating the virtual sensor configuration data from the retrieved predefined virtual sensor configuration data set.

### Claim 16 (depends on 1)

The method according to claim 1, wherein the beacon is a part of the body of a user, wherein generating said virtual sensor configuration data for the virtual sensor comprises:
determining from said at least one first 3D representation that said part of the body performs a predefined gesture/motion;
generating virtual sensor configuration data for the virtual sensor corresponding to the predefined gesture, wherein the position of the virtual sensor corresponds to a position in the real scene of said part of the body at the time the predefined gesture motion has been performed.

### Claim 17

A system for configuring a virtual sensor in a real scene, the system comprising:
a configuration sub-system for
obtaining a first three dimensional (3D) representation, wherein the 3D representation comprises points representing objects in the real scene and respective associated positions in the real scene;
analyzing said 3D representation to detect a beacon in the real scene, and computing a position of the beacon in the real scene from at least one position associated to a least one point of a set of points representing the beacon in said 3D representation,
generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing: a volume area having a predefined positioning with respect to the beacon, at least one trigger condition associated with the volume area, and at least one operation to be triggered when said at least one trigger condition is fulfilled.

### Claim 18

A beacon of a system for configuring a virtual sensor in a real scene,
wherein the beacon is configured to be placed in the real scene so as to mark a position in the real scene;
wherein the system comprises a configuration sub-system for
obtaining a first three dimensional (3D) representation of the real scene, wherein the 3D representation comprises points representing objects in the real scene and respective associated positions in the real scene;
analyzing said 3D representation to detect a beacon in the real scene, and computing a position of the beacon in the real scene from at least one position associated to a least one point of a set of points representing the beacon in said 3D representation,
generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing a volume area having a predefined positioning with respect to the beacon, at least one trigger condition associated with the volume area, and at least one operation to be triggered when said at least one trigger condition is fulfilled.
wherein the beacon comprises at least one identification element, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing said identification element in the first 3D representation.

### Claim 19

A beacon of a system for configuring a virtual sensor in a real scene,
wherein the beacon is configured to be placed in the real scene so as to mark a position in the real scene,
wherein the system comprises a configuration sub-system for
obtaining a first three dimensional (3D) representation of the real scene, wherein the 3D representation comprises points representing objects in the real scene and respective associated positions in the real scene;
analyzing said 3D representation to detect a beacon in the real scene, and computing a position of the beacon in the real scene from at least one position associated to a least one point of a set of points representing the beacon in said 3D representation,
generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing a volume area having a predefined positioning with respect to the beacon, at least one trigger condition associated with the volume area, and at least one operation to be triggered when said at least one trigger condition is fulfilled.
wherein the beacon comprises an emitter for emitting a signal, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing an origin of the signal in the first 3D representation.

### Claim 20

A beacon of a system for configuring a virtual sensor in a real scene,
wherein the beacon is configured to be placed in the real scene so as to mark a position in the real scene,
wherein the system comprises a configuration sub-system for
obtaining a first three dimensional (3D) representation of the real scene, wherein the 3D representation comprises points representing objects in the real scene and respective associated positions in the real scene;
analyzing said 3D representation to detect a beacon in the real scene, and computing a position of the beacon in the real scene from at least one position associated to a least one point of a set of points representing the beacon in said 3D representation,
generating virtual sensor configuration data for the virtual sensor on the basis at least of the position of the beacon, the virtual sensor configuration data representing: a volume area having a predefined positioning with respect to the beacon, at least one trigger condition associated with the volume area, and at least one operation to be triggered when said at least one trigger condition is fulfilled.
wherein the beacon has a predefined property, wherein the position of the beacon in the real scene is determined from at least one position associated to a least one point of a set of points representing the beacon with the predefined property in the first 3D representation.
