# US 2024/0402794 A1 · Method and apparatus for initiating an action

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0402794 A1
- Document ID: US20240402794A1
- Status: Published application
- Kind: A1
- Application number: 18/698,073
- Filed: 2022-09-08
- Published: 2024-12-05
- Earliest claimed: 2021-10-07
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: Christiaan Varekamp; Arnoldus Werner Johannes Oomen
- Web page: https://patentgrep.com/patent/US20240402794A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus comprises a first sensor (101) and second sensor (103) arranged to determine a first and second set of properties for entities being devices or persons, the sets being determined in accordance with different sensor modalities. A first processor (105) determines directions between entities and a second processor (107) determines an orientation of an entity. A first detector (109) detects a bi-directional information exchange link between a first person and another entity out of a plurality of possible bi-directional information exchange links between entities in response to the directions and the at least one orientation. An initiator (111) initiates an action in response to the detection of the bi-directional information exchange link. The detection of the bi-directional information exchange link is in response to the first set of properties and the second set of properties.

## Claims

### Claim 1

An apparatus comprising:
a first sensor,
wherein the first sensor is arranged to determine a first plurality of properties for a plurality of entities,
wherein the first plurality of properties is determined in accordance with a first sensor modality;
a second sensor,
wherein the second sensor is arranged to determine a second plurality of properties for the plurality of entities,
wherein the second plurality of properties is determined in accordance with a second sensor modality,
wherein the second sensor modality is different from the first sensor modality;
a first processor circuit, wherein the first processor circuit is arranged to determine real world directions between at least two entities of the plurality of entities;
a second processor circuit, wherein the second processor circuit is arranged to determine at least one orientation of at least one entity of the plurality of entities in response to the first plurality not of properties;
a first detector circuit,
wherein the first detector circuit is arranged to detect a bi-directional information exchange link in response to the directions and the at least one orientation,
wherein the bi-directional information exchange link exist between a first entity of the plurality of entities and a second entity of the plurality of entities,
wherein the bi-directional information exchange link is a real world audiovisual communication link,
wherein the real world audiovisual communication link enables information to be exchanged from the first entity to the second entity,
wherein the real world audiovisual communication link enables information to be exchanged from the second entity to the first entity;
an initiator circuit,
wherein the initiator circuit is arranged to initiate an action in response to the detection of the bi-directional information exchange link,
wherein the first detector circuit is arranged to detect the bi-directional information exchange link in response to the first plurality of properties and the second plurality of properties.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the at least one orientation comprises a orientation of the first entity.

### Claim 3 (depends on 1)

The apparatus of claim 1,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to the first direction.

### Claim 4 (depends on 1)

The apparatus of claim 1,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a detection that an orientation of the first entity aligns with the first direction.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein
the at least one real world orientation comprises an orientation of the second entity.

### Claim 6 (depends on 1)

The apparatus of claim 1,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a criterion,
wherein the criterion comprises a requirement that an orientation of radiation of information from the second entity to the first entity is aligned with the first direction.

### Claim 7 (depends on 1)

The apparatus of claim 1,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a criterion,
wherein the criterion comprises a requirement that a view direction of the first entity is aligned with the first direction.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising a second detector circuit,
wherein the second detector circuit is arranged to detect a trigger action by the first entity,
wherein the initiator circuit is arranged to initiate the action in response to the trigger action.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the second detector circuit is arranged to detect the trigger action as a communication by the first entity over the bi-directional information exchange link.

### Claim 10 (depends on 1)

The apparatus of claim 1,
wherein the first sensor modality is a vision modality,
wherein the second sensor modality is an audition modality.

### Claim 11 (depends on 1)

The apparatus of claim 1,
wherein the first entity is a person,
wherein the second entity is a person.

### Claim 12 (depends on 1)

The apparatus of claim 1,
wherein the first detector circuit is arranged to detect the bi-directional information exchange link in response a first detection and a second detection,
wherein the first detection comprises detecting that a pose for the first entity and a pose for the second entity meet a match criterion,
wherein the second detection comprises detecting that a sound from at least one of the first entity and the second entity meet a sound criterion.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the action is an action of the second entity.

### Claim 14 (depends on 1)

The apparatus of claim 1,
wherein the first sensor modality and the second sensor modality are different modalities,
wherein the first sensor modality and the second sensor modality selected from the group consisting of Vision, Audition, Tactition, Ultrasound, Infrared, Radar, and Tag detection.

### Claim 15

A method comprising:
determining a first plurality of properties of a plurality of entities,
wherein the first plurality of properties is determined in accordance with a first sensor modality;
determining a second plurality of properties of f the plurality of entities,
the second plurality of properties is determined in accordance with a second sensor modality,
wherein the second sensor modality is different from the first sensor modality;
determining directions between at least two entities of the plurality of entities;
determining at least one orientation of at least one entity of the plurality of entities in response to the first plurality of properties;
detecting a bi-directional information exchange link in response to the directions and the at least one orientation,
wherein the bi-directional information exchange link exist between a first entity of the plurality of entities and a second entity of the plurality of entities
wherein the bi-directional information exchange link is a real world audiovisual communication link,
wherein the real world audiovisual communication link enables information to be exchanged from the first entity to the second entity,
wherein the real world audiovisual communication link enables information to be exchanged from the second entity to the first entity;
initiating an action in response to the detection of the bi-directional information exchange link,
wherein the detection of the bi-directional information exchange link is in response to the first plurality of properties and the second plurality of properties.

### Claim 16 (depends on 15)

A computer program stored on a non-transitory medium, wherein the computer program when executed on a processor performs the method as claimed in claim 15.

### Claim 17 (depends on 15)

The method of claim 15,
wherein the at least two entities comprise a first entity and a second entity,
wherein at least one of the directions is a direction between the at least one entity to the second entity.

### Claim 18 (depends on 15)

The method of claim 15, wherein the at least one orientation comprises a orientation of the first entity.

### Claim 19 (depends on 15)

The method of claim 15,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to the first direction.

### Claim 20 (depends on 1)

The method of claim 1,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a detection that an orientation of the first entity aligns with the first direction.

### Claim 21 (depends on 15)

The method of claim 15, wherein the at least one orientation comprises an orientation of the second entity.

### Claim 22 (depends on 15)

The method of claim 15,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a criterion,
wherein the criterion comprises a requirement that an orientation of radiation of information from the second entity to the first entity is aligned with the first direction.

### Claim 23 (depends on 15)

The method of claim 15,
wherein the directions comprises a first direction,
wherein the first direction is between the first entity and the second entity,
wherein the first detector circuit is arranged to determine the bi-directional information exchange link in response to a criterion,
wherein the criterion comprises a requirement that a view direction of the first entity is aligned with the first direction.

### Claim 24 (depends on 15)

The method of claim 15, further comprising a second detector circuit,
wherein the second detector circuit is arranged to detect trigger action by the first entity,
wherein the initiator circuit is arranged to initiate the action in response to the trigger action.

### Claim 25 (depends on 24)

The method of claim 24, wherein the second detector circuit is arranged to detect the trigger action as a communication by the first entity over the bi-directional information exchange link.

### Claim 26 (depends on 15)

The method of claim 15,
wherein the first sensor modality is a vision modality,
wherein the second sensor modality is an audition modality.

### Claim 27 (depends on 15)

The method of claim 15,
wherein the first detector circuit is arranged to detect the bi-directional information exchange link in response a first detection and a second detection,
wherein the first detection comprises detecting that a pose for the first entity and a pose for the second entity meet a match criterion,
wherein the second detection comprises detecting that a sound from at least one of the first entity and the second entity meet a sound criterion.

### Claim 28 (depends on 15)

The method of claim 15, wherein the action is an action of the second entity.

### Claim 29 (depends on 1)

The apparatus of claim 1,
wherein the at least two entities comprise a first entity and a second entity,
wherein at least one of the directions is a direction between the at least one entity to the second entity.
