# US 2025/0097314 A1 · Translating sensory communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097314 A1
- Document ID: US20250097314A1
- Status: Published application
- Kind: A1
- Application number: 18/292,118
- Filed: 2021-07-27
- Published: 2025-03-20
- Earliest claimed: 2021-07-27
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget LM Ericsson (publ)
- Inventors: Selim ICKIN; Amin AZARI; Carmen LEE ALTMANN; Anusha Pradeep MUJUMDAR; Jalil TAGHIA
- Web page: https://patentgrep.com/patent/US20250097314A1

## CPC

- H04L 67/30: Profiles
- H04L 67/565: Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561)
- G06N 3/09: Supervised learning
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0475: Generative networks
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A computer implemented method for translating a sensory input to a sensory output for communication between first and second entities. The first entity includes a user and the second entity includes a user or a computing system. The method includes obtaining a first profile specifying a communication capability of the first entity, and a second profile specifying a communication capability of the second entity and obtaining a trained Machine Learning (ML) model operable to map an input sensory communication in accordance with one of the first or second profiles to an output sensory communication in accordance with the other of the profiles. The method further includes receiving an input sensory communication from one of the first or second entities, using the ML model to map the input sensory communication to an output sensory communication, and providing the output sensory communication to the other of the entities.

## Claims

### Claim 1

A computer implemented method for translating a sensory input to a sensory output for communication between first and second entities, the first entity comprising a user and the second entity comprises a user or a computing system, the method, performed by a translation system, comprising:
obtaining a first profile specifying a communication capability of the first entity, and a second profile specifying a communication capability of the second entity;
obtaining a trained Machine Learning, ML, model configured to map an input sensory communication in accordance with one of the first or second profiles to an output sensory communication in accordance with the other of the first or second profiles;
receiving an input sensory communication from one of the first or second entities;
using the ML model to map the input sensory communication to an output sensory communication; and
providing the output sensory communication to the other of the first or second entities.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein the input sensory communication is received from an entity comprising a user; and
wherein receiving the input sensory communication comprises receiving a representation, generated by a user device of the user, of a sensory communication input by the user to the user device.

### Claim 3 (depends on 1)

The method as claimed in claim 1, wherein the other of the first or second entities comprises a user; and
wherein providing the output sensory communication to the other of the first or second entities comprises providing to a user device of the user a representation of the output sensory communication, wherein the user device is configured to generate the output sensory communication for the user from the provided representation.

### Claim 4 (depends on 1)

The method as claimed in claim 1, wherein a communication capability comprises at least one of a sensory capability or an actuation capability.

### Claim 5 (depends on 1)

The method as claimed in claim 1, wherein a sensory communication comprises a communication the reception and interpretation of which requires a sensory capability.

### Claim 6 (depends on 5)

The method as claimed in claim 5, wherein the received input sensory communication and the provided output sensory communication require different sensory capabilities for reception and interpretation.

### Claim 7 (depends on 1)

The method as claimed in claim 1, wherein a sensory communication in accordance with a profile of an entity comprises at least one of:
a sensory communication in a format that is compatible with a sensory capability of the entity; or
a sensory communication in a format from which or to which the entity, or a user device associated with the entity, is configured to translate.

### Claim 8 (depends on 1)

The method as claimed in claim 1, wherein obtaining at least one of a first or second profile specifying a communication capability of the first or second entity comprises at least one of:
retrieving the first or second profile from a memory;
receiving the first or second profile in a message; and
detecting component elements of the first or second profile using a sensor.

### Claim 9 (depends on 1)

The method as claimed in claim 1, wherein obtaining a trained ML model configured to map an input sensory communication in accordance with one of the first or second profiles to an output sensory communication in accordance with the other of the first or second profiles comprises:
obtaining, from a repository, a candidate set of at least one trained ML model configured to map an input sensory communication in accordance with one of the first or second profiles to an output sensory communication in accordance with the other of the first or second profiles; and
selecting, from the candidate set, an ML model for use in translation of communication between the first and second entities.

### Claim 10 (depends on 9)

The method as claimed in claim 9, wherein selecting, from the candidate set, an ML model for use in translation of communication between the first and second entities comprises selecting an ML model using feedback provided for ML models in the candidate set from users of the ML models.

### Claim 11 (depends on 9)

The method as claimed in claim 9, further comprising obtaining a context for the communication between the first and second entities; and
wherein selecting, from the candidate set, an ML model for use in translation of communication between the first and second entities comprises using the obtained context to select the ML model.

### Claim 12 (depends on 11)

The method as claimed in claim 11, wherein the obtained context comprises an identification of a task to be achieved through the communication between the first and second entities.

### Claim 13 (depends on 1)

The method as claimed in claim 1, further comprising:
receiving an authentication token from at least one of the first or second entities; and
using the authentication token to authenticate the first or second entity.

### Claim 14 (depends on 1)

The method as claimed in claim 1, wherein using the ML model to map the input sensory communication to an output sensory communication comprises:
inputting to the ML model a representation of the input sensory communication, wherein the representation is processed by the ML model in accordance with trained values of the ML model parameters; and
obtaining from the ML model an output sensory communication comprising a representation of information contained in the input sensory communication.

### Claim 15 (depends on 14)

The method as claimed in claim 14, wherein the representation of information contained in the input sensory communication comprises at least one of:
a representation of the information in a format that is compatible with a sensory capability of the entity to which the output sensory communication is provided; or
a sensory communication in a format from which the entity to which the output sensory communication is provided, or a user device associated with the entity, is configured to translate.

### Claim 16 (depends on 1)

The method as claimed in claim 1, wherein the ML model comprises at least one of:
a multi-input-multi output Neural Network;
a split Neural Network;
a conditional Variational AutoEncoder, cVAE;
a generative model; and
a Natural Language Processing model.

### Claim 17 (depends on 1)

The method as claimed in claim 1, further comprising:
receiving feedback from at least one of the first or second entities; and
performing at least one of:
providing the feedback to a training node for inclusion in a training data set for the obtained ML model;
providing the feedback to a management node for inclusion in a training data set for a selection model for selecting ML models for translating a sensory input to a sensory output for communication between first and second entities;
using the feedback in a training process to update the obtained ML model; or
using the feedback in a training process to update a model for selecting ML models for translating a sensory input to a sensory output for communication between first and second entities.

### Claim 18 (depends on 1)

The method as claimed in claim 1, wherein the input sensory communication requires a sensory capability for reception and interpretation that is:
not present in the profile of the entity to which the output sensory communication is provided;
identified in the profile of the entity to which the output sensory communication is provided as non-optimal under at least some conditions; or
identified in the profile of the entity to which the output sensory communication is provided as unavailable under at least some conditions.

### Claim 19 (depends on 1)

The method as claimed in claim 1, wherein the output sensory communication requires an actuation capability for generation of the output sensory communication that is:
not present in the profile of the entity from which the input sensory communication is received;
identified in the profile of the entity from which the input sensory communication is received as non-optimal under at least some conditions; or
identified in the profile of the entity from which the input sensory communication is received as unavailable under at least some conditions.

### Claim at position 20

-21. (canceled)

### Claim 22

A computer implemented method for facilitating combined control of an environment by first and second users, the method comprising:
receiving from the first user a first control action to be executed on the environment;
receiving from the second user a second control action to be executed on the environment;
generating from the first and second control actions a combined control action for execution on the environment; and
initiating execution of the combined control action on the environment;
each of the first and second users having received a stimulus from the environment in the form of an input sensory communication; and
generating from the first and second control actions a combined control action for execution on the environment comprises weighting contributions of the first and second control actions to the combined control action according to a comparison between a sensory capability required for receiving and interpreting the input sensory communication, and communication capability profiles of the first and second users.

### Claim 23 (depends on 22)

The method as claimed in claim 22, wherein the input sensory communication has been translated for at least one of the first or second users to an output sensory communication compatible with a communication capability profile of the user, on the basis of which the user has generated the first or second control action; and
wherein generating from the first and second control actions a combined control action for execution on the environment further comprises weighting contributions of the first and second control actions to the combined control action according to a performance parameter of a model using which the input sensory communication has been translated.

### Claim 24 (depends on 23)

The method as claimed in claim 23, wherein the input sensory communication has been translated for at least one of the first or second users using a method comprising:
obtaining a first profile specifying a communication capability of the first user, and a second profile specifying a communication capability of the second user;
obtaining a trained Machine Learning, ML, model configured to map an input sensory communication in accordance with one of the first or second profiles to an output sensory communication in accordance with the other of the first or second profiles;
receiving an input sensory communication from one of the first or second users;
using the ML model to map the input sensory communication to an output sensory communication; and
providing the output sensory communication to the other of the first or second users.

### Claim at position 24

-29. (canceled)

### Claim 30

A control node for facilitating combined control of an environment by first and second users, the control node comprising processing circuitry configured to cause the control node to:
receive from the first user a first control action to be executed on the environment;
receive from the second user a second control action to be executed on the environment;
generate from the first and second control actions a combined control action for execution on the environment;
initiate execution of the combined control action on the environment;
each of the first and second users has having received a stimulus from the environment in the form of an input sensory communication; and
generating from the first and second control actions a combined control action for execution on the environment comprises weighting contributions of the first and second control actions to the combined control action according to a comparison between a sensory capability required for receiving and interpreting the input sensory communication, and communication capability profiles of the first and second users.

### Claim 31

(canceled)
