# US 2025/0166600 A1 · Personalized service provisioning with contextual awareness

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166600 A1
- Document ID: US20250166600A1
- Status: Published application
- Kind: A1
- Application number: 18/955,833
- Filed: 2024-11-21
- Published: 2025-05-22
- Earliest claimed: 2023-11-22
- Assignees: Vidi Labs Limited
- Applicants: Vidi Labs Limited
- Inventors: Turzo Bose; Reshika Palaniyappan Velumani
- Web page: https://patentgrep.com/patent/US20250166600A1

## CPC

- G10L 13/02: Methods for producing synthetic speech; Speech synthesisers
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06T 7/74: {involving reference images or patches}
- G06V 10/40: Extraction of image or video features
- G06V 10/768: {using context analysis, e.g. recognition aided by known co-occurring patterns}
- G06V 10/7715: {Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods}
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 20/63: {Scene text, e.g. street names}
- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G06V 20/20: in augmented reality scenes
- G06V 2201/08: Detecting or categorising vehicles
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems, devices, and methods related to provisioning services to a user are provided. An example of a user device worn by a visually impaired user is configured to obtain an image of a current scene surrounding the user, identify an object in the image, detect a plurality of texts associated with the object, detect a plurality of visual features and semantic features related to the text, determine an identity of the object and one or more attributes of the object based at least in part on the visual features and the semantic features, select one or more texts for presentation from the plurality of texts, and present the selected texts in an audio form to the user to allow the user to perceive the identity and one or more attributes of the object.

## Claims

### Claim 1

A method, performed by a user device, the method comprising:
obtaining an image of a current scene surrounding the user;
identifying an object in the image;
detecting a plurality of texts associated with the object;
detecting a plurality of visual features and semantic features related to the text;
determining an identity of the object and one or more attributes of the object based at least in part on the visual features and the semantic features;
selecting one or more texts for presentation from the plurality of texts; and
presenting the selected texts in an audio form to the user to allow the user to perceive the identity and one or more attributes of the object.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining a point of interest (POI) of the user, based on at least one of a user profile associated with the user, a current location of the user, and a user input; and
determining that the identified object is associated with the POI of the user.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
determining a relevance level to the POI for each one of the plurality of texts,
wherein the one or more texts for presentation are selected based on the relevance level.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining an object of interest for the user; and
determining that the identified object is the object of interest, before detecting the texts and visual features.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
determining a priority level for each one of the texts associated with the object, based at least in part on the visual features and semantic features related to the text,
wherein the one or more texts for presentation are selected based on the priority levels of the texts.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
determining a reading order for the one or more texts,
wherein the one or more texts are presented to the user following the reading order.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
determining a distance between the object and the user,
presenting the distance to the user in an audio form.

### Claim 8

A user device comprising:
one or more processors; and
a computer-readable storage media storing computer-executable instructions that, when executed by the one or more processors, cause the user device to:
obtain an image of a current scene surrounding the user;
identify an object in the image;
detect a plurality of texts associated with the object;
detect a plurality of visual features and semantic features related to the text;
determine an identity of the object and one or more attributes of the object based at least in part on the visual features and the semantic features;
select one or more texts for presentation from the plurality of texts; and
present the selected texts in an audio form to the user to allow the user to perceive the identity and one or more attributes of the object.

### Claim 9 (depends on 8)

The user device of claim 8, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine a point of interest (POI) of the user, based on at least one of a user profile associated with the user, a current location of the user, and a user input; and
determine that the identified object is associated with the POI of the user.

### Claim 10 (depends on 9)

The user device of claim 9, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine a relevance level to the POI for each one of the plurality of texts,
wherein the one or more texts for presentation are selected based on the relevance level.

### Claim 11 (depends on 8)

The user device of claim 8, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine an object of interest for the user; and
determine that the identified object is the object of interest, before detecting the texts and visual features.

### Claim 12 (depends on 8)

The user device of claim 8, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine a priority level for each one of the texts associated with the object, based at least in part on the visual features and semantic features related to the text,
wherein the one or more texts for presentation are selected based on the priority levels of the texts.

### Claim 13 (depends on 8)

The user device of claim 8, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine a reading order for the one or more texts,
wherein the one or more texts are presented to the user following the reading order.

### Claim 14 (depends on 8)

The user device of claim 8, wherein, the instructions when executed by the one or more processors further cause the user device to:
determine a distance between the object and the user,
present the distance to the user in an audio form.

### Claim 15

A system comprising:
a user device; and
a central server in communication with the user device via a network;
wherein the user device is configured to:
obtain an image of a current scene surrounding the user; and
transmit the image to the central server,
wherein the central server is configured to:
identify an object in the image;
detect a plurality of texts associated with the object;
detect a plurality of visual features and semantic features related to the text;
determine an identity of the object and one or more attributes of the object based at least in part on the visual features and the semantic features;
select one or more texts for presentation from the plurality of texts; and
transmit the selected texts to the user device;
wherein the user device is further configured to:
present the selected texts in an audio form to the user.

### Claim 16 (depends on 15)

The system of claim 15, wherein the central server is further configured to:
determine a point of interest (POI) of the user, based on at least one of a user profile associated with the user, a current location of the user, and a user input; and
determine that the identified object is associated with the POI of the user.

### Claim 17 (depends on 16)

The system of claim 16, wherein the central server is further configured to:
determine a relevance level to the POI for each one of the plurality of texts,
wherein the one or more texts for presentation are selected based on the relevance level.

### Claim 18 (depends on 15)

The system of claim 15, wherein the user device is further configured to:
determine an object of interest for the user; and
determine that the identified object is the object of interest, before detecting the texts and visual features.

### Claim 19 (depends on 15)

The user device of claim 15, wherein the central server is further configured to:
determine a priority level for each one of the texts associated with the object, based at least in part on the visual features and semantic features related to the text,
wherein the one or more texts for presentation are selected based on the priority levels of the texts.

### Claim 20 (depends on 15)

The user device of claim 15, wherein the central server is further configured to:
determine a reading order for the one or more texts,
wherein the one or more texts are presented to the user following the reading order.
