# US 2014/0157143 A1 · Method, device and system for user interface adaptation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0157143 A1
- Document ID: US20140157143A1
- Status: Published application
- Kind: A1
- Application number: 14/004,521
- Filed: 2011-03-16
- Published: 2014-06-05
- Earliest claimed: 2011-03-16
- Assignees: Nokia Corporation
- Inventors: Sami Ronkainen; Jukka Saarinen
- Web page: https://patentgrep.com/patent/US20140157143A1

## CPC

- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06V 10/17: {using hand-held instruments}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present application relates to adapting a user interface based on context information. In the method, apparatus and system according to the present application, a context vector (920) is used to select a plurality of resource availability vectors (930, 940, 950). The plurality of resource availability vectors are indicative of availability of user resources in the corresponding context. The selected resource availability vectors are then used together in adapting a user interface (960, 970, 980) according to the availability of the user resources. There is also a method and devices for forming a data structure that can be used in the selection of the resource availability vectors. The method may select from different user interface modalities (960, 970, 980) by processing sensor input data with an associative memory, such as a sparse distributed memory.

## Claims

### Claim at position 1

1-48. (canceled)

### Claim 49

A method comprising:
providing a data structure comprising context vectors and resource availability vectors and having an association between said context vectors and said resource availability vectors,
receiving a context vector,
using said context vector to select a plurality of resource availability vectors, the plurality of resource availability vectors being indicative of availability of user resources, and
modifying the selected resource availability vectors using a teaching resource availability vector associated with said context vector.

### Claim 50 (depends on 49)

A method according to claim 49, comprising
modifying said selected resource availability vectors by increasing the value of the elements corresponding to an available resource in said teaching resource availability vector.

### Claim 51 (depends on 49)

A method according to claim 49, comprising
modifying said selected resource availability vectors by decreasing the value of the elements corresponding to an unavailable resource in said teaching resource availability vector.

### Claim 52 (depends on 49)

A method according to claim 49, comprising
using a distance measure in said selecting, and
modifying said selected resource availability vectors according to said distance measure.

### Claim 53 (depends on 49)

A method according to claim 49, comprising
thresholding said teaching resource availability vector, and
modifying said selected resource availability vectors using said thresholded teaching resource availability vector.

### Claim 54

A method comprising:
receiving a context vector,
using said context vector to select a plurality of resource availability vectors, the plurality of resource availability vectors being indicative of availability of user resources, and
using said selected resource availability vectors together in adapting a user interface according to the availability of said user resources.

### Claim 55 (depends on 49)

A method according to claim 49, wherein said resource availability vectors reside in an associative memory such as a sparse distributed memory, the method comprising
inputting said context vector as a single memory address input to said associative memory, and
selecting a plurality of data vectors from the associative memory based on said input address.

### Claim 56 (depends on 55)

A method according to claim 55, comprising
choosing said associative memory among a group of associative memories based on said received context vector, and
selecting said plurality of data vectors in said selected associative memory using said context vector.

### Claim 57 (depends on 49)

A method according to claim 49, wherein resource availability vectors have an associated context address, the method comprising:
carrying out said selection by comparing said context vector to said context addresses.

### Claim 58 (depends on 55)

A method according to claim 55, wherein the possible address space of context addresses comprises more entries than the total number of context addresses associated to availability vectors, and the addresses of the memory locations having been assigned to the resource availability vectors using a function.

### Claim 59 (depends on 49)

A method according to claim 49, wherein said context vector is indicative of an environmental variable such as temperature, time, location, altitude, acceleration, attitude, lighting, noise conditions and humidity.

### Claim 60 (depends on 49)

A method according to claim 49, wherein said context vector is indicative of the state of the device such as an operating profile, availability of a keyboard, availability of a touch input device and power supply conditions.

### Claim 61 (depends on 1, 54)

A method according to claim 54, wherein said resource availability vectors having been formed by selecting former resource availability vectors as in claim 1, said method comprising
modifying the selected resource availability vectors using a teaching resource availability vector associated with said context vector.

### Claim 62 (depends on 54)

A method according to claim 54, comprising
forming an adaptation vector from said selected resource availability vectors.

### Claim 63

A data structure comprising context vectors and resource availability vectors and an association between said context vectors and said resource availability vectors, said data structure being suitable for obtaining control data for controlling an operation of a device by
using an input context vector to select a plurality of resource availability vectors from said data structure, the plurality of resource availability vectors being indicative of availability of user resources,
controlling operation of a device using said selected resource availability vectors together to adapt a user interface of the device according to the availability of said user resources.

### Claim 64 (depends on 63)

A computer-readable memory comprising the data structure of claim 63.

### Claim 65

An apparatus comprising at least one processor, memory, a user interface and computer program code in said memory, said computer program code being configured to, with the at least one processor, cause the apparatus at least to:
receive a context vector,
use said context vector to select a plurality of resource availability vectors, the plurality of resource availability vectors being indicative of availability of user resources,
use said selected resource availability vectors together in adapting said user interface according to the availability of said user resources.

### Claim 66 (depends on 65)

An apparatus according to claim 65, further comprising an associative memory such as a sparse distributed memory, resource availability vectors residing in said associative memory, and computer program code configured to cause the apparatus at least to:
input said context vector as a single memory address input to said associative memory, and
select a plurality of data vectors from the memory base on said input address.

### Claim 67 (depends on 65)

An apparatus according to claim 65, further comprising means for producing said context vector.

### Claim 68 (depends on 65)

An apparatus according to claim 65 comprising different user interface modalities, and means for enabling and disabling said user interface modalities based on said availability of user resources.
