# US 2010/0245257 A1 · Directional Audio Viewport for the Sight Impaired in Virtual Worlds

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0245257 A1
- Document ID: US20100245257A1
- Status: Published application
- Kind: A1
- Application number: 12/410,703
- Filed: 2009-03-25
- Published: 2010-09-30
- Earliest claimed: 2009-03-25
- Assignees: International Business Machines Corporation
- Inventors: Brian J. Cragun; Zachary A. Garbow; Christopher A. Peterson
- Web page: https://patentgrep.com/patent/US20100245257A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G09B 21/006: {using audible presentation of the information}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Embodiments of the invention provide techniques for presenting a virtual world to sight-impaired users. In one embodiment, the user may indicate an area of focus within the virtual world. The user may then be provided with audio descriptions of objects or avatars included within the area of focus. The descriptions may be provided at varying levels of detail, enabling the user to “zoom in” on particular items of interest. Further, the user may select an audio description to navigate an avatar to the location of the corresponding object.

## Claims

### Claim 1

A computer-implemented method, comprising:
presenting a user with a selection viewport in a user interface, wherein the selection viewport represents a partial view of a virtual environment from a perspective of an avatar present at a first location within the virtual environment, and wherein the virtual environment comprises a plurality of elements;
receiving a user interaction with the user interface;
based on the user interaction, determining an audio viewport, wherein the audio viewport is a portion of the selection viewport from which the user can select elements for which audio descriptions are desired;
identifying one or more elements included in the audio viewport;
determining at least one element, of the one or more elements, that satisfies one or more predefined user preferences for elements to be described; and
providing the user with audio descriptions of the determined at least one element.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more predefined user preferences specify whether an element that is partially included within the audio viewport should be described by the provided audio descriptions.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the user interaction with the user interface comprises touching a touch screen to define a selected portion of the selection viewport.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the user interface displays a visible image of the selection viewport.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving, within the user interface, a user selection of an element described by the audio descriptions;
determining a second location for the avatar, such that the selection viewport corresponding to the second location would be focused on the selected element;
navigating the avatar to the second location; and
updating the selection viewport according to the perspective of the avatar from the second location.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving, within the user interface, a user command to navigate to a second location within the virtual environment;
navigating the avatar to the second location; and
updating the selection viewport according to the perspective of the avatar from the second location.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the user preferences specify time-related characteristics of the audio descriptions.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the audio descriptions are provided to the user according to a hierarchical order of the described elements, such that the level of detail of the audio descriptions is adjusted based on an amount of time that the audio viewport stays focused on an element.

### Claim 9

A computer-readable storage medium including a program, which when executed on a processor performs an operation, the operation comprising:
presenting a user with a selection viewport in a user interface, wherein the selection viewport represents a partial view of a virtual environment from a perspective of an avatar present at a first location within the virtual environment, and wherein the virtual environment comprises a plurality of elements;
receiving a user interaction with the user interface;
based on the user interaction, determining an audio viewport, wherein the audio viewport is a portion of the selection viewport from which the user can select elements for which audio descriptions are desired;
identifying one or more elements included in the audio viewport;
determining at least one element, of the one or more elements, that satisfies one or more predefined user preferences for elements to be described; and
providing the user with audio descriptions of the determined at least one element.

### Claim 10 (depends on 9)

The computer-readable storage medium of claim 9, wherein the one or more predefined user preferences specify whether an element that is partially included within the audio viewport should be described by the provided audio descriptions.

### Claim 11 (depends on 9)

The computer-readable storage medium of claim 9, wherein the user interaction with the user interface comprises touching a touch screen to define a selected portion of the selection viewport.

### Claim 12 (depends on 9)

The computer-readable storage medium of claim 9, wherein the user interface displays a visible image of the selection viewport.

### Claim 13 (depends on 9)

The computer-readable storage medium of claim 9, the operation further comprising:
receiving, within the user interface, a user selection of an element described by the audio descriptions;
determining a second location for the avatar, such that the selection viewport corresponding to the second location would be focused on the selected element;
navigating the avatar to the second location; and
updating the selection viewport according to the perspective of the avatar from the second location.

### Claim 14 (depends on 9)

The computer-readable storage medium of claim 9, the operation further comprising:
receiving, within the user interface, a user command to navigate to a second location within the virtual environment;
navigating the avatar to the second location; and
updating the selection viewport according to the perspective of the avatar from the second location.

### Claim 15 (depends on 9)

The computer-readable storage medium of claim 9, wherein the user preferences specify time-related characteristics of the audio descriptions.

### Claim 16 (depends on 9)

The computer-readable storage medium of claim 9, wherein the audio descriptions are provided to the user according to a hierarchical order of the described elements, such that the level of detail of the audio descriptions is adjusted based on an amount of time that the audio viewport stays focused on an element.

### Claim 17

A system, comprising:
a database;
a processor; and
a memory containing a program, which when executed by the processor is configured to perform an operation, the operation comprising:
presenting a user with a selection viewport in a user interface, wherein the selection viewport represents a partial view of a virtual environment from a perspective of an avatar present at a first location within the virtual environment, and wherein the virtual environment comprises a plurality of elements;
receiving a user interaction with the user interface;
based on the user interaction, determining an audio viewport, wherein the audio viewport is a portion of the selection viewport from which the user can select elements for which audio descriptions are desired;
identifying one or more elements included in the audio viewport;
determining at least one element, of the one or more elements, that satisfies one or more predefined user preferences for elements to be described; and
providing the user with audio descriptions of the determined at least one element.

### Claim 18 (depends on 17)

The system of claim 17, wherein the one or more predefined user preferences specify whether an element that is partially included within the audio viewport should be described by the provided audio descriptions.

### Claim 19 (depends on 17)

The system of claim 17, wherein the user interaction with the user interface comprises touching a touch screen to define a selected portion of the selection viewport.

### Claim 20 (depends on 17)

The system of claim 17, wherein the user interface displays a visible image of the selection viewport.

### Claim 21 (depends on 17)

The system of claim 17, wherein the user preferences specify time-related characteristics of the audio descriptions.
