# US 2018/0024845 A1 · External accessibility systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024845 A1
- Document ID: US20180024845A1
- Status: Published application
- Kind: A1
- Application number: 15/217,735
- Filed: 2016-07-22
- Published: 2018-01-25
- Earliest claimed: 2016-07-22
- Assignees: EchoStar Technologies L.L.C.
- Applicants: EchoStar Technologies L.L.C.
- Inventors: John Anthony Card, II; Ellen Letendre; Karen Taxier
- Web page: https://patentgrep.com/patent/US20180024845A1

## CPC

- H04N 21/42203: {sound input device, e.g. microphone}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 9/451: Execution arrangements for user interfaces
- G09B 21/007: {using both tactile and audible presentation of the information}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)}
- H04N 21/440236: {by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/4884: {for displaying subtitles}
- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 9/454: {Multi-language systems; Localisation; Internationalisation}
- G09G 2370/18: Use of optical transmission of display information
- G10L 17/00: Speaker identification or verification techniques
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Described are systems, methods and computer program products for generating accessible interface elements to facilitate presentation of alternative versions of a user interface or portions thereof to a user, such as a user having a disability. The disclosed systems, methods, and products allow users having a disability to more easily interact with and/or understand the user interfaces of consumer electronic devices. The disclosed systems, methods, and computer program products may facilitate obtaining images of the user interface and analyzing the images to convert, modify, or otherwise generate an accessible interface, or a portion thereof, for presentation to the user. For example, alternative interface presentations may be generated to allow a blind, deaf, low-vision, or color blind user to more easily understand and interact with the user interface.

## Claims

### Claim 1

A method, comprising:
obtaining, by a computing device, an image of a graphical interface using an image capture device, wherein the graphical interface corresponds to a consumer electronic device different from the computing device;
analyzing the image to identify an interface element;
generating an accessible interface element using the interface element, wherein the accessible interface element corresponds to a different presentation of the interface element to facilitate use by a user; and
outputting an audio or visual output of the accessible interface element.

### Claim 2 (depends on 1)

The method of claim 1, wherein the interface element corresponds to a focusable element of the graphical interface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the interface element corresponds to a nonfocusable element of the graphical interface.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving input corresponding to identification of the interface element; and
wirelessly transmitting a command to facilitate selection of the interface element in the graphical interface.

### Claim 5

(canceled)

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
receiving the command at an actuation device; and
actuating a physical input device using the actuation device to facilitate selection of the interface element in the graphical interface.

### Claim 7 (depends on 4)

The method of claim 4, further comprising:
outputting a second audio or visual output to confirm selection of the interface element or outputting a tactile output to confirm selection of the interface element.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
receiving input corresponding to selection of a second interface element;
generating a second accessible interface element using the second interface element to facilitate use by the user; and
outputting a second audio or visual output of the second accessible interface element.

### Claim at position 9

-12. (canceled)

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
receiving input corresponding to selection of a second interface element;
receiving input corresponding to a command to ignore the second interface element.

### Claim at position 11

-15. (canceled)

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
obtaining a second image of the graphical interface using the image capture device;
analyzing the image of the graphical interface and the second image of the graphical interface to identify a change to the graphical interface; and
determining element focus in the graphical interface based on the change.

### Claim at position 13

-20. (canceled)

### Claim 21 (depends on 1)

The method of claim 1, wherein the accessible interface element corresponds to an audio version of the interface element, wherein the accessible interface element corresponds to a text version of an audio interface element, wherein the accessible interface element corresponds to an alternative color version of the interface element, wherein the accessible interface element corresponds to a magnified version of the interface element, wherein the accessible interface element corresponds to a simplified language version of the interface element, wherein the accessible interface element corresponds to a translated language version of the interface element, wherein the accessible interface element corresponds to a version of text having a second font size greater than a first font size of text in the interface element, wherein the accessible interface element corresponds to a version of text having a second texture different from a first texture of text in the interface element, or wherein the accessible interface element corresponds to a version of text having a second font style different from a first font style of text in the interface element.

### Claim 22 (depends on 1)

The method of claim 1, further comprising:
generating a graphical interface providing a selectable element, wherein the selectable element corresponds to a type of the accessible interface element;
receiving input corresponding to a particular selection of the selectable element, wherein generating the accessible interface element includes using the interface element and the type corresponding to the particular selection of the selectable element.

### Claim 23 (depends on 1)

The method of claim 1, further comprising:
obtaining audio output generated by the consumer electronic device using an audio capture device;
analyzing the audio to identify a contextual element in the audio;
generating an accessible contextual element using the contextual element, wherein the accessible contextual element corresponds to a different presentation of the contextual element to facilitate presentation to the user; and
outputting an audio or visual output of the accessible contextual element.

### Claim at position 17

-28. (canceled)

### Claim 29 (depends on 1)

The method of claim 1, further comprising:
obtaining a second image corresponding to a video presentation of the consumer electronic device using the image capture device;
analyzing the second image to identify a contextual element;
generating an accessible contextual element using the contextual element, wherein the accessible contextual element corresponds to a different presentation of the contextual element to facilitate presentation to the user; and
outputting an audio or visual output of the accessible contextual element.

### Claim at position 19

-33. (canceled)

### Claim 34

A system, comprising:
one or more processors; and
a non-transitory computer readable storage medium in data communication with the one or more processors, wherein non-transitory computer readable storage medium includes processor-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including:
obtaining an image of a graphical interface using an image capture device, wherein the graphical interface corresponds to a consumer electronic device different from the system;
analyzing the image to identify an interface element;
generating an accessible interface element using the interface element, wherein the accessible interface element corresponds to a different presentation of the interface element to facilitate use by a user; and
outputting an audio or visual output of the accessible interface element.

### Claim 35 (depends on 34)

The system of claim 34, further comprising:
the image capture device, wherein the image capture device is positioned in data communication with the one or more processors.

### Claim 36 (depends on 34)

The system of claim 34, further comprising:
an audio capture device positioned in data communication with the one or more processors.

### Claim 37

(canceled)

### Claim 38

A receiver comprising:
one or more processors;
an audio-video output interface in data communication with the one or more processors;
a network interface in data communication with the one or more processors; and
a non-transitory computer readable storage medium in data communication with the one or more processors, wherein non-transitory computer readable storage medium includes processor-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations including:
establishing a data connection with a remote computing device using the network interface;
generating a graphical interface for output by a presentation device using the audio-video output interface;
identifying an interface element of the graphical interface;
generating an accessible interface element using the interface element, wherein the accessible interface element corresponds to a different presentation of the interface element to facilitate use by a user; and
transmitting, using the network interface, a signal providing the accessible interface element to the remote computing device to facilitate an audio or visual presentation of the accessible interface element to a user.

### Claim 39 (depends on 38)

The receiver of claim 38, wherein the accessible interface element corresponds to an audio version of the interface element, wherein the accessible interface element corresponds to a magnified version of the interface element, wherein the accessible interface element corresponds to an alternative color version of the interface element, wherein the accessible interface element corresponds to a simplified language version of the interface element, wherein the accessible interface element corresponds to a translated language version of the interface element, wherein the accessible interface element corresponds to a version of text having a second font size greater than a first font size of text in the interface element, wherein the accessible interface element corresponds to a version of text having a second font style different from a first font style of text in the interface element, or wherein the accessible interface element corresponds to a version of text having a second texture different from a first texture of text in the interface element.

### Claim 40 (depends on 38)

The receiver of claim 38, wherein the operations further include:
analyzing audio received at or generated by the receiver to identify a contextual element in the audio;
generating an accessible contextual element using the contextual element, wherein the accessible contextual element corresponds to a different presentation of the contextual element to facilitate presentation to the user; and
transmitting, using the network interface, a signal providing the accessible contextual element to the remote computing device to facilitate an audio or visual presentation of the accessible interface element to the user.

### Claim 41 (depends on 38)

The receiver of claim 38, wherein the operations further include:
analyzing video received at or generated by the receiver to identify a contextual element in the video;
generating an accessible contextual element using the contextual element, wherein the accessible contextual element corresponds to a different presentation of the contextual element to facilitate presentation to the user; and
transmitting, using the network interface, a signal providing the accessible contextual element to the remote computing device to facilitate an audio or visual presentation of the accessible interface element to the user.
