# US 2025/0094019 A1 · Speech to text touchscreen graphics rendering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094019 A1
- Document ID: US20250094019A1
- Status: Published application
- Kind: A1
- Application number: 18/467,925
- Filed: 2023-09-15
- Published: 2025-03-20
- Earliest claimed: 2023-09-15
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Zachary A. Silverstein; Logan Bailey; Martin G. Keen; Tiberiu Suto
- Web page: https://patentgrep.com/patent/US20250094019A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Described is a method for generating graphics in a user interface corresponding to options provided by an interactive voice response component by determining an interactive voice response (IVR) component is active on a call initiated by a user. The method identifying a various options provided by the IVR component with respect to a keypad in a user interface on a touchscreen of a device and displaying a graphic for each option from the various options provided by the IVR component. In response to receiving a graphic selection for the plurality options from a user, sending an option selection corresponding to the graphic selection to the IVR component.

## Claims

### Claim 1

A computer-implemented method comprising:
determining an interactive voice response (IVR) component is active;
identifying a plurality of options provided by the IVR component with respect to a keypad in a user interface on a touchscreen of a device;
displaying a graphic for each option from the plurality of options provided by the IVR component; and
responsive to receiving a graphic selection for the plurality options, sending an option selection corresponding to the graphic selection to the IVR component.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving a user opt-in selection via a user selectable feature in the user interface, wherein the user opt-in selection displays the graphic for each option from the plurality options provided by the IVR component.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein sending the option selection corresponding to the graphic selection to the IVR component further comprises:
converting the graphic selection into a key selection on the keypad in the user interface; and
performing the key selection on the keypad in the user interface.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining the graphic for each option from the plurality of options provided by the IVR component utilizing a generative adversarial network (GAN) model to generate an image for the graphic for each option from the plurality options based on incoming audio from the IVR component.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
responsive to receiving a specific user input via the keypad in the user interface, sending a request to the IVR component for available IVR option pathways across a plurality of tiers with the plurality of options; and
responsive to receiving the available IVR option pathways from IVR component, displaying an ontology tree for the plurality of tiers with the plurality of options in the user interface for the graphic selection.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising:
receiving the graphic selection for an option from the plurality options via the ontology tree in the user interface, wherein the option is positioned on a tier that is not a first tier in the ontology tree.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
responsive to receiving a specific user input via the keypad in the user interface, displaying a summary of an option from the plurality of options for a specific graphic associated with a specific key on the keypad.

### Claim 8

A computer program product comprising:
one or more computer-readable storage media;
program instructions, stored on at least one of the one or more storage media, to determine an interactive voice response (IVR) component is active;
program instructions, stored on at least one of the one or more storage media, to identify a plurality of options provided by the IVR component with respect to a keypad in a user interface on a touchscreen of a device;
program instructions, stored on at least one of the one or more storage media, to display a graphic for each option from the plurality of options provided by the IVR component; and
program instructions, stored on at least one of the one or more storage media, responsive to receiving a graphic selection for the plurality options, to send an option selection corresponding to the graphic selection to the IVR component.

### Claim 9 (depends on 8)

The computer program product of claim 8, further comprising:
program instructions, stored on at least one of the one or more storage media, to receive a user opt-in selection via a user selectable feature in the user interface, wherein the user opt-in selection displays the graphic for each option from the plurality options provided by the IVR component.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein program instructions, stored on at least one of the one or more storage media, to send the option selection corresponding to the graphic selection to the IVR component further comprises:
program instructions, stored on at least one of the one or more storage media, to convert the graphic selection into a key selection on the keypad in the user interface; and
program instructions, stored on at least one of the one or more storage media, to perform the key selection on the keypad in the user interface.

### Claim 11 (depends on 8)

The computer program product of claim 8, further comprising:
program instructions, stored on at least one of the one or more storage media, to determine the graphic for each option from the plurality of options provided by the IVR component utilizing a generative adversarial network (GAN) model to generate an image for the graphic for each option from the plurality options based on incoming audio from the IVR component.

### Claim 12 (depends on 8)

The computer program product of claim 8, further comprising:
program instructions, stored on at least one of the one or more storage media, responsive to receiving a specific user input via the keypad in the user interface, to send a request to the IVR component for available IVR option pathways across a plurality of tiers with the plurality of options; and
program instructions, stored on at least one of the one or more storage media, responsive to receiving the available IVR option pathways from IVR component, to display an ontology tree for the plurality of tiers with the plurality of options in the user interface for the graphic selection.

### Claim 13 (depends on 12)

The computer program product of claim 12, further comprising:
program instructions, stored on at least one of the one or more storage media, to receiving the graphic selection for an option from the plurality options via the ontology tree in the user interface, wherein the option is positioned on a tier that is not a first tier in the ontology tree.

### Claim 14 (depends on 8)

The computer program product of claim 8, further comprising:
program instructions, stored on at least one of the one or more storage media, responsive to receiving a specific user input via the keypad in the user interface, to display a summary of an option from the plurality of options for a specific graphic associated with a specific key on the keypad.

### Claim 15

A computer system comprising:
one or more processors, one or more computer-readable memories and one or more computer-readable storage media;
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to determine an interactive voice response (IVR) component is active;
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to identify a plurality of options provided by the IVR component with respect to a keypad in a user interface on a touchscreen of a device;
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to display a graphic for each option from the plurality of options provided by the IVR component; and
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to receiving a graphic selection for the plurality options, to send an option selection corresponding to the graphic selection to the IVR component.

### Claim 16 (depends on 15)

The computer system of claim 15, further comprising:
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to receive a user opt-in selection via a user selectable feature in the user interface, wherein the user opt-in selection displays the graphic for each option from the plurality options provided by the IVR component.

### Claim 17 (depends on 15)

The computer system of claim 15, wherein program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to send the option selection corresponding to the graphic selection to the IVR component further comprises:
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to convert the graphic selection into a key selection on the keypad in the user interface; and
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to perform the key selection on the keypad in the user interface.

### Claim 18 (depends on 15)

The computer system of claim 15, further comprising:
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to determine the graphic for each option from the plurality of options provided by the IVR component utilizing a generative adversarial network (GAN) model to generate an image for the graphic for each option from the plurality options based on incoming audio from the IVR component.

### Claim 19 (depends on 15)

The computer system of claim 15, further comprising:
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to receiving a specific user input via the keypad in the user interface, to send a request to the IVR component for available IVR option pathways across a plurality of tiers with the plurality of options; and
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, responsive to receiving the available IVR option pathways from IVR component, to display an ontology tree for the plurality of tiers with the plurality of options in the user interface for the graphic selection.

### Claim 20 (depends on 19)

The computer system of claim 19, further comprising:
program instructions, stored on at least one of the one or more storage media for execution by at least one of the one or more processors via at least one of the one or more memories, to receive the graphic selection for an option from the plurality options via the ontology tree in the user interface, wherein the option is positioned on a tier that is not a first tier in the ontology tree.
