Providing accessibility to visually impaired users of dynamic applications
AssigneeCisco Technology, Inc.
InventorsDavid C. White, JR., Mohammed Izzat Hamzeh
Life of this patent
Estimating the term…
Abstract
In one implementation, a device obtains a captured image of application data displayed by an application to a user via an electronic display of an endpoint operated by the user. The device generates a prompt for input to a generative artificial intelligence model that asks the generative artificial intelligence model to summarize the captured image. The device sends the prompt to the generative artificial intelligence model, to generate a summary of the captured image. The device causes the endpoint operated by the user to read the summary of the captured image to the user.
Claims20
A method, comprising:
- obtaining, by a device, a captured image of application data displayed by an application to a user via an electronic display of an endpoint operated by the user;
- generating, by the device, a prompt for input to a generative artificial intelligence model that asks the generative artificial intelligence model to summarize the captured image;
- sending, by the device, the prompt to the generative artificial intelligence model, to generate a summary of the captured image;
- and
- causing, by the device, the endpoint operated by the user to read the summary of the captured image to the user.
An apparatus, comprising:
- one or more network interfaces;
- a processor coupled to the one or more network interfaces and configured to execute one or more processes;
- and
- a memory configured to store a process that is executable by the processor, the process when executed configured to:
- obtain a captured image of application data displayed by an application to a user via an electronic display of an endpoint operated by the user;
- generate a prompt for input to a generative artificial intelligence model that asks the generative artificial intelligence model to summarize the captured image;
- send the prompt to the generative artificial intelligence model, to generate a summary of the captured image;
- and
- cause the endpoint operated by the user to read the summary of the captured image to the user.
A tangible, non-transitory, computer-readable medium storing program instructions that cause a device to execute a process comprising:
- obtaining, by the device, a captured image of application data displayed by an application to a user via an electronic display of an endpoint operated by the user;
- generating, by the device, a prompt for input to a generative artificial intelligence model that asks the generative artificial intelligence model to summarize the captured image;
- sending, by the device, the prompt to the generative artificial intelligence model, to generate a summary of the captured image;
- and
- causing, by the device, the endpoint operated by the user to read the summary of the captured image to the user.
Dependencies are inferred from the claim text.