US 8,799,774 B2Granted

Translatable annotated presentation of a computer program operation

AssigneeInternational Business Machines Corporation

InventorsCarl Randall Chafy, Mario Francois Daigle, Craig Allen Statchuk, Wayne Robert Stevens

Life of this patent

Estimating the term…

Loading patent…

Abstract

Embodiments of the disclosure relate to generating a translatable and annotated multimedia or video presentation of a software program operation. An aspect of the disclosure comprises recording user interaction data that includes user interface gestures and text entries from a keyboard and other user devices while the program is operating. Embodiments of the disclosure transform recorded text and visual contents of the program to a selected format or language, annotate contents of interest, and merge recorded user interface gestures, transformed text and visual contents, and transformed annotations into the output presentation. The embodiments of the disclosure optionally generate an accessibility script in a selected format.

Claims21

Dependent claims

A system for generating a presentation of a program operation, comprising:

a computer;
a recorder coupled to the computer and comprising a user interface gesture capturing module and a user interface text capturing module, the user interface gesture capturing module recording user interface gestures in a gesture recording and the user interface text capturing module recording user interface text in a text recording while the program is operating, and the user interface text including input-output text and annotation text;
a gesture replay module operable to, during a subsequent playback of the program, read the gesture recording and synchronize input to a user interface from the gesture recording with execution of the program to recreate the user interface gestures that were previously demonstrated when creating the gesture recording to control the program and cause the program to perform operations that were previously demonstrated when recording the user interface gestures;
a text insertion module operable to, during the subsequent playback of the program, read the text recording and insert the previously recorded user interface text in a display with execution of the program;
a localization and transformation module operable to localize and transform the subsequently played back program by transforming a user interface resource into a desired local form, the localization and transformation module further operable to modify the text recording to cause the inserted text to be compatible with the desired local form;
an annotation capture module operable to generate a transformed accessibility script describing a user interface gesture of the gesture recording for a user with a disability;
and
a presentation generator for merging the gesture recording, the text recording, the inserted user interface text, the replayed user interface gestures, the modified text recording, and the accessibility script to generate the presentation.

5 more elements

A computer program product for generating a presentation of a program operation, the computer program product comprising a computer readable non-transitory storage medium having computer readable program code embodied therewith and configured to:

record user interface gestures in a gesture recording and record user interface text in a text recording while the program is operating, the user interface text including input-output text and annotation text;
during a subsequent playback of the program, read the gesture recording and synchronize input to a user interface from the gesture recording with execution of the program to recreate the user interface gestures that were previously demonstrated when creating the gesture recording to control the program and cause the program to perform operations that were previously demonstrated when recording the user interface gestures;
during the subsequent playback of the program, reading the text recording and inserting the previously recorded user interface text in a display with execution of the program;
localize and transform the subsequently played back program by transforming a user interface resource into a desired local form and modifying the text recording to cause the inserted text to be compatible with the desired local form;
generate a transformed accessibility script describing a user interface gesture of the gesture recording for a user with a disability;
and
merge the gesture recording, the text recording, the inserted user interface text, the replayed user interface gestures, the modified text recording, and the accessibility script to generate the presentation.

4 more elements

Dependencies are inferred from the claim text.