# US 2014/0196061 A1 · Method and system for integrating visual controls with legacy applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0196061 A1 - Document ID: US20140196061A1 - Status: Published application - Kind: A1 - Application number: 13/735,794 - Filed: 2013-01-07 - Published: 2014-07-10 - Earliest claimed: 2013-01-07 - Assignees: General Electric Company - Applicants: General Electric Company - Inventors: Giridhar Iyer; Venu Tadepalli - Web page: https://patentgrep.com/patent/US20140196061A1 ## CPC - G06F 9/541: {via adapters, e.g. between incompatible applications} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method is provided for controlling a legacy application. The method includes visually capturing a series of movements. The method also includes recording the series of movements at a first time as a recorded series of movements. Moreover, the recorded series of movements includes at least a command that is configured to control a legacy application. Furthermore, the method includes invoking the recorded series of movements at a second time. ## Claims ### Claim 1 A method for controlling a legacy application, comprising: visually capturing a series of movements; recording the series of movements at a first time as a recorded series of movements, wherein the recorded series of movements comprises at least a command that is configured to control a legacy application; and invoking the recorded series of movements at a second time. ### Claim 2 (depends on 1) The method of claim 1, comprising editing the recorded series of movements at a third time. ### Claim 3 (depends on 2) The method of claim 2, wherein editing of the recorded series of movements comprises using a mobile computing device. ### Claim 4 (depends on 1) The method of claim 1, wherein recording the series of movements comprises receiving user input to record a name for the recorded series of movements. ### Claim 5 (depends on 1) The method of claim 1, wherein recording the series of movements comprises using an image capturing device. ### Claim 6 (depends on 5) The method of claim 5, wherein using the image capturing device comprises using a wand configured to assist the image capturing device in capturing the series of movements. ### Claim 7 (depends on 1) The method of claim 1, wherein recording the series of movements comprises capturing voice commands and integrating the voice commands into the recorded series of movements. ### Claim 8 (depends on 1) The method of claim 1, comprising controlling a legacy application by using the recorded series of movements and without using a legacy application programming interface configured to control the legacy application, wherein the legacy application is configured to manage an electrical network. ### Claim 9 A system, comprising: at least one processor; a memory communicatively coupled to the at least one processor; an image capturing device configured to record a series of movements in the memory at a first time as a recorded series of movements, wherein the recorded series of movements comprises at least a command that is configured to control a legacy application; and an input interface configured to invoke the recorded series of movements at a second time. ### Claim 10 (depends on 9) The system of claim 9, comprising an editing interface configured to enable a user to edit the recorded series of movements. ### Claim 11 (depends on 9) The system of claim 9, wherein the input interface comprises a mobile computing device remote from the at least one processor. ### Claim 12 (depends on 11) The system of claim 11, wherein the mobile computing device comprises an editing interface configured to edit the recorded series of movements. ### Claim 13 (depends on 9) The system of claim 9, comprising a microphone configured to capture voice commands associated with the series of movements. ### Claim 14 (depends on 9) The system of claim 9, wherein the legacy application is configured to manage an electrical network. ### Claim 15 (depends on 9) The system of claim 9, wherein the at least one processor derives a plurality of user interface commands configured to navigate through a user interface included in the legacy application based on the recorded series of movements. ### Claim 16 (depends on 15) The system of claim 15, wherein an execution of the plurality of user interface commands by the at least one processor is faster than a playback of the recorded series of movements by the at least one processor. ### Claim 17 A visual control apparatus, comprising: an image capture device configured to capture a series of movements; a memory configured to record the series of movements as a recorded series of movements, wherein the recorded series of the movements comprises at least a command that is configured to control a legacy application, and a user interface application configured to invoke or to edit the recorded series of movements. ### Claim 18 (depends on 17) The apparatus of claim 17, wherein the legacy application is configured to manage an electrical network. ### Claim 19 (depends on 17) The apparatus of claim 17, comprising a communication interface configured to transport the recorded series of movements to the legacy application through one or more pools as a protein. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein each pool is a queue implemented as a ring buffer, and wherein the protein is a self describing data structure unit.