Conversion of remote application dialogs to native mobile controls

A remote server computing system comprising:

• a memory;
• and
• a processing device operatively coupled to the memory, the processing device to:
• identify pixel mapping data corresponding to an active application window, the active application window comprising a user interface in a first format generated by an application running on the remote server;
• identify, based on the pixel mapping data corresponding to the active application window, at least one control in the active application window and a plurality of control options associated with the at least one control;
• generate a first metadata representation of the at least one control and of the plurality of control options;
• and
• send the first metadata representation to a mobile device communicatively coupled to the remote server, the mobile device to generate a user interface in a second format based on the first metadata representation to present the control and the plurality of control options on the mobile device.