Dynamic user interface mode optimization for multimodal devices

Abstract

Approaches disclosed herein relate to dynamically determining and assigning user interface (UI) interaction modes across multiple multimodal devices based on real-time detection of input methods and screen sizes. Input methods are detected using web APIs. A screen size is determined using CSS pixel measurements and monitored for changes. CSS media queries are used to detect the effective resolution of the device's display. By applying breakpoints defined in CSS, the screen size can be categorized into predefined groups. The device state may be continuously monitored in real-time to identify any modifications, such as connecting or disconnecting input devices. Events triggered by these changes may be captured using the web APIs and event listeners. Such a system can listen for events like connecting or disconnecting devices to dynamically reassign the interaction mode. Such reassignment can be guided by an algorithm that prioritizes input methods based on the device's screen size and context.

Dependencies are inferred from the claim text.