# US 2017/0286371 A1 · Generation of a modified ui element tree > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0286371 A1 - Document ID: US20170286371A1 - Status: Published application - Kind: A1 - Application number: 15/089,268 - Filed: 2016-04-01 - Published: 2017-10-05 - Earliest claimed: 2016-04-01 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: John Franciscus Marie Helmes; James Scott; Stuart Alastair Taylor; Stephen Edward Hodges; Nicholas Yen-Cherng Chen; Tobias Alexander Grosse-Puppendahl; Josh Fromm; Pascal Knierim; Gavin Wood; Albrecht Schmidt; Thomas Denney - Web page: https://patentgrep.com/patent/US20170286371A1 ## CPC - G06F 40/154: Tree transformation for tree-structured or markup documents, e.g. XSLT, XSL-FO or stylesheets - G06F 9/451: Execution arrangements for user interfaces - G06F 40/106: Display of layout of documents; Previewing - G06F 40/166: Editing, e.g. inserting or deleting - G06F 40/169: Annotation, e.g. comment data or footnotes - G09G 5/005: {Adapting incoming signals to the display format of the display terminal} - G09G 2354/00: Aspects of interface with display user - G09G 2360/02: Graphics controller able to handle multiple formats, e.g. input or output formats - G09G 2360/121: using a cache memory - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A computing device comprises an electronic paper display, a processor and a memory. The memory is arranged to store platform software and application software for at least one application that is not adapted to work with an electronic paper display. The platform software comprises a UI conversion module comprising device-executable instructions, which when executed by the processor, cause the processor to: access a UI element tree for the application; generate a modified UI element tree for the application by removing and/or re-styling at least one UI element; and render data from the application using the modified UI element tree for display on the electronic paper display. ## Claims ### Claim 1 A computing device comprising: an electronic paper display; a processor; and a memory arranged to store platform software and application software for at least one application that is not adapted to work with an electronic paper display, and wherein the platform software comprises a UI conversion module comprising device-executable instructions, which when executed by the processor, cause the processor to: access a UI element tree for the application; generate a modified UI element tree for the application by removing and/or re-styling at least one UI element; and render data from the application using the modified UI element tree for display on the electronic paper display. ### Claim 2 (depends on 1) The computing device according to claim 1, further comprising an emissive display or an interface permitting direct control of an emissive display. ### Claim 3 (depends on 1) The computing device according to claim 1, wherein the platform software further comprises device-executable instructions, which when executed by the processor, cause the processor to: output the data rendered using the modified UI tree to the electronic paper display. ### Claim 4 (depends on 1) The computing device according to claim 1, further comprising: a detachable portion comprising the electronic paper display. ### Claim 5 (depends on 3) The computing device according to claim 3, wherein the detachable portion further comprises: a power source; a display data store arranged to store a set of inter-related re-rendered UI images for the application generated by the UI conversion module; and a processor arranged to select and display one of the stored re-rendered UI images on the electronic paper display. ### Claim 6 (depends on 4) The computing device according to claim 4, wherein the detachable portion further comprises: a user input device; and wherein processor is arranged to select and display one of the re-rendered UI images on the electronic paper display in response to an input received via the user input device. ### Claim 7 (depends on 1) The computing device according to claim 1, wherein the modified UI element tree is generated based on characteristics of the electronic paper display. ### Claim 8 (depends on 6) The computing device according to claim 6, wherein the characteristics comprise one or more of: dynamic range; resolution; update rate; aspect ratio and input sensing capabilities. ### Claim 9 (depends on 1) The computing device according to claim 1, wherein the modified UI element tree is generated by removing at least one UI element that is not supported by the electronic paper display and/or re-styling at least one UI element dependent upon interactivity provided by the electronic paper display. ### Claim 10 (depends on 1) The computing device according to claim 1, wherein the modified UI element tree is generated by expanding a view of the application to display to remove a scroll bar and using a pagination strategy to create a plurality of re-rendered UI images from the expanded view. ### Claim 11 (depends on 10) The computing device according to claim 10, wherein the plurality of re-rendered UI images are partially overlapping. ### Claim 12 (depends on 1) The computing device according to claim 1, wherein the modified UI element tree is generated by capturing a navigable set of data from the application and using a pagination strategy to create a plurality of re-rendered UI images from the captured data. ### Claim 13 (depends on 1) The computing device according to claim 1, wherein the platform software further comprises device-executable instructions, which when executed by the processor, cause the processor to: cache the data rendered using the modified UI tree in a display data store for subsequent display on the electronic paper display. ### Claim 14 (depends on 1) The computing device according to claim 1, wherein the UI conversion module further comprises device-executable instructions, which when executed by the processor, cause the processor to: check if the rendered data satisfies a target rendering fidelity; and in response to determining that the rendered data does not satisfy the target rendering fidelity, to further modify the UI element tree for the application and re-render the data from the application using the further modified UI element tree. ### Claim 15 (depends on 1) The computing device according to claim 1, wherein the platform software further comprises device-executable instructions, which when executed by the processor, cause the processor to: generate a signal to trigger generation of the modified UI element tree by the UI conversion module. ### Claim 16 (depends on 15) The computing device according to claim 15, wherein the signal is generated in response to a user input or in response to a change in state or anticipated change in state of the computing device. ### Claim 17 A method of generating data for display on an electronic paper display, the data relating to an application that is not adapted to work with an electronic paper display and the method comprising: accessing a UI element tree for the application; generating a modified UI element tree for the application by removing and/or re-styling at least one UI element; and rendering data from the application using the modified UI element tree for display on the electronic paper display. ### Claim 18 (depends on 17) The method according to claim 17, further comprising: outputting the data rendered using the modified UI tree to the electronic paper display. ### Claim 19 (depends on 17) The method according to claim 17, wherein generating a modified UI element tree for the application by removing and/or re-styling at least one UI element comprises at least one of: removing at least one UI element that is not supported by the electronic paper display; re-styling at least one UI element dependent upon interactivity provided by the electronic paper display; and expanding a view of the application to display to remove an interactive control and processing the expanded view to create a plurality of re-rendered UI images from the expanded view. ### Claim 20 A computing device comprising: a processor; and a memory arranged to store compiler software and application software for at least one application that is not adapted to work with an electronic paper display, and wherein the compiler software comprises a UI conversion module comprising device-executable instructions, which when executed by the processor, cause the processor to: access a UI element tree for the application; generate a modified UI element tree for the application by removing and/or re-styling at least one UI element; and store the modified UI element tree for use in rendering data from the application for display on an electronic paper display.