# US 2023/0391190 A1 · Synchronized rendering

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0391190 A1
- Document ID: US20230391190A1
- Status: Published application
- Kind: A1
- Application number: 17/952,143
- Filed: 2022-09-23
- Published: 2023-12-07
- Earliest claimed: 2022-06-04
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Andre M. BOULE; Bartosz CIECHANOWSKI; Eldad EILAM; Vikrant KASARABADA; Michael L. KNIPPERS; Sylvain P. REBAUD; Gennadiy SHEKHTMAN; Mark J. VAN BELLEGHEM; Francesco ZULIANI
- Web page: https://patentgrep.com/patent/US20230391190A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/21: using visual output, e.g. blinking lights or matrix displays
- B60K 35/215: characterised by the combination of multiple visual outputs, e.g. combined instruments with analogue meters and additional displays
- B60K 35/22: Display screens
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/25: using haptic output
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/80: Arrangements for controlling instruments
- B60K 37/00: Dashboards (as road-vehicle superstructure sub-units B62D25/14)
- G01C 21/3664: {Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/1462: {with means for detecting differences between the image stored in the host and the images displayed on the remote displays}
- G06F 3/147: using display panels
- G06F 9/451: Execution arrangements for user interfaces
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 11/65: on geographic maps
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images}
- B60K 2360/563: Vehicle displaying mobile device information
- B60K 2360/573: Mobile devices controlling vehicle functions
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/10: Automotive applications
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Current techniques for rendering content using data on multiple devices are generally ineffective and/or inefficient. This disclosure provides more effective and/or efficient techniques for rendering such content. The techniques optionally complement or replace other methods for rendering content.

## Claims

### Claim 1

A method, comprising:
receiving, from a device, a rendered frame;
receiving, from the device, a message including data;
determining, based on the data, a modification with respect to a user interface element;
in accordance with the determining, rendering the user interface element;
generating a combined frame by combining the user interface element with the rendered frame; and
outputting the combined frame for display.

### Claim 2 (depends on 1)

The method of claim 1, wherein the rendered frame is rendered by the device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the message is received before the rendered frame is received.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving rendered content corresponding to the user interface element, wherein the rendered content is received before the message is received.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a script for rendering the user interface element, wherein the script is received before the message is received.

### Claim 6 (depends on 1)

The method of claim 1, wherein the rendered frame received from the device includes a placeholder portion, and wherein the combined frame includes the user interface element at a location corresponding to the placeholder portion.

### Claim 7 (depends on 1)

The method of claim 1, wherein the data includes an indication of a size of the user interface element.

### Claim 8 (depends on 1)

The method of claim 1, wherein the data includes an indication of a location within the rendered frame.

### Claim 9 (depends on 1)

The method of claim 1, wherein the data includes an indication of an opacity.

### Claim 10 (depends on 1)

The method of claim 1, wherein the data includes an indication of a color.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
after receiving the rendered frame, receiving, from the device, a second rendered frame;
at a third time, receiving, from the device, a second message including a fourth time, wherein the fourth time is after the third time; and
outputting a frame corresponding to the second rendered frame for display at the fourth time.

### Claim 12

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first device, the one or more programs including instructions for:
receiving, from a second device different from the first device, a rendered frame;
receiving, from the second device, a message including data;
determining, based on the data, a modification with respect to a user interface element;
in accordance with the determining, rendering the user interface element;
generating a combined frame by combining the user interface element with the rendered frame; and
outputting the combined frame for display.

### Claim 13

A first device comprising:
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for
receiving, from a second device different from the first device, a rendered frame;
receiving, from the second device, a message including data;
determining, based on the data, a modification with respect to a user interface element;
in accordance with the determining, rendering the user interface element;
generating a combined frame by combining the user interface element with the rendered frame; and
outputting the combined frame for display.
