# US 12,008,388 B2 · Data transfers from memory to manage graphical output latency

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,008,388 B2
- Document ID: US12008388B2
- Status: Granted
- Kind: B2
- Application number: 18/208,705
- Filed: 2023-06-12
- Published: 2023-10-12
- Granted: 2024-06-11
- Earliest claimed: 2022-01-31
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Jian Wei Leong; Leo Baghdassarian; Lucas Hiroshi De Carvalho Hirata
- Web page: https://patentgrep.com/patent/US12008388B2

## CPC

- G06F 9/451: Execution arrangements for user interfaces
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/0485: Scrolling or panning
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/63: Querying
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods of transferring data from memory to manage graphical output latency are provided. A device having a display receives an acoustic signal that carries a query. The device determines that a wireless controller is in a first state. The device establishes, based on receipt of the acoustic signal and the determination that the wireless controller device is in the first state, a first interaction mode for a graphical user interface rendered by the computing device for display via the display device. The device sets a prefetch parameter to a first value and prefetches the corresponding amount of electronic content items. The device establishes a second interaction mode and overrides the first value of the prefetch parameter to a second value, and prefetches a second amount of electronic content items corresponding to the second value.

## Claims

### Claim 1

A computer implemented method, comprising:
identifying a first user interaction received at a device;
determining a voice interaction mode via which the first user interaction was received;
identifying one or more features of content available in the voice interaction mode;
rendering the features of the content available in the voice interaction mode via a graphical user interface (GUI) of the device;
identifying, subsequent to rendering the features of the content available in the voice interaction mode, a second user interaction at the device;
determining a remote interaction mode via which the second user interaction was received;
identifying one or more additional features of the content available in the remote interaction mode which are unavailable in the voice interaction mode; and
rendering the additional features of the content available in the remote interaction mode via the GUI of the device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the features of the content available in the voice interaction mode are identified based on the features being structured for user interaction with the content in a one-dimensional format.

### Claim 3 (depends on 2)

The method of claim 2, wherein the one-dimensional format is a scrolling mode in which the content can be scrolled along a horizontal axis or a vertical axis of the GUI in response to voice interaction.

### Claim 4 (depends on 1)

The method of claim 1, wherein the additional features of the content available in the remote interaction mode are identified based on the additional features being structured for user interaction with the content in a multi-dimensional format.

### Claim 5 (depends on 4)

The method of claim 4, wherein the multi-dimensional format is a pagination mode in which the content can be scrolled along at least a horizontal axis and a vertical axis of the GUI in response to remote interaction.

### Claim 6 (depends on 1)

The method of claim 1, wherein rendering the features of the content available in the voice interaction mode comprises rendering the features formatted in a first GUI template corresponding to a first percentage of the content presentable at the device in response to the first user interaction occurring via the voice interaction mode.

### Claim 7 (depends on 1)

The method of claim 1, wherein rendering the additional features of the content available in the remote interaction mode comprises rendering the additional features formatted in a second GUI template corresponding to a second percentage of the content presentable at the device in response to the second user interaction occurring via the remote interaction mode.

### Claim 8 (depends on 7)

The method of claim 7, wherein the second percentage of the content presentable at the device in response to the second user interaction occurring via the remote interaction mode is greater than a first percentage of the content presentable at the device in response to the first user interaction occurring via the voice interaction mode based on the voice interaction mode including a greater quantity of dimensions via which user interaction with the content can occur.

### Claim 9 (depends on 1)

The method of claim 1, further comprising: pre-fetching the content using first parameters optimized for a first GUI template in response to identifying the features of the content available in the voice interaction mode, and pre-fetching the content using second parameters optimized for a second GUI template in response to identifying the additional features of the content available in the remote interaction mode.

### Claim 10 (depends on 9)

The method of claim 9, wherein a greater quantity of the content is pre-fetched using the second parameters than the first parameters based on a second percentage of the content being presentable at the device in response to the second user interaction occurring via the remote interaction mode being greater than a first percentage of the content being presentable at the device in response to the first user interaction occurring via the voice interaction mode.

### Claim 11 (depends on 9)

The method of claim 9, further comprising:
identifying a third user interaction received at the device prior to receiving the first user interaction at the device;
determining the third user interaction was received via the remote interaction mode;
determining, subsequent to determining the voice interaction mode via which the first user interaction is received, that in response to receiving the third user interaction via the remote interaction mode, content was pre-fetched using the second parameters and includes features structured for user interaction with the content in a one-dimensional format; and
rendering, based on the content pre-fetched using the second parameters and in response to the interaction, the content optimized for the first GUI template via the GUI of the device.

### Claim 12

A system, comprising:
one or more processors; and
one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations comprising:
identifying a first user interaction received at a device;
determining a voice interaction mode via which the first user interaction was received;
identifying features of content available in the voice interaction mode;
rendering the features of the content available in the voice interaction mode via a graphical user interface (GUI) of the device;
identifying, subsequent to rendering the features of the content available in the voice interaction mode, a second user interaction received at the device;
determining a remote interaction mode via which the second user interaction was received;
identifying additional features of the content available in the remote interaction mode which are unavailable in the voice interaction mode; and
rendering the additional features of the content available in the remote interaction mode via the GUI of the device.

### Claim 13 (depends on 12)

The system of claim 12, wherein the features of the content available in the voice interaction mode are structured for user interaction with the content in a one-dimensional format.

### Claim 14 (depends on 13)

The system of claim 13, wherein the one-dimensional format is a scrolling mode in which the content can be scrolled along a horizontal axis or a vertical axis of the GUI in response to voice interaction.

### Claim 15 (depends on 12)

The system of claim 12, wherein the additional features of the content available in the remote interaction mode are structured for user interaction with the content in a multi-dimensional format.

### Claim 16 (depends on 15)

The system of claim 15, wherein the multi-dimensional format is a pagination mode in which the content can be scrolled along at least a horizontal axis and a vertical axis of the GUI in response to remote interaction.

### Claim 17 (depends on 12)

The system of claim 12, wherein the features of the content available in the voice interaction mode are formatted in a first GUI template corresponding to a first percentage of the content presentable in response to the first user interaction occurring via the voice interaction mode.

### Claim 18 (depends on 12)

The system of the claim 12, the additional features of the content available in the remote interaction mode are formatted in a second GUI template corresponding to a second percentage of the content presentable in response to the second user interaction occurring via the remote interaction mode.

### Claim 19 (depends on 18)

The system of claim 18, wherein the second percentage of the content presentable at the device in response to the second user interaction occurring via the remote interaction mode is greater than a first percentage of the content presentable at the device in response to the first user interaction occurring via the voice interaction mode based on the voice interaction mode including a greater quantity of dimensions via which user interaction with the content can occur.

### Claim 20 (depends on 12)

The system of claim 12, wherein the content is pre-fetched using first parameters optimized for a first GUI template in response to identifying features of the content available in the voice interaction mode, and the content is pre-fetched using second parameters optimized for a second GUI template in response to identifying features of the content available in the remote interaction mode.
