# US 2023/0055223 A1 · Server-provided visual output at a voice interface device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055223 A1
- Document ID: US20230055223A1
- Status: Published application
- Kind: A1
- Application number: 17/973,620
- Filed: 2022-10-26
- Published: 2023-02-23
- Earliest claimed: 2016-11-18
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Kenneth Mixter; Yuan Yuan
- Web page: https://patentgrep.com/patent/US20230055223A1

## CPC

- G08B 5/36: using visible light sources
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G08B 3/10: using electric transmission; using electromagnetic transmission
- G09G 3/14: Semiconductor devices, e.g. diodes
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- H04L 12/2825: {Reporting to a device located outside the home and the home network (access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; telephonic communication systems adapted for combination with telemetering systems H04M11/002)}
- G10L 2015/225: {Feedback of the input speech}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method at an electronic device with an array of indicator lights includes: obtaining first visual output instructions stored at the electronic device, where the first visual output instructions control operation of the array of indicator lights based on operating state of the electronic device; receiving a voice input; obtaining from a remote system a response to the voice input and second visual output instructions, where the second visual output instructions are provided by the remote system along with the response in accordance with a determination that the voice input satisfies one or more criteria; executing the response; and displaying visual output on the array of indicator lights in accordance with the second visual output instructions, where otherwise in absence of the second visual output instructions the electronic device displays visual output on the array of indicator lights in accordance with the first visual output instructions.

## Claims

### Claim 1

An electronic device, comprising:
an array of indicator lights;
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
causing first visual output instructions stored at the electronic device to control operation of the array of indicator lights based on an operating state of the electronic device;
receiving an input;
obtaining, from a remote system, a response to the input and second visual output instructions, wherein the second visual output instructions and the response are provided by the remote system; and
in response to obtaining the second visual output instructions, changing operation of the array of indicator lights to respond to the second visual output instructions instead of the first visual output instructions.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the one or more programs further comprise instructions for:
in response to an absence of the second visual output instructions, displaying visual output on the array of indicator lights in accordance with the first visual output instructions.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the one or more programs further comprise instructions for:
receiving a second input;
determining that the second input satisfies one or more criteria; and
causing third visual output instructions to control operation of the array of indicator lights instead of the first visual output instructions based on the one or more criteria determined to be satisfied.

### Claim 4 (depends on 3)

The electronic device of claim 3, wherein the third visual output instructions cause a different color and/or animation to be displayed by the array of indicator lights than the first visual output instructions.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the one or more programs further comprise instructions for executing the response.

### Claim 6 (depends on 1)

The electronic device of claim 1, further comprising: a microphone and a speaker.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the input is a voice input received via the microphone.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the response comprises outputting an audible output via the speaker.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein indicator lights of the array of indicator lights are arranged in a ring.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the indicator lights of the array of indicator lights are full color light emitting diodes (LEDs).

### Claim 11

A method, comprising:
causing, by an electronic device, first visual output instructions stored at the electronic device to control operation of an array of indicator lights based on an operating state of the electronic device, wherein:
the electronic device comprises the array of indicator lights and one or more processors;
receiving, by the electronic device, an input;
obtaining, by the electronic device from a remote system, a response to the input and second visual output instructions, wherein the second visual output instructions and the response are provided by the remote system; and
in response to obtaining the second visual output instructions, changing, by the electronic device, operation of the array of indicator lights to respond to the second visual output instructions instead of the first visual output instructions.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
in response to an absence of the second visual output instructions, causing, by the electronic device, the first visual output instructions to control operation of the array of indicator lights.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
receiving, by the electronic device, a second input;
determining, by the electronic device, that the second input satisfies one or more criteria; and
causing, by the electronic device, third visual output instructions stored by the electronic device to control operation of the array of indicator lights instead of the first visual output instructions based on the one or more criteria determined to be satisfied.

### Claim 14 (depends on 13)

The method of claim 13, wherein the third visual output instructions cause a different color and/or animation to be displayed by the array of indicator lights than the first visual output instructions.

### Claim 15 (depends on 11)

The method of claim 11, further comprising executing, by the electronic device, the response by outputting an audible output via a speaker of the electronic device.

### Claim 16 (depends on 15)

The method of claim 15, wherein the input is a voice input received by a microphone of the electronic device.

### Claim 17 (depends on 11)

The method of claim 11, wherein indicator lights of the array of indicator lights are physically arranged in a ring shape.

### Claim 18

A non-transitory processor-readable medium, comprising processor-readable instructions configured to cause one or more processors of an electronic device to:
cause first visual output instructions stored at the electronic device to control operation of an array of indicator lights based on an operating state of the electronic device;
receive an input;
obtain, from a remote system, a response to the input and second visual output instructions, wherein the second visual output instructions and the response are provided by the remote system; and
in response to obtaining the second visual output instructions, change operation of the array of indicator lights to respond to the second visual output instructions instead of the first visual output instructions.

### Claim 19 (depends on 18)

The non-transitory processor-readable medium of claim 18, wherein the processor-readable instructions are further configured to cause the one or more processors to:
receive a second input;
determine that the second input satisfies one or more criteria; and
cause third visual output instructions stored by the electronic device to control operation of the array of indicator lights instead of the first visual output instructions based on the one or more criteria determined to be satisfied.

### Claim 20 (depends on 19)

The non-transitory processor-readable medium of claim 19, wherein the third visual output instructions cause a different color and/or animation to be displayed by the array of indicator lights than the first visual output instructions.
