# US 2020/0349942 A1 · Home appliance and method for controlling thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0349942 A1
- Document ID: US20200349942A1
- Status: Published application
- Kind: A1
- Application number: 16/859,330
- Filed: 2020-04-27
- Published: 2020-11-05
- Earliest claimed: 2019-04-30
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Changkyu AHN; Minkyong KIM; Miyoung YOO; Hyoungjin LEE
- Web page: https://patentgrep.com/patent/US20200349942A1

## CPC

- G08C 23/02: using infrasonic, sonic or ultrasonic waves
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04L 12/2803: {Home automation networks}
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
- G08C 2201/12: Power saving techniques of remote control or controlled devices
- G08C 2201/31: Voice input
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 25/87: Detection of discrete points within a voice signal
- G10L 25/93: Discriminating between voiced and unvoiced parts of speech signals (G10L25/90 takes precedence)
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/226: {using non-speech characteristics}
- G10L 2015/228: {of application context}
- H04L 12/2816: {Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)}
- H04L 12/2823: {Reporting information sensed by appliance or service execution status of appliance services in a home automation network (device-related reporting H04L43/065; arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)}
- H04L 12/2829: {involving user profiles according to which the execution of a home appliance functionality is automatically triggered}
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)

## Abstract

A home appliance is provided. The home appliance includes a sensor, a microphone, a speaker, and a processor. The processor is configured to, based on one of a first event wherein a user action is detected through the sensor or a second event wherein a trigger command for initiating a voice recognition mode is input through the microphone occurring, operate in the voice recognition mode, and control the speaker to output an audio signal corresponding to the event occurred, and the audio signal is an audio signal set differently for each of the first event and the second event.

## Claims

### Claim 1

A home appliance comprising:
a memory storing instructions; and
at least one processor that executes the instructions to:
based on a user action being detected through a sensor, control a speaker to output an audio signal corresponding to the detection of the user action and control the home appliance to operate in a voice recognition mode, and
based on a trigger command for initiating the voice recognition mode being input through a microphone, control the speaker to output an audio signal corresponding to the input of the trigger command and control the home appliance to operate in the voice recognition mode,
wherein the audio signal corresponding to the detection of the user action is different than the audio signal corresponding to the input of the trigger command.

### Claim 2 (depends on 1)

The home appliance of claim 1, wherein
the home appliance includes a door and the sensor,
the sensor is to detect opening of the door, and
the user action is the opening of the door.

### Claim 3 (depends on 1)

The home appliance of claim 1, wherein
the sensor is a motion detector, and
the user action is user access of the home appliance indicated by motion of the user detected by the sensor.

### Claim 4 (depends on 1)

The home appliance of claim 1, wherein
the audio signal corresponding to the detection of the user action is a voice message informing that the voice recognition mode is initiated, and
the audio signal corresponding to the input of the trigger command is an alarming sound.

### Claim 5 (depends on 4)

The home appliance of claim 4, further comprising:
a user interface device configured to receive a selection of whether to activate each of the detection of the user action through the sensor and the inputting of the trigger command through the microphone,
wherein the at least one processor executes the instructions to:
based on the inputting of the trigger command through the microphone being inactivated by a selection received by the user interface device, turn off the microphone, and
based on the inputting of the trigger command through the microphone being activated by a selection received by the user interface device, turn on the microphone and execute a voice recognition module to initiate the voice recognition mode.

### Claim 6 (depends on 5)

The home appliance of claim 5, wherein the at least one processor executes the instructions to:
based on the detection of the user action through the sensor being inactivated by a selection received by the user interface device, turn off the sensor, and
based on the detection of the user action through the sensor being activated by a selection received by the user interface device, turn on the sensor.

### Claim 7 (depends on 1)

The home appliance of claim 1, wherein
the at least one processor includes first and second processors,
the first processor is configured to recognize the trigger command input through the microphone and to output a signal to the second processor in response to the trigger command being recognized, and
the second processor is configured to be turned off in a standby state and to receive the signal output by the first processor when turned off in the standby state, and, when receiving the signal output by the first processor when turned off in the standby state, to be turned on and then operate in the voice recognition mode.

### Claim 8 (depends on 1)

The home appliance of claim 1, further comprising:
a memory configured to store authority information for each user of the home appliance,
wherein the at least one processor executes the instructions to:
based on a user voice being input through the microphone in the voice recognition mode, recognize the user by identifying the user voice, and based on an operation corresponding to the user voice matching the authority information of the recognized user, perform the operation.

### Claim 9

A method comprising:
by at least one processor of a home appliance,
based on a user action being detected through a sensor, control a speaker to output an audio signal corresponding to the detection of the user action and control the home appliance to operate in a voice recognition mode, and
based on a trigger command for initiating the voice recognition mode being input through a microphone, control the speaker to output an audio signal corresponding to the input of the trigger command and control the home appliance to operate in the voice recognition mode,
wherein the audio signal corresponding to the detection of the user action is different than the audio signal corresponding to the input of the trigger command.

### Claim 10 (depends on 9)

The method of claim 9, wherein:
the sensor is to detect opening of a door of the home appliance, and
the user action is the opening of the door.

### Claim 11 (depends on 9)

The method of claim 9, wherein:
the sensor is a motion detector, and
the user action is user access of the home appliance indicated by motion of the user detected by the sensor.

### Claim 12 (depends on 9)

The method of any one of claim 9, wherein
the audio signal corresponding to the detection of the user action is a voice message informing that the voice recognition mode is initiated, and
the audio signal corresponding to the input of the trigger command is an alarming sound.

### Claim 13 (depends on 12)

The method of claim 12, wherein the home appliance includes a user interface device configured to receive a selection of whether to activate each of the detection of the user action through the sensor and the inputting of the trigger command through the microphone, and the method further comprising:
by the at least one processor of the home appliance,
based on the inputting of the trigger command through the microphone being inactivated by a selection received by the user interface device, turn off the microphone, and
based on the inputting of the trigger command through the microphone being activated by a selection received by the user interface device, turn on the microphone and execute a voice recognition module to initiate the voice recognition mode.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
by the at least one processor of the home appliance,
based on the detection of the user action through the sensor being inactivated by a selection received by the user interface device, turning off the sensor, and
based on the detection of the user action through the sensor being activated by a selection received by the user interface device, turn on the sensor.

### Claim 15 (depends on 9)

The method of claim 9, wherein the at least one processor includes a first processor and a second processor, and the method further comprising:
recognizing, by the first processor, the trigger command input through the microphone and outputting, while the second processor is turned off in a standby state, a signal in response to the trigger command being recognized, and
by the second processor,
receiving, while turned off in the standby state, the signal output by the first processor, then turning on, and then operating in the voice recognition mode.

### Claim 16 (depends on 9)

The method of claim 9, further comprising:
by the at least one processor of the home appliance,
based on a user voice being input through the microphone in the voice recognition mode, recognizing the user by identifying the user voice;
reading authority information of the recognized user from a memory; and
based on an operation corresponding to the user voice matching the authority information, performing the operation.

### Claim 17

A non-transitory recording medium storing a program that, when executed by at least one processor of a home appliance, causes the following to be performed:
based on a user action being detected through a sensor, control a speaker to output an audio signal corresponding to the detection of the user action and control the home appliance to operate in a voice recognition mode, and
based on a trigger command for initiating the voice recognition mode being input through a microphone, control the speaker to output an audio signal corresponding to the input of the trigger command and control the home appliance to operate in the voice recognition mode,
wherein the audio signal corresponding to the detection of the user action is different than the audio signal corresponding to the input of the trigger command.
