# US 2025/0095653 A1 · Hub device, multi-device system including the hub device and plurality of devices, and method of operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095653 A1
- Document ID: US20250095653A1
- Status: Published application
- Kind: A1
- Application number: 18/965,517
- Filed: 2024-12-02
- Published: 2025-03-20
- Earliest claimed: 2019-05-02
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Yeonho LEE; Sangwook Park; Kookjin Yeo
- Web page: https://patentgrep.com/patent/US20250095653A1

## CPC

- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 15/18: using natural language modelling
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- G16Y 20/20: relating to the thing itself
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G16Y: INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]

## Abstract

A hub device, a multi-device system including the hub device, and a method of operating the same may include: converting, by the hub device, received voice input into text; identifying, by the hub device, a device capable of performing an operation corresponding to the text; identifying which device stores a function determination model corresponding to the device capable of performing the operation corresponding to the text, from among the hub device, and a plurality of other devices connected to the hub device; and based on the identified device that stores the function determination model being a device that is different from the hub device, transmitting at least part of the text to the identified device.

## Claims

### Claim 1

A hub device for controlling a device based on a voice input, the hub device comprising:
a communication interface configured to perform data communication with at least one of a voice assistant server or a plurality of devices comprising a listener device;
memory configured to store a program comprising one or more instructions; and
at least one processor configured to execute the one or more instructions of the program stored in the memory,
wherein the at least one processor is further configured to:
receive, through the communication interface, a voice signal from the listener device,
convert the received voice signal into text by performing automatic speech recognition (ASR),
analyze the text by using a first natural language understanding (NLU) model,
determine an operation-performing device which is capable of performing an operation corresponding to the analyzed text by using a device determination model,
identify which device stores a function determination model corresponding to the operation-performing device from among the operation-performing device and the listener device, and
transmit, through the communication interface, at least part of the text to the identified device that stores the function determination model.

### Claim 2 (depends on 1)

The hub device of claim 1, wherein the at least one processor is further configured to determine whether the determined operation-performing device is the same as the listener device.

### Claim 3 (depends on 2)

The hub device of claim 2, wherein, in a case that it is determined that the operation-performing device is the same as the listener device, the at least one processor is further configured to:
obtain function determination model information about whether the listener device stores the function determination model in an internal memory, and
determine the listener device as the device that stores the function determination model based on the obtained function determination model information.

### Claim 4 (depends on 2)

The hub device of claim 2, wherein, in a case that it is determined that the operation-performing device is a device different from the listener device, the at least one processor is further configured to:
obtain function determination model information about whether the determined operation-performing device stores the function determination model in an internal memory, and
determine whether the operation-performing device is the device that stores the function determination model based on the obtained function determination model information.

### Claim 5 (depends on 1)

The hub device of claim 1, wherein the at least one processor is further configured to:
receive, through the communication interface, update data of the device determination model from the voice assistant server, and
update the device determination model, by using the received update data.

### Claim 6 (depends on 5)

The hub device of claim 5, wherein the update data comprises data for updating the device determination model to determine an updated function from the text and determine the operation-performing device corresponding to the updated function, based on update information of the function determination model included in at least one of the operation-performing device or the listener device.

### Claim 7 (depends on 1)

The hub device of claim 1, wherein the at least one processor is further configured to:
receive, through the communication interface, device information of a new device comprising at least one of device identification information, storage information of a device determination model, or storage information of a function determination model of the new device, from the voice assistant server, and
update the device determination model by adding the new device to device candidates determinable as the operation-performing device by the device determination model by using the received device information of the new device.

### Claim 8

A method, performed by a hub device, of controlling a device, the method comprising:
receiving a voice signal from a listener device by a hub device;
converting the received voice signal into text, by performing automatic speech recognition (ASR);
analyzing the text by using a first natural language understanding (NLU) model;
determining an operation-performing device corresponding to the analyzed text by using a device determination model;
identifying which device stores a function determination model corresponding to the determined operation-performing device from among the determined operation-performing device and the listener device; and
transmitting at least part of the text to the identified device.

### Claim 9 (depends on 8)

The method of claim 8, further comprising determining whether the determined operation-performing device is the same as the listener device.

### Claim 10 (depends on 8)

The method of claim 8, wherein, in a case that it is determined that the operation-performing device is the same as the listener device, the identifying of the device that stores the function determination model comprises:
obtaining function determination model information about whether the listener device stores the function determination model in an internal memory; and
determining the listener device as the device that stores the function determination model, based on the obtained function determination model information.

### Claim 11 (depends on 8)

The method of claim 8, wherein, in a case that it is determined that the operation-performing device is a device different from the listener device, the identifying of the device that stores the function determination model comprises:
obtaining function determination model information about whether the determined operation-performing device stores the function determination model in an internal memory; and
determining whether the operation-performing device is the device that stores the function determination model, based on the obtained function determination model information.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
receiving update data of the device determination model from a voice assistant server; and
updating the device determination model, by using the received update data.

### Claim 13 (depends on 12)

The method of claim 12, wherein the update data comprises data for updating the device determination model to determine an updated function from the text and determine the operation-performing device corresponding to the updated function, based on update information of the function determination model included in at least one of the operation-performing device or the listener device.

### Claim 14 (depends on 8)

The method of claim 8, further comprising:
receiving, from a voice assistant server, device information of a new device comprising at least one of device identification information, storage information of a device determination model, or storage information of a function determination model of the new device; and
updating the device determination model, by adding the new device to device candidates determinable as the operation-performing device by the device determination model by using the received device information of the new device.

### Claim 15

A non-transitory computer-readable recording medium having recorded thereon a program for executing a method comprising:
receiving a voice signal from a listener device;
converting the received voice signal into text by performing automatic speech recognition (ASR);
analyzing the text by using a first natural language understanding (NLU) model;
determining an operation-performing device corresponding to the analyzed text by using a device determination model;
identifying which device stores a function determination model corresponding to the determined operation-performing device from among the determined operation-performing device and the listener device; and
transmitting at least part of the text to the identified device.