# US 11,308,954 B2 · Method for associating an AI device with a device based on a behavior pattern of a user and an apparatus therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,954 B2 - Document ID: US11308954B2 - Status: Granted - Kind: B2 - Application number: 16/556,061 - Filed: 2019-08-29 - Published: 2019-12-26 - Granted: 2022-04-19 - Earliest claimed: 2019-08-07 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Jichan Maeng - Web page: https://patentgrep.com/patent/US11308954B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - B60W 60/0051: {from occupants to vehicle} - B60W 60/0059: {Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity} - G05B 13/027: {using neural networks only} - G05D 1/00: Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots (drive control systems specially adapted for autonomous road vehicles B60W60/00) - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/09: Supervised learning - G06N 3/092: Reinforcement learning - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping - G06N 3/08: Learning methods - G10L 2015/223: {Execution procedure of a spoken command} - H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Provided are a method of associating an AI device with a device based on a behavior pattern of a user and a device therefor. The method of associating the AI device with the device according to an embodiment of the invention receives a preset behavior pattern of the user sensed by a first camera from the first camera, receives a voice command for controlling an operation of the device from the user, and transmits the voice command to the device, thus allowing devices having no AI function to be used in conjunction with the AI device. The AI device and the dive of the invention may be associated with artificial intelligence modules, drones (unmanned aerial vehicles (UAVs)), robots, augmented reality (AR) devices, virtual reality (VR) devices, devices related to 5G service, etc. ## Claims ### Claim 1 A method of associating an Artificial Intelligence (AI) device with a device based on a behavior pattern of a user, the method performed by the AI device comprising: receiving a preset behavior pattern of the user sensed by a first camera from the first camera; receiving a voice command for controlling an operation of the device, from the user; and transmitting the voice command to the device, wherein the voice command is a command corresponding to the preset behavior pattern of the user, and wherein the receiving of the voice command for controlling the operation of the device from the user comprises: operating in a standby status to receive the voice command for a preset time determined on the basis of the behavior pattern of the user; and receiving the voice command to perform the operation of the device from the user in the standby status. ### Claim 2 (depends on 1) The method of claim 1, wherein the transmitting of the voice command to the device comprises: transmitting the voice command to a server; receiving a control instruction for controlling an operation of the device corresponding to the voice command from the server; and transmitting the control instruction to the device. ### Claim 3 (depends on 2) The method of claim 2, further comprising: receiving an operation performance result corresponding to the control instruction, from the device. ### Claim 4 (depends on 1) The method of claim 1, further comprising: receiving information about the user's spatial movement from a second camera, when the first camera and the device is located at a first space, the second camera and the AI device is located at a second space, and the user moves from the first space to the second space, wherein the information about the user's spatial movement is information that is obtained by sensing the user's spatial movement using the first camera and is transmitted to the second camera. ### Claim 5 (depends on 1) The method of claim 1, wherein the first camera, the AI device and the device are connected to each other via an Internet of Things (IOT) network. ### Claim 6 An AI device for performing a method of associating the Artificial Intelligence (AI) device with a device based on a behavior pattern of a user, the AI device comprising: a Radio Frequency (RF) module configured to transmit and receive a wireless signal; and a processor functionally connected to the RF module, wherein the processor receives a preset behavior pattern of the user sensed by a first camera from the first camera, receives a voice command for controlling an operation of the device from the user, and transmits the voice command to the device, wherein the voice command is a command corresponding to the preset behavior pattern of the user, and wherein the processor operates in a standby status to receive the voice command for a preset time determined on the basis of the behavior pattern of the user, and receives the voice command to perform the operation of the device from the user in the standby status. ### Claim 7 (depends on 6) The AI device of claim 6, wherein the processor transmits the voice command to a server, receives a control instruction for controlling an operation of the device corresponding to the voice command from the server, and transmits the control instruction to the device. ### Claim 8 (depends on 7) The AI device of claim 7, wherein the processor receives an operation performance result corresponding to the control instruction, from the device. ### Claim 9 (depends on 6) The AI device of claim 6, wherein the processor receives information about the user's spatial movement from a second camera, when the first camera and the device is located at a first space, the second camera and the AI device is located at a second space, and the user moves from the first space to the second space, wherein the information about the user's spatial movement is information that is obtained by sensing the user's spatial movement using the first camera and is transmitted to the second camera. ### Claim 10 (depends on 6) The AI device of claim 6, wherein the first camera, the AI device and the device are connected to each other via an Internet of Things (IOT) network. ### Claim 11 (depends on 1) An electronic device, comprising: at least one processor; a memory; and at least one program, wherein the program is stored in the memory and is executed by the processor, the program comprising a command for performing the method of claim 1.