# US 10,769,916 B2 · Refrigerator and home automation system having the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,916 B2
- Document ID: US10769916B2
- Status: Granted
- Kind: B2
- Application number: 15/689,623
- Filed: 2017-08-29
- Published: 2018-03-29
- Granted: 2020-09-08
- Earliest claimed: 2016-09-28
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Sangoh Kim; Hyungyul Kim; Jongho Yun; Cholok Han
- Web page: https://patentgrep.com/patent/US10769916B2

## CPC

- G08B 13/19695: {Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves}
- F25D 23/028: {Details}
- F25D 29/00: Arrangement or mounting of control or safety devices
- F25D 29/005: {Mounting of control devices}
- F25D 29/008: {Alarm devices}
- G08B 13/19658: {Telephone systems used to communicate with a camera, e.g. PSTN, GSM, POTS}
- G08B 13/1966: {Wireless systems, other than telephone systems, used to communicate with a camera}
- H04L 12/2818: {from a device located outside both the home and the home network (access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; arrangements for transmitting signals characterised by the use of a wireless eletrical link G08C17/00; telephonic communication systems adapted for combination with remote control systems H04M11/007)}
- H04L 67/125: involving control of end-device applications over a network
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04W 68/005: {Transmission of information for alerting of incoming communication}
- F25D 2500/06: Stock management
- F25D 2700/02: Sensors detecting door opening
- F25D 2700/04: Sensors detecting the presence of a person
- G06V 40/166: {using acquisition arrangements}
- G06V 40/172: {Classification, e.g. identification}
- H04L 2012/285: {Generic home appliances, e.g. refrigerators}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- F25D: REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR (refrigerated showcases A47F3/04; thermally-insulated vessels for domestic use A47J41/00; refrigerated vehicles, see the appropriate subclasses of classes B60 - B64; containers with thermal insulation in general B65D81/38; heat-transfer, heat-exchange or heat-storage materials, e.g. refrigerants, or materials for the production of heat or cold by chemical reactions other than by combustion C09K5/00; thermally-insulated vessels for liquefied or solidified gases F17C; air-conditioning or air-humidification F24F; refrigeration machines, plants, or systems F25B; cooling of instruments or comparable apparatus without refrigeration G12B)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A refrigerator may include: a communication device, an object detection sensor for sensing an object positioned within a predetermined region around the refrigerator door; and a controller for controlling the refrigerator to operate in a specific mode based on a connected state between the communication network and preset mobile terminals. If an object sensing signal is received from the object detection sensor in the specific mode, the controller may send a notification to at least one of the preset mobile terminals through the communication network.

## Claims

### Claim 1

A refrigerator, comprising:
a communication device at the refrigerator to connect to a communication network;
an object detection sensor provided at an outer surface of a refrigerator door, and the object detection sensor to detect an object within a predetermined distance from the object detection sensor; and
a controller that controls the refrigerator to operate in a specific mode based on a connected state between the communication network and at least one of a plurality of preset mobile terminals,
wherein in response to receiving an object sensing signal from the object detection sensor while the refrigerator is operating in the specific mode, the controller contacts the communication device to send a notification to at least one of the preset mobile terminals through the communication network,
wherein the object detection sensor detects any object that can move by itself,
wherein the refrigerator and one of the preset mobile terminals are connected to an access point (AP) at home for communication through Wi-Fi access when a user of the one of the preset mobile terminals is at home, and the one of the preset mobile terminals is disconnected from the AP when the user of the one of the preset mobile terminals is not at home, so that whether the user of the one of the preset mobile terminals is at home is determined,
wherein the controller is to perform a determination whether the one of the preset mobile terminals is connected to the access point at preset time intervals to continuously monitor whether the user of the one of the preset mobile terminals is at home, and
wherein the object detection sensor includes:
a first sensor spaced apart from a floor that senses an object located in a first area that is positioned on a front side of the refrigerator door and spaced apart from the floor; and
a second sensor disposed below the first sensor and to be adjacent the floor, and the second sensor to sense an object located in a second area that is positioned on the front side of the refrigerator door and positioned below the first area,
wherein when the second sensor senses an object while the first sensor does not sense an object, the controller controls components such that a notification is not to be sent.

### Claim 2 (depends on 1)

The refrigerator of claim 1, wherein when at least one of the mobile terminals is not connected to the wireless communication network, the controller controls the refrigerator to enter the specific mode, and
wherein the specific mode is a crime prevention mode to perform a security function for an empty house.

### Claim 3 (depends on 2)

The refrigerator of claim 2, further comprising:
a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open; and
a door switch that senses whether the refrigerator door is open,
wherein in response to receiving, from the door switch, a signal indicating the refrigerator door is open while the refrigerator is in the specific mode, the controller controls the camera to capture an image, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

### Claim 4 (depends on 3)

The refrigerator of claim 3, wherein the controller performs an image processing with respect to a face included in the captured image, and deletes the captured image when the face included in the captured image is determined to match a preset face.

### Claim 5 (depends on 4)

The refrigerator of claim 4, wherein the controller controls the communication device to send a notification requesting a connection with the communication network, to a mobile terminal of a user determined to match the face in the captured image.

### Claim 6 (depends on 2)

The refrigerator of claim 2, further comprising a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open,
wherein in response to receiving an object sensing signal from the object detection sensor while the refrigerator is in the specific mode, the controller controls the refrigerator door to open, controls the camera to capture an image while the refrigerator door is open, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

### Claim 7 (depends on 1)

The refrigerator of claim 1, wherein when only a specific mobile terminal, from among the mobile terminals, is connected to the communication network, the controller controls the refrigerator to enter the specific mode,
wherein a user of the specific mobile terminal is classified in a first group and a second group according to age, and
wherein the specific mode includes:
a silver care mode to monitor an activity state of an old person when a user of the specific mobile terminal is determined as belonging to the first group; and
a children care mode to monitor an activity state of a child when a user of the specific mobile terminal is determined as belonging to the second group.

### Claim 8 (depends on 1)

The refrigerator of claim 1, further comprising:
a door switch that senses an open state of the refrigerator door, and
wherein the controller is to perform a determination whether the one of the preset mobile terminals is connected to an access point at preset time intervals to continuously monitor whether the user of the one of the preset mobile terminals is at home.

### Claim 9 (depends on 8)

The refrigerator of claim 8, wherein when at least one of the mobile terminals is not connected to the communication network, the controller controls the refrigerator to enter the specific mode, and
wherein the specific mode is a crime prevention mode to perform a security function for an empty house.

### Claim 10 (depends on 9)

The refrigerator of claim 9, further comprising a camera at the refrigerator, and the camera is exposed to outside the refrigerator when the refrigerator door is open,
wherein in response to receiving a signal indicating the open state of the refrigerator door when the refrigerator is operating in the specific mode, the controller controls the camera to capture an image, and controls the communication device to send the captured image to at least one of the mobile terminals through the communication network.

### Claim 11 (depends on 10)

The refrigerator of claim 10, wherein the controller performs an image processing with respect to a face included in the captured image, and deletes the captured image when the face included in the captured image is determined to match a preset face.

### Claim 12 (depends on 11)

The refrigerator of claim 11, wherein the controller controls the communication device to send a notification requesting a connection with the communication network, to a mobile terminal of a user determined to match the face in the captured image.

### Claim 13 (depends on 8)

The refrigerator of claim 8, wherein when only a specific mobile terminal, from among the mobile terminals, is connected to the communication network, the controller controls the refrigerator to enter the specific mode,
wherein a user of the specific mobile terminal is classified in a first group and a second group according to age, and
wherein the specific mode includes:
a silver care mode to monitor an activity state of an old person when a user of the specific mobile terminal is determined as belonging to the first group; and
a children care mode to monitor an activity state of a child when a user of the specific mobile terminal is determined as belonging to the second group.

### Claim 14

A refrigerator, comprising:
a communication device provided at the refrigerator to connect to a communication network;
an object detection sensor provided at an outer surface of a refrigerator door to detect an object within a predetermined distance from the sensor;
a camera at the refrigerator, and the camera exposed to outside the refrigerator when the refrigerator door is open; and
a controller that controls the refrigerator to operate in a specific mode based on a user's setting,
wherein in response to receiving an object sensing signal from the object detection sensor when the refrigerator is operating in the specific mode, the controller controls the refrigerator door to open, controls the camera to capture an image of outside the refrigerator while the refrigerator door is open, and controls the communication device to send the captured image to at least one of a plurality of mobile terminals through the communication network,
wherein the object detection sensor detects any object that can move by itself,
wherein the refrigerator and one of the plurality of mobile terminals are connected to an access point (AP) at home for communication through Wi-Fi access when a user of the one of the plurality of mobile terminals is at home, and the one of the plurality of mobile terminals is disconnected from the AP when the user of the one of the plurality of mobile terminals is not at home, so that whether the user of the one of the plurality of mobile terminals is at home is determined,
wherein the controller is to perform a determination whether the one of the preset mobile terminals is connected to the access point at preset time intervals to continuously monitor whether the user of the one of the preset mobile terminals is at home, and
wherein the object detection sensor includes:
a first sensor spaced apart from a floor that senses an object located in a first area that is positioned on a front side of the refrigerator door and spaced apart from the floor; and
a second sensor disposed below the first sensor and to be adjacent the floor, and the second sensor to sense an object located in a second area that is positioned on the front side of the refrigerator door and positioned below the first area,
wherein when the second sensor senses an object while no object is sensed by the first sensor, the controller controls components such that a notification is not to be sent.

### Claim 15 (depends on 14)

The refrigerator of claim 14, wherein in response to receiving an object sensing signal from the object detection sensor while the refrigerator is operating in the specific mode, the controller contacts the communication device to send a notification to at least one of the mobile terminals through the communication network.

### Claim 16 (depends on 14)

The refrigerator of claim 14, wherein the controller performs an image processing with respect to a face included in the captured image, and deletes the captured image when the face included in the captured image is determined to match a preset face.

### Claim 17 (depends on 16)

The refrigerator of claim 16, wherein the controller controls the communication device to send a notification requesting a connection with the communication network, to a mobile terminal of a user determined to match the face in the captured image.

### Claim 18 (depends on 14)

The refrigerator of claim 14, wherein when only a specific mobile terminal, from among the mobile terminals, is connected to the communication network, the controller controls the refrigerator to enter the specific mode,
wherein a user of the specific mobile terminal is classified in a first group and a second group according to age, and
wherein the specific mode includes:
a silver care mode to monitor an activity state of an old person when a user of the specific mobile terminal is determined as belonging to the first group; and
a children care mode to monitor an activity state of a child when a user of the specific mobile terminal is determined as belonging to the second group.

### Claim 19 (depends on 14)

The refrigerator of claim 14, comprising:
a refrigerator body that includes a storage space,
wherein the refrigerator body is to be provided on an external surface, and
the first sensor is spaced a first distance apart from the external surface when the refrigerator body is provided on the external surface, and
the second sensor is spaced a second distance apart from the external surface when the refrigerator body is provided on the external surface,
wherein the second distance is greater than the first distance.

### Claim 20 (depends on 1)

The refrigerator of claim 1, comprising:
a refrigerator body that includes a storage space,
wherein the refrigerator body is to be provided on an external surface, and
the first sensor is spaced a first distance apart from the external surface when the refrigerator body is provided on the external surface, and
the second sensor is spaced a second distance apart from the external surface when the refrigerator body is provided on the external surface,
wherein the second distance is greater than the first distance.