# US 2023/0068718 A1 · Cooking apparatus using artificial intelligence and method for operating same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0068718 A1
- Document ID: US20230068718A1
- Status: Published application
- Kind: A1
- Application number: 17/792,520
- Filed: 2020-04-06
- Published: 2023-03-02
- Earliest claimed: 2020-01-13
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Boeun KIM
- Web page: https://patentgrep.com/patent/US20230068718A1

## CPC

- H05B 6/6464: {using weight sensors}
- F24C 7/085: {on baking ovens}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 10/82: using neural networks
- G06V 20/68: Food, e.g. fruit or vegetables
- G06V 30/10: Character recognition
- G06V 30/19: Recognition using electronic means
- H05B 6/6435: {Aspects relating to the user interface of the microwave heating apparatus}
- H05B 6/6447: {Method of operation or details of the microwave heating apparatus related to the use of detectors or sensors}
- H05B 6/668: {Microwave heating devices connected to a telecommunication network}
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/098: Distributed learning, e.g. federated learning
- G06V 2201/09: Recognition of logos
- H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- F24C: DOMESTIC STOVES OR RANGES (exclusively for solid fuels F24B); DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Embodiments of the present disclosure relate to a cooking appliance using artificial intelligence and an operation method thereof. The artificial intelligence cooking appliance may include: a driving device for cooking a product to be cooked; an image sensor configured to obtain an image related to the product to be cooked; and at least one processor connected operatively to the driving device and the image sensor. The at least one processor may control the cooking appliance to obtain the image related to the product to be cooked, to obtain cooking information of the product to be cooked, on the basis of the image, and to cook the product to be cooked, on the basis of the cooking information.

## Claims

### Claim 1

An artificial intelligence cooking appliance comprising:
a cooking device;
an image sensor configured to obtain an image related to a product to be cooked; and
at least one processor configured to:
determine cooking information of the product based on the image, and
manage the cooking device to cook the product based on the cooking information,
wherein the cooking information includes at least one of time information or temperature information.

### Claim 2 (depends on 1)

The artificial intelligence cooking appliance of claim 1, further comprising:
a memory,
wherein the memory stores information associated with at least one of a packaging of the product, a logo of the product, a name of the product, or contents of the product, and
wherein the at least one processor is configured to:
recognize text data included in the image and obtain the cooking information based on the text data, or
obtain the cooking information based on determining that the image includes the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product cooked, and reading, from the memory, the information associated with at least one of a packaging of the product, a logo of the product, a name of the product, or contents of the product.

### Claim 3 (depends on 2)

The artificial intelligence cooking appliance of claim 2, wherein the at least one processor is configured to recognize the text data or to determine whether the image includes the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product by using a trained artificial neural network model.

### Claim 4 (depends on 1)

The artificial intelligence cooking appliance of claim 1, further comprising:
a communication circuit configured to perform data communication with at least one external device,
wherein the at least one processor is configured to:
control the communication circuit to transmit the image to the at least one external device, and receive the cooking information from the at least one external device.

### Claim 5

An electronic device comprising:
a communication circuit configured to perform data communication with at least one cooking appliance; and
at least one processor,
wherein the at least one processor is configured to:
obtain an image related to a product to be cooked,
determine, based on the image, cooking information of the product, and
transmit, via the communication circuit, the cooking information to the at least one cooking appliance, and
wherein the cooking information comprises at least one of time information or temperature information.

### Claim 6 (depends on 5)

The electronic device of claim 5, further comprising:
an image sensor,
wherein the at least one processor, when obtaining in the image, controls the communication circuit receive the image related to the product from the at least one cooking appliance, or controls the image sensor to capture the image related to the product.

### Claim 7 (depends on 5)

The electronic device of claim 5, further comprising:
a memory operatively connected to the at least one processor,
wherein the memory stores information associated with at least one of a packaging of the product, a logo of the product, a name of the product, or contents of the product, and
wherein the at least one processor processes the image to recognize text data included in the image and obtain the cooking information based on the text data, or obtains the cooking information based on the information associated with the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product when the image includes the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the at least one processor controls the electronic device to recognize the text data or to determine whether the image includes the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product using a trained artificial neural network model.

### Claim 9 (depends on 5)

The electronic device of claim 5,
wherein the at least one processor obtains a plurality of pieces of the cooking information for the product, and the plurality of pieces of the cooking information include first cooking information related to cooking the product on a first cooking appliance and second cooking information related to cooking the product a second cooking appliance, and
the at least one processor selects one of the plurality of pieces of cooking information and controls the electronic device to transmit the selected one of the pieces of the cooking information to a corresponding cooking appliance of the at least one cooking appliance.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the at least one processor, when selecting the one of the plurality of pieces of cooking information, controls the electronic device to output the plurality of pieces of cooking information and to receive a user's input for selecting one of the plurality of pieces of the cooking information.

### Claim 11 (depends on 5)

The electronic device of claim 5, wherein the at least one processor controls the communication circuit to transmit the image related to the product to a computing device and to receive the cooking information from the computing device.

### Claim 12

An operation method of an artificial intelligence cooking appliance, the operation method comprising:
obtaining an image related to a product to be cooked;
obtaining cooking information of the product to be cooked based on the image; and
cooking the product based on the cooking information,
wherein the cooking information includes at least one of time information or temperature information.

### Claim 13 (depends on 12)

The operation method of claim 12, wherein the obtaining of the cooking information of the product to be cooked based on the image includes at least one of
recognizing text data included in the image, and obtaining the cooking information based on the text data; or
recognizing at least one of a packaging of the product, a logo of the product, a name of the product, or contents of the product included in the image, and obtaining the cooking information based on the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product.

### Claim 14 (depends on 13)

The operation method of claim 13, wherein the obtaining of the cooking information of the product to be cooked based on the image further comprises at least one of
recognizing the text data by using a first trained artificial neural network model; or
determining, by using a second trained artificial neural network model, whether the image comprises the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product.

### Claim 15 (depends on 12)

The operation method of claim 12, the obtaining of the cooking information of the product based on the image includes:
transmitting the image to at least one external device; and
receiving the cooking information from the at least one external device.

### Claim 16

An operation method of an electronic device, the operation method comprising:
obtaining an image related to a product to be cooked;
obtaining cooking information of the product based on the image; and
transmitting the cooking information to at least one cooking appliance,
wherein the cooking information includes at least one of time information or temperature information.

### Claim 17 (depends on 16)

The operation method of claim 16, wherein the obtaining of the image related to a product includes at least one of:
receiving, from the at least one cooking appliance, the image related to the product; or
obtaining, by using an image sensor of the electronic device, the image related to the product.

### Claim 18 (depends on 16)

The operation method of claim 16, wherein the obtaining of the cooking information of the product to be cooked based on the image includes at least one of:
recognizing text data included in the image and obtaining the cooking information based on the text data; or
obtaining the cooking information based on at least one of a packaging of the product, a logo of the product, a name of the product, or contents of the product included in the image.

### Claim 19 (depends on 18)

The operation method of claim 18, wherein the obtaining of the cooking information of the product based on the image further comprises at least one of:
recognizing the text data by using a first trained artificial neural network model; or
determining whether the image includes the at least one of the packaging of the product, the logo of the product, the name of the product, or the contents of the product using a second trained artificial neural network model.

### Claim 20 (depends on 16)

The operation method of claim 16, wherein the obtaining of the cooking information of the product based on the image comprises:
obtaining a plurality of pieces of the cooking information, wherein the plurality of pieces of the cooking information include first cooking information related to a first cooking appliance and second cooking information related to a second cooking appliance; and
selecting, when the plurality of pieces of the cooking information, one of the plurality of pieces of cooking information, and
wherein the transmitting of the cooking information to at least one cooking appliance comprises transmitting the selected one of the pieces of the cooking information to a corresponding cooking appliance of the at least one cooking appliance.

### Claim 21 (depends on 20)

The operation method of claim 20, wherein the selecting of the one of the plurality of pieces of cooking information comprises:
outputting the plurality of pieces of cooking information; and
receiving a user's input for selecting one of the plurality of pieces of the cooking information.

### Claim 22 (depends on 16)

The operation method of claim 16, wherein the obtaining of the cooking information of the product based on the image comprises:
transmitting the image related to the product to a computing device; and
receiving the cooking information from the computing device.
