# US 2019/0319816 A1 · Method for exchanging information between a household appliance and a mobile device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0319816 A1
- Document ID: US20190319816A1
- Status: Published application
- Kind: A1
- Application number: 16/347,669
- Filed: 2017-10-04
- Published: 2019-10-17
- Earliest claimed: 2016-11-09
- Assignees: Electrolux Appliances Aktiebolag
- Applicants: Electrolux Appliances Aktiebolag
- Inventors: Riccardo FOIERA; Gianluca VENTURINI; Alex VIROLI; Massimo NOSTRO; Laurent JEANNETEAU
- Web page: https://patentgrep.com/patent/US20190319816A1

## CPC

- H04L 12/2807: {Exchanging configuration information on appliance services in a home automation network (arrangements for maintenance or administration involving network analysis for automatically determining the actual topology of a network H04L41/12; hardware or software tools for network management using graphical user interfaces H04L41/22; address allocation H04L61/50)}
- G06T 7/73: using feature-based methods
- G08C 23/04: using light waves, e.g. infrared
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- H04L 12/2823: {Reporting information sensed by appliance or service execution status of appliance services in a home automation network (device-related reporting H04L43/065; arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00)}
- F24C 7/083: {on tops, hot plates}
- G05B 2219/24097: Camera monitors controlled machine
- G05B 2219/2613: Household appliance in general
- G06T 2207/30204: Marker
- H04L 2012/285: {Generic home appliances, e.g. refrigerators}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- F24C: DOMESTIC STOVES OR RANGES (exclusively for solid fuels F24B); DETAILS OF DOMESTIC STOVES OR RANGES, OF GENERAL APPLICATION
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

The invention relates to a method for exchanging information between a household appliance (1) and a mobile device (2), the method comprising the steps of: providing optical information at a graphical user interface (3) of the household appliance (1) (S10); preferably, aligning the mobile device (2) with respect to the household appliance (1) based on one or more markers (4) displayed at a graphical user interface (5) of the mobile device (2) or based on a time-invariant portion of provided optical information (S11); receiving optical information at the mobile device (2) by capturing said optical information provided at the household appliance (1) by a camera (6) of the mobile device (2) (S12); processing said received optical information at the mobile device (1) in order to derive an information message included in said received optical information (S13); providing said information message or information associated with said information message at a user interface of the mobile device (2) (S14).

## Claims

### Claim 1

Method for exchanging information between a household appliance and a mobile device, the method comprising the steps of:
providing optical information at a graphical user interface of the household appliance, which comprises a seven-segment display;
aligning the mobile device with respect to the household appliance based on one or more markers displayed at a graphical user interface of the mobile device, wherein a first subset of bars of said seven segment display is used for providing optical reference information used for alignment purposes;
receiving the optical information at the mobile device by capturing said optical information provided at the household appliance by a camera of the mobile device;
processing said received optical information at the mobile device in order to derive an information message included in said received optical information;
providing said information message or information associated with said information message at the user interface of the mobile device.

### Claim 2 (depends on 1)

Method according to claim 1, wherein said one or more markers comprise a frame or segments of a frame.

### Claim 3 (depends on 1)

Method according to claim 1, wherein said one or more markers are corner markers.

### Claim 4 (depends on 1)

Method according to claim 1, wherein the step of aligning comprises capturing of an optical reference information at the household appliance by means of said camera of the mobile device and arranging the mobile device and/or performing a zoom action at the mobile device such that said optical reference information is displayed at the graphical user interface of the mobile device and said optical reference information is fitted into said one or more markers.

### Claim 5 (depends on 4)

Method according to claim 4, wherein said optical reference information comprises a fixed area of the graphical user interface of the household appliance or reference information is temporarily displayed at the graphical user interface of the household appliance.

### Claim 6 (depends on 4)

Method according to claim 4, wherein the optical reference information is built by a fixed, permanently existent marking.

### Claim 7 (depends on 1)

Method according to claim 1, wherein during said aligning step, a portion of said graphical user interface portion of the household appliance, which shows said optical information, is displayed at the graphical user interface of the mobile device and is fitted into an area of said graphical user interface of the mobile device, said area being defined by said one or more markers.

### Claim 8 (depends on 6)

Method according to claim 6, wherein said fixed, permanently existent marking is fitted into an area of the graphical user interface of the mobile device which is defined by said one or more markers.

### Claim 9 (depends on 1)

Method according to claim 1, wherein said optical information displayed at said graphical user interface of the household appliance is time-invariant.

### Claim 10 (depends on 1)

Method according to claim 1, wherein said optical information displayed at the graphical user interface of the household appliance includes time-varying information.

### Claim 11 (depends on 1)

Method according to claim 1, wherein said optical information received by the camera is processed in real time or quasi-real time into digital information.

### Claim 12 (depends on 1)

Method according to claim 1, wherein the graphical user interface of the household appliance comprises a seven segment display adapted to display one or more digits or one or more light emitting diodes which are used for providing said optical information.

### Claim 13 (depends on 1)

Method according to claim 1, wherein said derived information message comprises information regarding error codes, warnings or usage statistics.

### Claim 14 (depends on 1)

Method according to claim 1, wherein processing said received optical information is started manually or automatically after aligning the mobile device.

### Claim 15 (depends on 1)

Method according to claim 1, wherein said optical information comprise a sequence of digitally coded information including error correction information.

### Claim 16

Method for exchanging information between a household appliance and a mobile device, the method comprising the steps of,
providing optical information at a graphical user interface of the household appliance;
aligning the mobile device with respect to the household appliance based on one or more markers displayed at a graphical user interface of the mobile device, or based on a time-invariant portion of provided optical information;
receiving the optical information at the mobile device by capturing said optical information provided at the household appliance by a camera of the mobile device;
processing said received optical information at the mobile device in order to derive an information message included in said received optical information;
providing said information message or information associated with said information message at the user interface of the mobile device,
wherein information processing at the mobile device is synchronized to the information provision at the household appliance based on a dot-shaped portion of the seven segment display.

### Claim 17 (depends on 1)

Method according to claim 1, wherein said optical information comprises a sequence of digitally coded information which is transmitted based on a frame structure comprising multiple time slots in which data segments of the digitally coded information are transmitted.

### Claim 18 (depends on 16)

Method according to claim 16, wherein a first subset of bars of a seven segment display of the graphical user interface of said household appliance is used for providing optical reference information which is used for alignment purposes.

### Claim 19 (depends on 18)

Method according to claim 18, wherein a second subset of bars of said seven segment display is used for providing digitally coded information at the graphical user interface of the household appliance.

### Claim 20 (depends on 18)

Method according to claim 18, wherein one digit of the seven segment display provides two or more bits of digital information in a time slot of said frame structure.

### Claim 21

Method for exchanging information between a household appliance and a mobile device, the method comprising the steps of:
providing optical information at a graphical user interface of the household appliance;
aligning the mobile device with respect to the household appliance based on one or more markers displayed at a graphical user interface of the mobile device, or based on a time-invariant portion of provided optical information;
receiving the optical information at the mobile device by capturing said optical information provided at the household appliance by a camera of the mobile device;
processing said received optical information at the mobile device in order to derive an information message included in said received optical information;
providing said information message or information associated with said information message at the user interface of the mobile device,
wherein the mobile device extracts symbols included in the captured optical information based on an optical character recognition algorithm.

### Claim 22 (depends on 1)

Household appliance comprising a graphical user interface for providing optical information, the household appliance being adapted to exchange information with a mobile device according to the method of claim 1.
