# US 2021/0334641 A1 · Artificial intelligence laundry treatment apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0334641 A1 - Document ID: US20210334641A1 - Status: Published application - Kind: A1 - Application number: 16/497,782 - Filed: 2019-06-13 - Published: 2021-10-28 - Earliest claimed: 2019-06-13 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Jinok KIM; Yunsik PARK; Sungmok HWANG - Web page: https://patentgrep.com/patent/US20210334641A1 ## CPC - D06F 33/43: Control of cleaning or disinfection of washing machine parts, e.g. of tubs - D06F 34/05: for wireless communication between components, e.g. for remote monitoring or control - D06F 34/20: Parameters relating to constructional components, e.g. door sensors - D06F 37/266: {Gaskets mounted between tub and casing around the loading opening} - D06F 39/14: Doors or covers; Securing means therefor - G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade} - G06F 18/241: relating to the classification model, e.g. parametric or non-parametric approaches - G06N 3/04: Architecture, e.g. interconnection topology - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06T 7/001: {using an image reference approach} - G06T 7/62: of area, perimeter, diameter or volume - G06V 10/764: using classification, e.g. of video objects - G06V 20/20: in augmented reality scenes - D06F 2103/00: Parameters monitored or detected for the control of domestic laundry washing machines, washer-dryers or laundry dryers - D06F 2103/64: Radiation, e.g. microwaves - D06F 2105/54: Changing between normal operation mode and special operation modes, e.g. service mode, component cleaning mode or stand-by mode - D06F 2105/58: Indications or alarms to the control system or to the user - G06T 2207/20224: Image subtraction - D06F: LAUNDERING, DRYING, IRONING, PRESSING OR FOLDING TEXTILE ARTICLES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An artificial intelligent laundry treatment apparatus according to an embodiment of the present invention includes: a door including an external cover and an internal glass and configured to open and close a laundry entrance; a gasket formed on an inner circumferential surface of the laundry entrance; a door imaging sensor disposed to face the internal glass and configured to acquire a door image; a gasket imaging sensor configured to acquire a gasket image including a region of the gasket; and a processor configured to classify a state of the door on the basis of the door image, to acquire a gasket contamination degree on the basis of the gasket image, and to determine whether inside cleansing is required for a region including an inside of a drum on the basis of at least one of the classification result of the state of the door or the acquired gasket contamination degree. ## Claims ### Claim 1 A laundry treatment apparatus comprising: a door including an external cover and an internal glass and configured to open and close a laundry entrance; a gasket formed on an inner circumferential surface of the laundry entrance; a door imaging sensor disposed to face the internal glass and configured to acquire a door image; a gasket imaging sensor configured to acquire a gasket image including a region of the gasket; and a processor configured to classify a state of the door on the basis of the door image, to acquire a gasket contamination degree on the basis of the gasket image, and to determine whether inside cleansing is required for a region including an inside of a drum on the basis of at least one of the classification result of the state of the door or the acquired gasket contamination degree. ### Claim 2 (depends on 1) The laundry treatment apparatus of claim 1, further comprising a memory configured to store a classification model, which is learned using a deep learning algorithm, for classifying the state of the door from the door image. ### Claim 3 (depends on 2) The laundry treatment apparatus of claim 2, wherein the processor inputs the door image as input data of the classification model, and acquires the classification result based on at least one characteristic point extracted from a region corresponding to the internal glass of the door image from the classification model. ### Claim 4 (depends on 3) The laundry treatment apparatus of claim 3, further comprising a learning processor configured to update the classification model on the basis of the door image or the at least one characteristic point, and the classification result. ### Claim 5 (depends on 1) The laundry treatment apparatus of claim 1, wherein the door imaging sensor is disposed in a space between the external cover and the internal glass. ### Claim 6 (depends on 1) The laundry treatment apparatus of claim 1, further comprising a memory storing a reference gasket image, wherein the processor performs image subtraction between a gasket image acquired from the gasket imaging sensor and the reference gasket image, calculates an area of a contaminant existence region of the acquired gasket image on the basis of the image subtraction result, and acquires the gasket contamination degree on the basis of the calculated area. ### Claim 7 (depends on 6) The laundry treatment apparatus of claim 6, the larger the calculated area, the more the gasket contamination degree increases. ### Claim 8 (depends on 1) The laundry treatment apparatus of claim 1, wherein the gasket imaging sensor is disposed on the inner circumferential surface of the laundry entrance. ### Claim 9 (depends on 1) The laundry treatment apparatus of claim 1, further comprising at least one light source disposed on the inner circumferential surface of the laundry entrance, wherein the processor turns on the at least one light source when acquiring the door image or the gasket image. ### Claim 10 (depends on 1) The laundry treatment apparatus of claim 1, wherein the processor controls the door imaging sensor to acquire the door image when a washing operation of the laundry treatment apparatus is not performed. ### Claim 11 (depends on 10) The laundry treatment apparatus of claim 10, wherein the processor controls the door imaging sensor to acquire the door image after a predetermined time passes from end of the washing operation. ### Claim 12 (depends on 1) The laundry treatment apparatus of claim 1, wherein the processor controls the gasket imaging sensor to acquire the gasket image with the door open. ### Claim 13 (depends on 1) The laundry treatment apparatus of claim 1, wherein the processor controls at least one of a display or a speaker to output an inside cleansing notice when determining that inside cleansing is required. ### Claim 14 (depends on 1) The laundry treatment apparatus of claim 1, wherein the processor controls a communication unit to transmit an inside cleansing notice to a server or a user's terminal when determining that inside cleansing is required.