# US 11,026,559 B2 · Dishwasher with image-based fluid condition sensing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,026,559 B2 - Document ID: US11026559B2 - Status: Granted - Kind: B2 - Application number: 16/588,034 - Filed: 2019-09-30 - Published: 2021-04-01 - Granted: 2021-06-08 - Earliest claimed: 2019-09-30 - Assignees: Midea Group Co., Ltd. - Applicants: Midea Group Co., Ltd. - Inventors: Joel Boyer - Web page: https://patentgrep.com/patent/US11026559B2 ## CPC - A47L 15/4297: {Arrangements for detecting or measuring the condition of the washing water, e.g. turbidity} - G06T 7/0004: {Industrial image inspection} - A47L 15/0063: {using remote monitoring or controlling of the dishwasher operation, e.g. networking systems} - A47L 15/4225: {Arrangements or adaption of recirculation or discharge pumps} - A47L 15/4244: {Water-level measuring or regulating arrangements} - G06T 7/001: {using an image reference approach} - G06T 7/62: of area, perimeter, diameter or volume - G06T 7/73: using feature-based methods - H04N 7/183: {for receiving images from a single remote source} - H04N 23/11: for generating image signals from visible and infrared light wavelengths - H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils - H04N 23/56: provided with illuminating means - H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices - H04N 23/60: Control of cameras or camera modules - H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming - A47L 15/4246: {Details of the tub (A47L15/4272 takes precedence; insulation arrangements A47L15/4209)} - A47L 15/4282: {Arrangements to change or modify spray pattern or direction} - G06T 2207/10024: Color image - G06T 2207/10152: Varying illumination - G06T 2207/20081: Training; Learning - G06T 2207/30164: Workpiece; Machine component - H04N 23/20: for generating image signals from infrared radiation only - A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image-based fluid condition sensor is configured to sense turbidity or another condition of fluid in the sump of a dishwasher using an image device positioned outside of the sump. ## Claims ### Claim 1 A dishwasher, comprising: a wash tub including a sump; an imaging device positioned above the sump and configured to capture images of the sump; an illumination source disposed in the sump and directed at the imaging device; and a controller coupled to the imaging device and the illumination source and configured to sense a turbidity of a fluid disposed in the sump by: controlling the illumination source to emit light; controlling the imaging device to capture one or more images of the sump while light is emitted by the illumination source; and determining a value representative of the turbidity of the fluid disposed in the sump based upon a sensed light intensity for the illumination source in the captured one or more images. ### Claim 2 A dishwasher, comprising: a wash tub including a sump; an imaging device positioned outside of the sump and configured to capture images of the sump, wherein the imaging device is positioned above the sump and above a maximum fluid level for the sump to capture images of the fluid through a top surface of the fluid; an illumination source configured to illuminate a portion of the sump within the field of view of the imaging device; and a controller coupled to the imaging device and configured to sense turbidity of a fluid disposed in the sump by controlling the imaging device to capture one or more images of the sump from which a condition of the fluid in the sump may be determined while the illumination source illuminates the portion of the sump, wherein the controller is further configured to perform a calibration operation by controlling the imaging device to capture one or more images of the sump while the illumination source illuminates the portion of the sump and when clean water is disposed in the sump for use in determining a baseline light intensity for clear water such that the condition of the fluid in the sump may be determined based in part on a comparison of a light intensity sensed in the captured one or more images with the baseline light intensity, and wherein the controller is further configured to control the imaging device to capture one or more additional images within the dishwasher to perform a non-fluid condition sensing operation in the dishwasher. ### Claim 3 (depends on 2) The dishwasher of claim 2, wherein the non-fluid condition sensing operation is a load sensing operation, an object sensing operation, a soil sensing operation, remote viewing operation, a detergent sensing operation, a filter sensing operation, a filter cleaning operation, a fluid level sensing operation, a sprayer position sensing operation, a self-cleaning operation or a diagnostic operation. ### Claim 4 (depends on 2) The dishwasher of claim 2, wherein the imaging device is disposed on a wall of the wash tub and above the sump. ### Claim 5 (depends on 4) The dishwasher of claim 4, wherein the imaging device has a fixed field of view directed at the sump. ### Claim 6 (depends on 4) The dishwasher of claim 4, wherein the imaging device has a controllably-varied field of view, and wherein the controller is configured to control the imaging device to direct the field of view thereof at the sump when sensing the condition of the fluid disposed in the sump. ### Claim 7 (depends on 2) The dishwasher of claim 2, further comprising: a tubular spray element disposed in the wash tub and being rotatable about a longitudinal axis thereof, the tubular spray element including one or more apertures extending through an exterior surface thereof, and the tubular spray element in fluid communication with a fluid supply to direct fluid from the fluid supply into the wash tub through the one or more apertures; and a tubular spray element drive coupled to the tubular spray element and configured to rotate the tubular spray element between a plurality of rotational positions about the longitudinal axis thereof; wherein the controller is coupled to the tubular spray element drive and configured to control the tubular spray element drive to discretely direct the tubular spray element to each of a plurality of rotational positions. ### Claim 8 (depends on 7) The dishwasher of claim 7, wherein the imaging device is coupled to the tubular spray element such that the controller controls a field of view of the imaging device using the tubular spray element drive. ### Claim 9 (depends on 2) The dishwasher of claim 2, wherein the controller is further configured to sense the condition of the fluid disposed in the sump by determining from the captured one or more images a value representative of the condition of the fluid disposed in the sump. ### Claim 10 (depends on 2) The dishwasher of claim 2, wherein the controller is further configured to sense the condition of the fluid disposed in the sump by communicating the captured one or more images to a remote device that determines a value representative of the condition of the fluid disposed in the sump, and receiving the determined value from the remote device. ### Claim 11 (depends on 2) The dishwasher of claim 2, wherein the illumination source generates white light, red light, green light, a pattern of light, or infrared light. ### Claim 12 (depends on 2) The dishwasher of claim 2, wherein the condition of the fluid disposed in the sump is determined based upon attenuation of light emitted by the illumination source. ### Claim 13 (depends on 2) The dishwasher of claim 2, wherein the illumination source is disposed in the sump, and wherein the condition of the fluid is sensed based upon direct illumination by the illumination source. ### Claim 14 (depends on 2) The dishwasher of claim 2, further comprising a reflective element disposed in the sump, wherein the condition of the fluid is sensed based upon indirect illumination by the illumination source that is reflected by the reflective element. ### Claim 15 (depends on 2) The dishwasher of claim 2, wherein the controller is further configured to determine a load cleanliness or a rate of soil removal based at least in part on the sensed condition of the fluid disposed in the sump. ### Claim 16 (depends on 15) The dishwasher of claim 15, further comprising an imaging system including the imaging device, wherein the controller is configured to determine the load cleanliness or the rate of soil removal further based at least in part on one or more images captured of a load in the dishwasher by the imaging system. ### Claim 17 (depends on 2) The dishwasher of claim 2, wherein the controller is further configured to determine when to complete a wash or rinse operation performed during a wash cycle based at least in part on the sensed condition of the fluid disposed in the sump. ### Claim 18 (depends on 2) The dishwasher of claim 2, wherein the condition is turbidity. ### Claim 19 A method of sensing condition of a fluid disposed in a sump of a dishwasher, the method comprising: performing image analysis on one or more images of the sump of the dishwasher captured using an imaging device positioned outside of the sump and while a portion of the sump within the field of view of the imaging device is illuminated by an illumination source disposed in the sump; and determining the condition of the fluid based upon the image analysis performed on the captured one or more images, wherein the condition of the fluid is determined based upon direct illumination from the illumination source. ### Claim 20 (depends on 19) The method of claim 19, wherein the imaging device has a controllably-varied field of view, the method further comprising controlling the imaging device to direct the field of view thereof at the sump when sensing the condition of the fluid disposed in the sump. ### Claim 21 (depends on 19) The method of claim 19, further comprising performing a calibration operation by controlling the imaging device to capture one or more images of the sump when clean water is disposed in the sump for use in determining a baseline light intensity for clear water such that the condition of the fluid in the sump may be determined based in part on a comparison of a light intensity sensed in the captured one or more images with the baseline light intensity.