# US 12,183,068 B2 · System and method for randomized verification of services performed

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,068 B2
- Document ID: US12183068B2
- Status: Granted
- Kind: B2
- Application number: 17/519,098
- Filed: 2021-11-04
- Published: 2023-05-04
- Granted: 2024-12-31
- Earliest claimed: 2021-11-04
- Assignees: Modern Cleaning Concept L.P.
- Applicants: Modern Cleaning Concept L.P.
- Inventors: Alejandro Bremer Sada; Daniel Eric Wolfe; Jason Arthur Prizant; Bram Mitchell Lesser; Rajiv Uttamchandani; Christopher Manitt; Claire Robbins; Avi Steinberg
- Web page: https://patentgrep.com/patent/US12183068B2

## CPC

- G06Q 10/06395: {Quality analysis or management}
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06Q 10/0639: Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q 50/10: Services
- G06V 10/235: {based on user input or interaction}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Computing platforms and methods are disclosed for verification of cleaning services to be performed in an area to be cleaned. Exemplary implementations may: identify, from among a plurality of cleaning regions relating to the area to be cleaned, a group of designated cleaning regions; randomly generate, with respect to the plurality of cleaning regions, a set of inspection regions; provide a user interface to prompt a user to capture an image of each inspection region; directly capture the images of each inspection region via the user interface; compare the captured images of each inspection region with corresponding reference images to determine whether each of the inspection regions has been properly cleaned; and output an inspection result based on the comparison of the captured images with the corresponding reference images. Implementations provide a method for virtually supervising otherwise unsupervised workers, which increases accountability and generates unprecedented visibility.

## Claims

### Claim 1

A computing platform configured for verification of cleaning services to be performed in an area to be cleaned, the computing platform comprising:
a non-transient computer-readable storage medium having executable instructions embodied thereon; and
one or more hardware processors configured to execute the instructions to:
identify, from among a plurality of cleaning regions relating to the area to be cleaned, a group of designated cleaning regions;
randomly select a subset of the plurality of cleaning regions as corresponding to a set of inspection regions, the set of inspection regions including at least one of the designated cleaning regions, each inspection region having a reference image associated therewith representing the inspection region in a properly cleaned state;
provide a user interface prompting a user to capture an image of each inspection region in the set of inspection regions by displaying the reference image for each inspection region;
directly capture the images of each inspection region via the user interface; and
output an inspection result based on a comparison of the captured images with the corresponding reference images.

### Claim 2 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to:
randomly generate at least one designated cleaning region from among the identified group of designated cleaning regions; and
randomly generate remaining regions in the set of inspection regions from among the plurality of cleaning regions that are absent from the group of designated cleaning regions.

### Claim 3 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: determine the group of designated cleaning regions based on a stored cleaning profile.

### Claim 4 (depends on 3)

The computing platform of claim 3, wherein the one or more hardware processors are further configured by the instructions to: determine whether each of the plurality of cleaning regions belongs in the group of designated cleaning regions based on the stored cleaning profile.

### Claim 5 (depends on 3)

The computing platform of claim 3, wherein the stored cleaning profile is selected from the group consisting of: a property type-specific cleaning profile; an industry-specific cleaning profile; a franchisor-specific cleaning profile; an owner-specific cleaning profile; a contract-specific cleaning profile; and a site-specific cleaning profile.

### Claim 6 (depends on 1)

The computing platform of claim 1, wherein randomly selecting the subset of the plurality of cleaning regions is performed based on a random number generator or based on a quasi-random number generator.

### Claim 7 (depends on 1)

The computing platform of claim 1, wherein directly capturing the images comprises obtaining a live camera capture from a user device while preventing any other means of image capture.

### Claim 8 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: store the directly captured images of each inspection region in an image capture memory that is inaccessible to the user and independent of a user device.

### Claim 9 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: store the captured images at a cloud server such that the captured images are accessible using a uniform resource locator.

### Claim 10 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to:
for a selected inspection region from among the set of inspection regions, provide the reference image associated with the selected inspection region in a first portion of a split-screen user interface; and
for the selected inspection region from among the set of inspection regions, provide an image capture preview in a second portion of the split-screen user interface to prompt the user to capture an image of the selected inspection region.

### Claim 11 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: provide, via the user interface, a user authentication to determine that the user being prompted to capture the image corresponds to a person assigned to perform the cleaning services being verified.

### Claim 12 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: compare, using a machine learning-based comparator, the captured images of each inspection region with the corresponding reference images; and generate the inspection result based at least in part on a result of the comparison using the machine learning-based comparator.

### Claim 13 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: send, for external verification, at least one of the captured images and the corresponding reference images; and output the inspection result based at least in part on a received external verification result.

### Claim 14 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: with respect to a first inspection region and a subsequent second inspection region in the set of inspection regions, provide the user interface to prompt the user to capture a second image of the second inspection region only in response to a satisfactory first inspection result based on the comparison of a first captured image of the first inspection region with the corresponding reference image.

### Claim 15 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: prevent the user interface from capturing a subsequent image in response to an unsatisfactory inspection result based on the comparison of a previous captured image with the corresponding reference image.

### Claim 16 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: determine a region-specific inspection result based on determining within a degree of certainty that the captured image for a specific region matches the corresponding reference image for the specific region and represents a properly cleaned area.

### Claim 17 (depends on 1)

The computing platform of claim 1, wherein the one or more hardware processors are further configured by the instructions to: for a new cleaning period, randomly select a new subset of the plurality of cleaning regions as corresponding to an updated set of inspection regions, the updated set of inspection regions being different from the originally select set of inspection regions.

### Claim 18 (depends on 1)

The computing platform of claim 1, wherein the instructions are carried out as a part of a self-verification process such that the user prompted to capture the images is also the person assigned to perform the cleaning services being verified.

### Claim 19

A computer-implemented method for verification of cleaning services to be performed in an area to be cleaned, the method comprising:
identifying, from among a plurality of cleaning regions relating to the area to be cleaned, a group of designated cleaning regions;
randomly selecting a subset of the plurality of cleaning regions as corresponding to a set of inspection regions, the set of inspection regions including at least one of the designated cleaning regions, each inspection region having a reference image associated therewith representing the inspection region in a properly cleaned state;
providing a user interface prompting a user to capture an image of each inspection region in the set of inspection regions by displaying the reference image for each inspection region;
directly capturing the images of each inspection region via the user interface; and
outputting an inspection result based on a comparison of the captured images with the corresponding reference images.

### Claim 20

A non-transient computer-readable storage medium having instructions embodied thereon, the instructions being executable by one or more processors to perform a method for verification of cleaning services to be performed in an area to be cleaned, the method comprising:
identifying, from among a plurality of cleaning regions relating to the area to be cleaned, a group of designated cleaning regions;
randomly selecting a subset of the plurality of cleaning regions as corresponding to a set of inspection regions, the set of inspection regions including at least one of the designated cleaning regions, each inspection region having a reference image associated therewith representing the inspection region in a properly cleaned state;
providing a user interface prompting a user to capture an image of each inspection region in the set of inspection regions by displaying the reference image for each inspection region;
directly capturing the images of each inspection region via the user interface; and
outputting an inspection result based on a comparison of the captured images with the corresponding reference images.
