# US 2023/0390942 A1 · Surface finish quality evaluation system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0390942 A1
- Document ID: US20230390942A1
- Status: Published application
- Kind: A1
- Application number: 18/448,572
- Filed: 2023-08-11
- Published: 2023-12-07
- Earliest claimed: 2019-02-21
- Assignees: Canvas Construction, Inc.
- Applicants: Canvas Construction, Inc.
- Inventors: Maria J. Telleria; Kevin B. Albert; Irene M. Davis; Henry Tonoyan; Gabriel F. Hein; Zelda Othenin-Girard; Jason De Alba
- Web page: https://patentgrep.com/patent/US20230390942A1

## CPC

- B25J 15/0019: {End effectors other than grippers}
- B25J 5/007: {mounted on wheels}
- B25J 9/1679: {characterised by the tasks executed}
- B25J 9/1697: {Vision controlled systems}
- B25J 11/005: {Manipulators for mechanical processing tasks}
- B25J 11/0075: {Manipulators for painting or coating}
- B25J 15/04: with provision for the remote detachment or exchange of the head or parts thereof
- B25J 19/021: {Optical sensing devices}
- E04F 21/08: Mechanical implements (E04F21/14 takes precedence; spraying in general B05B; sand-blasting B24C)
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529)
- G05B 2219/37402: Flatness, roughness of surface
- G05B 2219/37571: Camera detecting reflected light from laser
- G05B 2219/40074: Move tip of arm or carried object on surface, wall, constraint
- G05B 2219/40298: Manipulator on vehicle, wheels, mobile
- G05B 2219/45062: Surface finishing robot
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- E04F: FINISHING WORK ON BUILDINGS, e.g. STAIRS, FLOORS (windows, doors E06B)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A surface evaluation system that includes one or more vision systems that generate target surface data during evaluation of a surface, the one or more vision systems comprising two or more of: at least one light, a camera, a structured light camera, a laser scanner and a 3D scanner.

## Claims

### Claim 1

A method, comprising:
generating instructions to control an automated surface finishing system to apply a material to a target surface;
controlling one or more of a distance and an angle of a light relative to the target surface;
receiving one or more images of the target surface captured by a camera while the light is illuminating the target surface at an incident angle relative to the target surface;
processing the one or more images to identify a feature in the image that indicates a defect in the target surface; and
identifying a rework area based on a location of the feature in the image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating a task list for an operator that includes the rework area.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
identify the rework area on the target surface for an operator using augmented reality system, wherein the augmented reality system comprises one or more of: screens, projectors, lasers, and augmented glasses.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
directing a light at the rework area on the target surface;
continuously monitor a finish quality of the target surface by processing further images captured by the camera; and
changing a color of the light to indicate when the rework area has achieved a desired finish quality.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
generating an annotated image visually highlighting to an operator the rework area as feedback.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
generating a toolpath and parameters of an automated surface finishing system based on the rework area.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system;
the feature comprises a shadow in the image; and
the method further comprises:
determining a high spot in the target surface based on the shadow; and
generating instructions to control the positioning system and the sanding end effector to cause the sanding end effector to sand down the high spot.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system;
the feature comprises a shadow in the image; and
the method further comprises:
determining a low spot in the target surface based on the shadow; and
generating instructions to control the positioning system and the sanding end effector to cause the sanding end effector to avoid sanding down the low spot.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system;
the feature comprises a shadow in the image; and
the method further comprises:
as the target surface is being sanded down by the sanding end effector, processing further images to determine whether the target surface meets a threshold for surface quality; and
generating instructions to control a positioning system and the sanding end effector coupled to the positioning system to end sanding in response to determining the target surface meets the threshold.

### Claim 10

A method, comprising:
controlling a position of a scanner relative to a target surface;
receiving, three-dimensional topography information of the target surface captured by the scanner;
processing the three-dimensional topography information to determine a surface profile of the target surface; and
generating a toolpath and parameters for an automated surface finishing system based on the surface profile.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system; and
the method further comprises:
determining a high spot in the target surface based on the surface profile; and
generating instructions to control the automated surface finishing system to cause the sanding end effector to sand down the high spot.

### Claim 12 (depends on 10)

The method of claim 10, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system; and
the method further comprises:
determining a low spot in the target surface based on the surface profile; and
generating instructions to control the positioning system and the sanding end effector to cause the sanding end effector to avoid sanding down the low spot.

### Claim 13 (depends on 10)

The method of claim 10, wherein:
the automated surface finishing system comprises a positioning system and a sanding end effector coupled to the positioning system; and
the method further comprises:
as the target surface is being sanded down the sanding end effector, processing further three-dimensional topography information to determine whether the target surface meets a threshold for surface quality; and
generating instructions to control the positioning system and the sanding end effector to end sanding in response to determining the target surface meets the threshold.

### Claim 14

A surface quality evaluation system comprising:
a frame having a base-bars to define a frame base that frames an area of a target surface;
top-bars that define a frame top;
side-bars extending from corners of the frame base to define frame sidewalls and couple with the top-bars;
a first light and a second light in different orientations to light up the area;
one or more cameras to capture images of the area; and
a display device to present results of an image analysis of the images to a user.

### Claim 15 (depends on 14)

The surface quality evaluation system of claim 14, further comprising:
shields to create a light box for controlling lighting of the target surface.

### Claim 16 (depends on 14)

The surface quality evaluation system of claim 14, wherein:
the first light is coupled at the frame top.

### Claim 17 (depends on 14)

The surface quality evaluation system of claim 14, wherein:
the second light is coupled at a frame sidewall.

### Claim 18 (depends on 14)

The surface quality evaluation system of claim 14, wherein:
the first light comprises a first light array;
the second light comprises a second light array;
lights of the first light array are selectively illuminated; and
lights of the second light array are selectively illuminated.

### Claim 19 (depends on 14)

The surface quality evaluation system of claim 14, further comprising:
one or more scanners to capture three-dimensional topography information of the target surface.

### Claim 20 (depends on 14)

The surface quality evaluation system of claim 14, wherein the display device further outputs feedback to the user, the feedback including one or more of:
rework areas of the target surface;
instructions on finish parameters to improve surface finish quality; and
alert when a specified surface finish quality is achieved.
