# US 2020/0401803 A1 · Apparatus and methods for augmented reality measuring of equipment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401803 A1
- Document ID: US20200401803A1
- Status: Published application
- Kind: A1
- Application number: 16/880,827
- Filed: 2020-05-21
- Published: 2020-12-24
- Earliest claimed: 2019-06-19
- Assignees: Deere & Company; Iowa State University Research Foundation, Inc.
- Applicants: Deere & Company; Iowa State University Research Foundation, Inc.
- Inventors: Stephen Gilbert; Eliot Winer; Jack Miller; Alex Renner; Nathan Sepich; Vinodh Sankaranthi; Chris Gallant; David Wehr; Rafael Radkowski; Cheng Song
- Web page: https://patentgrep.com/patent/US20200401803A1

## CPC

- G06T 7/001: {using an image reference approach}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06Q 10/20: Administration of product repair or maintenance
- G06T 7/0006: {using a design-rule based approach}
- G06T 11/65: on geographic maps
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30108: Industrial image inspection
- G06V 2201/12: Acquisition of 3D measurements of objects
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Methods, apparatus, systems and articles of manufacture are disclosed for augmented reality measuring of equipment. An example apparatus disclosed herein includes an image comparator to compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data, and an inspection image analyzer to, in response to the image comparator identifying the vehicle part, measure the vehicle part by causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface, and determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

## Claims

### Claim 1

An apparatus comprising:
an image comparator to compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
an inspection image analyzer to, in response to the image comparator identifying the vehicle part, measure the vehicle part by:
causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface; and
determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the inspection image analyzer is to, when prior inspection data for the vehicle part exists, compare the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the inspection image analyzer is to determine a wear metric based on the comparison of the measurement with the prior measurement.

### Claim 4 (depends on 1)

The apparatus of claim 1, further including an inspection data transmitter to transmit the measurement or a wear metric based on the measurement to an inspection manager.

### Claim 5 (depends on 1)

The apparatus of claim 1, further including an inspection profile manager to:
access an inspection profile corresponding to the vehicle part; and
generate a navigation instruction to cause a user to move to position the camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the vehicle part is a tire, the overlay representation is a circular overlay, the inspection image analyzer to determine at least one of a diameter of the tire, radius of the tire, tread depth of the tire, or a thickness of the tire based on the one or more user inputs to adjust the circular overlay.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the inspection image analyzer is to, when prior inspection data for the vehicle part exists, generate predictive analytics based on an analyses of the prior inspection data for the vehicle part, the predictive analytics associated with a prediction of an amount of time for a measure of wear to occur.

### Claim 8

A non-transitory computer readable storage medium comprising instructions that, when executed, cause a processor to at least:
compare camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
in response to identifying the vehicle part, measure the vehicle part by:
generating an overlay representation of the reference vehicle part over the camera data displayed on a user interface; and
determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein, when prior inspection data for the vehicle part exists, the instructions, when executed, cause the processor to compare the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

### Claim 10 (depends on 9)

The non-transitory computer readable storage medium of claim 9, wherein the instructions, when executed, cause the processor to determine a wear metric based on the comparison of the measurement with the prior measurement.

### Claim 11 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the instructions, when executed, cause the processor to transmit the measurement or a wear metric based on the measurement to an inspection manager.

### Claim 12 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the instructions, when executed, cause the processor to:
access an inspection profile corresponding to the vehicle part; and
generate a navigation instruction to cause a user to move to position the camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

### Claim 13 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the vehicle part is a tire, the overlay representation is a circular overlay, the instructions, when executed, cause the processor to determine at least one of a diameter of the tire, radius of the tire, tread depth of the tire, or a thickness of the tire based on the one or more user inputs to adjust the circular overlay.

### Claim 14 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the instructions, when executed, cause the processor to, when prior inspection data for the vehicle part exists, generate predictive analytics based on an analyses of the prior inspection data for the vehicle part, the predictive analytics associated with a prediction of an amount of time for a measure of wear to occur.

### Claim 15

A method comprising:
comparing camera data with reference information of a reference vehicle part to identify a vehicle part included in the camera data; and
measuring, in response to identifying the vehicle part, the vehicle part by:
causing an interface generator to generate an overlay representation of the reference vehicle part on the camera data displayed on a user interface; and
determining, based on one or more user inputs to adjust the overlay representation, a measurement corresponding to the vehicle part.

### Claim 16 (depends on 15)

The method of claim 15, further including comparing, when prior inspection data for the vehicle part exists, the measurement corresponding to the vehicle part with a prior measurement corresponding to the vehicle part in the prior inspection data.

### Claim 17 (depends on 16)

The method of claim 16, further including determining a wear metric based on the comparison of the measurement with the prior measurement.

### Claim 18 (depends on 15)

The method of claim 15, further including transmitting the measurement or a wear metric based on the measurement to an inspection manager.

### Claim 19 (depends on 15)

The method of claim 15, further including:
accessing an inspection profile corresponding to the vehicle part; and
generating a navigation instruction to cause a user to move to position the camera at a location to view the vehicle part based on the inspection profile and a location of the camera.

### Claim 20 (depends on 15)

The method of claim 15, wherein the vehicle part is a tire, the overlay representation is a circular overlay, and further including determining at least one of a diameter of the tire, radius of the tire, tread depth of the tire, or a thickness of the tire based on the one or more user inputs to adjust the circular overlay.
