# US 2025/0166162 A1 · Methods and apparatus for grading images of collectables using image segmentation and image analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0166162 A1
- Document ID: US20250166162A1
- Status: Published application
- Kind: A1
- Application number: 18/931,992
- Filed: 2024-10-30
- Published: 2025-05-22
- Earliest claimed: 2021-02-18
- Assignees: Collectors Universe, Inc.
- Applicants: Collectors Universe, Inc.
- Inventors: David SHALAMBERIDZE; Kevin C. LENANE
- Web page: https://patentgrep.com/patent/US20250166162A1

## CPC

- G06T 7/0008: {checking presence/absence}
- G06T 7/001: {using an image reference approach}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06V 10/24: Aligning, centring, orientation detection or correction of the image
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In some embodiments, a method can include augmenting a set of images of collectables to generate a set of synthetic images of collectables. The method can further include combining the set of images of collectables and the set of synthetic images of collectables to produce a training set. The method can further include training a set of machine learning models based on the training set. Each machine learning model from the set of machine learning models can generate a grade for an image attribute from a set of image attributes. The set of image attributes can include an edge, a corner, a center, or a surface. The method can further include executing, after training, the set of machine learning models to generate a set of grades for an image of collectable not included in the training set.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

An apparatus, comprising:
a memory; and
a processor operatively coupled to the memory, the processor configured to:
train at least one model based on each image from a set of images of a set of collectables and at least one of (1) a first grade classification label associated with that image and for a surface condition of the set of collectables, (2) a second grade classification label associated with that image and for an edge condition of the set of collectables, or (3) a third grade classification label associated with that image and for a corner condition of the set of collectables, the at least one model including (1) a first model trained using (a) each image from the set of images, and (b) the first grade classification label associated with that image, (2) a second model trained using (a) each image from the set of images, and (b) the second grade classification label associated with that image, and (3) a third model trained using (a) each image from the set of images, and (b) the third grade classification label associated with that image;
cause the at least one model to be applied to an image of a collectable not included in the set of collectables; and
cause an output to be displayed indicating that the collectable includes a defect.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein a first image from the set of images was taken under a first lighting condition, and a second image from the set of images was taken under a second lighting condition different than the first lighting condition.

### Claim 23 (depends on 21)

The apparatus of claim 21, wherein a first image from the set of images was taken at a first angle relative to a first collectable from the set of collectables, and a second image from the set of images was taken at a second angle relative to one of the first collectable or a second collectable from the set of collectables different than the first collectable, the second angle different than the first angle.

### Claim 24 (depends on 21)

The apparatus of claim 21, wherein a first image from the set of images was taken with a first background, and a second image from the set of images was taken with a second background different than the first background.

### Claim 25 (depends on 21)

The apparatus of claim 21, wherein the at least one model includes at least one dropout layer to reduce overfitting.

### Claim 26 (depends on 21)

The apparatus of claim 21, wherein the processor is further configured to:
improve hyperparameters associated with the at least one model using at least one of a random search algorithm, a hyperband algorithm, or a Bayesian optimization algorithm.

### Claim 27 (depends on 21)

The apparatus of claim 21, wherein each image from the set of images is further associated with a fourth grade classification label for centering conditions of the collectable and the at least one model further includes (1) a fourth model trained using (a) each image from the set of images, and (b) the fourth grade classification label associated with that image and (2) a fifth model trained using (a) each image from the set of images, and (b) at least one defect type label associated with that image.

### Claim 28

A method, comprising:
applying a machine learning (ML) model to an image of an object to generate a plurality of defect confidence levels, each defect confidence level from the plurality of defect confidence levels (1) associated with a unique portion of the image from a plurality of unique portions of the image, and (2) indicating a likelihood that at least one defect is present within that unique portion of the image, the ML model trained using a training dataset that includes at least one image and at least one synthetic image generated by modifying a brightness of the at least one image; and
causing the image to be displayed.

### Claim 29 (depends on 28)

The method of claim 28, further comprising:
causing each unique portion of the image from the plurality of unique portions of the image associated with a defect confidence level from the plurality of defect confidence levels outside a predetermined range to be indicated on a display.

### Claim 30 (depends on 28)

The method of claim 28, wherein the ML model is a first ML model, the method further comprising:
applying a second ML model to the image to generate a first score indicating surface conditions of the object;
applying a third ML model to the image to generate a second score indicating edge conditions of the object;
applying a fourth ML model to the image to generate a third score indicating corner conditions of the object;
applying a fifth ML model to the image to generate a fourth score indicating centering conditions of the object;
assigning at least one label indicating an overall condition of the object to the object based on the first score, the second score, the third score, and the fourth score; and
causing each defect confidence level from the plurality of defect confidence levels to be displayed as superimposed on a unique portion of the image associated that defect confidence level.

### Claim 31 (depends on 30)

The method of claim 30, further comprising:
applying a computer vision model to the image to identify at least one of a card type, player information, or character information associated with the object, at least one of the card type, the player information, or the character information used by at least one of the first ML model to generate the plurality of defect confidence levels, the second ML model to generate the first score, the third ML model to generate the second score, the fourth ML model to generate the third score, or the fifth ML model to generate the fourth score.

### Claim 32 (depends on 30)

The method of claim 30, wherein
the applying the first ML model is performed prior to the applying the second ML model, the applying the third ML model, the applying the fourth ML model, and the applying the fifth ML model, and
at least two of the applying the second ML model, the applying the third ML model, the applying the fourth ML model, or the applying the fifth ML model are performed in parallel.

### Claim 33 (depends on 28)

The method of claim 28, further comprising:
determining, for the image, at least one of a card type, player information, or character information, the ML model further applied to at least one of the card type, the player information, or the character information to generate the plurality of defect confidence levels.

### Claim 34

A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the instructions comprising code to cause the processor to:
augment an image of an object to generate a synthetic image of the object, the image being shifted to generate the synthetic image; and
train a set of machine learning models based on the image and the synthetic image, each machine learning model from the set of machine learning models configured to generate a grade for an image attribute from a set of image attributes, the set of image attributes including at least one of an edge, a corner, a center, or a surface

### Claim 35 (depends on 34)

The non-transitory processor-readable medium of claim 34, wherein the object is a first object, the image is a first image, and the code further comprises code to cause the processor to:
execute, after training the set of machine learning models, the set of machine learning models to generate a grade for a second image of a second object.

### Claim 36 (depends on 35)

The non-transitory processor-readable medium of claim 35, wherein the first image is captured using a first camera setting, and the second image is captured using a second camera setting different than the first camera setting.

### Claim 37 (depends on 34)

The non-transitory processor-readable medium of claim 34, wherein the object is a collectable.

### Claim 38 (depends on 37)

The non-transitory processor-readable medium of claim 37, wherein the collectable is at least one of a trading card, a coin, or a currency.

### Claim 39 (depends on 37)

The non-transitory processor-readable medium of claim 37, wherein the augmenting includes at least one of rotating the image, shifting the image vertically, shifting the image horizontally, scaling the image, adjusting a brightness of the image, adjusting a contrast of the image, flipping the image vertically, or flipping the image horizontally.

### Claim 40 (depends on 34)

The non-transitory processor-readable medium of claim 34, wherein the image is a first image, the synthetic image is a first synthetic image, and the set of machine learning models is further trained based on (1) a second image and (2) a second synthetic image generated by modifying a brightness of the second image.
