# US 12,118,418 B2 · System and method for automatically classifying printable images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,418 B2
- Document ID: US12118418B2
- Status: Granted
- Kind: B2
- Application number: 18/383,008
- Filed: 2023-10-23
- Published: 2024-02-15
- Granted: 2024-10-15
- Earliest claimed: 2021-03-18
- Assignees: Zebra Technologies Corporation
- Applicants: Zebra Technologies Corporation
- Inventors: Yan Zhang; Chih Huan Chien; David E. Coons; Victor L. Salmons; Leo T. Lowy
- Web page: https://patentgrep.com/patent/US12118418B2

## CPC

- G06K 15/4065: {Managing print media, e.g. determining available sheet sizes (feeding means G06K15/16)}
- G06K 15/1822: {Analysing the received data before processing}
- G06K 15/1823: {for evaluating the resources needed, e.g. rasterizing time, ink, paper stock}
- G06K 15/021: {Adaptations for printing on specific media}
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS

## Abstract

A method for classifying media to be printed comprising: receiving, at a printing device, print data representing the media to be printed; generating an image of the media based on the print data; classifying the image to obtain a media stock type associated with the media; printing the media according to the print data; and updating a stock of the media stock type.

## Claims

### Claim 1

A system comprising:
a printer;
a server in communication with the printer, the server being configured to:
receive print data representing the printable image to be printed by the printer;
generate an image of the printable image based on the print data;
classify the image to obtain a format associated with the printable image;
communicate with the printer to print the printable image according to the print data; and
wherein, to classify the image, the server is configured to:
input the image into an image classifier to obtain an image classification;
input the image into a keyword detector to obtain a keyword classification; and
reconcile the image classification and the keyword classification to obtain the format associated with the printable image.

### Claim 2 (depends on 1)

The system of claim 1, wherein to reconcile the image classification and the keyword classification, the server is configured to input the image classification and the keyword classification into an ensemble classifier to obtain the format associated with the printable image.

### Claim 3 (depends on 1)

The system of claim 1, wherein, to classify the image, the server is configured to:
input the image into an image classifier to obtain an image classification;
when a confidence level associated with the image classification exceeds a threshold confidence level, use the image classification as the format associated with the printable image; and
when the confidence level associated with the image classification does not exceed the threshold confidence level, input the image into a keyword detector to obtain the format associated with the printable image.

### Claim 4 (depends on 1)

The system of claim 1, wherein, to classify the image, the server is configured to:
obtain a signature map for the image; and
compare the signature map to established signature maps stored in memory to identify the format associated with the printable image.

### Claim 5 (depends on 4)

The system of claim 4, wherein to obtain the signature map, the server is configured to analyze one or more of: image dimensions, average dot coverage, center of dot mass, and image segmentation.

### Claim 6 (depends on 4)

The system of claim 4, wherein to compare the signature map to established signature maps, the server is configured to input the signature map into a machine learning engine to identify the format associated with the printable image.

### Claim 7 (depends on 1)

The printing device of claim 1, wherein the server is further configured to:
update a counter associated with the format in response to printing the printable image;
update a stock level of a media stock type for the label format based on the counter for the format; and
send a notification to a client device when the stock level of the media stock type falls below a threshold stock level.

### Claim 8 (depends on 1)

The printing device of claim 1, wherein the print data comprises form data defining a selected form to be used and having a plurality of fields, and field data defining data to input in each field of the selected form; and wherein to render the printable image, the processor is configured to:
input the field data into each field of the selected form; and
render the image according to the form data.

### Claim 9

A system comprising:
a printer;
a server in communication with the printer, the server configured to:
receive print data representing the printable image to be printed by the printer;
generate an image of the printable image based on the print data;
classify the image to obtain a format associated with the printable image;
communicate with the printer to print the printable image according to the print data; and
wherein, to classify the image, the processor is configured to:
input the image into an image classifier to obtain an image classification;
when a confidence level associated with the image classification exceeds a threshold confidence level, use the image classification as the format associated with the printable image; and
when the confidence level associated with the image classification does not exceed the threshold confidence level, input the image into a keyword detector to obtain the format associated with the printable image.

### Claim 10 (depends on 1)

The system of claim 1, wherein, to classify the image, the server is configured to:
obtain a signature map for the image; and
compare the signature map to established signature maps stored in memory to identify the format associated with the printable image.

### Claim 11 (depends on 10)

The system of claim 10, wherein to obtain the signature map, the server is configured to analyze one or more of: image dimensions, average dot coverage, center of dot mass, and image segmentation.

### Claim 12 (depends on 10)

The system of claim 10, wherein to compare the signature map to established signature maps, the server is configured to input the signature map into a machine learning engine to identify the format associated with the printable image.

### Claim 13 (depends on 9)

The system of claim 9, wherein the server is further configured to:
update a counter associated with the format in response to printing the printable image;
update a stock level of a media stock type for the label format based on the counter for the format; and
send a notification to a client device when the stock level of the media stock type falls below a threshold stock level.

### Claim 14 (depends on 9)

The system of claim 9, wherein the print data comprises form data defining a selected form to be used and having a plurality of fields, and field data defining data to input in each field of the selected form; and wherein to render the printable image, the processor is configured to:
input the field data into each field of the selected form; and
render the image according to the form data.

### Claim 15

A system comprising:
a printer;
a server in communication with the printer, the server configured to:
receive print data representing the printable image to be printed;
generate an image of the printable image based on the print data;
classify the image to obtain a format associated with the printable image;
communication with the printer to print the printable image according to the print data; and
wherein the print data comprises form data defining a selected form to be used and having a plurality of fields, and field data defining data to input in each field of the selected form; and
wherein to render the printable image, the processor is configured to:
input the field data into each field of the selected form; and
render the image according to the form data.

### Claim 16 (depends on 15)

The system of claim 15, wherein, to classify the image, the server is configured to:
input the image into an image classifier to obtain an image classification;
input the image into a keyword detector to obtain a keyword classification; and
reconcile the image classification and the keyword classification to obtain the format associated with the printable image.

### Claim 17 (depends on 15)

The system of claim 15, wherein, to classify the image, the server is configured to:
input the image into an image classifier to obtain an image classification;
when a confidence level associated with the image classification exceeds a threshold confidence level, use the image classification as the format associated with the printable image; and
when the confidence level associated with the image classification does not exceed the threshold confidence level, input the image into a keyword detector to obtain the format associated with the printable image.

### Claim 18 (depends on 15)

The system of claim 15, wherein, to classify the image, the server is configured to:
obtain a signature map for the image; and
compare the signature map to established signature maps stored in memory to identify the format associated with the printable image by inputting the signature map into a machine learning engine to identify the format associated with the printable image.
