# US 11,907,890 B2 · Method and apparatus for label-less return shipments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,907,890 B2
- Document ID: US11907890B2
- Status: Granted
- Kind: B2
- Application number: 17/235,585
- Filed: 2021-04-20
- Published: 2021-10-21
- Granted: 2024-02-20
- Earliest claimed: 2020-04-21
- Assignees: Deutsche Post AG
- Applicants: Ali Özyigit; Baris Cem Sal
- Inventors: Ali Özyigit; Baris Cem Sal
- Web page: https://patentgrep.com/patent/US11907890B2

## CPC

- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/0833: Tracking
- G06F 16/381: {using identifiers, e.g. barcodes, RFIDs (for URLs G06F16/9554)}
- G06K 7/10861: {sensing of data fields affixed to objects or articles, e.g. coded labels (postal sorting B07C3/14, conveying articles B65G47/48)}
- G06Q 10/0832: Special goods or special handling procedures, e.g. handling of hazardous or fragile goods
- G06Q 10/0837: Return transactions
- G06Q 30/0601: Electronic shopping [e-shopping]
- G06V 30/224: of printed characters having additional code marks or containing code marks
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Apparatus configured to perform or control obtaining or causing obtaining an image of at least a part of a surface of a consignment unit. The apparatus derives or causes deriving a representation of the at least a part of the surface from the image. The representation includes a set of values representing a corresponding set of height levels. The apparatus generates or causes generation of a string of characters based on representation of the at least a part of the surface. The string of characters includes a first portion representative of the set of height levels of corresponding sections of the at least a part of the surface and a second portion generated based on a function of the representation and/or of the first portion of the string of characters. The apparatus associates or causes associating information representing the string of characters with shipping information of the consignment unit.

## Claims

### Claim 1

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining an image of at least a part of a surface of a consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface;
generating or causing generating a string of characters based on the representation of the at least a part of the surface, the string of characters comprising at least a first portion representative of the set of height levels of the corresponding sections of the at least a part of the surface and a second portion generated based on a function of the representation and/or of the first portion of the string of characters; and
associating or causing associating information representing the string of characters with shipping information of the consignment unit.

### Claim 2 (depends on 1)

Apparatus according to claim 1, wherein associating the information representing the string of characters with the shipping information comprises at least one of the following:
storing or causing storing the information representing the string of characters with the shipping information of the consignment unit;
providing or causing providing the information representing the string of characters in association with the shipping information of the consignment unit to be accessible by at least one external network device.

### Claim 3 (depends on 1)

Apparatus according to claim 1, wherein obtaining the image comprises obtaining or causing obtaining the image of at least a part of:
a bare surface portion of the consignment unit;
a part of a label of the consignment unit.

### Claim 4 (depends on 3)

Apparatus according to claim 3, wherein obtaining the image of the at least a part of the surface comprises:
applying or causing applying ultraviolet, UV, infrared, IR, and/or white light to the at least a part of the surface.

### Claim 5 (depends on 1)

The Apparatus according to claim 1, wherein the at least one external network device is a communication path.

### Claim 6

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation;
wherein obtaining the first information comprises:
obtaining or causing obtaining an image of at least a part of a surface of the first consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface:
generating or causing generating the first string of characters based on the representation of the at least a part of the surface;
receiving or causing receiving the first information via a network connection.

### Claim 7 (depends on 6)

Apparatus according to claim 6, wherein a second portion of the first string of characters is generated based on a function of the representation and/or of the first portion of the first string of characters.

### Claim 8 (depends on 6)

Apparatus according to claim 6, wherein obtaining the image comprises obtaining or causing obtaining the image of at least a part of:
a bare surface portion of the consignment unit;
a part of a label of the consignment unit.

### Claim 9 (depends on 8)

Apparatus according to claim 8, wherein obtaining the image of the at least a part of the surface comprises:
applying or causing applying ultraviolet, UV, infrared, IR, and/or white light to the at least a part of the surface.

### Claim 10

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform or control:
if the first string of characters is not present in the database:
determining or causing determining, based on a metric function, whether or not at least one second string of characters is present in the database, a distance of which to the first string of characters is below a first predefined threshold;
if at least one second string of characters is present in the database, the distance of which to the first string of characters is below the first predefined threshold, at least one of (a), (b):
(a) outputting or causing outputting shipping information associated with information representing the at least one second string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one second string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 11 (depends on 10)

Apparatus according to claim 10, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform or control:
if at least one second string of characters is determined to be present in the database, the at least one second string of characters comprising a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of at least one respective second consignment unit corresponding to the at least one second string of characters and the distance of which to the first string of characters and/or to the at least one first model string of characters is below the first and/or the second predefined threshold, the following steps (a), (b) and (c):
(a) obtaining or causing obtaining, for each one of the at least one second string of characters, at least third information representing at least one respective second model string of characters corresponding to the at least one second string of characters with a first portion being representative of a second model set of height levels of corresponding sections of at least a part of the surface of the respective second consignment unit corresponding to the at least one second string of characters;
(b) determining or causing determining whether or not at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters is present in the database for which a distance to any one of the first string of characters and/or the at least one first model string of characters is below a third predefined threshold; and
(c) if at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters is found, the distance of which to any one of the first string of characters and/or the at least one first model string of characters is below the third predefined threshold, at least one of (c1), (c2):
(c1) outputting or causing outputting shipping information associated with information representing the at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters in the database;
(c2) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 12

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; wherein the part of the surface of the consignment unit and/or of the first consignment unit corresponds to or comprises at least in part at least one of:
a bare surface portion of the consignment unit;
at least a part of a label of the consignment unit.

### Claim 13

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform or control:
if the first string of characters is not present in the database, the following steps (a), (b), and (c):
(a) obtaining or causing obtaining at least second information representing at least one first model string of characters with a first portion representative of a first model set of height levels of the corresponding sections of the at least a part of the surface of the first consignment unit;
(b) determining or causing determining, based on a metric function, whether or not at least one second string of characters is present in the database, a distance of which to the at least one first model string of characters and/or the first string of characters is below a second predefined threshold;
(c) if at least one second string of characters is present in the database, the distance of which to the at least one first model string of characters and/or the first string of characters is below the second predefined threshold, at least one of (c1), (c2):
(c1) outputting or causing outputting shipping information associated with information representing the at least one second string of characters in the database;
(c2) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one second string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 14

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation;
wherein for each one of the at least one first model string of characters, the first model set of height levels of the corresponding sections of the at least a part of the surface of the first consignment unit is obtained by calculating the height levels of the corresponding sections assuming different lighting conditions; and/or
wherein for each one of the at least one second model string of characters, the second model set of height levels of the corresponding sections of the at least a part of the surface of the second consignment unit is obtained by calculating the height levels of the corresponding sections assuming different lighting conditions.

### Claim 15

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; wherein the first string of characters, the at least one second string of characters, the at least one first model string of characters and the at least one second model string of characters each comprise respective second portions; and
wherein respective mutual distances between the first string of characters, the at least one second string of characters, the at least one first model string of characters and the at least one second model string of characters are determined based on the metric function and based on the respective second portions.

### Claim 16

An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause an apparatus at least to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; wherein the string of characters, the first string of characters, the second string of characters, the at least one first model string of characters, and/or the second model string of characters further comprises a third portion different from the first and/or the second portion and being determined based on a hash function of the first portion and/or the second portion and/or comprising a checksum of the first portion and/or the second portion.

### Claim 17

A method performed by at least one apparatus, the method comprising:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, the method further comprises at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation;
wherein obtaining the first information comprises:
obtaining or causing obtaining an image of at least a part of a surface of the first consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface:
generating or causing generating the first string of characters based on the representation of the at least a part of the surface;
or
receiving or causing receiving the first information via a network connection.

### Claim 18 (depends on 17)

The method according to claim 17, wherein the part of the surface of the consignment unit and/or of the first consignment unit corresponds to or comprises at least in part at least one of:
a bare surface portion of the consignment unit;
at least a part of a label of the consignment unit.

### Claim 19 (depends on 17)

The method according to claim 17, further comprising:
if the first string of characters is not present in the database, the method further comprises the following steps (a), (b), and (c):
(a) obtaining or causing obtaining at least second information representing at least one first model string of characters with a first portion representative of a first model set of height levels of the corresponding sections of the at least a part of the surface of the first consignment unit;
(b) determining or causing determining, based on a metric function, whether or not at least one second string of characters is present in the database, a distance of which to the at least one first model string of characters and/or the first string of characters is below a second predefined threshold;
(c) if at least one second string of characters is present in the database, the distance of which to the at least one first model string of characters and/or the first string of characters is below the second predefined threshold, the method further comprises at least one of (c1), (c2):
(c1) outputting or causing outputting shipping information associated with information representing the at least one second string of characters in the database;
(c2) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one second string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 20

A method performed by at least one apparatus, the method comprising:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, the method further comprises at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; further comprising:
if the first string of characters is not present in the database:
determining or causing determining, based on a metric function, whether or not at least one second string of characters is present in the database, a distance of which to the first string of characters is below a first predefined threshold;
if at least one second string of characters is present in the database, the distance of which to the first string of characters is below the first predefined threshold, the method further comprises at least one of (a), (b):
(a) outputting or causing outputting shipping information associated with information representing the at least one second string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one second string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 21

A method performed by at least one apparatus, the method comprising:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, the method further comprises at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation; further comprising:
if at least one second string of characters is determined to be present in the database, the at least one second string of characters comprising a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of at least one respective second consignment unit corresponding to the at least one second string of characters and the distance of which to the first string of characters and/or to the at least one first model string of characters is below the first and/or the second predefined threshold, the method further comprises the following steps (a), (b) and (c):
(a) obtaining or causing obtaining, for each one of the at least one second string of characters, at least third information representing at least one respective second model string of characters corresponding to the at least one second string of characters with a first portion being representative of a second model set of height levels of corresponding sections of at least a part of the surface of the respective second consignment unit corresponding to the at least one second string of characters;
(b) determining or causing determining whether or not at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters is present in the database for which a distance to any one of the first string of characters and/or the at least one first model string of characters is below a third predefined threshold; and
(c) if at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters is found, the distance of which to any one of the first string of characters and/or the at least one first model string of characters is below the third predefined threshold, the method further comprises at least one of (c1), (c2):
(c1) outputting or causing outputting shipping information associated with information representing the at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters in the database;
(c2) outputting or causing outputting a control signal based on the shipping information associated with information representing the at least one string of characters of the at least one second string of characters and the at least one corresponding second model string of characters for causing the external apparatus to perform the predetermined operation.

### Claim 22

A non-transitory computer readable storage medium in which a computer program is stored, the computer program when executed by a processor causing an apparatus or system to perform or control:
obtaining or causing obtaining first information representing a first string of characters with a first portion representative of a set of height levels of corresponding sections of at least a part of a surface of a first consignment unit;
determining or causing determining, based on the obtained first information, whether or not the first string of characters is present in a database; and
if the first string of characters is present in the database, at least one of (a) or (b):
(a) outputting or causing outputting shipping information associated with the first information representing the first string of characters in the database;
(b) outputting or causing outputting a control signal based on the shipping information for causing an external apparatus to perform a predetermined operation;
wherein obtaining the first information comprises:
obtaining or causing obtaining an image of at least a part of a surface of the first consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface;
generating or causing generating the first string of characters based on the representation of the at least a part of the surface;
or
receiving or causing receiving the first information via a network connection.

### Claim 23

A method performed by at least one apparatus, the method comprising:
obtaining or causing obtaining an image of at least a part of a surface of a consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface;
generating or causing generating a string of characters based on the representation of the at least a part of the surface, the string of characters comprising at least a first portion representative of the set of height levels of the corresponding sections of the at least a part of the surface and a second portion generated based on a function of the representation and/or of the first portion of the string of characters; and
associating or causing associating information representing the string of characters with shipping information of the consignment unit.

### Claim 24

A non-transitory computer readable storage medium in which a computer program is stored, the computer program when executed by a processor causing an apparatus or system to perform or control:
obtaining or causing obtaining an image of at least a part of a surface of a consignment unit;
deriving or causing deriving a representation of the at least a part of the surface from the image, the representation comprising a set of values respectively representing a corresponding set of height levels of corresponding sections of the at least a part of the surface;
generating or causing generating a string of characters based on the representation of the at least a part of the surface, the string of characters comprising at least a first portion representative of the set of height levels of the corresponding sections of the at least a part of the surface and a second portion generated based on a function of the representation and/or of the first portion of the string of characters; and
associating or causing associating information representing the string of characters with shipping information of the consignment unit.