# US 2021/0279471 A1 · Deep learning tattoo match system based

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279471 A1
- Document ID: US20210279471A1
- Status: Published application
- Kind: A1
- Application number: 17/188,194
- Filed: 2021-03-01
- Published: 2021-09-09
- Earliest claimed: 2020-03-04
- Assignees: NEC Laboratories America, Inc.
- Applicants: NEC Laboratories America, Inc.
- Inventors: Yi Yang; Biplob Debnath; Giuseppe Coviello; Oliver Po; Srimat Chakradhar; Yang Gao
- Web page: https://patentgrep.com/patent/US20210279471A1

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06F 18/211: Selection of the most significant subset of features
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A computer-implemented method executed by at least one processor for detecting tattoos on a human body is presented. The method includes inputting a plurality of images into a tattoo detector, selecting one or more images of the plurality of images including tattoos, extracting, via a feature extractor, tattoo feature vectors from the tattoos found in the one or more images of the plurality of images including tattoos, applying a deep learning tattoo matching model to determine potential matches between the tattoo feature vectors and preexisting tattoo images stored in a tattoo training database, and generating a similarity score between the tattoo feature vectors and one or more of the preexisting tattoo images stored in the tattoo training database.

## Claims

### Claim 1

A computer-implemented method executed by at least one processor for detecting tattoos on a human body, the method comprising:
inputting a plurality of images into a tattoo detector;
selecting one or more images of the plurality of images including tattoos;
extracting, via a feature extractor, tattoo feature vectors from the tattoos found in the one or more images of the plurality of images including tattoos;
applying a deep learning tattoo matching model to determine potential matches between the tattoo feature vectors and preexisting tattoo images stored in a tattoo training database; and
generating a similarity score between the tattoo feature vectors and one or more of the preexisting tattoo images stored in the tattoo training database.

### Claim 2 (depends on 1)

The method of claim 1, wherein the tattoo training database employs a combination of two training datasets.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first training dataset includes non-permanent tattoos detected from multiple frames of a video stream.

### Claim 4 (depends on 3)

The method of claim 3, wherein each non-permanent tattoo image in the first training dataset has multiple image versions, with each image version captured at a different angle.

### Claim 5 (depends on 4)

The method of claim 4, wherein the second training dataset includes permanent tattoos detected from video capturing devices.

### Claim 6 (depends on 5)

The method of claim 5, wherein an identifier is assigned to each non-permanent tattoo instance and each permanent tattoo instance.

### Claim 7 (depends on 5)

The method of claim 5, wherein locations of each non-permanent tattoo instance and each permanent tattoo instance are labeled in different frames of the video stream.

### Claim 8

A system for detecting tattoos on a human body, the system comprising:
a memory; and
a processor in communication with the memory, wherein the processor runs program code to:
input a plurality of images into a tattoo detector;
select one or more images of the plurality of images including tattoos;
extract, via a feature extractor, tattoo feature vectors from the tattoos found in the one or more images of the plurality of images including tattoos;
apply a deep learning tattoo matching model to determine potential matches between the tattoo feature vectors and preexisting tattoo images stored in a tattoo training database; and
generate a similarity score between the tattoo feature vectors and one or more of the preexisting tattoo images stored in the tattoo training database.

### Claim 9 (depends on 8)

The system of claim 8, wherein the tattoo training database employs a combination of two training datasets.

### Claim 10 (depends on 9)

The system of claim 9, wherein the first training dataset includes non-permanent tattoos detected from multiple frames of a video stream.

### Claim 11 (depends on 10)

The system of claim 10, wherein each non-permanent tattoo image in the first training dataset has multiple image versions, with each image version captured at a different angle.

### Claim 12 (depends on 11)

The system of claim 11, wherein the second training dataset includes permanent tattoos detected from video capturing devices.

### Claim 13 (depends on 12)

The system of claim 12, wherein an identifier is assigned to each non-permanent tattoo instance and each permanent tattoo instance.

### Claim 14 (depends on 12)

The system of claim 12, wherein locations of each non-permanent tattoo instance and each permanent tattoo instance are labeled in different frames of the video stream.

### Claim 15

A non-transitory computer-readable storage medium comprising a computer-readable program for detecting tattoos on a human body, wherein the computer-readable program when executed on a computer causes the computer to perform the steps of:
inputting a plurality of images into a tattoo detector;
selecting one or more images of the plurality of images including tattoos;
extracting, via a feature extractor, tattoo feature vectors from the tattoos found in the one or more images of the plurality of images including tattoos;
applying a deep learning tattoo matching model to determine potential matches between the tattoo feature vectors and preexisting tattoo images stored in a tattoo training database; and
generating a similarity score between the tattoo feature vectors and one or more of the preexisting tattoo images stored in the tattoo training database.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the tattoo training database employs a combination of two training datasets.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the first training dataset includes non-permanent tattoos detected from multiple frames of a video stream.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein each non-permanent tattoo image in the first training dataset has multiple image versions, with each image version captured at a different angle.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the second training dataset includes permanent tattoos detected from video capturing devices.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein an identifier is assigned to each non-permanent tattoo instance and each permanent tattoo instance.
