# US 2021/0241019 A1 · Machine learning photographic metadata

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241019 A1
- Document ID: US20210241019A1
- Status: Published application
- Kind: A1
- Application number: 16/778,479
- Filed: 2020-01-31
- Published: 2021-08-05
- Earliest claimed: 2020-01-31
- Assignees: salesforce.com, inc.
- Applicants: salesforce.com, inc.
- Inventors: Luke MacNeil; Paulson McIntyre
- Web page: https://patentgrep.com/patent/US20210241019A1

## CPC

- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- G06F 16/583: using metadata automatically derived from the content
- G06N 5/025: Extracting rules from data
- G06N 20/00: Machine learning
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method and system for automated generation of photographic metadata in response to a machine learning algorithm including an input for receiving an image, a processor configured to perform an image recognition algorithm to generate a first metadata, to predict a second set of metadata in response to the first set of metadata and a set of rules generated in response to a machine learning training process wherein the set of rules are generated in response to a plurality of images having user generated metadata, and an output for transmitting the second set of metadata and the image to a storage medium.

## Claims

### Claim 1

An apparatus comprising:
an input for receiving an image;
a processor configured to perform an image recognition algorithm to generate a first metadata, to predict a second set of metadata in response to the first set of metadata and a set of rules generated in response to a machine learning training process wherein the set of rules are generated in response to a plurality of images having user generated metadata; and
an output for transmitting the second set of metadata and the image to a storage medium.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the machine learning training process is performed using a plurality of user stored images and associated user generated metadata.

### Claim 3 (depends on 1)

The apparatus of claim 1 wherein the first metadata is generated in response to a characteristic of the set of rules.

### Claim 4 (depends on 1)

The apparatus of claim 1 wherein the apparatus is a photographic image server.

### Claim 5 (depends on 1)

The apparatus of claim 1 wherein the input is a universal serial bus port.

### Claim 6 (depends on 1)

The apparatus of claim 1 wherein the input is an electronic storage medium.

### Claim 7 (depends on 1)

The apparatus of claim 1 wherein the image recognition algorithm is performed in response to a request from a photographic image management application.

### Claim 8 (depends on 1)

The apparatus of claim 1 wherein the user generated metadata is indicative of a category of metadata and wherein the first metadata is generated in response to the category of metadata.

### Claim 9

A method comprising:
receiving an image;
performing an image recognition algorithm in response to the image to generate a first metadata;
performing a comparison of the first metadata to a set of rules to generate a second metadata, the set of rules being generated in response to a plurality of images, each of the plurality of images having one of a plurality of user generated metadata; and
generating an image file in response to the image and the second metadata.

### Claim 10 (depends on 9)

The method of claim 9 wherein the set of rules are generated in response to a machine learning training process performed using a plurality of user stored images and associated user generated metadata.

### Claim 11 (depends on 9)

The method of claim 9 wherein the first metadata is generated in response to a category of image defined by the set of rules.

### Claim 12 (depends on 9)

The method of claim 9 wherein the input is an photographic image server configured to perform a photographic image management application.

### Claim 13 (depends on 9)

The method of claim 9 wherein the input is a universal serial bus port.

### Claim 14 (depends on 9)

The method of claim 9 wherein the input is an electronic storage memory card.

### Claim 15 (depends on 9)

The method of claim 9 wherein the image recognition algorithm is performed in response to a control signal generated by an image management application.

### Claim 16 (depends on 9)

The method of claim 9 further comprising transmitting the image file to a device configured to perform an image management application.

### Claim 17 (depends on 9)

The method of claim 9 where the user generated metadata is indicative of a category of metadata and wherein the first metadata is generated in response to the category of metadata

### Claim 18

A system for image management comprising:
a first storage medium configured to store a first image having a first set of metadata;
an image recognition processor operative to generate a second set of metadata in response to an image recognition algorithm and the first image;
a digital signal processor configured to generate a third set of metadata in response to the second set of metadata and an artificial intelligence rule set generated in response to a previous image and a previous user generated metadata;
a data processor operative to generate an image file in response to the first image, the first set of metadata, and the third set of metadata; and
a second storage medium operative to store the image file for access by an image management application.

### Claim 19 (depends on 18)

The method of claim 18 wherein the artificial intelligence rule set is generated in response to a plurality of images and a plurality of user generated metadata associated with each of the plurality of images.

### Claim 20 (depends on 18)

The method of claim 18 wherein the first set of metadata is generated by a camera.
