# US 12,182,889 B2 · Media management system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,182,889 B2
- Document ID: US12182889B2
- Status: Granted
- Kind: B2
- Application number: 18/315,994
- Filed: 2023-05-11
- Published: 2023-09-14
- Granted: 2024-12-31
- Earliest claimed: 2015-09-28
- Assignees: Oracle America, Inc.
- Applicants: Oracle America Inc.
- Inventors: Joshua Kanner; Andrew J. Hiser; Sean D. True
- Web page: https://patentgrep.com/patent/US12182889B2

## CPC

- G06Q 50/08: Construction
- G06Q 10/10: Office automation; Time management
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Described herein are various techniques for managing media related to a construction project, which may relate to one or more buildings to be built and/or renovated as part of the construction project. In accordance with techniques described herein, the media may be managed according to information regarding the construction project that is stored by one or more other systems separate from a media management system. The other systems may be construction information management systems that each store information regarding a construction project, including information relating to planning and/or execution of the construction project. For example, the media management system may generate tags based on the information regarding the construction project, may be trained to recognize features in the media that relate to the tags, and add the appropriate tags to the media based on the recognized features.

## Claims

### Claim 1

A media management system for tagging one or more particular defects in particular media including content relating to a premises, the media management system comprising:
at least one processor; and
at least one storage medium having encoded thereon executable instructions that, when executed by the at least one processor, cause the at least one processor to carry out a method comprising:
training a model to recognize a defect in an object using a plurality of media descriptive of the defect in the object, wherein training the model comprises extracting features corresponding to the defect from portions of the plurality of media descriptive of the defect, the portions of the plurality of media being associated with data indicating that the portions correspond to the defect;
further training the model using scale training data to recognize at least one physical dimension of the defect, wherein the scale training data comprises at least some of the plurality of media, wherein the at least some of the plurality of media depicts at least one other object, and wherein training the model using the scale training data comprises determining a scale for the at least some of the plurality of media in the scale training data based on at least one known physical dimension of the at least one other object and determining a physical dimension of the defect in the object in the at least some of the plurality of media based on the scale;
receiving the particular media including the content relating to the premises;
processing the particular media using the model to identify a particular defect in the particular media including content relating to the premises using the model and to determine a physical dimension of the particular defect in the particular media; and
adding at least one tag to the particular media responsive to identifying the particular defect in the particular media including content relating to the premises, the at least one tag being descriptive of a presence of the particular defect and the at least one physical dimension of the particular defect.

### Claim 2 (depends on 1)

The media management system of claim 1, wherein:
the particular media comprises an image of the premises, the particular defect comprises a crack in a surface, and the at least one physical dimension of the particular defect comprises at least one of a length of the crack and a width of the crack.

### Claim 3 (depends on 2)

The media management system of claim 2, wherein:
the particular defect comprises a crack in a wall.

### Claim 4 (depends on 2)

The media management system of claim 2, wherein:
identifying the particular defect further comprises:
identifying a number of pixels illustrating the crack; and
generating a crack score based on the number of pixels illustrating the crack; and
adding the at least one tag to the particular media further comprises:
adding a crack score tag descriptive of the crack score to the particular media.

### Claim 5 (depends on 1)

The media management system of claim 1, wherein the at least one known physical dimension of the at least one other object comprises at least one of:
a height of a wall represented in the particular media;
a width of a door represented in the particular media; and
a physical dimension of equipment represented in the particular media.

### Claim 6 (depends on 1)

The media management system of claim 1, wherein the model is trained using a plurality of historical media depicting similar types of defects in similar types of objects.

### Claim 7 (depends on 1)

The media management system of claim 1, wherein:
the particular defect is in a piece of equipment and is of a known type of defect that has occurred in a family of the piece of equipment.

### Claim 8 (depends on 1)

The media management system of claim 1, wherein the method further comprises:
outputting the particular media as tagged.

### Claim 9 (depends on 8)

The media management system of claim 8, wherein outputting the particular media as tagged further comprises at least one of:
storing the particular media as tagged in a non-transitory computer readable medium;
displaying the particular media as tagged in a user interface; and
transmitting the particular media as tagged to another system.

### Claim 10 (depends on 8)

The media management system of claim 8, wherein outputting the particular media as tagged further comprises:
providing a link to the particular media as tagged to an external system; and
providing the particular media as tagged to the external system responsive to the link being activated.

### Claim 11

A method of tagging one or more particular defects in particular media including content relating to a premises, the method comprising:
training a model to recognize a defect in an object using a plurality of media descriptive of the defect in the object, wherein training the model comprises extracting features corresponding to the defect from portions of the plurality of media descriptive of the defect, the portions of the plurality of media being associated with data indicating that the portions correspond to the defect;
further training the model using scale training data to recognize at least one physical dimension of the defect, wherein the scale training data comprises at least some of the plurality of media, wherein the at least some of the plurality of media depicts at least one other object, and wherein training the model using the scale training data comprises determining a scale for the at least some of the plurality of media in the scale training data based on at least one known physical dimension of the at least one other object and determining a physical dimension of the defect in the object in the at least some of the plurality of media based on the scale;
receiving the particular media including the content relating to the premises;
processing the particular media using the model to identify a particular defect in the particular media including content relating to the premises using the model and to determine a physical dimension of the particular defect in the particular media; and
adding at least one tag to the particular media responsive to identifying the particular defect in the particular media including content relating to the premises, the at least one tag being descriptive of a presence of the particular defect and the at least one physical dimension of the particular defect.

### Claim 12 (depends on 11)

The method of claim 11, wherein:
the particular media comprises an image of the premises, the particular defect comprises a crack in a surface, and the at least one physical dimension of the particular defect comprises at least one of a length of the crack and a width of the crack.

### Claim 13 (depends on 12)

The method of claim 12, wherein:
the particular defect comprises a crack in a wall.

### Claim 14 (depends on 12)

The method of claim 12, wherein:
identifying the particular defect further comprises:
identifying a number of pixels illustrating the crack; and
generating a crack score based on the number of pixels illustrating the crack; and
adding the at least one tag to the particular media further comprises:
adding a crack score tag descriptive of the crack score to the particular media.

### Claim 15 (depends on 11)

The method of claim 11, wherein the at least one known physical dimension of the at least one other object comprises at least one of:
a height of a wall represented in the particular media;
a width of a door represented in the particular media; and
a physical dimension of equipment represented in the particular media.

### Claim 16 (depends on 11)

The method of claim 11, wherein the model is trained using a plurality of historical media depicting similar types of defects in similar types of objects.

### Claim 17 (depends on 11)

The method of claim 11, wherein:
the particular defect is in a piece of equipment and is of a known type of defect that has occurred in a family of the piece of equipment.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
outputting the particular media as tagged.

### Claim 19 (depends on 18)

The method of claim 18, wherein outputting the particular media as tagged further comprises at least one of:
storing the particular media as tagged in a non-transitory computer readable medium;
displaying the particular media as tagged in a user interface; and
transmitting the particular media as tagged to another system.

### Claim 20 (depends on 19)

The method of claim 19, wherein outputting the particular media as tagged further comprises:
providing a link to the particular media as tagged to an external system; and
providing the particular media as tagged to the external system responsive to the link being activated.