# US 2025/0156713 A1 · Methods and systems for automatically detecting design elements in a two-dimensional design document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0156713 A1
- Document ID: US20250156713A1
- Status: Published application
- Kind: A1
- Application number: 19/022,535
- Filed: 2025-01-15
- Published: 2025-05-15
- Earliest claimed: 2019-06-06
- Assignees: Bluebeam, Inc.
- Applicants: Bluebeam, Inc.
- Inventors: Bruno ALVES; Jae Min LEE
- Web page: https://patentgrep.com/patent/US20250156713A1

## CPC

- G06F 30/13: Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads
- G06N 3/08: Learning methods
- G06F 16/93: Document management systems
- G06F 30/12: characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD
- G06N 3/04: Architecture, e.g. interconnection topology
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06V 10/82: using neural networks
- G06V 20/176: {Urban or other man-made structures}
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06V 30/422: Technical drawings; Geographical maps
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are disclosed for automatically detecting a design element in a design document. One method comprises receiving a design document and generating an enhanced design document based on the received design document. The enhanced design document may be generated by augmenting additional information to the design document using machine learning techniques. In response to receiving a user input, one or more design elements in the enhanced design document may be determined, and additional information associated with the determined one or more design elements may be displayed to the user.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computer-implemented method of searching for one or more design elements in a 2D design document, the method comprising:
receiving, by a document review application, the 2D design document, wherein the 2D design document includes the one or more design elements;
generating, by the document review application, an enhanced 2D design document based on the received 2D design document;
receiving, by the document review application, a search query from a user;
determining, by the document review application, the one or more design elements in the enhanced 2D design document based on the received query; and
displaying, by the document review application, a set of information associated with the one or more design elements in the enhanced 2D design document.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein receiving the 2D design document includes retrieving the 2D design document from at least one of a local storage, a remote storage, or the user.

### Claim 23 (depends on 22)

The computer-implemented method of claim 22, wherein retrieving the 2D design document from the user includes receiving the 2D design document from at least one of a peripheral device or a currently created 2D design document.

### Claim 24 (depends on 21)

The computer-implemented method of claim 21, wherein the document review application includes a document review component and a design element detection component,
wherein the document review component is configured to enable a user to perform at least one of locating the 2D design document, opening the 2D design document, modifying the 2D design document, or saving the 2D design document,
wherein the design element detection component is configured to analyze the 2D design document to detect one or more design elements in the 2D design document.

### Claim 25 (depends on 24)

The computer-implemented method of claim 24, wherein the document review component generates the enhanced 2D design document.

### Claim 26 (depends on 21)

The computer-implemented method of claim 21, wherein the enhanced 2D design document includes an electronic document including a 2D image of a design project augmented with one or more sets of information pertaining to the one or more design elements.

### Claim 27 (depends on 21)

The computer-implemented method of claim 21, further comprising, prior to receiving the search query from the user, displaying a search box within the document review application.

### Claim 28 (depends on 21)

The computer-implemented method of claim 21, wherein determining the one or more design elements in the enhanced 2D design document includes:
determining information pertaining to the one or more design elements, wherein the information pertaining to the one or more design elements includes at least one of one or more keywords, one or more image data, or one or more user selections.

### Claim 29 (depends on 28)

The computer-implemented method of claim 28, wherein determining the one or more design elements in the enhanced 2D design document further includes matching the determined information to one or more keywords from the search query.

### Claim 30 (depends on 28)

The computer-implemented method of claim 28, wherein determining the one or more design elements in the enhanced 2D design document further includes matching the determined information to the image data from the search query.

### Claim 31 (depends on 28)

The computer-implemented method of claim 28, wherein determining the one or more design elements in the enhanced 2D design document further includes matching the determined information to the one or more user selections.

### Claim 32 (depends on 21)

The computer-implemented method of claim 21, wherein the set of information associated with the one or more design elements in the enhanced 2D design document includes at least one of a location, a type, or a keyword.

### Claim 33 (depends on 21)

The computer-implemented method of claim 21, wherein generating the enhanced 2D design document includes:
detecting, using a trained machine learning model, the one or more design elements in the 2D design document, wherein the trained machine learning model is trained using a set of sample design elements that are automatically extracted from a plurality of enhanced 2D design documents; and
augmenting the 2D design document based on detailed information for each of the detected one or more design elements.

### Claim 34 (depends on 33)

The computer-implemented method of claim 33, wherein the trained machine learning model includes at least one of a supervised or unsupervised machine learning model.

### Claim 35 (depends on 33)

The computer-implemented method of claim 33, wherein the trained machine learning model is trained by:
receiving, from a training data collection system, training data, wherein the training data includes image data, the image data including the set of sample design elements that are each labeled with an object type;
preparing the received training data; and
inputting the prepared training data to the machine learning model configured to learn relationships between the set of sample design elements and the object types.

### Claim 36 (depends on 35)

The computer-implemented method of claim 35, wherein preparing the received training data includes performing at least one of:
randomizing an order of the training data;
identifying relevant relationships between one or more variables of the training data;
identifying one or more data imbalances;
splitting the training data into one or more portions; or
de-coupling and/or normalizing one or more errors in the training data.

### Claim 37 (depends on 35)

The computer-implemented method of claim 35, wherein, upon the training, the trained machine learning model is validated by analyzing at least a portion of the training data that is known to represent one or more object types.

### Claim 38 (depends on 37)

The computer-implemented method of claim 37, wherein the validated trained machine learning model is stored in a storage of the training data collection system and transmitted to the document review application.

### Claim 39

A system for searching for one or more design elements in a 2D design document, the system comprising:
one or more processors; and
one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to perform a method comprising:
receiving the 2D design document, wherein the 2D design document includes the one or more design elements;
generating an enhanced 2D design document based on the received 2D design document;
receiving a search query from a user;
determining the one or more design elements in the enhanced 2D design document based on the received query; and
displaying a set of information associated with the one or more design elements in the enhanced 2D design document.

### Claim 40

One or more non-transitory computer readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations for searching for one or more design elements in a 2D design document, the operations comprising:
receiving the 2D design document, wherein the 2D design document includes the one or more design elements;
generating an enhanced 2D design document based on the received 2D design document;
receiving a search query from a user,
determining the one or more design elements in the enhanced 2D design document based on the received query; and
displaying a set of information associated with the one or more design elements in the enhanced 2D design document.
