Back to results
US 2025/0139157 A1Published application
Method and system for construction project management using photo imaging measurements
OwnerWilliam Ernest Millerinventor
Life of this patent
Estimating the term…
Abstract
The present invention is a method and system of small construction project management by way of photo imaging and measurement capture for use by do-it-yourselfers, handymen and small contractors. The method and system operates on mobile computing devices and includes an image recognition system. By performing various imaging based measurements and then processing the resultant data, the method and system produces bills of materials, invoices, and receipts for the necessary tools and materials required by a construction project.
Claims20
A method comprising:
- collecting, at a server via a network, training data comprising images of one or more rooms;
- determining at one or more server design components via object recognition operations performed on the images, a set of design components in each room of the one or more rooms and at least one profile model applicable to each of the one or more rooms;
- collecting at the server via network retailer information for a plurality of retail products available via one or more vendor ecommerce sites, wherein the network retailer information is indexed by the server against a set of profile models and the set of design components, wherein each of the set of design components comprise a set of purchasable items;
- collecting visual data of a room by taking at least one image via a camera of a mobile computing device and conveying the visual data over the network to the server;
- calculating at the server, one or more dimensions of at least one aspect of the room;
- determining at the server, the at least one profile model applicable to the room and determine a subset of one or more design components specific the determined profile model, conveying the at least one profile model from the server to the mobile computing device over the network;
- displaying, via a user interface of the mobile computing device the at least one profile model;
- selecting, at the mobile computing device, the one or more design components in response to a user input;
- displaying, at the mobile computing device, the one or more design components partially based on calculated dimensions of the at least one aspect of each room of the one or more rooms;
- and
- displaying at the mobile computing device, an augmented reality environment of the room, the augmented reality environment configured to show the room as the room would be if a user selected one of the set of design components were added to the room.
8 more elements
A method comprising:
- training a machine learning algorithm of a server communicatively linked to a network, including:
- collecting via the network a real property listing data set from a plurality of real estate listings that includes images of each listing;
- processing at the server images of each listing of the data set to identify design components;
- compiling at the server a real property training data set that includes dimensions of each of the design components and at least one component image collecting visual data, comprising an image, of a room via a mobile computing device by at least capturing the image of the room via a camera of the mobile computing device;
- conveying via the network the visual data, from the mobile device to the server;
- executing at the server an image recognition program configured to determine from analyzing at least one room design component solution for the room, wherein the room design component solution comprises at least one of the design components for the room;
- automatically determined by the server for the room based upon results from of an unsupervised learning processor and the real property training data set;
- generating at the server, an augmented reality objects, which are conveyed over the network from the server to the mobile device, wherein the augmented reality objects comprise an object for at least a portion of the room an object for the design component of the room design component solution, wherein the augmented reality objects are scaled relative to each other based at least in part on server determined dimensions of the room from the image and upon dimensions of the design component;
- and
- displaying within an augmented reality interface of an augmented reality environment of the mobile device comprising the augmented reality objects received from the server.
7 more elements
A system comprising:
- a server comprising a server memory and a server processor;
- a mobile computing device connected to the server via a network, the mobile computing device comprising:
- a memory;
- a processor coupled to the memory and configured to:
- collect visual data of a first location comprising a room via an image taken from a camera of the mobile computing device;
- collect second visual data of a second location comprising a second room via a second image taken from the camera of the mobile computing device,
- convey the visual data and the second visual data from the mobile computing device to the server via the network;
- wherein the server is configured to:
- calculate, at the server, dimensions of at least one aspect of the first location and of the second location;
- execute a machine learning algorithm one the visual data of the first location, wherein the machine learning algorithm is configured to:
- identify a first theme of the first location;
- rank a plurality of previously stored design components;
- recommend a design component to install in the second location based on the first theme and results of ranking the previously stored design components, wherein the recommended design component is configured to fit in a specific work area having work area dimensions, which are a subcomponent of the server calculated dimensions of the second location;
- and
- convey the recommended design component and calculated work area dimensions over the network to the mobile computing device;
- receive the recommended design component and calculated work area dimensions at the mobile computing device;
- display one or more recommended design components for the second room;
- receive at the mobile computing device a selected one or more recommended design components in response to a user input;
- display the recommended one or more design components based upon the calculated work area dimensions;
- display an augmented reality environment of the second room showing the recommended design component positioned within the work area per the calculated work area dimensions.
17 more elements
The system of claim 14, wherein displaying the augmented reality environment further comprises:
- displaying the plurality of design components as a selectable set of items;
- moving a first digital representation of the selected design component in response to a user input from the set of selectable items via a touch-enabled display;
- establishing the first digital representation at a first position within the augmented reality environment;
- and
- rendering an updated digital representation of the selected design component at the first position, wherein the updated digital representation renders the selected design component to scale relative to the room within the augmented reality environment.
2 more elements
A system, comprising:
- a computing device having a processor and a camera;
- the processor comprising instructions to:
- create a new project;
- calibrate the camera to ascertain a relative size and perspective of a field of view, wherein in the system for calibrating includes allowing a user to choose one or more of a triangulation frame of reference process, a point of the reference process and a target object 3D scan process;
- capture and display, via a display interface, a photo image from the camera;
- calculate a dimension of an object in the photo image, including selecting a dimension to be measured from a user interface and measuring the dimension while the photo image is being displayed in the display interface based on a user drawn line;
- tag the photo image and save the photo image and tag as photo image data, wherein the photo image data is stored in an image recognition database;
- upload, via a server interface, the photo image data and the dimension to a server.
5 more elements
A method using a computing device having a processor and a camera, comprising:
- providing an interface for managing a construction project, including:
- creating a new project;
- capturing and displaying a photo image from the camera via a display interface;
- calculating dimensions of an object in the photo image;
- defining the photo image with a tag and saving the photo image and tag as photo image data, wherein the photo image data is stored in an image recognition database;
- and
- uploading at least the photo image data to a server;
- receiving and displaying a list of project guides, wherein the list of project guides are determined based on the photo image data.
5 more elements
Dependencies are inferred from the claim text.