Automated Usability Assessment Of Buildings Using Visual Data Of Captured In-Room Images

A computer-implemented method comprising:

• obtaining, by one or more computing systems, one or more panorama images captured in a room of a house and having visual data that in combination provides 360 degrees of horizontal visual data of the room;
• determining, by the one or more computing systems, and for each of multiple objects installed in the room, one or more target attributes of that object for which to capture additional data, including analyzing the visual data of the one or more panorama images to identify the multiple objects and to determine locations of the multiple objects in the room and to determine that the visual data of the one or more panorama images lacks details sufficient to satisfy a defined threshold about the one or more target attributes of each of the multiple objects;
• providing, by the one or more computing systems, instructions about capturing the additional data about the one or more target attributes of each of the multiple objects and that include information about the determined locations of the multiple objects, wherein the capturing of the additional data includes obtaining additional perspective images of one or more specified types of the multiple objects;
• determining, by the one or more computing systems, an assessment of a current usability of the room for an indicated purpose, including assessing current contributions of the multiple objects to the current usability of the room based at least in part on information from the additional data about the one or more target attributes of each of the multiple objects, and including combining information about the assessed current contributions of the multiple objects;
• and
• displaying, by the one or more computing systems, information about the determined assessment of the current usability of the room along with additional visual information about the room.

A computer-implemented method comprising:

• obtaining, by one or more computing systems, one or more images captured in a room of a house, and information about multiple objects installed in the room;
• determining, by the one or more computing systems, and for each of one or more objects of the multiple objects, one or more target attributes of that object for which to capture additional data, including analyzing visual data of the one or more images to identify that the visual data lacks details sufficient to satisfy a defined threshold about the one or more target attributes of that object;
• providing, by the one or more computing systems, instructions for capturing the additional data about the one or more target attributes of each of the one or more objects, wherein the capturing of the additional data includes obtaining additional visual data in additional images of one or more specified types of the one or more objects;
• analyzing, by the one or more computing systems and via use of at least one trained neural network, the additional visual data of the additional images to, for each of the one or more objects, verify that the additional data about the one or more target attributes of that object has been captured;
• determining, by the one or more computing systems, an assessment of a current usability of the room for an indicated purpose, including assessing contributions of the one or more objects to the current usability of the room based at least in part on information from the additional data about the one or more target attributes of each of the one or more objects, and including combining information about the assessed contributions of the one or more objects;
• and
• providing, by the one or more computing systems, information about the determined assessment of the current usability of the room.

A non-transitory computer-readable medium having stored contents that cause one or more computing devices to perform automated operations that include at least:

• obtaining, by the one or more computing devices, one or more images captured in a room of a building;
• providing, by the one or more computing devices and based at least in part on analysis of visual data of the one or more images, instructions for capturing additional images having additional visual data for multiple objects in the room to provide additional data about one or more indicated target attributes of each of the multiple objects;
• analyzing, by the one or more computing devices, the additional visual data of the additional images to, for each of the multiple objects, verify that the additional data about the one or more target attributes of that object has been captured, including to determine that the additional visual data satisfies a defined threshold about at least one target attribute of at least one of the multiple objects;
• determining, by the one or more computing devices and using the additional data from the additional images, assessments of the multiple objects that include, for each of the multiple objects, an assessment of a contribution of that object to usability of the room for an indicated purpose based at least in part on information from the additional data about the one or more target attributes of that object;
• and
• providing, by the one or more computing devices, information about the determined assessment of the multiple objects.

A system comprising:

• one or more hardware processors of one or more computing systems;
• and
• one or more memories with stored instructions that, when executed by at least one of the one or more hardware processors, cause at least one of the one or more computing systems to perform automated operations including at least:
• obtaining one or more images captured in a room of a building;
• determining, based at least in part on analyzing visual data of the one or more images, one or more objects in the room, and one or more target attributes of each of the one or more objects for which to capture additional data;
• providing instructions for capturing the additional data about the one or more target attributes of each of the one or more objects, including to obtain additional visual data about the one or more objects;
• analyzing, for each of the one or more objects, the additional visual data as part of verifying that the additional data about the one or more target attributes of that object has been captured;
• and
• providing information about the verifying for each of the one or more objects.