# US 12,111,669 B2 · Systems and methods for providing an augmented reality interface for the management and maintenance of building systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,111,669 B2 - Document ID: US12111669B2 - Status: Granted - Kind: B2 - Application number: 18/386,780 - Filed: 2023-11-03 - Published: 2024-05-02 - Granted: 2024-10-08 - Earliest claimed: 2013-07-10 - Assignees: CrowdComfort, Inc. - Applicants: CrowdComfort, Inc. - Inventors: B. Eric Graham; Abdullah Daoud; Galen C. Nelson; Chris Fuentes; Kevin Loos; Jeff Mcaulay - Web page: https://patentgrep.com/patent/US12111669B2 ## CPC - G05D 23/1927: {using a plurality of sensors (G05D23/1902, G05D23/1917, and G05D23/1919 take precedence)} - F24F 11/30: for purposes related to the operation of the system, e.g. for safety or monitoring - F24F 11/58: using Internet communication - G05B 15/02: electric - G05B 19/048: Monitoring; Safety - G05D 23/1917: {using digital means} - G06F 3/002: {Specific input/output arrangements not covered by G06F3/01 - G06F3/16 (other optical apparatus G02B27/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling - F24F 11/52: Indication arrangements, e.g. displays - G05B 2219/2614: HVAC, heating, ventillation, climate control - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - F24F: AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING (removing dirt or fumes from areas where they are produced B08B15/00; vertical ducts for carrying away waste gases from buildings E04F17/02; tops for chimneys or ventilating shafts, terminals for flues F23L17/02) - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract The present invention relates to systems and methods for improved building systems management and maintenance. The present invention provides a system for providing an augmented reality-like interface for the management and maintenance of building systems, specifically the mechanical, electrical, and plumbing (MEP) systems within a building, including the heating, ventilation, and air-conditioning (HVAC) systems. ## Claims ### Claim 1 A method for providing an augmented reality interface for crowdsourced management and maintenance of a plurality of building spaces, the method comprising: providing a crowdsourcing platform having an interface with which users can interact, via user mobile devices, for crowdsourced building management and maintenance; receiving, via the crowdsourcing platform, user reports, wherein each user report is related to a maintenance, comfort, or inspection issue and is associated with a time and location of the user mobile device from which the report was made; aggregating, via the crowdsourcing platform, the user reports based on issue, time, and building space; receiving, via the crowdsourcing platform, information relating to a location of an authorized user mobile device; identifying, via the crowdsourcing platform, a building space associated with the authorized user mobile device location; identifying, via the crowdsourcing platform, user reports related to a given issue for the identified building space; identifying, via the crowdsourcing platform, a piece of equipment associated with the given issue for the identified building space; and generating and outputting an augmented reality interface to the authorized user mobile device, wherein the augmented reality interface comprises at least one interactive visual rendering, each interactive visual rendering including the piece of equipment and a selected one of the identified user reports through which the authorized user can interact with and respond to the identified user reports to address the given issue. ### Claim 2 (depends on 1) The method of claim 1, wherein at least some of the user reports include at least one of custom text, images, or comments on others' reports. ### Claim 3 (depends on 1) The method of claim 1, wherein aggregating the user reports further comprises weighting the user reports based on a predetermined weighting rule. ### Claim 4 (depends on 1) The method of claim 1, wherein the location of at least one of the user mobile devices or the authorized user mobile device is based on a scan of a unique identifier situated at the location. ### Claim 5 (depends on 1) The method of claim 1, wherein the piece of equipment is associated with at least one of mechanical, electrical, and plumbing systems of a building. ### Claim 6 (depends on 5) The method of claim 5, wherein the piece of equipment is associated with at least one of heating, ventilation, and air-conditioning (HVAC) systems of a building. ### Claim 7 (depends on 1) The method of claim 1, wherein the augmented reality interface comprises a visual illustration of the equipment, the visual illustration depicting at least one of internal components of the equipment and real-time diagnostics of the equipment while in operation. ### Claim 8 (depends on 1) The method of claim 1, further comprising: receiving input from the authorized user mobile device with respect to an interactive visual rendering; generating a control signal for the piece of equipment; and transmitting the control signal to said piece of equipment to cause adjustment of operation of said piece of equipment. ### Claim 9 (depends on 8) The method of claim 8, further comprising: identifying user mobile devices located in the identified building space; and transmitting a notification to each user mobile device located in the identified building space regarding the adjustment. ### Claim 10 (depends on 9) The method of claim 9, wherein the notification allows the users associated with the user mobile devices to vote on the adjustment. ### Claim 11 A system for providing an augmented reality interface for crowdsourced management and maintenance of a plurality of building spaces, the system comprising: a central management information system configured to communicate and exchange data with one or more user mobile devices over a network, each user mobile device associated with a respective user, the central management information system comprising at least one hardware processor coupled to at least one non-transitory, computer-readable memory containing instructions executable by the at least one processor to cause the central management information system to perform processes comprising: providing a crowdsourcing platform having an interface with which users can interact, via user mobile devices, for crowdsourced building management and maintenance; receiving, via the crowdsourcing platform, user reports, wherein each user report is related to a maintenance, comfort, or inspection issue and is associated with a time and location of the user mobile device from which the report was made; aggregating, via the crowdsourcing platform, the user reports based on issue, time, and building space; receiving, via the crowdsourcing platform, information relating to a location of an authorized user mobile device; identifying, via the crowdsourcing platform, a building space associated with the authorized user mobile device location; identifying, via the crowdsourcing platform, user reports related to a given issue for the identified building space; identifying, via the crowdsourcing platform, a piece of equipment associated with the given issue for the identified building space; and generating and outputting an augmented reality interface to the authorized user mobile device, wherein the augmented reality interface comprises at least one interactive visual rendering, each interactive visual rendering including the piece of equipment and a selected one of the identified user reports through which the authorized user can interact with and respond to the identified user reports to address the given issue. ### Claim 12 (depends on 11) The system of claim 11, wherein at least some of the user reports include at least one of custom text, images, or comments on others' reports. ### Claim 13 (depends on 11) The system of claim 11, wherein aggregating the user reports further comprises weighting the user reports based on a predetermined weighting rule. ### Claim 14 (depends on 11) The system of claim 11, wherein the location of at least one of the user mobile devices or the authorized user mobile device is based on a scan of a unique identifier situated at the location. ### Claim 15 (depends on 11) The system of claim 11, wherein the piece of equipment is associated with at least one of mechanical, electrical, and plumbing systems of a building. ### Claim 16 (depends on 15) The system of claim 15, wherein the piece of equipment is associated with at least one of heating, ventilation, and air-conditioning (HVAC) systems of a building. ### Claim 17 (depends on 11) The system of claim 11, wherein the augmented reality interface comprises a visual illustration of the equipment, the visual illustration depicting at least one of internal components of the equipment and real-time diagnostics of the equipment while in operation. ### Claim 18 (depends on 11) The system of claim 11, further comprising: receiving input from the authorized user mobile device with respect to an interactive visual rendering; generating a control signal for the piece of equipment; and transmitting the control signal to said piece of equipment to cause adjustment of operation of said piece of equipment. ### Claim 19 (depends on 18) The system of claim 18, further comprising: identifying user mobile devices located in the identified building space; and transmitting a notification to each user mobile device located in the identified building space regarding the adjustment. ### Claim 20 (depends on 19) The system of claim 19, wherein the notification allows the users associated with the user mobile devices to vote on the adjustment.