# US 10,120,397 B1 · Interior climate control utilizing multimodal sensor positioning > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,397 B1 - Document ID: US10120397B1 - Status: Granted - Kind: B1 - Application number: 15/042,074 - Filed: 2016-02-11 - Granted: 2018-11-06 - Earliest claimed: 2016-02-11 - Assignees: Indoor Reality Inc. - Applicants: Indoor Reality - Inventors: Avideh Zakhor; Joseph Menke; Plamen Levchev - Web page: https://patentgrep.com/patent/US10120397B1 ## CPC - F24F 11/63: Electronic processing - F24F 11/0008: {for air-humidification (F24F11/30 takes precedence)} - F24F 11/30: for purposes related to the operation of the system, e.g. for safety or monitoring - F24F 11/62: characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values - F24F 11/70: Control systems characterised by their outputs; Constructional details thereof - G05B 15/02: electric - F24F 11/46: Improving electric energy efficiency or saving - F24F 11/56: Remote control - F24F 2110/00: Control inputs relating to air properties - F24F 2120/10: Occupancy - F24F 2120/12: Position of occupants - F24F 2130/00: Control inputs relating to environmental factors not covered by group F24F2110/00 - F24F 2130/10: Weather information or forecasts - F24F 2140/60: Energy consumption - G01C 21/206: {specially adapted for indoor navigation} - G05B 2219/2642: Domotique, domestic, home control, automation, smart house - F24F: AIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING (removing dirt or fumes from areas where they are produced B08B15/00; vertical ducts for carrying away waste gases from buildings E04F17/02; tops for chimneys or ventilating shafts, terminals for flues F23L17/02) - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) ## Abstract Methods for interior climate control of a building utilizing multimodal sensor positioning using an electronic mobile device are presented, the method including: causing the electronic mobile device to receive a building floor plan; generating a number of fingerprint databases corresponding with the building floor plan; determining positions of users each having a mobile electronic device in the building; receiving occupancy climate parameters; and adjusting interior climate control for a zone corresponding with users in the zone and occupation climate parameters. In some embodiments, generating a number of fingerprint databases further includes: performing a single walkthrough of the building with the mobile electronic device; gathering spatial sensor data corresponding with the mobile electronic device during the single walkthrough, where the spatial sensor data corresponds with any of images WiFi signal strength, Bluetooth signal strength, and/or magnetic vector fingerprint captured along a path traversed during the walkthrough. ## Claims ### Claim 1 A method for interior climate control of a building utilizing multimodal sensor positioning using an electronic mobile device, the method comprising: causing the electronic mobile device to receive a building floor plan; generating a plurality of fingerprint databases corresponding with the building floor plan; determining a position of a user having a mobile electronic device in the building, wherein determining the position of the user with an electronic mobile device in the building further comprises, receiving any of the following singly or in combination, initial WiFi data corresponding with a start position of the user, initial image data corresponding with a start position of the user, initial Bluetooth data corresponding with a start position of the user, and receiving initial magnetic data corresponding with a start position of the user, and performing an initialization of the start position corresponding with the received data; receiving occupancy climate parameters; and adjusting interior climate control for a zone corresponding with the position of the user and a plurality of occupancy climate parameters. ### Claim 2 (depends on 1) The method of claim 1, wherein generating a plurality of fingerprint databases further comprises: performing a single walkthrough of the building with the mobile electronic device; gathering spatial sensor data corresponding with the mobile electronic device during the single walkthrough, wherein the spatial sensor data corresponds with at least one of, a plurality of images captured along a path traversed during the walkthrough, a plurality of WiFi scans captured along the path traversed during the walkthrough, a plurality of Bluetooth scans captured along the path traversed during the walkthrough a plurality of magnetic vectors captured along the path traversed during the walkthrough; aligning a path traversed during the walkthrough to the building floor plan; and generating at least an image fingerprint database, a WiFi fingerprint database, a Bluetooth fingerprint database and a magnetic vector database corresponding with a common coordinate frame. ### Claim 3 (depends on 2) The method of claim 2, further comprising: providing an Inertial Measurement Unit (IMU) which may or may not be mounted on a shoe for tracking the path traversed during the walkthrough. ### Claim 4 (depends on 1) The method of claim 1, wherein determining the position of the user in the building using particle filtering further comprises: initializing the particles performing step detection on the mobile electronic device; and propagating a position of a plurality of particles at each step detected to track the mobile electronic device. ### Claim 5 (depends on 4) The method of claim 4, wherein propagating a position of a plurality of particles at each step detected to track the user further comprises; computing any of the following singly or in combination: a first weight of each of the plurality of particles based on a current WiFi observation; a second weight of each of the plurality of particles based on a current Bluetooth observation a third weight of each of the plurality of particles based on a current image observation; a fourth weight of each of the plurality of particles based on a current magnetic observation; resampling the plurality of particles to find a current position of the mobile electronic device based on the observations; and estimating the current position of the mobile electronic device. ### Claim 6 (depends on 5) The method of claim 5, further comprising: outputting the current position of the mobile electronic device. ### Claim 7 (depends on 1) The method of claim 1, wherein the plurality of occupancy climate parameters are selected from the group consisting of: user defined climate settings, mobile electronic device temperature readings, user schedules, building schedules, meeting schedules, building control settings, interior temperature readings, exterior temperature readings, airflow equipment capacities, heating equipment capacities, and cooling equipment capacities. ### Claim 8 (depends on 7) The method of claim 7, wherein adjusting interior climate control for the zone corresponding with the position of the user further comprises: adjusting the interior climate control for the zone in response to a scheduled occupancy change; and adjusting the interior climate control for the zone in response to an occupancy change. ### Claim 9 (depends on 8) The method of claim 8, wherein adjusting interior climate control for a zone corresponding with the position of the user further comprises: adjusting the interior climate control for the zone accounting for any combination of the plurality of occupancy climate parameters. ### Claim 10 A system of electronic hardware for interior climate control of a building utilizing multimodal sensor positioning comprising: an occupancy server having a processor for receiving a building floor plan, generating a plurality of fingerprint databases corresponding with the building floor plan, wherein generating a plurality of fingerprint databases further comprises: performing a single walkthrough of the building with a mobile electronic device, gathering spatial sensor data corresponding with the mobile electronic device during the single walkthrough, wherein the spatial sensor data corresponds with at least one of, a plurality of images captured along a path traversed during the walkthrough, a plurality of WiFi scans captured along the path traversed during the walkthrough, a plurality of Bluetooth scans captured along the path traversed during the walkthrough, a plurality of magnetic vectors captured along the path traversed during the walkthrough; aligning a path traversed during the walkthrough to the building floor plan; and generating at least an image fingerprint database, a WiFi fingerprint database, a Bluetooth fingerprint database and a magnetic vector database corresponding with a common coordinate frame; determining a position of a user in the building, receiving occupancy climate parameters, and adjusting interior climate control for a zone corresponding with the position of the user and a plurality of occupancy climate parameters; a mobile electronic device for capturing relevant data for determining the position of the user; and a Heating Ventilating and Air Conditioning (HVAC) and lighting control module for receiving input from the occupancy server for determining control configurations. ### Claim 11 (depends on 10) The system of claim 10, wherein the mobile electronic device further controls the HVAC and lighting control module via the occupancy server. ### Claim 12 (depends on 10) The system of claim 10, wherein the plurality of occupancy climate parameters are selected from the group consisting of: user defined climate settings, mobile electronic device temperature readings, user schedules, building schedules, meeting schedules, building control settings, interior temperature readings, exterior temperature readings, airflow equipment capacities, heating equipment capacities, and cooling equipment capacities. ### Claim 13 (depends on 10) The system of claim 10, wherein adjusting interior climate control for the zone corresponding with the position of the user further comprises: adjusting the interior climate control for the zone in response to a scheduled occupancy change; and adjusting the interior climate control for the zone in response to an occupancy change. ### Claim 14 (depends on 10) The system of claim 10, wherein adjusting interior climate control for a zone corresponding with the position of the user further comprises: adjusting the interior climate control for the zone accounting for any combination of the plurality of occupancy climate parameters. ### Claim 15 A computing device program product for interior climate control of a building utilizing multimodal sensor positioning using an electronic mobile device, the method comprising: a non-transitory computer readable medium; first programmatic instructions for causing the electronic mobile device to receive a building floor plan; second programmatic instructions for generating a plurality of fingerprint databases corresponding with the building floor plan; third programmatic instructions for determining a position of a user having a mobile electronic device in the building, wherein third programmatic instructions for determining the position of the user with an electronic mobile device in the building further comprises: tenth programmatic instructions for receiving any of the following singly or in combination: initial WiFi data corresponding with a start position of the user, initial image data corresponding with a start position of the user, initial Bluetooth data corresponding with a start position of the user, and receiving initial magnetic data corresponding with a start position of the user, and eleventh programmatic instructions for performing an initialization of the start position corresponding with the received data; fourth programmatic instructions for receiving occupancy climate parameters; and fifth programmatic instructions for adjusting interior climate control for a zone corresponding with the position of the user and a plurality of occupancy climate parameters, wherein the programmatic instructions are stored on the non-transitory computer readable medium. ### Claim 16 (depends on 15) The computing device program product of claim 15, wherein second programmatic instructions for generating a plurality of fingerprint databases further comprises: sixth programmatic instructions for performing a single walkthrough of the building with the mobile electronic device; seventh programmatic instructions for gathering spatial sensor data corresponding with the mobile electronic device during the single walkthrough, wherein the spatial sensor data corresponds with at least one of, a plurality of images captured along a path traversed during the walkthrough, a plurality of WiFi scans captured along the path traversed during the walkthrough, a plurality of Bluetooth scans captured along the path traversed during the walkthrough a plurality of magnetic vectors captured along the path traversed during the walkthrough; eighth programmatic instructions for aligning a path traversed during the walkthrough to the building floor plan; and ninth programmatic instructions for generating at least an image fingerprint database, a WiFi fingerprint database, a Bluetooth fingerprint database and a magnetic vector database corresponding with a common coordinate frame. ### Claim 17 (depends on 15) The computing device program product of claim 15, wherein third programmatic instructions for determining the position of the user in the building using particle filtering further comprises: twelfth programmatic instructions for initializing the particles thirteenth programmatic instructions for performing step detection on the mobile electronic device; fourteenth programmatic instructions for propagating a position of a plurality of particles at each step detected to track the mobile electronic device, wherein fourteenth programmatic instructions for propagating a position of a plurality of particles at each step detected to track the user further comprises; fifteenth programmatic instructions for computing any of the following singly or in combination: a first weight of each of the plurality of particles based on a current WiFi observation; a second weight of each of the plurality of particles based on a current Bluetooth observation a third weight of each of the plurality of particles based on a current image observation; a fourth weight of each of the plurality of particles based on a current magnetic observation; sixteenth programmatic instructions for resampling the plurality of particles to find a current position of the mobile electronic device based on the observations; and seventeenth programmatic instructions for estimating the current position of the mobile electronic device.