# US 11,299,046 B2 · Method, device, and computer program product for managing application environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,299,046 B2 - Document ID: US11299046B2 - Status: Granted - Kind: B2 - Application number: 16/882,870 - Filed: 2020-05-26 - Published: 2021-11-04 - Granted: 2022-04-12 - Earliest claimed: 2020-04-30 - Assignees: EMC IP Holding Company LLC - Applicants: EMC IP Holding Company LLC - Inventors: Zhen Jia; Pedro Fernandez Orellana; Danqing Sha - Web page: https://patentgrep.com/patent/US11299046B2 ## CPC - G01D 21/02: Measuring two or more variables by means not covered by a single other subclass - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60K 35/22: Display screens - B60K 35/25: using haptic output - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 2360/11: Instrument graphical user interfaces or menu aspects - B60K 2360/166: Navigation - B60K 2360/167: Vehicle dynamics information - G01D: MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES ## Abstract In a method, a set of attribute information is received from a set of sensors in the application environment, respectively. Based on the set of attribute information, a state of the application environment is obtained. Based on a knowledge base associated with the application environment, reference information corresponding to the state of the application environment is determined, and the reference information represents candidate information that a user in the application environment needs in the state. The reference information is provided to the user. Further provided are a corresponding device and a corresponding computer program product. With exemplary embodiments of the present disclosure, the manual labor loads in the application environment can be reduced for the user, and information required in the current state can be provided to the user, thus reducing mis-operations of the user caused by mistakes in human discretion. ## Claims ### Claim 1 A method for managing an application environment, the method comprising: receiving a set of attribute information from a set of sensors in the application environment respectively; obtaining a state of the application environment based on the set of attribute information; determining reference information corresponding to the state of the application environment based on a knowledge base associated with the application environment, wherein the reference information represents candidate information that a user in the application environment needs in the state; providing the reference information to the user; wherein the set of attribute information comprises one or more images of a set of indicator features of a control panel of the application environment; and wherein obtaining the state of the application environment comprises analyzing the one or more images to identify states of respective ones of the set of indicator features of the control panel of the application environment. ### Claim 2 (depends on 1) The method according to claim 1, wherein providing the reference information comprises superimposing the reference information on at least one of the one or more images, and the method further comprises updating the reference information based on a feedback received from the user on the reference information. ### Claim 3 (depends on 1) The method according to claim 1, wherein the application environment comprises a data center, and wherein the application object comprises an electronic device in the data center. ### Claim 4 (depends on 3) The method according to claim 3, wherein determining the reference information comprises determining at least one of: a location of the electronic device; navigation to the location of the electronic device; and guidance to operate the electronic device. ### Claim 5 (depends on 1) The method according to claim 1, wherein the application environment comprises a vehicle environment, wherein the control panel of the application environment comprises a dashboard of the vehicle, and wherein the set of attribute information further comprises at least one of speed, acceleration, steering, engine speed, airbag information, tire information, and collision information of the vehicle. ### Claim 6 (depends on 5) The method according to claim 5, wherein determining the reference information comprises determining at least one of: safety guide; rescue information; and surrounding facility information. ### Claim 7 (depends on 1) The method according to claim 1, wherein the set of sensors comprises at least one of: an image sensor; a video sensor; an audio sensor; a temperature sensor; a humidity sensor; a pressure sensor; an air quality sensor; a smoke sensor; a speed sensor; an acceleration sensor; a vibration sensor; a light sensor; and a position sensor. ### Claim 8 (depends on 1) The method according to claim 1, wherein providing the reference information comprises: selecting, based on a type of the application environment, at least one of a set of two or more different types of presentation devices for presentation of the reference information to the user; and providing the reference information to the selected at least one of the set of two or more different types of presentation devices; wherein the two or more different types of presentation devices comprise two or more of: a mobile display device; a display device; a projection device; a wearable display device; an audio device; and a haptic device. ### Claim 9 (depends on 1) The method according to claim 1, wherein receiving the set of attribute information comprises receiving the set of attribute information based on a determination that the user enters the application environment. ### Claim 10 (depends on 1) The method of claim 1, wherein the set of indicator features of the control panel comprise indicator lights of an electronic device. ### Claim 11 (depends on 10) The method of claim 10, wherein analyzing the one or more images to identify states of respective ones of the set of indicator features of the control panel of the application environment comprises: determining whether each of the indicator lights is on or off; and representing the set of indicator features as a binary number, wherein each bit of the binary number represents the state of one of the indicator lights. ### Claim 12 An electronic device, comprising: at least one processor; and a memory coupled to the at least one processor, wherein the memory has instructions stored therein, the instructions, when executed by the at least one processor, cause the device to perform an action for managing an application environment, and the action comprises: receiving a set of attribute information from a set of sensors in the application environment respectively; obtaining a state of the application environment based on the set of attribute information; determining reference information corresponding to the state of the application environment based on a knowledge base associated with the application environment, wherein the reference information represents candidate information that a user in the application environment needs in the state; and providing the reference information to the user; wherein the set of attribute information comprises one or more images of a set of indicator features of a control panel of the application environment; and wherein obtaining the state of the application environment comprises analyzing the one or more images to identify states of respective ones of the set of indicator features of the control panel of the application environment. ### Claim 13 (depends on 12) The device according to claim 12, wherein providing the reference information comprises superimposing the reference information on at least one of the one or more images, and the action further comprises updating the reference information based on a feedback received from the user on the reference information. ### Claim 14 (depends on 12) The device according to claim 12, wherein the application environment comprises a data center, and wherein the application object comprises an electronic device in the data center. ### Claim 15 (depends on 14) The device according to claim 14, wherein determining the reference information comprises determining at least one of: a location of the electronic device; navigation to the location of the electronic device; and guidance to operate the electronic device. ### Claim 16 (depends on 11) The device according to claim 11, wherein the application environment comprises a vehicle environment, wherein the control panel of the application environment comprises a dashboard of the vehicle, and wherein the set of attribute information further comprises at least one of speed, acceleration, steering information, engine speed, airbag information, tire information, and collision information of the vehicle. ### Claim 17 (depends on 16) The device according to claim 16, wherein determining the reference information comprises determining at least one of: safety guide; rescue information; and surrounding facility information. ### Claim 18 (depends on 12) The device according to claim 12, wherein the set of sensors comprises at least one of: an image sensor; a video sensor; an audio sensor; a temperature sensor; a humidity sensor; a pressure sensor; an air quality sensor; a smoke sensor; a speed sensor; an acceleration sensor; a vibration sensor; a light sensor; and a position sensor. ### Claim 19 A computer program product, tangibly stored in a non-transitory computer-readable medium and comprising machine-executable instructions that when executed by a processing device cause the processing device to: receive a set of attribute information from a set of sensors in the application environment respectively; obtain a state of the application environment based on the set of attribute information; determine reference information corresponding to the state of the application environment based on a knowledge base associated with the application environment, wherein the reference information represents candidate information that a user in the application environment needs in the state; and provide the reference information to the user; wherein the set of attribute information comprises one or more images of a set of indicator features of a control panel of the application environment; and wherein obtaining the state of the application environment comprises analyzing the one or more images to identify states of respective ones of the set of indicator features of the control panel of the application environment. ### Claim 20 (depends on 19) The computer program product according to claim 19, wherein providing the reference information comprises superimposing the reference information on at least one of the one or more images, and further cause the processing device to update the reference information based on a feedback received from the user on the reference information.