# US 10,504,221 B2 · Methods, apparatus and systems for monitoring devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,221 B2 - Document ID: US10504221B2 - Status: Granted - Kind: B2 - Application number: 15/718,874 - Filed: 2017-09-28 - Published: 2019-03-28 - Granted: 2019-12-10 - Earliest claimed: 2017-09-28 - Assignees: Intel Corporation - Applicants: Intel Corporation - Inventors: Vadim Sukhomlinov; Kshitij Doshi; Tamir Damian Munafo - Web page: https://patentgrep.com/patent/US10504221B2 ## CPC - G06T 7/001: {using an image reference approach} - G06T 7/254: involving subtraction of images - G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)} - G07C 5/12: in graphical form - G06T 2207/30164: Workpiece; Machine component - G06T 2207/30248: Vehicle exterior or interior - G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE ## Abstract Methods, apparatus, systems and articles of manufacture are disclosed herein including a monitoring system an image sensor to obtain image data of a device and a governor to cause the image sensor to obtain image data of the device, to form an impression from the image data, to use the impression and the image data to determine a verdict. ## Claims ### Claim 1 A monitoring system, comprising: a thermal image sensor to obtain thermal image data of a device; and a governor to: form an impression from the thermal image data, the impression to map thermal gradients within a selected volume of a structure of the device onto coefficients vectors, generate expected values for a state of the device at a predetermined time based on the impression and the thermal image data, and compare the thermal image data for the device at the predetermined time with the generated expected values. ### Claim 2 (depends on 1) The monitoring system of claim 1, further including an optical image sensor to obtain optical image data. ### Claim 3 (depends on 1) The monitoring system of claim 1, further including a spatial image sensor to obtain spatial image data. ### Claim 4 (depends on 3) The monitoring system of claim 3, wherein the impression is to map spatial gradients within the selected volume of the structure of the device onto coefficients vectors. ### Claim 5 (depends on 1) The monitoring system of claim 1, wherein the thermal image sensor is to obtain the thermal image data of the device during operation of the device. ### Claim 6 (depends on 1) The monitoring system of claim 1, wherein the thermal image sensor is to obtain the thermal image data of the device between operation cycles of the device. ### Claim 7 (depends on 1) The monitoring system of claim 1, wherein the impression is formed from a plurality of sets of the thermal image data. ### Claim 8 (depends on 1) The monitoring system of claim 1, further including a communication device to communicate, to a remote device the impression, the thermal image data and a deviation report relating to the impression, the governor to generate the deviation report in response to a difference between expected values generated from the impression and actual values of the image data. ### Claim 9 (depends on 1) The system of claim 1, wherein the governor is to update the coefficient vectors to modify the impression based on a change in the thermal image data. ### Claim 10 (depends on 1) The system of claim 1, wherein the governor is to form the impression based on a plurality of training samples occurring over time, and the governor is to adjust the coefficient vectors for respective training samples. ### Claim 11 A method for automated monitoring of a device, comprising: thermal imaging a device during an operating state of the device to obtain first thermal image data; forming an impression from the first thermal image data, the impression to map thermal gradients within a selected volume of a structure of the device onto coefficients vectors; imaging the device during a subsequent operating state of the device to obtain second thermal image data; estimating values for the second thermal image data using the impression; and comparing the estimated values for the second thermal image data to actual values for the second thermal image data. ### Claim 12 (depends on 11) The method of claim 11, further including determining if a difference between the estimated values for the second thermal image data and the actual values for the second thermal image data is less than a threshold difference. ### Claim 13 (depends on 12) The method of claim 12, further including determining if telemetry data from a sensor of the device is within acceptable limits. ### Claim 14 (depends on 13) The method of claim 13, further including updating the impression to incorporate the second thermal image data as good data if the telemetry data is within acceptable limits. ### Claim 15 (depends on 13) The method of claim 13, further including updating the impression to incorporate the second thermal image data as bad data if telemetry data from a sensor of the device is not within acceptable limits. ### Claim 16 (depends on 15) The method of claim 15, further including outputting a deviation report. ### Claim 17 (depends on 12) The method of claim 12, further including, following a determination that the difference between the estimated values for the second thermal image data and the actual values for the second thermal image data are less than the threshold difference, comparing the estimated values for the second thermal image data to known values corresponding to a bad outcome to determine if the estimated values for the second thermal image data correspond to the bad outcome. ### Claim 18 A monitoring system, comprising: a thermal image sensor to obtain thermal image data of a device; and a governor to: form an impression from the thermal image data, the impression to map thermal gradients within a selected volume of a structure of the device onto coefficients vectors, and use the impression and the thermal image data to determine a verdict. ### Claim 19 (depends on 18) The monitoring system of claim 18, wherein the verdict is determined by using the impression and the thermal image data to generate expected values for a state of the device at a predetermined time and to compare the thermal image data for the device at the predetermined time with the generated expected values. ### Claim 20 (depends on 18) The monitoring system of claim 18, wherein the impression is to determine the verdict using the thermal image data directly.