# US 12,181,856 B2 · Method and system for collecting machine data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,181,856 B2 - Document ID: US12181856B2 - Status: Granted - Kind: B2 - Application number: 17/423,460 - Filed: 2020-01-09 - Published: 2022-03-17 - Granted: 2024-12-31 - Earliest claimed: 2019-01-17 - Assignees: Technische Hochschule Deggendorf - Applicants: Technische Hochschule Deggendorf - Inventors: Florian Schweiger; Ilja Fuchs; Andreas Grzemba - Web page: https://patentgrep.com/patent/US12181856B2 ## CPC - G05B 19/0428: {Safety, monitoring (G05B19/0423 takes precedence)} - G05B 19/406: characterised by monitoring or safety (G05B19/19 takes precedence) - G06V 30/10: Character recognition - G05B 2219/50185: Monitoring, detect failures, control of efficiency of machine, tool life - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method for collecting machine data from a machine comprising the following steps: collecting image information displayed on a graphical user interface of a machine and transmitting the collected information to a computer unit; masking the collected information or information derived therefrom to define data regions; extracting alphanumeric characters from at least one data region by means of a text recognition program; writing the alphanumeric characters into a data structure; and storing or outputting the data structure. ## Claims ### Claim 1 A method for collecting machine data from a machine, comprising the following steps: collecting image information displayed on a graphical user interface of a machine and transmitting the collected information to a computer unit; masking the collected information or information derived therefrom to define data regions; extracting alphanumeric characters from at least one data region by means of a text recognition program; writing the alphanumeric characters into a data structure; and storing or outputting the data structure wherein, during operation of the machine, the image information is periodically collected at different points in time, alphanumeric characters are periodically extracted and the extracted characters are written into the data structure, so that the collected information contains information about the temporal change in the image information and the temporal change of machine data is inferred from the time-dependent course of the collected information. ### Claim 2 (depends on 1) The method according to claim 1, wherein the image information is collected by sampling with a predetermined sampling frequency. ### Claim 3 (depends on 1) The method according to claim 1, wherein the collection of the image information comprises acquiring the image information displayed on the graphical user interface by means of a camera. ### Claim 4 (depends on 1) The method according to claim 1, wherein the collection of the image information comprises the collection of the electrical image information signals transmitted between a graphical output interface and the graphical user interface. ### Claim 5 (depends on 1) The method according to claim 1, wherein the collected information or information derived therefrom is processed before the extraction of alphanumeric characters by means of at least one image processing program. ### Claim 6 (depends on 5) The method according to claim 5, wherein the processing comprises filtering and/or a contrast change, in particular a color contrast change. ### Claim 7 (depends on 1) The method according to claim 1, wherein, after the text recognition, the collected information is verified in a verification step. ### Claim 8 (depends on 7) The method according to claim 7, wherein during the verification of the collected information it is determined whether the values of temporally successively collected information change more than a predetermined change threshold value. ### Claim 9 (depends on 7) The method according to claim 7, wherein on the basis of the verification step it is determined whether there is a change in the extracted alphanumeric characters when image processing parameters are changed. ### Claim 10 (depends on 1) The method according to claim 1, wherein a plurality of data sets are stored for the collection of machine data from different machine types, each data set being assigned to one or more machine types, and each data set comprising information for masking the collected information, for filtering the collected information, for the font and/or for the font size. ### Claim 11 (depends on 1) The method according to claim 1, wherein a plurality of different pages each having different image information can be displayed on the graphical user interface, and in that switching between the pages takes place in order to collect the image information of the different pages. ### Claim 12 (depends on 1) The method according to claim 1, wherein graphic sections or image components are extracted from the image information and stored in the data structure. ### Claim 13 A system for collecting machine data, comprising: a collection unit, by means of which image information displayed on a graphical user interface of a machine can be collected; a computer unit, which is coupled to the collection unit and which is designed to receive the information collected by the collection unit; wherein the computer unit is designed to mask the collected information or information derived therefrom to define data regions, to extract alphanumeric characters from at least one data region by means of a text recognition program, and to write the extracted alphanumeric characters into a data structure or to output the extracted alphanumeric characters into a data stream, wherein the computer unit is designed to, during operation of the machine, periodically collect the image information at different points in time, periodically extract alphanumeric characters and write the extracted characters into the data structure, so that the collected information contains information about the temporal change in the image information and the temporal change of machine data is inferred from the time-dependent course of the collected information. ### Claim 14 (depends on 13) The system according to claim 13, wherein the computer unit comprises one or more data input interfaces, via which the computer unit can be coupled to one or more collection units. ### Claim 15 (depends on 14) The system according to claim 14, wherein each data input interface and each data output interface is assigned to one machine each. ### Claim 16 (depends on 13) The system according to claim 13, wherein the computer unit comprises one or more data output interfaces, via which a data structure containing alphanumeric characters or a data stream of alphanumeric characters is output. ### Claim 17 (depends on 13) The system according to claim 13, wherein the computer unit comprises at least one switching interface for providing a switching signal by means of which switching between pages of the graphical user interface of a machine takes place.