# US 12,006,913 B2 · Method and an apparatus for computer-implemented monitoring of one or more wind turbines in a wind farm > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,006,913 B2 - Document ID: US12006913B2 - Status: Granted - Kind: B2 - Application number: 17/628,404 - Filed: 2020-07-10 - Published: 2022-08-25 - Granted: 2024-06-11 - Earliest claimed: 2019-07-26 - Assignees: Siemens Gamesa Renewable Energy A/S - Applicants: Siemens Gamesa Renewable Energy A/S - Inventors: Bert Gollnick - Web page: https://patentgrep.com/patent/US12006913B2 ## CPC - F03D 17/00: Monitoring or testing of wind motors, e.g. diagnostics (testing during commissioning of wind motors F03D13/30) - F03D 17/003: {characterised by using optical devices, e.g. lidar or cameras} - F03D 17/005: {using computation methods, e.g. neural networks} - F03D 17/028: {Blades} - G06T 7/0004: {Industrial image inspection} - F03D 7/048: {controlling wind farms} - F05B 2260/80: Diagnostics - F05B 2260/84: Modelling or simulation - F05B 2270/322: the detection or prediction of a wind gust - F05B 2270/326: Rotor angle - F05B 2270/333: Noise or sound levels - F05B 2270/709: with neural networks - F05B 2270/8041: Cameras - G06T 2207/20084: Artificial neural networks [ANN] - G06T 2207/30164: Workpiece; Machine component - G06T 2207/30168: Image quality inspection - Y02E 10/72: Wind turbines with rotation axis in wind direction - F03D: WIND MOTORS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - F05B: INDEXING SCHEME RELATING TO WIND, SPRING, WEIGHT, INERTIA OR LIKE MOTORS, TO MACHINES OR ENGINES FOR LIQUIDS COVERED BY SUBCLASSES F03B, F03D AND F03G - Y02E: REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION ## Abstract Provided is a method for monitoring one or more wind turbines in a wind farm, each wind turbine having a rotor with rotor blades which are rotatable around a rotor axis, wherein one or several times during the operation of the wind farm a process is performed that includes i) obtaining a digital image of the respective rotor blade, the image being a current image taken by a camera looking at the respective rotor blade; ii) determining one or more operation characteristics of the respective rotor blade by processing the image by a trained data driven model, where the image is fed as a digital input to the trained data driven model and the trained data driven model provides the one or more operation characteristics of the respective rotor blade as a digital output. ## Claims ### Claim 1 A method for computer-implemented monitoring of one or more wind turbines in a wind farm, each wind turbine having a rotor with rotor blades which are rotatable by wind around a rotor axis, wherein one or several times during the operation of the wind farm a process is performed comprising the following steps for a respective rotor blade of one or more rotor blades of a respective wind turbine of the one or more wind turbines: i) obtaining a digital image of the respective rotor blade, the digital image being a current image taken by a camera looking at the respective rotor blade; and ii) determining one or more operation characteristics of the respective rotor blade by processing the digital image by a trained data driven model, where the digital image is fed as a digital input to the trained data driven model and the trained data driven model provides the one or more operation characteristics of the respective rotor blade as a digital output; wherein the camera is installed on another wind turbine than the respective wind turbine for which the process is performed. ### Claim 2 (depends on 1) The method according to claim 1, wherein the trained data driven model is a neural network, in particular a Convolutional Neural Network. ### Claim 3 (depends on 1) The method according to claim 1, wherein an information based on the one or more operation characteristics of the respective rotor blade is output via a user interface. ### Claim 4 (depends on 1) The method according to claim 1, wherein the one or more operation characteristics comprise one or more of the following characteristics: at least one root bending moment acting on the respective rotor blade, an edge-wise root bending moment and/or a flap-wise root bending moment; a deflection of the tip of the respective rotor blade, where the wind speed is determined by the deflection; and a twist of the respective rotor blade. ### Claim 5 (depends on 1) The method according to claim 1, wherein the camera is installed on a nacelle of the respective wind turbine for which the process is performed. ### Claim 6 (depends on 1) The method according to claim 1, wherein the camera is installed on a rotor hub of the respective wind turbine for which the process is performed. ### Claim 7 (depends on 1) The method according to claim 1, wherein the camera looks at the respective rotor blade in a direction substantially perpendicular to the rotor axis of the respective wind turbine. ### Claim 8 (depends on 1) The method according to claim 1, wherein an angular position of the respective rotor blade around the rotor axis at a time of taking the image is fed as an additional input to the data driven model. ### Claim 9 (depends on 1) The method according to claim 1, wherein in step i) several images of the respective rotor blade taken by the camera are processed, where the digital image having the best image quality according to one or more quality criteria is chosen as the digital image being obtained. ### Claim 10 (depends on 1) The method according to claim 1, wherein the process is performed for several rotor blades of the respective wind turbine, where rotor blades are identified which have one or more operation characteristics with a deviation from the one or more operation characteristics of the other rotor blades higher than a predetermined threshold. ### Claim 11 (depends on 1) The method according to claim 1, wherein a gust with corresponding gust wind speed is detected based on the one or more operation characteristics of at least one rotor blade of the respective wind turbine for which the process is performed. ### Claim 12 (depends on 11) The method according to claim 11, wherein the control of a wind turbine located downstream with respect to the wind direction relative to the respective turbine for which the process is performed is adapted in dependence on the gust wind speed. ### Claim 13 (depends on 1) A computer program product, comprising a non-transitory computer readable hardware storage device having computer readable program code stored therein, said program code executable by a processor of a computer system to implement the method according to claim 1 when the program code is executed on a computer. ### Claim 14 An apparatus for computer-implemented monitoring of one or more wind turbines in a wind farm, each wind turbine having a rotor with rotor blades which are rotatable by wind around a rotor axis, the apparatus comprising: a processor configured to perform one or several times during the operation of the wind farm a process comprising the following steps for a respective rotor blade of one or more rotor blades of a respective wind turbine of the one or more wind turbines: i) obtaining a digital image of the respective rotor blade, the digital image being a current image taken by a camera looking at the respective rotor blade; and ii) determining one or more operation characteristics of the respective rotor blade by processing the digital image by a trained data driven model, where the digital image is fed as a digital input to the trained data driven model and the trained data driven model provides the one or more operation characteristics of the respective rotor blade as a digital output; wherein the camera is installed on another wind turbine than the respective wind turbine for which the process is performed. ### Claim 15 (depends on 14) A wind farm comprising a plurality of wind turbines, wherein the wind farm comprises the apparatus according to claim 14.