# US 12,225,293 B2 · Phenotyping device, method and system for measuring phenotypic traits of one or more plants in a target canopy > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,225,293 B2 - Document ID: US12225293B2 - Status: Granted - Kind: B2 - Application number: 17/801,576 - Filed: 2021-02-19 - Published: 2023-04-27 - Granted: 2025-02-11 - Earliest claimed: 2020-02-28 - Assignees: Yield System Oy - Applicants: Yield Systems Oy - Inventors: Linh Nguyen; Simo Seppälä; Paul Wagner; Harri Juntunen; Jussi Gillberg - Web page: https://patentgrep.com/patent/US12225293B2 ## CPC - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - A01G 7/00: Botany in general - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - A01G: HORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING (picking of fruits, vegetables, hops or the like A01D46/00; propagating unicellular algae C12N1/12) ## Abstract A phenotyping device, method and system for measuring phenotypic traits of one or more plants in a target canopy, wherein the includes a canopy spreader for spreading the target canopy, a camera unit, a means for controlling the angle and the distance of the camera unit in relation to the canopy spreader, an electronic control unit for controlling the camera unit. The phenotyping device, method and system enables recording the raw data from the target canopy during a data collection session including information of the plants that are not visible to a camera unit without spreading the canopy. ## Claims ### Claim 1 A phenotyping device for measuring phenotypic traits of one or more plants in a target canopy comprises: one or more shafts arranged, when the phenotyping device is moved, to move parallel to a surface of a ground and partly in contact with the target canopy for revealing the one or more plants for imaging in the target canopy; one or more camera units; a means for controlling the angle and the distance of the one or more camera units in relation to the one or more shafts arranged to maintain the position and orientation of the one or more camera units fixed relative to the shaft; an electronic control unit for controlling the camera unit, the electronic control unit being further configured to: defining an input data specification for a raw data collected by the one or more camera units of the phenotyping device from a current set of raw data collection targets; defining a use-orientation-height specification; defining a device-specific device-location-angle specification; defining a use movement specification; adjusting at least one parameter of the means for controlling an angle and a distance of the one or more camera units in relation to the one or more shafts according to the device-specific device-location-angle specification for maintaining the position and orientation of the one or more camera units fixed relative to the shaft; initiating the raw data collection session; moving the one or more shafts of the phenotyping device partly in contact with the one or more plants in the target canopy according to the defined use-orientation-height specification and according to the use movement specification for revealing the one or more plants for imaging in measuring phenotypic traits of the one or more plants; recording the raw data of the one or more plants in the target canopy while moving the device in contact with the target canopy according to the use-orientation-height specification and according to the defined use movement specification; processing the recorded raw data to estimate the phenotypic traits of the one or more plants in the target canopy. ### Claim 2 (depends on 1) The device according to claim 1, wherein means for controlling the angle and the distance of the one or more camera units comprises an adjustable frame comprising a camera position maintenance unit and the one or more shafts is attached to the adjustable frame by an adjustable connector. ### Claim 3 (depends on 2) The device according to claim 2, wherein the adjustable frame further comprises two telescopic adjustable structures. ### Claim 4 (depends on 1) The device according to claim 1, wherein a camera unit of the one or more camera units comprises at least one of one or more cameras, one or more spectral sensors, a laser scanner or a Lidar sensors. ### Claim 5 (depends on 1) The device according to claim 1, wherein the device further comprises at least one of: one or more tension sensors or one or more height sensors. ### Claim 6 (depends on 2) The device according to claim 2, wherein the device further comprises one or more mechanical support structures attached to the adjustable frame or attached to the one or more shafts. ### Claim 7 (depends on 1) The device according to claim 1, wherein the device further comprises a mechanisation unit connected to the one or more shafts, or to the means for controlling the angle and the distance of the one or more camera units or to the mechanical support structure. ### Claim 8 (depends on 7) The device according to claim 7, wherein the mechanisation unit comprises a motorised height controller and one or more sensors for estimating the height of the canopy. ### Claim 9 (depends on 1) A phenotyping system for measuring phenotypic traits of one or more plants in a target canopy comprising: at least one phenotyping device according to claim 1; a means for moving the phenotyping device; and a means for processing the data produced by a phenotyping method comprising one or more computational units. ### Claim 10 (depends on 9) The system according to claim 9, wherein the one or more computational units hosting one or more machine learning systems configured to process data from the current set of raw data collection targets collected by one or more camera units of the one or more phenotyping device into one or more sets of result estimates. ### Claim 11 A phenotyping method for measuring phenotypic traits of one or more plants in a target canopy, the method comprising: defining an input data specification for a raw data collected by one or more camera units of a phenotyping device from a current set of raw data collection targets; defining a use-orientation-height specification; defining a device-specific device-location-angle specification; defining a use movement specification; adjusting at least one parameter of a means for controlling an angle and a distance of the one or more camera units in relation to a one or more shafts according to the device-specific device-location-angle specification for maintaining the position and orientation of the one or more camera units fixed relative to the shaft; initiating the raw data collection session; moving the one or more shafts of the phenotyping device partly in contact with the one or more plants in the target canopy according to the defined use-orientation-height specification and according to the use movement specification for revealing the one or more plants for imaging in measuring phenotypic traits of the one or more plants; recording the raw data of the one or more plants in the target canopy while moving the device in contact with the target canopy according to the use-orientation-height specification and according to the defined use movement specification; processing the recorded raw data to estimate the phenotypic traits of the one or more plants in the target canopy. ### Claim 12 (depends on 11) The method according to claim 11, wherein defining the input data specification comprises defining angular and distance parameters of the one or more camera units and their tolerances of the one or more camera units in relation to the current set of raw data collection targets. ### Claim 13 (depends on 11) The method according to claim 11, wherein defining the use-orientation-height specification comprises defining tolerances for deviations from the orientation and height within which the raw data recorded by the one or more camera units of the phenotyping device fulfils the input data specification. ### Claim 14 (depends on 11) The method according to claim 11, wherein defining the device-specific device-location-angle specification comprises specifying and adjusting the distance and angle of each of the camera units in relation to the one or more shafts to values of the parameters in which current set of raw data collection targets are positioned in relation to the one or more camera units according to the input data specification of the cameras when the phenotyping device is moved according to the use-orientation-height specific action and the use movement specification. ### Claim 15 (depends on 11) The method according to claim 11, wherein the use movement specification comprises a velocity of the movement in the direction specified by the use-orientation-height specification and tolerances for the velocity such that when the velocity of the phenotyping device is within the tolerance and the direction of movement within the direction tolerance specified by the use-orientation-height specification, the raw data recorded is within the tolerances of an input data specification and the raw data is processed into one or more sets of result estimates by one or more machine learning systems. ### Claim 16 (depends on 11) The method according to claim 11, wherein the method further comprises defining the orientation and height with respect to the canopy, at which orientation and height the phenotyping device is used and the direction of movement with respect to the canopy.