# US 12,215,001 B2 · Guide display device and crane equipped with same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,215,001 B2 - Document ID: US12215001B2 - Status: Granted - Kind: B2 - Application number: 17/911,049 - Filed: 2021-03-23 - Published: 2023-04-06 - Granted: 2025-02-04 - Earliest claimed: 2020-03-26 - Assignees: Tadano Ltd.; The School Corporation Kansai University - Applicants: Tadano Ltd.; The School Corporation Kansai University - Inventors: Iwao Ishikawa; Takayuki Kosaka; Keita Mashima; Satoshi Kubota; Shigenori Tanaka; Masaya Nakahara; Koki Nakahata - Web page: https://patentgrep.com/patent/US12215001B2 ## CPC - B66C 13/46: Position indicators for suspended loads or for crane elements - B66C 15/065: {electrical} - G01S 7/4808: {Evaluating distance, position or velocity data} - G01S 17/89: for mapping or imaging - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06V 10/762: using clustering, e.g. of similar faces in social networks - G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads - G06V 20/64: Three-dimensional [3D] objects - G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations - B66C: CRANES; LOAD-ENGAGING ELEMENTS OR DEVICES FOR CRANES, CAPSTANS, WINCHES, OR TACKLES ({specially adapted for lifting invalids A61G7/10;} rope, cable, or chain winding mechanisms, braking or detent devices therefor B66D; specially adapted for nuclear reactors G21) - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The present invention provides a guide display device capable of recognizing a feature in a work area while distinguishing whether the feature is a moving body or not. In a guide display device of a crane, 3D maps are created for continuous frames; an altitude value for each grid in a 3D map that is created at time closest to the current time is obtained as a first altitude value; altitude values for respective corresponding grids in a predetermined number of 3D maps other than the 3D map that is created at time closest to the current time are obtained, and the average of the altitude values is calculated as a second altitude value; and it is determined that the feature is a moving body when the difference between the first altitude value and the second altitude value exceeds a predetermined threshold. ## Claims ### Claim 1 A guide display device of a crane, comprising: a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point, wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time, wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell, wherein the data processing section acquires an altitude value of each grid cell as a first altitude value for the three-dimensional map created at a time closest to a current time, wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second altitude value, wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not. ### Claim 2 (depends on 1) A crane comprising the guide display device according to claim 1. ### Claim 3 A guide display device of a crane, comprising: a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point, wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time, wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell, wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of the three-dimensional maps including the three-dimensional map created at a time closest to a current time, and calculates an average of the altitude value as a first average value, wherein the data processing section acquires an altitude value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the altitude value as a second average value, wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not. ### Claim 4 A guide display device of a crane, comprising: a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point, wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time, wherein the data processing section provides a label value for each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell, wherein the data processing section acquires the label value of each grid cell as a first label value for the three-dimensional map created at a time closest to a current time, wherein the data processing section acquires the label value of each grid cell for a predetermined number of other three-dimensional maps excluding the three-dimensional map created at the time closest to the current time, and calculates an average of the label value as a second label value, wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not. ### Claim 5 A guide display device of a crane, comprising: a data processing section configured to calculate a representative point for each grid cell by using point group data acquired with a laser scanner by scanning a lifting cargo, a ground surface and a ground object from above the lifting cargo and create a three-dimensional map based on the representative point, wherein the data processing section creates the three-dimensional map for each frame that is generated successively based on the point cloud data acquired at each time, wherein the data processing section labels each grid cell of the three-dimensional map with either the lifting cargo, the ground surface, or the ground object based on a height of the representative point of each grid cell, wherein the data processing section acquires, as a first ground object position, a position of the ground object in the three-dimensional map created at a time closest to a current time, wherein the data processing section acquires, as a second ground object position, the position of the ground object in another three-dimensional map excluding the three-dimensional map created at a time closest to a current time, wherein the data processing section calculates a difference between the first altitude value and the second altitude value for each corresponding grid of the three-dimensional map, and determines that the ground object is a moving object when the difference exceeds a predetermined threshold value, and wherein the data processing section associates the three-dimensional map with an image captured by a camera from above the lifting cargo and creates a guide frame diagram for the ground object identified on the three-dimensional map, and displays the guide frame diagram by superimposing it on the image, the guide frame diagram being set so that it is possible for an operator to distinguish whether the ground object is the moving object or not.