# US 12,075,149 B2 · Device and method for detecting the orientation and position of markings in three-dimensional space > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,075,149 B2 - Document ID: US12075149B2 - Status: Granted - Kind: B2 - Application number: 18/005,191 - Filed: 2021-06-24 - Published: 2023-08-24 - Granted: 2024-08-27 - Earliest claimed: 2020-07-13 - Assignees: Soft2Tec GmbH - Applicants: soft2tec GmbH - Inventors: Laurent Gilson; Wolfgang Bruening; Frank Honisch - Web page: https://patentgrep.com/patent/US12075149B2 ## CPC - H04N 23/56: provided with illuminating means - G01B 11/002: {for measuring two or more coordinates} - G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image} - G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments - G06T 7/73: using feature-based methods - G06T 2207/10016: Video; Image sequence - G06T 2207/30204: Marker - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A device for orientation and position detection of markings in three-dimensional space includes a marking arrangement, an optical image capture unit and an evaluation unit. The marking arrangement comprises two or more marking units each having three or more illuminating means arranged along a path. At least one marking unit belongs to a first marking unit type having at least three markings, and at least one other marking unit belongs to a second marking unit type having exactly two markings and a communication element arranged therebetween. At least one marking unit of the first type and at least one marking unit of the second type are arranged in a non-coplanar manner. The evaluation unit is adapted to recognize the marking units of the different types and to unambiguously determine the orientation and the position of the marking arrangement using the markings of recognized marking units of the different types. ## Claims ### Claim 1 A device for orientation and position detection of markings in three-dimensional space, the device comprising: at least one marking arrangement, the at least one marking arrangement comprising at least two marking units each having at least three illuminating means arranged along a path, the illuminating means being designed as markings and/or communication elements; at least one optical image capture unit configured to capture images of the marking arrangement; and an evaluation unit configured to unambiguously determine an orientation and a position of the marking arrangement from exactly one image of the at least one optical image capture unit, wherein: at least one of the marking units belongs to a first marking unit type having at least three markings, at least one other of the marking units belongs to a second marking unit type having exactly two markings and at least one communication element, the at least one communication element being arranged between the two markings, at least one of the marking units of the first marking unit type and at least one of the marking units of the second marking unit type are arranged in a non-coplanar manner, and the evaluation unit is adapted to recognize the marking units of the first marking unit type and the second marking unit type and to unambiguously determine the orientation and the position of the marking arrangement using the markings of recognized marking units of the first marking unit type and the second marking unit type. ### Claim 2 (depends on 1) The device according to claim 1, wherein the at least one marking arrangement comprises two marking units of the first marking unit type and one marking unit of the second marking unit type. ### Claim 3 (depends on 2) The device according to claim 2, wherein the marking unit of the second marking unit type is arranged outside a plane spanned by the two marking units of the first marking unit type. ### Claim 4 (depends on 1) The device according to claim 1 wherein the straight paths of the illuminating means of the marking units of the marking arrangement are arranged parallel to one another. ### Claim 5 (depends on 1) The device according to claim 1 wherein one marking unit of the first marking unit type is always arranged adjacent to one marking unit of the second marking unit type in the marking arrangement. ### Claim 6 (depends on 1) The device according to claim 1, wherein several marking arrangements are combined into a common structure in which individual marking arrangements are arranged in a defined manner relative to one another and form a multi-marking arrangement, an outer contour of the common structure forming a convex body. ### Claim 7 (depends on 1) The device according to claim 1, wherein the evaluation unit is configured to: detecting the illuminating means in the captured image of the at least one marking arrangement comprising the at least one marking unit of the first marking unit type and the at least one marking unit of the second marking unit type; assigning detected ones of the illuminating means designed exclusively as markings to at least one marking unit of the first marking unit type; assigning other ones of the detected illuminating means designed as markings and communication elements to at least one marking unit of the second marking unit type; assigning a marking function and/or a communication element function to the illuminating means detected in the image; and determining the orientation and the position of the marking arrangement based on the markings using knowledge about the arrangement of the markings on the marking arrangement. ### Claim 8 A method for orientation and position detection of markings in three-dimensional space, the method comprising: capturing an image of at least one marking arrangement comprising at least one marking unit of a first marking unit type and at least one marking unit of a second marking unit type, each comprising at least three illuminating means arranged along a path; detecting the illuminating means in the captured image; assigning detected ones of the illuminating means designed exclusively as markings to at least one marking unit of the first marking unit type; assigning other ones of the detected illuminating means designed as markings and communication elements to at least one marking unit of the second marking unit type; assigning a marking function and/or a communication element function to the illuminating means detected in the image; and determining the orientation and the position of the marking arrangement based on the markings using knowledge about the arrangement of the markings on the marking arrangement. ### Claim 9 (depends on 8) The method according to claim 8, wherein the assigning of the detected illuminating means to the at least one marking unit of the first marking unit type or the at least one marking unit of the second marking unit type includes determining in the captured image all straight paths with a total of exactly three illuminating means. ### Claim 10 (depends on 9) The method according to claim 9, further comprising determining, from an entirety of the determined straight paths, which ones of the straight paths have a corresponding distance between end points of the straight paths. ### Claim 11 (depends on 9) The method according to claim 9, further comprising determining, from an entirety of the determined straight paths, which ones of the straight paths lie in parallel. ### Claim 12 (depends on 9) The method according to claim 9, further comprising selecting the straight paths belonging to the at least one marking unit of the second marking unit type from the determined straight paths, and deriving an identification of the marking arrangement from the communication elements of the at least one marking unit of the second marking unit type. ### Claim 13 (depends on 12) The method according to claim 12, further comprising defining a search area around the straight paths belonging to the second marking unit type, and searching for at least one of the straight paths belonging to the first marking unit type in the search area. ### Claim 14 A method for teaching in a set-up of markings and communication elements in a marking arrangement, in which at least one marking unit of a first marking unit type and at least one marking unit of a second marking unit type are positioned, each of the marking units having at least three illuminating means arranged along a path, an arrangement of the illuminating means used as markings or communication elements in the marking units of the first marking unit type and the second marking unit type being known a priori, the method comprising: moving the marking arrangement with the marking units fixed thereto relative to an image capture unit and capturing a sequence of images during the movement; detecting potential marking arrangements in an image of the image sequence; tracking the potential marking units over several images of the sequence of images; creating initial relations between the marking units and iteratively improving relations over an entirety of the sequence of images until an entirety of the relations over the entirety of the sequence of images with motion is known; and deriving an arrangement of the marking units from the entirety of the relations based on geometric assignments. ### Claim 15 (depends on 14) The method according to claim 14, wherein, during the capturing of the sequence of images, no illuminating means are arranged in an image area of the image capturing unit which are not positioned in a marking unit.