# US 10,503,943 B2 · Log scanning system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,503,943 B2
- Document ID: US10503943B2
- Status: Granted
- Kind: B2
- Application number: 15/503,613
- Filed: 2015-08-13
- Published: 2017-08-17
- Granted: 2019-12-10
- Earliest claimed: 2014-08-13
- Assignees: C 3 Limited
- Applicants: C 3 Limited
- Inventors: Nawar Sami Alwesh; Glen Edward Murphy; David William Penman; Johann August Schoonees; Robert Jan Valkenburg
- Web page: https://patentgrep.com/patent/US10503943B2

## CPC

- G06K 7/10722: {Photodetector array or CCD scanning}
- B07C 5/14: Sorting timber or logs {, e.g. tree trunks, beams, planks or the like}
- G01B 11/25: by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50})
- G06F 17/00: Digital computing or data processing equipment or methods, specially adapted for specific functions (information retrieval, database structures or file system structures therefor G06F16/00)
- G06K 7/12: using a selected wavelength, e.g. to sense red marks and ignore blue marks
- G06K 7/1417: {2D bar codes}
- G06K 17/0022: {arrangements or provisions for transferring data to distant stations, e.g. from a sensing device ("transfer between computer elements G06F13/00 "; data-transmission H04L)}
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 10/08772: {Inventory counting methods}
- G06T 7/12: Edge-based segmentation
- G06K 2007/10524: {Hand-held scanners}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30161: Wood; Lumber
- G06T 2207/30242: Counting objects in image
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- B07C: POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING (specially adapted for a specific purpose covered by another class, see the relevant place, e.g. A43D33/06, B23Q7/12)
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A log scanning system and method for scanning a log load. Each individual log in the log load may have an ID element with a unique log ID data on at least one log end face. The system has a handheld scanner unit for free-form scanning by an operator over a load end face of the log load. The scanner unit has a depth sensor configured to capture a series of depth images of the load end face and a texture sensor configured to capture a series of texture images of the load end face during the load end face scan. The system also has a data processor(s) that receives and processes the depth and texture images captured from the scan. The processor(s) are configured to fuse the depth images or depth and texture images into a data model of the load end face, determine log end boundaries of the individual logs visible in the load end face by processing the data model, process the texture images to identify and decode any ID elements visible in the scan to extract individual log ID data, and generate output data representing the log load based on the determined log end boundaries and extracted log ID data.

## Claims

### Claim 1

A log scanning system for scanning a load of logs (log load), each individual log in the log load comprising an ID element comprising unique log ID data on at least one log end face, the system comprising:
a handheld scanner unit for free-form scanning by an operator over a load end face of the log load, the scanner unit comprising sensors for depth sensing and texture sensing, the sensors configured to capture:
a series of depth images of the load end face during the load end face scan; and
a texture sensor configured to capture a series of texture images of the load end face during the load end face scan; and
a data processor or processors that receives the series of depth images and texture images captured from the scan, and which are configured to:
fuse the depth images into a data model of the load end face;
determine log end boundaries of the individual logs visible in the load end face by processing the data model;
process the texture images to identify and decode any ID elements visible in the scanned load end face to extract individual log ID data for individual logs in the log load; and
generate output data representing the log load based on the determined log end boundaries and extracted log ID data.

### Claim 2 (depends on 1)

The log scanning system according to claim 1 wherein the data processor or processors are configured to generate output data by measuring one or more physical properties of the log ends based on the determined log end boundaries to generate representative log end boundary data for each log and the generated output data representing the log load comprises the log end boundary data for each log.

### Claim 3 (depends on 2)

The log scanning system according to claim 2 wherein the data processor or processors are further configured to generate a link or association between the generated individual log ID data and its respective log end boundary data, and wherein the generated output data representing the log load comprises the link or association between the individual log ID data and its respective log end boundary data.

### Claim 4 (depends on 1)

The log scanning system according to claim 1 wherein the data processor or processors are configured to generate output data by generating a log count based on the number of determined individual log end boundaries identified from the load end face scan, and wherein the generated output data representing the log load comprises the log count representing the number of logs in the log load.

### Claim 5 (depends on 1)

The log scanning system according to claim 1 wherein the handheld scanner unit is configured to operate the sensors to capture the depth images and texture images simultaneously in pairs as the scanner unit is scanned over the entire load end face during a scan, or wherein the handheld scanner unit is configured to operate the sensors such that at least some of the depth and texture images captured in the scan are in pairs simultaneously captured at the same instant in time.

### Claim 6 (depends on 5)

The log scanning system according to claim 5 wherein the handheld scanner unit is configured to capture the depth and texture images in pairs simultaneously based on a common trigger signal to the sensors.

### Claim 7 (depends on 1)

The log scanning system according to claim 1 wherein each depth image and texture image captures a portion of the load end face, and wherein the field of view of the sensors captures only a portion of the total load end face for each pair of depth and texture images when operated at a predetermined stand-off distance from the load end face, and wherein the series of pairs of depth and texture images collectively capture the entire load end face at the completion of the scan.

### Claim 8 (depends on 1)

The log scanning system according to claim 1 wherein the sensors of the handheld scanner unit comprise a depth camera, and wherein the depth camera of the handheld scanner unit operates at infra-red frequencies and comprises an infrared filter to reduce noise.

### Claim 9 (depends on 1)

The log scanning system according to claim 1 wherein the sensors of the handheld scanner unit comprise a stereo camera.

### Claim 10 (depends on 1)

The log scanning system according to claim 1 wherein the sensors of the handheld scanner comprise a texture camera.

### Claim 11 (depends on 10)

The log scanning system according to claim 10 wherein the texture camera of the handheld scanner unit is a monochrome camera provided with one or more colour filters configured to enhance a texture image for determining the wood-bark boundary of the log ends, or wherein the texture camera of the handheld scanner unit is a colour camera.

### Claim 12 (depends on 1)

The log scanning system according to claim 1 wherein the system further comprises an operator interface device having a display screen that is operatively connected to the handheld scanner unit and which is configured to display scan feedback to the user.

### Claim 13

A method of identifying and measuring a load of logs (log load), each individual log in the log load comprising an ID element comprising unique log ID data on at least one log end face, the method comprising:
scanning a load end face of the log load with a handheld scanner unit comprising sensors for depth sensing and texture sensing to acquire a series of depth images and texture images of the load end face;
fusing the depth images into a data model of the load end face;
determining log end boundaries of the individual logs visible in the load end face by processing the data model;
processing the texture images to identify and decode any ID elements visible in the scanned load end face to extract the individual log ID data for individual logs in the log load; and
generating output data representing the log load based on the determined log end boundaries and extracted log ID data.

### Claim 14 (depends on 1)

The log scanning system according to claim 1 wherein the handheld scanner unit is a separate device to the data processor or processors, and wherein the handheld scanner unit is configured to communicate with the data processor or processors over a data link.

### Claim 15 (depends on 1)

The log scanning system according to claim 1 wherein the ID elements are machine-readable printed codes, each machine-readable printed code comprising an encoded unique log ID data or code that is assigned to its respective log.

### Claim 16 (depends on 1)

The log scanning system according to claim 1 wherein the data processor or processors are configured to fuse the depth images, or depth images and texture images, into a data model of the load end face by:
processing the depth images, or depth images and texture images, to estimate the pose of the handheld scanner unit at each depth image, or depth image and texture image, captured and generating pose estimate data associated with each depth image, or depth image and texture image; and
processing the depth images, or depth images and texture images, and pose estimate data into a data model in the form of a spatial data structure.

### Claim 17 (depends on 1)

The log scanning system according to claim 1 wherein the data processor or processors are configured to generate the log end boundaries of the individual logs visible in the load end face by processing the data model to generate one or more raycast images, and extracting the log end boundaries from the raycast images, and wherein the one or more raycast images comprise a raycast depth image, and wherein the data processor or processors are further configured to generate a raycast normal image of the load end face, and then further image process the raycast depth image based on the raycast normal image to generate a cleaned raycast depth image that removes non-log features and/or sides of logs, and the cleaned raycast depth image is processed to determine the log end boundaries.

### Claim 18 (depends on 17)

The log scanning system according to claim 17 wherein the log end boundaries determined from the one or more raycast images are further refined by the data processor or processors by transforming and projecting the determined log end boundaries onto one or more of the captured texture images, and processing of the texture images in the region of the projected log end boundaries to detect the wood-bark boundary by executing a segmentation algorithm that is configured to process the texture images to detect the wood-bark boundary interface for each log and adjust the projected log end boundary to the detected wood-bark boundary to generate a refmed under-bark log end boundary for each log.

### Claim 19 (depends on 1)

The log scanning system according to claim 1 wherein the data processor or processors are configured to generate output data by measuring one or more physical properties of the log ends based on determined or refmed log end boundaries to generate representative log end boundary data for each log and then generate output data representing the log load comprising the log end boundary data for each log, and wherein the data processor or processors are configured to measure the physical properties of the log ends by:
calculating the planes associated with each log end face and projecting the determined or refmed log end boundaries onto their respective calculated log end planes;
transforming the log end boundaries and planes into a metric world coordinate system; and
measuring one or more physical properties of the log ends based on the transformed log end boundaries,
wherein the data processor or processors are configured to generate a link or association between the extracted individual log ID data and its respective log end boundary data by triangulating the center of the ID elements based on the texture images to detect which ID element corresponds to which log end boundary and its associated log end boundary data, and generating output data representing the log load that comprises the generated link or association representing this correspondence.

### Claim 20 (depends on 1)

The log scanning system according to claim 1 wherein the log load is in situ on a transport vehicle or alternatively resting on the ground or another surface when scanned by the handheld scanner unit.

### Claim 21 (depends on 1)

The log scanning system according to claim 1 wherein the ID elements are provided on only the small end of each of the logs in the log load, and wherein where the log load comprises all small ends of the logs at the same load end face, the system is configured to process scan data from only the scan of the load end face comprising the small ends, or where the log load comprises small ends of the logs mixed between both ends of the log load, the system is configured to receive and process data from two separate scans, one scan of each load end face of the log load, and combine or merge the scan data from both scans.

### Claim 22 (depends on 1)

The log scanning system according to claim 1 further comprising an operable powered carrier system to which the handheld scanner unit is mounted or carried, and wherein the carrier system is configured to move the handheld scanner unit relative to the log load to scan the load end face either automatically or in response to manual control by an operator.

### Claim 23 (depends on 1)

The log scanning system according to claim 1 wherein the sensors of the scanner unit comprise a depth sensor that is configured to capture the series of depth images, and a texture sensor that is configured to capture the series of texture images.