# US 2024/0177468 A1 · Tracking system and method employing an artificial neural network for tracking tools in and nearby a transportation vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177468 A1
- Document ID: US20240177468A1
- Status: Published application
- Kind: A1
- Application number: 18/435,818
- Filed: 2024-02-07
- Published: 2024-05-30
- Earliest claimed: 2021-01-29
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: Turgay Isik Aslandere; Marcel Grein
- Web page: https://patentgrep.com/patent/US20240177468A1

## CPC

- G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting}
- G06V 10/809: {of classification results, e.g. where the classifiers operate on the same input data}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- H04W 4/025: {using location based information parameters}
- H04W 4/38: for collecting sensor information
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A tracking system and method for tracking tools in and nearby a transportation vehicle is provided. The tracking system comprises a vehicle-based detection unit for optically acquiring tool sets in the vehicle loading space from different angles and providing digital image data as well as corresponding range information. An electronic main controller unit is operatively coupled to a communication receiving unit and communicates with the vehicle-based detection unit and a cloud-based computer system of the tracking system. A mobile computing unit includes an optical camera and a LIDAR sensor device and wirelessly communicates with the electronic main controller unit and the cloud-based computer system. The tool detection and tracking is accomplished by combining an image-based detection employing an artificial neural network in the cloud-based computer system and a signal-based detection employing the short-range wireless network communication means.

## Claims

### Claim 1

A method of tracking tools in and nearby a transportation vehicle (6) using a tracking system, the method comprising:
training (S200) the at least one artificial neural network of the cloud-based computer system (12) using digital image data and corresponding range information provided by the mobile computing unit (9);
communicating (S4, S300) the weights of the at least one trained artificial neural network to the electronic main controller unit (7) of the tracking system; and
periodically:
by activating (S6) the vehicle-based detection unit (24), providing digital image data and corresponding range information regarding the vehicle loading space (23),
providing (S500) a prediction output regarding identity and location of tool sets (4) of the plurality of tool sets (4), based on the provided digital image data and corresponding range information and the trained artificial neural network,
receiving signals transmitted by each short-range wireless network communication member (5) with the short-range wireless network communication receiving unit (22),
performing (S600) a tracking and localization algorithm on the received signals to obtain an estimate for locations of identified tool sets (4) of the plurality of tool sets (4), and
applying (S700) a recursive estimator algorithm for deriving a refined result for locations of identified tool sets (4) of the plurality of tool sets (4), using the prediction output derived on the basis of the trained artificial neural network and the estimate for locations of identified tool sets (4) as input data.

### Claim 2 (depends on 1)

The method as claimed in claim 1, wherein training (S200) of the at least one artificial neural network further comprises using (S5) signals, provided by the mobile computing unit (9), that have been transmitted by and that are unique to each short-range wireless network communication member (5).

### Claim 3 (depends on 1)

The method as claimed in claim 1, further comprising visualizing (S10) the refined result for locations of identified tool sets (4) of the plurality of tool sets (4) on a display unit of the mobile computing unit (9).

### Claim 4 (depends on 1)

The method as claimed in claim 1, further comprising storing (S9) the derived refined results for locations of identified tool sets (4) of the plurality of tool sets (4) in the cloud-based computer system (12).
