# US 12,118,862 B2 · Systems and methods for passenger bags tampering and theft identification > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,862 B2 - Document ID: US12118862B2 - Status: Granted - Kind: B2 - Application number: 18/122,006 - Filed: 2023-03-15 - Published: 2024-05-30 - Granted: 2024-10-15 - Earliest claimed: 2022-11-29 - Assignees: Arinc Incorporated - Applicants: ARINC Incorporated - Inventors: Nitin Kumar Goyal; Ashutosh Kumar Jha; Vishal Kannan Ram; Venugopal Padmanabhan - Web page: https://patentgrep.com/patent/US12118862B2 ## CPC - G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion} - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06V 10/764: using classification, e.g. of video objects - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 20/64: Three-dimensional [3D] objects - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G08B 13/19669: {Event triggers storage or change of storage policy} - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A baggage handling system is described. The baggage handling system may include cameras. Video from the cameras may be automatically monitored. The video may be automatically monitored in real time across the entire journey of the baggage. The baggage handling system may provide an automated approach to identify theft of airport bags\luggage without manual effort required by humans. The bags may then be safely transported through an airport without theft or tampering. The automated surveillance and responding system may not depend on airport staff to monitor for baggage theft. The automated surveillance and responding system may detect multiple types of baggage theft/tampering. ## Claims ### Claim 1 A baggage handling system comprising: a first baggage conveyor; a first camera configured to capture a video, wherein at least a portion of the first baggage conveyor is disposed in the video; a display; a memory maintaining program instructions; and one or more processors configured to execute the program instructions causing the one or more processors to: receive the video; classify the video to determine: a first bounding box including the first baggage conveyor; a second bounding box including a first baggage; a third bounding box including at least one of a body part of a human or a tool; cause the display to display the video, the first bounding box, the second bounding box, and the third bounding box; and detect: the first baggage is disposed on the first baggage conveyor in a first set of frames of the video by the first bounding box overlapping the second bounding box in the first set of frames; and the at least one body part of the human or the tool touches the first baggage in the first set of frames by the third bounding box at least partially overlapping the second bounding box in the first set of frames. ### Claim 2 (depends on 1) The baggage handling system of claim 1, wherein the program instructions cause the one or more processors to record the video in the memory in response to detecting that the third bounding box at least partially overlaps the second bounding box. ### Claim 3 (depends on 2) The baggage handling system of claim 2, wherein the program instructions cause the one or more processors to record the video in the memory in response to detecting that the third bounding box at least partially overlaps the second bounding box for at least five seconds. ### Claim 4 (depends on 1) The baggage handling system of claim 1, wherein a free-space is disposed adjacent to a side of the at least the portion of the first baggage conveyor; wherein the free-space is disposed in the video. ### Claim 5 (depends on 4) The baggage handling system of claim 4, wherein the program instructions cause the one or more processors to: detect: the first baggage is disposed in the free-space in a second set of frames of the video by the second bounding box being disposed adjacent to the first bounding box in the second set of frames; and at least one of the body part of the human or the tool is disposed in the free-space in the second set of frames by the third bounding box being disposed adjacent to the first bounding box in the second set of frames. ### Claim 6 (depends on 4) The baggage handling system of claim 4, wherein the program instructions cause the one or more processors to: classify the video to determine a fourth bounding box including a second baggage; detect the second baggage is disposed in the free-space by the fourth bounding box being disposed adjacent to the first bounding box; and cause the display to raise an alarm in response to detecting that the fourth bounding box is disposed adjacent to the first bounding box. ### Claim 7 (depends on 6) The baggage handling system of claim 6, wherein the program instructions cause the one or more processors to cause the display to raise an alarm in response to detecting that the fourth bounding box is disposed adjacent to the first bounding box for at least two minutes. ### Claim 8 (depends on 1) The baggage handling system of claim 1, wherein the program instructions cause the one or more processors to preprocess the video to increase a luminance of the video. ### Claim 9 (depends on 1) The baggage handling system of claim 1, wherein the memory comprises an object classification model; wherein the one or more processors are configured to classify the video to determine the first bounding box, the second bounding box, and the third bounding box by the object classification model. ### Claim 10 (depends on 9) The baggage handling system of claim 9, wherein the object classification model comprises a pre-trained model. ### Claim 11 (depends on 1) The baggage handling system of claim 1, wherein the program instructions cause the one or more processors to: capture a first template image of the first baggage from a frame of the video; and find the first template image in a subsequent frame of the video. ### Claim 12 (depends on 11) The baggage handling system of claim 11, wherein the program instructions cause the one or more processors to detect a marking in the subsequent frame, wherein the marking is not present in the template image indicating the marking has been added to the first baggage after the camera captured the template image. ### Claim 13 (depends on 11) The baggage handling system of claim 11, wherein the program instructions cause the one or more processors to: classify, in one or more images of the video, a fourth bounding box including a second baggage; capture a second template image of the second baggage from the frame of the video; and find the second template image in the subsequent frame of the video. ### Claim 14 (depends on 13) The baggage handling system of claim 13, wherein the program instructions cause the one or more processors to: detect: the second baggage is disposed on the first baggage conveyor by the first bounding box overlapping the fourth bounding box; the first baggage is disposed in front of the second baggage on the first baggage conveyor by the second bounding box being disposed in front of the fourth bounding box in the video; and the first baggage is disposed behind the second baggage in a subsequent set of frames of the video by the second bounding box being disposed behind the fourth bounding box in the subsequent set of frames; and cause the display to raise an alarm in response to detecting that the second bounding box is disposed behind the fourth bounding box. ### Claim 15 (depends on 1) The baggage handling system of claim 1, wherein the first camera is disposed above the first baggage conveyor; wherein the first camera is parallel to the first baggage conveyor; the baggage handling system comprising a second camera configured to capture a second video; wherein at least the portion of the first baggage conveyor is disposed in the second video; wherein the second camera is disposed above the first baggage conveyor; wherein the second camera is angled at an acute angle relative to the first baggage conveyor. ### Claim 16 (depends on 1) The baggage handling system of claim 1, wherein the body part of the human comprises at least one of one of a hand, a leg, or a head. ### Claim 17 (depends on 1) The baggage handling system of claim 1, wherein the tool comprises at least one of a rope, a stick, or a thread.