# US 2019/0318164 A1 · Methods and systems for automated presence verification, location confirmation, and identification of objects in defined zones

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318164 A1
- Document ID: US20190318164A1
- Status: Published application
- Kind: A1
- Application number: 15/951,465
- Filed: 2018-04-12
- Published: 2019-10-17
- Earliest claimed: 2018-04-12
- Assignees: The Boeing Company
- Applicants: The Boeing Company
- Inventors: Anil Kumar; Guangyu Pei
- Web page: https://patentgrep.com/patent/US20190318164A1

## CPC

- G06V 20/20: in augmented reality scenes
- B64D 11/0015: {Arrangements for entertainment or communications, e.g. radio, television}
- B64D 11/0631: {for life vests}
- B64D 25/08: Ejecting or escaping means
- B64D 45/00: Aircraft indicators or protectors not otherwise provided for
- B64F 5/60: Testing or inspecting aircraft components or systems
- G06K 7/10475: {arrangements to facilitate interaction with further interrogation devices, e.g. such that at least two interrogation devices may function and cooperate in a network of such devices}
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04W 64/00: Locating users or terminals {or network equipment} for network management purposes, e.g. mobility management
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64F: GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Provided are methods and systems for automated location and identification of multiple objects in an aircraft cabin. A method utilizes a wireless client, RFID reader, and camera, which together form a set. Each set is associated with a specific inspection zone in the cabin. The RFID reader determines the presence of a RFID tag in only one zone. Further, the camera captures an image of that zone. A data feedback is generated based on both the image and the RFID reader response. The data feedback is transmitted by the wireless client to a router and is analyzed to determine the presence of the object in the inspection zone and, if present, the identity of the object. The data feedback is associated with the location of the zone in the aircraft cabin, which is known or may be determined using a set of wireless routers positioned throughout the cabin.

## Claims

### Claim 1

A method for automated location and identification of multiple objects disposed in an aircraft cabin, the method comprising:
wirelessly transmitting a first data request from a first wireless router to a first wireless client, wherein:
the first wireless router is one of wireless routers disposed throughout the aircraft cabin, and
the first wireless client is one of wireless clients, each one of the wireless clients associated with a different one of the multiple objects;
transmitting a first interrogation signal using a first RFID reader, communicatively coupled to the first wireless client, wherein the first wireless client instructs the first RFID reader to transmit the first interrogation signal upon receiving the first data request at the first wireless client;
monitoring a first response signal using the first REID reader, wherein the first response signal depends on presence of a first RFID tag in a first inspection zone and, if present, information encoded on the first RFID tag;
capturing a first image of the first inspection zone using a first camera, communicatively coupled to the first wireless client, wherein the first wireless client instructs the first camera to capture the first image of the first inspection zone upon receiving the first data request at the first wireless client;
generating a first data feedback using the first wireless client, wherein the first data feedback is generated based on the first response signal and the first image;
wirelessly transmitting the first data feedback from the first wireless client to the first wireless router; and
analyzing the first data feedback to determine at least one of:
presence of a first object of the multiple objects in the first inspection zone, and
identification of the first object.

### Claim 2 (depends on 1)

The method of claim 1, wherein analyzing the first data feedback comprises associating the first data feedback with a location of the first inspection zone in the aircraft cabin.

### Claim 3 (depends on 2)

The method of claim 2, wherein the location of the first inspection zone in the aircraft cabin is provided from a database associated with the aircraft cabin and the multiple wireless clients.

### Claim 4 (depends on 2)

The method of claim 2, wherein analyzing the first data feedback comprises determining the location of the first inspection zone in the aircraft cabin.

### Claim 5 (depends on 4)

The method of claim 4, wherein determining the location of the first inspection zone comprises:
wirelessly transmitting a first location request from the first wireless router to the first wireless client;
wirelessly transmitting a first location feedback from the first wireless client to the first wireless router, wherein the first location feedback is generated by the first wireless client upon receipt of the first location request from the first wireless router;
wirelessly transmitting a second location request from a second wireless router to the first wireless client;
wirelessly transmitting a second location feedback from the first wireless client to the second wireless router, wherein the second location feedback is generated by the first wireless client upon receipt of the second location request from the second wireless router; and
analyzing the first location feedback, the second location feedback, location of the first wireless router in the aircraft cabin, and location of the second wireless router in the aircraft cabin to determine the location of the first inspection zone.

### Claim 6 (depends on 4)

The method of claim 4, wherein determining the location of the first inspection zone comprises validating the location of the first inspection zone using an expected location area of the first inspection zone.

### Claim 7 (depends on 1)

The method of claim 1, wherein analyzing the first data feedback comprises analyzing the first image in the first data feedback to determine at least the presence of the first object.

### Claim 8 (depends on 7)

The method of claim 7, wherein analyzing the first data feedback further comprises comparing results of analyzing the first image with the first response signal.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
analyzing the first data feedback comprises generating a report validating the presence of the first object in the first inspection zone and the identification of the first object; and
if one of the presence of the first object in the first inspection zone or the identification of the first object does not meet corresponding predetermined criteria, the report comprises instructions to manually inspect the first inspection zone.

### Claim 10 (depends on 9)

The method of claim 9, wherein the predetermined criteria comprise at least one of an indicium associated with the first object or an expiration date associated with the first object.

### Claim 11 (depends on 9)

The method of claim 9, wherein the report is generated using an off-board controller positioned outside of the aircraft cabin.

### Claim 12 (depends on 9)

The method of claim 9, further comprising, if the report comprises instructions to manually inspect the first inspection zone, manually inspecting the first inspection zone.

### Claim 13 (depends on 9)

The method of claim 9, wherein the report comprises validation of the presence of each one of the multiple objects disposed in the aircraft cabin and the identification of each one of the multiple objects.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
wirelessly transmitting a second data request from a second wireless router to a second wireless client, wherein:
the second wireless router is one of the wireless routers, and
the second wireless client is one of multiple wireless clients,
transmitting a second interrogation signal using a second RFID reader, communicatively coupled to the second wireless client, wherein the second wireless client instructs the second RFID reader to transmit the second interrogation signal upon receiving the second data request at the second wireless client;
monitoring a second response signal using the second RFID reader, wherein:
the second response signal depends on a presence of a second RFID tag and information encoded on the second RFID tag in a second inspection zone, and
the second inspection zone does not overlap with the first inspection zone;
capturing a second image of the second inspection zone using a second camera, communicatively coupled to the second wireless client, wherein the second wireless client instructs the second camera to capture the second image of the second inspection zone upon receiving the second data request at the second wireless client;
generating a second data feedback using the second wireless client, wherein the second data feedback is generated based on the second response signal and the second image;
wirelessly transmitting the second data feedback from the second wireless client to the second wireless router; and
analyzing the second data feedback to determine at least one of:
presence of a second object of the multiple objects in the second inspection zone, and
identification of the second object.

### Claim 15 (depends on 14)

The method of claim 14, wherein monitoring the second response signal using the second RFID reader and monitoring the first response signal using the first RFID reader overlap in time.

### Claim 16 (depends on 14)

The method of claim 14, wherein analyzing the first data feedback and analyzing the second data feedback overlap in time and are performed using one controller.

### Claim 17 (depends on 1)

The method of claim 1, wherein wirelessly transmitting the first data request from the first wireless router to the first wireless client is performed over a 60 GHz network.

### Claim 18 (depends on 1)

The method of claim 1, wherein the first inspection zone is one of a space under a seat or a space in an overhead compartment in the aircraft cabin.

### Claim 19 (depends on 1)

The method of claim 1, wherein the first object is a life-west.

### Claim 20 (depends on 1)

The method of claim 1, further comprising wirelessly transmitting inflight entertainment data from the first wireless router to the first wireless client.

### Claim 21

An identification system for automated location and identification of multiple objects disposed in an aircraft cabin, the identification system comprising:
a first wireless router, positioned in the aircraft cabin;
a second wireless router, positioned in the aircraft cabin;
a first wireless client, positioned in the aircraft cabin closer to the first wireless router than to the second wireless router, wherein the first wireless client is configured to wireless communicate with the first wireless router and with the second wireless router;
a second wireless client, positioned in the aircraft cabin closer to the second wireless router than to the first wireless router, wherein the second wireless client is configured to wireless communicate with the first wireless router and with the second wireless router;
a first RFID reader, communicatively coupled to the first wireless client, wherein the first RFID reader defines a first inspection zone;
a second RFID reader, communicatively coupled to the second wireless client, wherein the second RFID reader defines a second inspection zone, not overlapping with the first inspection zone;
a first camera, communicatively coupled to the first wireless client and configured to capture an image of the first inspection zone; and
a second camera, communicatively coupled to the second wireless client and configured to capture an image of the second inspection zone.

### Claim 22 (depends on 21)

The identification system of claim 21, wherein:
the first wireless client is configured to generate first data feedback from a first response signal received from the first REID reader and a first image received from the first camera; and
the second wireless client s configured to generate second data feedback from a second response signal received from the second RFID reader and a second image received from the second camera.

### Claim 23 (depends on 22)

The identification system of claim 22, further comprising a controller communicatively coupled to the first wireless router and to the second wireless router, wherein:
the controller is configured to analyze the first data feedback received from the first wireless client to determine at least one of:
presence of a first object of the multiple objects in the first inspection zone, and
identification of the first object; and
the controller is configured to analyze the second data feedback received from the second wireless client to determine at least one of:
presence of a second object of the multiple objects in the second inspection zone, and
identification of the second object.

### Claim 24 (depends on 23)

The identification system of claim 23, wherein the controller is an off-board controller positioned outside of the aircraft cabin.

### Claim 25 (depends on 23)

The identification system of claim 23, wherein the controller is further configured to associate the first data feedback with location of the first inspection zone and to associate the second data feedback with location of the second inspection zone.
