# US 2021/0241638 A1 · Runway activity monitoring, logging and analysis for aircraft touchdown detection and abnormal behavior alerting > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0241638 A1 - Document ID: US20210241638A1 - Status: Published application - Kind: A1 - Application number: 17/233,620 - Filed: 2021-04-19 - Published: 2021-08-05 - Earliest claimed: 2016-11-24 - Assignees: X - Sight Systems Ltd. - Applicants: X - Sight Systems Ltd. - Inventors: Alon NITZAN; Aviv GONER; Shlomit TESHUVA-WINKLER - Web page: https://patentgrep.com/patent/US20210241638A1 ## CPC - G08G 5/727: {from a ground station} - B64D 45/00: Aircraft indicators or protectors not otherwise provided for - G06F 17/00: Digital computing or data processing equipment or methods, specially adapted for specific functions (information retrieval, database structures or file system structures therefor G06F16/00) - G08G 5/22: located on the ground - G08G 5/54: for approach or landing - G08G 5/55: for a single aircraft - G01S 2013/916: {Airport surface monitoring [ASDE]} - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - B64D: EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES ## Abstract A system of automatically documenting a plurality of aircraft touchdown events detected by analyzing sensory data received from a plurality of sensors, comprising one or more interfaces for connecting to a plurality of sensors deployed to monitor at least part of a runway in an airport, the sensors comprising one or more image sensors, audio sensors and/or vibration sensors, and one or more processors coupled to the one or more interfaces. The processor(s) is adapted to receive sensory data from said plurality of sensors, the sensory data comprising image data, audio data and/or vibration data, identify a timing and a location of a landing touchdown event of an aircraft on the runway by analyzing the sensory data and classify the landing touchdown event as a normal landing touchdown event or an abnormal landing touchdown event based on the analysis. ## Claims ### Claim 1 A system of automatically documenting a plurality of aircraft touchdown events detected by analyzing sensory data received from a plurality of sensors, comprising: at least one interface for connecting to a plurality of sensors deployed to monitor at least part of a runway in an airport, said plurality of sensors comprising at least one of: an image sensor, an audio sensor and a vibration sensor; and at least one processor coupled to said at least one interface, said at least one processor is adapted to: receive sensory data from said plurality of sensors, said sensory data comprising at least one of: image data, audio data and vibration data, identify a timing and a location of a landing touchdown event of an aircraft on said runway by analyzing said sensory data, and classify said landing touchdown event as a normal landing touchdown event or an abnormal landing touchdown event based on said analysis. ### Claim 2 (depends on 1) The system of claim 1, wherein said timing is identified with an accuracy of 1 second and said location is identified with an accuracy of 10 meters. ### Claim 3 (depends on 1) The system of claim 1, wherein said at least one processor is further adapted to: store at least part of said sensory data relating to said landing touchdown event based on said timing, and log said timing and said location in association with said aircraft landing touchdown event. ### Claim 4 (depends on 1) The system of claim 1, wherein said analysis comprises image processing of said image data to identify a smoke pattern next to at least one wheel of said aircraft in said image data. ### Claim 5 (depends on 1) The system of claim 1, wherein said analysis comprises signal processing of said audio data to identify an aircraft touchdown sound pattern in said audio data. ### Claim 6 (depends on 1) The system of claim 1, wherein said analysis comprises signal processing of said vibration data to identify a predefined pitch pattern in said vibration data, said pitch pattern is indicative of said landing touchdown event. ### Claim 7 (depends on 1) The system of claim 1, further comprising said sensory data comprising at least two of: said image data, said audio data and said vibration data. ### Claim 8 (depends on 1) The system of claim 1, wherein said at least one processor is further adapted to receive documentary data relating to said runway from at least one system of said airport, said documentary data is time tagged at a time of reception and synchronized with said sensory data in a timeline sequence, wherein said at least one system is a member selected from a group consisting of: a runway lighting control system, a weather monitoring system, a runway surface monitoring system, a traffic management system and a foreign objects detection system. ### Claim 9 (depends on 1) The system of claim 1, wherein said at least one processor is further adapted to calculate an estimated taxiway exit said aircraft takes following said landing touchdown event to leave said runway to a taxiway, wherein said calculation is based on at least some of: a weight of said aircraft, a speed of said aircraft while approaching said runway, a wind speed at said runway, a wind direction at said runway and a friction of said runway induced by at least one weather condition. ### Claim 10 (depends on 1) The system of claim 1, wherein said at least one processor is further adapted to analyze said sensory data to detect an actual taxiway exit said aircraft takes following said landing touchdown event to leave said runway to a taxiway. ### Claim 11 (depends on 10) The system of claim 10, wherein said at least one processor is further adapted to generate an alert on detection of at least one discrepancy of said actual taxiway exit compared to a planned taxiway exit. ### Claim 12 (depends on 1) The system of claim 1, wherein said at least one processor is further adapted to graphically display a timeline sequence consisting of at least part of said sensory data. ### Claim 13 A computerized method of automatically documenting a plurality of aircraft touchdown events detected by analyzing sensory data received from a plurality of sensors, comprising: receiving sensory data from a plurality of sensors deployed to monitor at least part of a runway in an airport, said sensory data comprising at least one of: image data received from at least one image sensor, audio data received from at least one audio sensor and vibration data received from at least one vibration sensor; identifying a timing and a location of a landing touchdown event of an aircraft on said runway by analyzing said sensory data; and classifying said landing touchdown event as a normal landing touchdown event or an abnormal landing touchdown event based on said analysis. ### Claim 14 (depends on 13) The computerized method of claim 13, further comprising: storing at least part of said sensory data relating to said landing touchdown event based on said timing, and logging said timing and said location in association with said aircraft landing touchdown event. ### Claim 15 A system of automatically documenting a plurality of aircraft activity events at a runway to detect hazardous conditions indicative of a potential abnormal phenomenon during at least one of said plurality of aircraft activity events, comprising: at least one interface for connecting to a plurality of sensors deployed to monitor at least part of a runway in an airport, said plurality of sensors comprising at least one of: an image sensor, an audio sensor and a vibration sensor; and at least one processor coupled to said at least one interface, said at least one processor is adapted to: receive sensory data from said plurality of sensors, said sensory data comprising at least one of: image data, audio data and vibration data, detect at least one hazardous condition indicative of a potential abnormal phenomenon during at least one of a plurality of aircraft activity events at said runway by analyzing said sensory data, and store at least part of said sensory data relating to said at least one hazardous condition. ### Claim 16 (depends on 15) The system of claim 15, further comprising said sensory data comprising at least two of: said image data, said audio data and said vibration data. ### Claim 17 (depends on 15) The system of claim 15, wherein each of said plurality of aircraft activity events is a member selected from a group consisting of: an aircraft landing, an aircraft take-off and an aircraft taxi. ### Claim 18 (depends on 15) The system of claim 15, wherein said at least one hazardous condition detected by said analysis is a member selected from a group consisting of: a contact between a body part of said aircraft and said runway, a fire in proximity to at least one engine of said aircraft, a smoke in proximity to said at least one engine, a smoke in proximity to said at least one wheel, a non-typical pattern of movement of said aircraft on said runway and a non-typical position or angle of said aircraft with respect to said runway. ### Claim 19 (depends on 15) The system of claim 15, wherein said at least one processor is further adapted to graphically display a timeline sequence consisting of at least part of said sensory data. ### Claim 20 (depends on 16) The system of claim 16, wherein said analysis comprises applying at least one classifier on at least some of said sensory data, said at least one classifier is trained to detect said at least one hazardous condition.