# US 12,178,202 B2 · Insect monitoring system and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,178,202 B2 - Document ID: US12178202B2 - Status: Granted - Kind: B2 - Application number: 18/009,591 - Filed: 2020-06-09 - Published: 2023-07-06 - Granted: 2024-12-31 - Earliest claimed: 2020-06-09 - Assignees: Rynan Technologies Pte. Ltd. - Applicants: Rynan Technologies Pte. Ltd. - Inventors: My T. Nguyen; Cuong Q. Hong; Toan Q. Tran; Phuong H. Son; Luom H. Pham; Quy M. Phan; Nam Q. Doan - Web page: https://patentgrep.com/patent/US12178202B2 ## CPC - A01M 1/08: {Attracting and catching insects by} using combined illumination {or colours} and suction effects - A01M 1/026: {combined with devices for monitoring insect presence, e.g. termites (bait stations A01M1/2005; detecting other animals in a given area A01M31/002)} - A01M 1/06: {Catching insects by} using a suction effect {(A01M3/00 takes precedence)} - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/084: Backpropagation, e.g. using gradient descent - G06N 3/09: Supervised learning - G06Q 10/02: Reservations, e.g. for tickets, services or events - G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202) - G06Q 10/047: Optimisation of routes or paths, e.g. travelling salesman problem - G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling - G06Q 10/0635: Risk analysis of enterprise or organisation activities - G06Q 10/0637: Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals - G06Q 30/0282: Rating or review of business operators or products - G06Q 50/02: Agriculture; Fishing; Forestry; Mining - G06Q 50/06: Energy or water supply - G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083) - G06Q 50/50: Business processes related to the communications industry (charging, metering or billing arrangements specially adapted for data communications H04L12/14; telephonic communication involving automatic or semi-automatic exchanges H04M3/00; arrangements for metering, time-control or time indication H04M15/00; prepayment telephone systems H04M17/00; accounting or billing for wireless communication networks H04W4/24) - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - A01M 1/10: {Catching insects by using} Traps {(using suction effect A01M1/06)} - A01M 2200/01: Insects - G06Q 30/0631: {Recommending goods or services} - G06V 10/82: using neural networks - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - A01M: CATCHING, TRAPPING OR SCARING OF ANIMALS (appliances for catching swarms or drone-catching A01K57/00; fishing A01K69/00 - {A01K99/00}; biocides, pest repellants or attractants A01N); APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An insect monitoring system (ISM) and related e-commerce system are provided. The ISM includes an insect attracting light, an intake, an exhaust, an airflow conduit between intake and exhaust, an insect collecting mesh in the conduit, a fan for generating airflow in the airflow conduit, and one or more cameras pointed on the insect collecting mesh. The insect attracting light and the fan are activated such that insects are drawn into the intake and trapped against the insect collecting mesh. The images of the insect collecting mesh are processed and analyzed using a machine learning algorithm to recognize a type and number of insects. Recommendations are provided based on the analysis. In some aspects, the insect monitoring system is connected to electronic client devices over a communication network. The electronic devices are provided with an e-commerce application for sale of products and services responsive to the recommendations. ## Claims ### Claim 1 An insect monitoring system comprising: an insect attracting light; an intake positioned adjacent the insect attracting light; an exhaust; an airflow conduit extending between the intake and the exhaust; a motorized fan for creating an airflow in the airflow conduit from the intake to the exhaust; a movable insect collecting mesh positioned in the airflow conduit between the intake and the exhaust, said movable insect collecting mesh being rotatively mounted in the airflow conduit to be movable from a first position for forcing the airflow through the movable insect collecting mesh and a second position for releasing insects to the exhaust; a movable cleaning blade for scraping the movable insect collecting mesh when placed in the second position; a digital camera positioned to capture images of the movable insect collecting mesh; and a controller operatively connected to each of the insect attracting light, the motorized fan, the movable inset collecting mesh, the movable cleaning blade and the digital camera, the controller being operable to cause: activation of the insect attracting light; activation of the motorized fan such that insects attracted by the insect attracting light are drawn into the intake and airflow conduit by the airflow and trapped against the movable insect collecting mesh when in the first position; acquisition of images by the at least one digital camera; and activation of the movable cleaning blade when the movable insect collecting mesh is in the second position. ### Claim 2 (depends on 1) The insect monitoring system of claim 1, wherein the controller is further operable to cause: deactivation of the insect attracting light; and deactivation of the motorized fan. ### Claim 3 (depends on 1) The insect monitoring system of claim 1, wherein the movable insect collecting mesh is movable by a first servo motor operatively connected to the controller. ### Claim 4 (depends on 3) The insect monitoring system of claim 3, wherein the movable cleaning blade is movable by a second servo motor operatively connected to the controller. ### Claim 5 (depends on 1) The insect monitoring system of claim 1, further comprising: a lighting array positioned adjacent the digital camera for illuminating the movable insect collecting mesh; and wherein the controller is further operable to cause activation of the lighting array in an insect attraction mode, and deactivation of the lighting array in a stand-by mode. ### Claim 6 (depends on 1) The insect monitoring system of claim 1, wherein the insect attracting light is operable to emit light at a wavelength between 350 nm and 650 nm. ### Claim 7 (depends on 1) The insect monitoring system of claim 1, wherein the controller is operable according to a predetermined schedule. ### Claim 8 (depends on 1) The insect monitoring system of claim 1, further comprising a communication module for transmitting and receiving data over a communication network. ### Claim 9 (depends on 1) The insect monitoring system of claim 1, further comprising: a processor operatively connected to the digital camera, the processor having access to a machine learning algorithm (MLA) having been trained for insect recognition, the processor being configured for: receiving the images acquired by the digital camera; analyzing, using the MLA, the images to determine a set of recognized insects, each recognized insect being associated with an insect identifier indicative of a type of insect; and outputting the set of recognized insects. ### Claim 10 (depends on 9) The insect monitoring system of claim 9, wherein each recognized insect is associated with a prediction score indicative of a confidence of the MLA in recognizing the insect. ### Claim 11 (depends on 10) The insect monitoring system of claim 10, wherein each recognized insect is associated with a bounding box indicative of an approximate location and size of the recognized insect in the images. ### Claim 12 (depends on 11) The insect monitoring system of claim 11, wherein each recognized insect is associated with a mask at least partially indicative of pixels belonging to the recognized insect in the images. ### Claim 13 (depends on 9) The insect monitoring system of claim 9, wherein the outputting the set of recognized insects comprises outputting a number of each type of recognized insect. ### Claim 14 (depends on 9) The insect monitoring system of claim 9, wherein the MLA comprises a convolutional neural network (CNN) or a region proposal network (RPN). ### Claim 15 (depends on 9) The insect monitoring system of claim 9, further comprising: determining, based on the set of recognized insects, a ratio of natural enemies in the set of recognized insects. ### Claim 16 (depends on 9) The insect monitoring system of claim 9, wherein the insect monitoring system is connected to a database, preferably by a server; and wherein the processor is further configured for: querying the database based on the set of recognized insects to obtain insecticide recommendations. ### Claim 17 (depends on 16) The insect monitoring system of claim 16, further comprising: a client device connected to the server, the client device being operable to: receive the set of recognized insects from the server. ### Claim 18 (depends on 17) The insect monitoring system of claim 17, wherein the client device is connected to the insect monitoring system. ### Claim 19 (depends on 17) The insect monitoring system of claim 17, wherein the server is further configured for: determining, based on the set of recognized insects, insecticide recommendations; and transmitting the insecticide recommendations to the client device and providing an e-commerce application for sale of products and services responsive to the recommendations, preferably including a price and means for online ordering. ### Claim 20 (depends on 19) The insect monitoring system of claim 19, wherein the transmitting the insecticide recommendations to the client device comprises transmitting a recommendation of at least one additional product or service available from the e-commerce application such as an agricultural nutrient, a replacement part for the insect monitoring system or a service call for servicing the insect monitoring system.