# US 12,223,732 B2 · Systems and methods for object monitoring > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,732 B2 - Document ID: US12223732B2 - Status: Granted - Kind: B2 - Application number: 17/647,989 - Filed: 2022-01-14 - Published: 2022-05-05 - Granted: 2025-02-11 - Earliest claimed: 2019-07-17 - Assignees: Zhejiang Dahua Technology Co., Ltd. - Applicants: Zhejiang Dahua Technology Co., Ltd. - Inventors: Lixun Gao; Zhenshan Lu; Zhewei Li; Tianfu Lan; Wenjin Zhang; Qing Zhan; Minglang Ying; Kexue Ma - Web page: https://patentgrep.com/patent/US12223732B2 ## CPC - G06V 20/54: of traffic, e.g. cars on the road, trains or boats - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition - G06V 20/60: Type of objects - G08G 1/0116: {from roadside infrastructure, e.g. beacons} - G08G 1/0133: {for classifying traffic situation} - G08G 1/0141: {for traffic information dissemination} - G08G 1/0175: {by photographing vehicles, e.g. when violating traffic rules} - G08G 1/04: using optical or ultrasonic detectors - G08G 1/052: with provision for determining speed or overspeed {(speed measuring in general G01P)} - G08G 1/054: photographing overspeeding vehicles - G08G 1/096716: {where the received information does not generate an automatic action on the vehicle control} - G08G 1/096741: {where the source of the transmitted information selects which information to transmit to each vehicle} - G08G 1/096775: {where the origin of the information is a central station} - G06T 2207/30196: Human being; Person - G06T 2207/30232: Surveillance - G06T 2207/30236: Traffic on road, railway or crossing - G06T 2207/30241: Trajectory - G06V 20/582: {of traffic signs} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) ## Abstract The present disclosure relates to systems and methods for object monitoring. The system may obtain at least one image associated with a predetermined region captured by a capture device. The system may obtain a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on one or more predetermined images associated with the predetermined region. The system may identify at least one object in the at least one image. The system may monitor a traffic behavior of the at least one object based on the predetermined traffic rule. ## Claims ### Claim 1 A system for object monitoring, comprising: at least one storage medium including a set of instructions; and at least one processor in communication with the at least one storage medium, wherein when executing the set of instructions, the at least one processor is directed to cause the system to: obtain multimedia information associated with a predetermined region captured by a capture device, the multimedia information including at least one image associated with the predetermined region, at least one video associated with the predetermined region, acoustic information, and text information; obtain a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on the multimedia information associated with the predetermined region; identify at least one object in the multimedia information, the at least one object including a vehicle and a pedestrian; determine status information associated with the at least object based on the multimedia information, the status information including location information of the at least one object; and monitor a traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, wherein the at least one processor is directed to cause the system further to: determine whether the pedestrian is on a motor vehicle lane according to a prescribed moving region and location information of the pedestrian. ### Claim 2 (depends on 1) The system of claim 1, wherein the capture device includes at least one of a camera, a video recorder, or a sensor. ### Claim 3 (depends on 1) The system of claim 1, wherein to obtain the predetermined traffic rule associated with the predetermined region, the at least one processor is directed to cause the system to: extract one or more traffic signs in the multimedia information associated with the predetermined region, the one or more traffic signs including at least one of a lane line, an indicator sign, a color of a traffic light, or a speed limit sign, the indicator sign including an indicator sign indicating sound honk; and determine the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs. ### Claim 4 (depends on 1) The system of claim 1, wherein the status information associated with the at least object includes a type of the at least one object, velocity information of the at least one object, a moving path of the at least one object, or a moving direction of the at least one object. ### Claim 5 (depends on 4) The system of claim 4, in response to determining that the at least one object is the vehicle, the at least one processor being directed to cause the system further to: determine sizes of the vehicle in different locations of the multimedia information according to a type of the vehicle and a location of the vehicle in the multimedia information associated with the predetermined region. ### Claim 6 (depends on 4) The system of claim 4, wherein the at least one processor is directed to cause the system further to: determine whether a congestion occurs in the predetermined region according to velocity information of a plurality of vehicles in the predetermined region. ### Claim 7 (depends on 4) The system of claim 4, in response to determining that the at least one object is the vehicle, the at least one processor being directed to cause the system further to: determine a relationship between pixel distance information in the multimedia information and actual distance information based on a type of the vehicle. ### Claim 8 (depends on 1) The system of claim 1, wherein to monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, the at least one processor is directed to cause the system further to: for each of the at least one object, determine whether the traffic behavior of the object violates the predetermined traffic rule based on the status information of the object; and in response to determining that the traffic behavior of the object violates the predetermined traffic rule, transmit event information associated with the traffic behavior of the object to a target device. ### Claim 9 (depends on 8) The system of claim 8, wherein the event information associated with the traffic behavior of the object includes at least one image corresponding to the object, the status information of the object, location information associated with the predetermined region, or a traffic violation type. ### Claim 10 (depends on 8) The system of claim 8, wherein the target device includes at least one of a traffic management department, a data center, an alarm center, or a terminal device associated with the object. ### Claim 11 (depends on 1) The system of claim 1, wherein to monitor the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, the at least one processor is directed to cause the system further to: for each of the at least one object, determine whether the traffic behavior of the object satisfies a predetermined condition based on the status information according to the predetermined traffic rule; and in response to determining that the traffic behavior of the object satisfies the predetermined condition, transmit reminder information to a terminal device associated with the object. ### Claim 12 (depends on 1) The system of claim 1, wherein the at least one processor is directed to cause the system further to: store the multimedia information associated with the predetermined region into a storage device according to a predetermined time interval. ### Claim 13 A system for object monitoring, comprising: at least one storage medium including a set of instructions; and at least one processor in communication with the at least one storage medium, wherein when executing the set of instructions, the at least one processor is directed to cause the system to: obtain multimedia information associated with a predetermined region captured by a capture device, the multimedia information including at least one image associated with the predetermined region, at least one video associated with the predetermined region, acoustic information, and text information; extract one or more traffic signs in the multimedia information; determine a traffic rule based on the one or more traffic signs; identify at least one object in the multimedia information, the at least one object including a vehicle and a pedestrian; determine status information associated with the at least object based on the multimedia information, the status information including location information of the at least one object; and monitor a traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, wherein the at least one processor is directed to cause the system further to: determine whether the pedestrian is on a motor vehicle lane according to a prescribed moving region and location information of the pedestrian. ### Claim 14 A method implemented on a computing device including at least one processor, at least one storage medium, and a communication platform connected to a network, the method comprising: obtaining multimedia information associated with a predetermined region captured by a capture device, the multimedia information including at least one image associated with the predetermined region, at least one video associated with the predetermined region, acoustic information, and text information; obtaining a predetermined traffic rule associated with the predetermined region, wherein the predetermined traffic rule is determined based on the multimedia information associated with the predetermined region; identifying at least one object in the multimedia information, the at least one object including a vehicle and a pedestrian; determining status information associated with the at least object based on the multimedia information, the status information including location information of the at least one object; and monitoring a traffic behavior of the at least one object based on the status information according to the predetermined traffic rule, comprising: determining whether the pedestrian is on a motor vehicle lane, according to a prescribed moving region and location information of the pedestrian. ### Claim 15 (depends on 14) The method of claim 14, wherein the capture device includes at least one of a camera, a video recorder, or a sensor. ### Claim 16 (depends on 14) The method of claim 14, wherein the obtaining the predetermined traffic rule associated with the predetermined region includes: extracting one or more traffic signs in the multimedia information associated with the predetermined region, the one or more traffic signs including at least one of a lane line, an indicator sign, a color of a traffic light, or a speed limit sign, the indicator sign including an indicator sign indicating sound honk; and determining the predetermined traffic rule associated with the predetermined region based on the one or more traffic signs. ### Claim 17 (depends on 14) The method of claim 14, wherein the status information associated with the at least object includes a type of the at least one object, velocity information of the at least one object, a moving path of the at least one object, or a moving direction of the at least one object. ### Claim 18 (depends on 14) The method of claim 14, wherein the monitoring the traffic behavior of the at least one object based on the status information according to the predetermined traffic rule includes: for each of the at least one object, determining whether the traffic behavior of the object violates the predetermined traffic rule based on the status information of the object; and in response to determining that the traffic behavior of the object violates the predetermined traffic rule, transmitting event information associated with the traffic behavior of the object to a target device.