# US 12,002,350 B2 · System for detecting pedestrian at crosswalk and preventing accident on basis of artificial intelligence

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,002,350 B2
- Document ID: US12002350B2
- Status: Granted
- Kind: B2
- Application number: 17/789,503
- Filed: 2020-12-07
- Published: 2023-02-09
- Granted: 2024-06-04
- Earliest claimed: 2019-12-26
- Assignees: Mjvisiontech Co., Ltd.
- Applicants: Mjvisiontech Co., Ltd.
- Inventors: Young Seok Park; Jae Il Lee; Young Jin Kim
- Web page: https://patentgrep.com/patent/US12002350B2

## CPC

- G08G 1/005: including pedestrian guidance indicator
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/90: Determination of colour characteristics
- G06V 10/56: relating to colour
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/54: of traffic, e.g. cars on the road, trains or boats
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G08G 1/04: using optical or ultrasonic detectors
- G08G 1/095: Traffic lights
- G08G 1/096: provided with indicators in which a mark progresses showing the time elapsed, e.g. of green phase
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 2207/10024: Color image
- G06T 2207/30196: Human being; Person
- G06T 2207/30232: Surveillance
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for detecting a pedestrian at a crosswalk and preventing an accident on the basis of artificial intelligence, the system comprising: a camera device installed on a mast arm installed at the top of a traffic light pole installed at a crosswalk to capture pedestrians and the vicinity of the crosswalk; a pedestrian detection module for detecting a pedestrian in an image captured by the camera device through a pre-installed image analysis solution; a color detection module for detecting a current blinking color of a traffic light consisting of a pedestrian traffic light and a driving traffic light; and a warning signal output module for outputting an unauthorized crossing warning message to the pedestrian waiting at the crosswalk according to a detection result of the color detection module and a detection result of the pedestrian detection module.

## Claims

### Claim 1

A system for detecting a pedestrian at a crosswalk and preventing an accident on basis of artificial intelligence, the system comprising:
a camera device installed on a mast arm, which is installed at a top of a traffic light pole installed at the crosswalk, to capture the pedestrian and a periphery of the crosswalk;
a pedestrian detection module for detecting the pedestrian in an image captured by the camera device through a pre-installed image analysis solution;
a color detection module for detecting a current blinking color of a traffic light including a pedestrian traffic light and a driving traffic light;
a warning signal output module for outputting a jaywalking warning message to the pedestrian waiting at the crosswalk according to a detection result of the color detection module and a detection result of the pedestrian detection module,
a safety induction block module installed on a bottom surface of the crosswalk so as to be controlled in conjunction with the traffic light to perform blinking;
a communication module for transmitting, when the detection result of the color detection module and the detection result of the pedestrian detection module are determined as jaywalking or an abnormal behavior of the pedestrian, a determination result to an outside;
a database for storing the detection result of the color detection module, the detection result of the pedestrian detection module, and determination result information on the jaywalking or the abnormal behavior analyzed by the warning signal output module; and
a control module for controlling operations of the camera device, the pedestrian detection module, the color detection module, the warning signal output module, the safety induction block module, the communication module, and the database, wherein:
the warning signal output module detects the current blinking color of the traffic light based on blinking information of the safety induction block module, which is obtained from the camera device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the warning signal output module determines an abnormal behavior pattern state of the pedestrian through a pre-installed behavior analysis solution in the image captured by the camera device.

### Claim 3 (depends on 1)

The system of claim 1, wherein, in a case where the traffic light operates with a night blinking signal, when the pedestrian is detected by the pedestrian detection module, the control module switches the traffic light into a normal blinking signal, and operates the safety induction block module.

### Claim 4 (depends on 1)

The system of claim 1, wherein the warning signal output module includes an LED lighting controller installed on a lower side of the mast arm.

### Claim 5 (depends on 1)

The system of claim 1, wherein the control module is coupled to the camera device on the mast arm so as to be installed on the mast arm, or installed on one side of a support pole that is vertically installed on a ground while being located inside a housing.