# US 2021/0174652 A1 · Tracking assistance device, tracking assistance system, and tracking assistance method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174652 A1
- Document ID: US20210174652A1
- Status: Published application
- Kind: A1
- Application number: 16/074,255
- Filed: 2016-11-16
- Published: 2021-06-10
- Earliest claimed: 2016-02-05
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Sonoko HIRASAWA; Takeshi FUJIMATSU
- Web page: https://patentgrep.com/patent/US20210174652A1

## CPC

- G08B 13/19608: {Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 13/19645: {Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over}
- G08B 13/1968: {Interfaces for setting up or customising the system}
- G08B 13/19682: {Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system}
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/77: between a recording apparatus and a television camera
- H04N 5/91: Television signal processing therefor
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)}
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Tracking assistance to reduce a burden on a monitoring person, includes search condition setter setting a search condition by user operation, tracking target setter setting, as a tracking target, a person designated by monitoring person's operation to select a tracking mark on a tracking target search screen displaying a video conforming to the search condition, confirmation video presentor displaying tracking target confirmation screen displaying video of a person having a highest possibility of being the tracking target from each camera as a confirmation video, video display period setter that in a case where the tracking mark is not displayed in the tracking target on the tracking target search screen, sets a video display period by the user's operation, and in-camera tracking information corrector correcting the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

## Claims

### Claim 1

A tracking assistance device that displays on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assists a monitoring person's work of tracking a moving object which is a tracking target, the device comprising:
a search condition setter that sets a search condition for finding out a video of the moving object which is a tracking target, in response to a user's operation input;
a tracking target setter that acquires a video conforming to the search condition from the video accumulator to display a tracking target search screen on the display device, and in response to a monitoring person's operation input of designating the moving object which is the tracking target, by an operation of selecting a tracking mark displayed on the video on the tracking target search screen, sets the designated moving object as the tracking target;
a confirmation video presentor that extracts for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displays on the display device, a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos;
a video display period setter that in a case where the tracking mark is not displayed on the moving object which is the tracking target on the tracking target search screen, sets a video display period during which the moving object which is set as the tracking target appears in the video, in response to the user's operation input; and
a tracking information corrector that corrects the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

### Claim 2 (depends on 1)

The tracking assistance device of claim 1,
wherein the video display period setter displays on the tracking target search screen, a moveable operation portion in which a start time and an end time of the video display period are displayed respectively, and allows the user to perform an operation to adjust a range of the video display period by shifting the moveable operation portion.

### Claim 3 (depends on 1)

The tracking assistance device of claim 1,
wherein the video display period setter displays on the tracking target search screen, the video from the camera in such a manner that the display time thereof can be adjusted, and acquires a start time and an end time of the video display period by allowing the user to perform an operation to select a video in which the moving object which is the tracking target appears first and a video immediately before the moving object which is the tracking target disappears.

### Claim 4

A tracking assistance device that displays on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assists a monitoring person's work of tracking a moving object which is a tracking target, the device comprising:
a confirmation video presentor that extracts for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displays on the display device, a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos;
a video display period setter that displays a tracking result editing screen on the display device in a case where there is excess or deficiency in the confirmation video for each camera displayed on the tracking target confirmation screen, and sets a video display period during which a moving object set as the tracking target appears in a video, in response to a user's operation input on the tracking result editing screen; and
a tracking information corrector that corrects the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

### Claim 5 (depends on 4)

The tracking assistance device of claim 4,
wherein the video display period setter displays a tracking period acquired in an in-camera tracking process for the video for each camera as an initial video display period on the tracking result editing screen, and allows the user to perform an operation to adjust the range of the video display period on the tracking result editing screen such that the initial video display period to be partly deleted or added.

### Claim 6 (depends on 4)

The tracking assistance device of claim 4,
wherein the video display period setter displays on the tracking result editing screen, a moveable operation portion in which a start time and an end time of the video display period are displayed respectively, and allows the user to perform an operation to adjust a range of the video display period by shifting the moveable operation portion.

### Claim 7 (depends on 4)

The tracking assistance device of claim 4,
wherein the video display period setter displays on the tracking result editing screen, the video from the camera in such a manner that the display time thereof can be adjusted, and acquires at least one of the start time or the end time of the video display period by allowing the user to perform an operation to select at least one of a video in which the moving object which is the tracking target appears first or a video immediately before the moving object which is the tracking target disappears.

### Claim 8 (depends on 4)

The tracking assistance device of claim 4,
wherein the video display period setter sets the video display period to include the tracking period of the selected moving object by allowing the user to perform an operation to select a tracking mark of the moving object which is the tracking target appearing in the video, on the tracking result editing screen.

### Claim 9 (depends on 1)

The tracking assistance device of claim 1, further comprising:
a video playback device that displays on the display device, a continuous playback screen in which a moving object set as the tracking target and a video from each of the cameras related to the moving object associated as the same as the moving object are arranged and displayed in order of imaging time, and performs continuous playback in which the video from each camera is sequentially displayed as a moving image with the lapse of time, on the continuous playback screen.

### Claim 10

A tracking assistance system that displays on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assists a monitoring person's work of tracking a moving object which is a tracking target, the system comprising:
the camera that captures an image of a monitoring area;
the display device that displays a video from each of the cameras; and
a plurality of information processing devices,
wherein one of the plurality of information processing devices includes
a search condition setter that sets a search condition for finding out a video of the moving object which is a tracking target, in response to a user's operation input;
a tracking target setter that acquires a video conforming to the search condition from the video accumulator to display a tracking target search screen on the display device, and in response to a monitoring person's operation input of designating the moving object which is the tracking target, by an operation of selecting a tracking mark displayed on the video on the tracking target search screen, sets the designated moving object as the tracking target;
a confirmation video presentor that extracts for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displays on the display device, a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos;
a video display period setter that in a case where the tracking mark is not displayed on the moving object which is the tracking target on the tracking target search screen, sets a video display period during which the moving object which is set as the tracking target appears in the video, in response to the user's operation input; and
a tracking information corrector that corrects the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

### Claim 11

A tracking assistance system that displays on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assists a monitoring person's work of tracking a moving object which is a tracking target, the system comprising:
the camera that captures an image of a monitoring area;
the display device that displays a video from each of the cameras; and
a plurality of information processing devices,
wherein one of the plurality of information processing devices includes
a confirmation video presentor that extracts for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displays on the display device, a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos;
a video display period setter that displays a tracking result editing screen on the display device in a case where there is excess or deficiency in the confirmation video for each camera displayed on the tracking target confirmation screen, and sets a video display period during which a moving object set as the tracking target appears in a video, in response to a user's operation input on the tracking result editing screen; and
a tracking information corrector that corrects the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

### Claim 12

A tracking assistance method, by an information processing device, of displaying on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assisting a monitoring person's work of tracking a moving object which is a tracking target, the method comprising:
setting a search condition for finding out a video of the moving object which is the tracking target, in response to a user's operation input;
acquiring a video conforming to the search condition from the video accumulator to display a tracking target search screen on the display device, and in response to a monitoring person's operation input of designating the moving object which is the tracking target, by an operation of selecting a tracking mark displayed on the video on the tracking target search screen, setting the designated moving object as the tracking target;
extracting for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displaying a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos, on the display device;
setting a video display period during which the moving object which is set as the tracking target appears in the video, in response to the user's operation input, in a case where the tracking mark is not displayed on the moving object which is the tracking target on the tracking target search screen; and
correcting the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.

### Claim 13

A tracking assistance method, by an information processing device, of displaying on a display device, a video from each of a plurality of cameras which is accumulated in video accumulator and assisting a monitoring person's work of tracking a moving object which is a tracking target, the method comprising:
extracting for each of the cameras, a video of a moving object having a highest possibility of being the moving object set as the tracking target, based on tracking information acquired in a tracking process executed on the videos accumulated in the video accumulator, and displaying a tracking target confirmation screen in which only the extracted videos are displayed as confirmation videos, on the display device;
displaying a tracking result editing screen on the display device in a case where there is excess or deficiency in the confirmation video for each camera displayed on the tracking target confirmation screen, and setting a video display period during which a moving object set as the tracking target appears in a video, in response to a user's operation input on the tracking result editing screen; and
correcting the tracking information so as to display the confirmation video on the tracking target confirmation screen based on the video display period.
