# US 2023/0145472 A1 · Method for capturing image material for monitoring image-analysing systems, device and vehicle for use in the method and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0145472 A1
- Document ID: US20230145472A1
- Status: Published application
- Kind: A1
- Application number: 17/594,748
- Filed: 2020-04-09
- Published: 2023-05-11
- Earliest claimed: 2019-04-30
- Assignees: Volkswagen Aktiengesellschaft
- Applicants: Volkswagen Aktiengesellschaft
- Inventors: Sebastian Ehmann
- Web page: https://patentgrep.com/patent/US20230145472A1

## CPC

- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06F 18/217: {Validation; Performance evaluation; Active pattern learning techniques}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 10/98: Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30168: Image quality inspection
- G06T 2207/30241: Trajectory
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V 20/582: {of traffic signs}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Technologies and techniques for capturing image material for monitoring image-analyzing systems, wherein an object is monitored to determine if it has been correctly recognized by the image-analyzing system in respect of time or location. The images captured are recorded in a memory. When a discrepancy is determined, in object recognition beyond a tolerance limit over a temporal or locational reference, select images or image sections are archived for more precise inspection.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

A method for capturing image material for an image analyzing system for a vehicle, comprising:
receiving image data in a memory of the image analyzing system;
executing, via a processor of the image analyzing system, first object recognition processing on the received image data;
processing, via the processor, a recognized object to determine if one or more differences of the recognized object to a temporal or spatial reference exceeds a tolerance limit; and
archiving at least portions of the image data for second object recognition processing if the one or more differences of the recognized object to a temporal or spatial reference exceeds the tolerance limit, wherein the second object recognition processing is more precise than the first object recognition processing.

### Claim 17 (depends on 16)

The method of claim 16, wherein processing the recognized object comprises calculating a trajectory of a moving object, and wherein archiving at least the portion of the image data comprises archiving the image data based on the calculated trajectory.

### Claim 18 (depends on 17)

The method of claim 17, further comprising performing a reverse calculation using the calculated trajectory to calculate a number of images or image sections in the image data in which the moving object may be visible, even if the moving object cannot be recognized via the first object recognition processing.

### Claim 19 (depends on 18)

The method of claim 18, wherein a distance to the recognized object at which the object recognition takes place via the first object recognition processing is checked in order to determine whether the object recognition takes place at a correct time or place, and wherein a standard recognition distance is established, indicating a starting distance at which the second object recognition should recognize the object.

### Claim 20 (depends on 16)

The method of claim 16, further comprising receiving position data for the recognized object, and processing the position data to determine a distance between the vehicle and the recognized object, for determining the one or more differences in the first object recognition processing.

### Claim 21 (depends on 20)

The method of claim 20, wherein the determined distance comprises at least one of a standard recognition distance and an object recognition distance, wherein processing the recognized object comprises calculating a trajectory of a moving object, and wherein the archiving at least portions of the image data comprises transmitting the at least portions of the image data between the standard recognition distance and the object recognition distance to one of the memory of the image analyzing system or an external memory.

### Claim 22 (depends on 21)

The method of claim 21, wherein the archiving at least portions of the image data comprises archiving at least portions of the image data with a higher quality and a lower quality.

### Claim 23

An image analyzing system for capturing image material for a vehicle, comprising:
a memory configured to receive image data;
a processor, operatively coupled to the memory, wherein the processor and memory are configured to:
executing, via a processor of the image analyzing system, first object recognition processing on the received image data;
processing, via the processor, a recognized object to determine if one or more differences of the recognized object to a temporal or spatial reference exceeds a tolerance limit; and
archiving at least portions of the image data for second object recognition processing if the one or more differences of the recognized object to a temporal or spatial reference exceeds the tolerance limit, wherein the second object recognition processing is more precise than the first object recognition processing.

### Claim 24 (depends on 23)

The image analyzing system of claim 23, wherein the processor and memory are configured to process the recognized object by calculating a trajectory of a moving object, and wherein archiving at least the portion of the image data comprises archiving the image data based on the calculated trajectory.

### Claim 25 (depends on 24)

The image analyzing system of claim 24, wherein the processor and memory are configured to perform a reverse calculation using the calculated trajectory to calculate a number of images or image sections in the image data in which the moving object may be visible, even if the moving object cannot be recognized via the first object recognition processing.

### Claim 26 (depends on 25)

The image analyzing system of claim 25, wherein the processor and memory are configured to determine a distance to the recognized object at which the object recognition takes place via the first object recognition processing and checked in order to determine whether the object recognition takes place at a correct time or place, and wherein a standard recognition distance is established, indicating a starting distance at which the second object recognition should recognize the object.

### Claim 27 (depends on 23)

The image analyzing system of claim 23, wherein the processor and memory are configured to receive position data for the recognized object, and process the position data to determine a distance between the vehicle and the recognized object, for determining the one or more differences in the first object recognition processing.

### Claim 28 (depends on 27)

The image analyzing system of claim 27, wherein the determined distance comprises at least one of a standard recognition distance and an object recognition distance, wherein processing the recognized object comprises calculating a trajectory of a moving object, and wherein the archiving at least portions of the image data comprises transmitting the at least portions of the image data between the standard recognition distance and the object recognition distance to one of the memory of the image analyzing system or an external memory.

### Claim 29 (depends on 28)

The image analyzing system of claim 28, wherein the processor and memory are configured to archive at least portions of the image data by archiving at least portions of the image data with a higher quality and a lower quality.

### Claim 30

A computer-readable medium having stored therein instructions executable by one or more processors of an image analyzing system for a vehicle, to:
receive image data in a memory of the image analyzing system;
execute first object recognition processing on the received image data;
process a recognized object to determine if one or more differences of the recognized object to a temporal or spatial reference exceeds a tolerance limit; and
archive at least portions of the image data for second object recognition processing if the one or more differences of the recognized object to a temporal or spatial reference exceeds the tolerance limit, wherein the second object recognition processing is more precise than the first object recognition processing.

### Claim 31 (depends on 30)

The computer-readable medium of claim 30, wherein the instructions are further configured to process the recognized object by calculating a trajectory of a moving object, and wherein archiving at least the portion of the image data comprises archiving the image data based on the calculated trajectory.

### Claim 32 (depends on 31)

The computer-readable medium of claim 31, wherein the instructions are further configured to perform a reverse calculation using the calculated trajectory to calculate a number of images or image sections in the image data in which the moving object may be visible, even if the moving object cannot be recognized via the first object recognition processing.

### Claim 33 (depends on 32)

The computer-readable medium of claim 32, wherein a distance to the recognized object at which the object recognition takes place via the first object recognition processing is checked in order to determine whether the object recognition takes place at a correct time or place, and wherein a standard recognition distance is established, indicating a starting distance at which the second object recognition should recognize the object.

### Claim 34 (depends on 30)

The computer-readable medium of claim 30, wherein the instructions are further configured to receive position data for the recognized object, and processing the position data to determine a distance between the vehicle and the recognized object, for determining the one or more differences in the first object recognition processing.

### Claim 35 (depends on 34)

The computer-readable medium of claim 34, wherein the determined distance comprises at least one of a standard recognition distance and an object recognition distance, wherein processing the recognized object comprises calculating a trajectory of a moving object, and wherein the archiving at least portions of the image data comprises transmitting the at least portions of the image data between the standard recognition distance and the object recognition distance to one of the memory of the image analyzing system or an external memory.
