# US 12,192,620 B2 · System and method for opportunistic imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,620 B2
- Document ID: US12192620B2
- Status: Granted
- Kind: B2
- Application number: 17/576,677
- Filed: 2022-01-14
- Published: 2023-07-20
- Granted: 2025-01-07
- Earliest claimed: 2022-01-14
- Assignees: Rm Acquisition, LLC
- Applicants: Rm Acquisition, LLC
- Inventors: Andreas U. Kuehnle; Zheng Li
- Web page: https://patentgrep.com/patent/US12192620B2

## CPC

- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- B60W 40/02: related to ambient conditions
- B60W 40/08: related to drivers or passengers
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 23/80: Camera processing pipelines; Components thereof
- B60W 2420/403: Image sensing, e.g. optical camera
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A system for opportunistic imaging includes an imaging device that generates data comprising a plurality of sequential image frames. The system also includes a control module that causes the imaging device to generate standard-resolution image frames at a standard-frame rate and a standard-resolution, such that there is a processing time lull between the generation of sequential standard-resolution image frames. The control module also causes the imaging device to generate one or more burst-resolution image frames at a burst-frame rate and a burst-resolution within the processing time lull.

## Claims

### Claim 1

A system for opportunistic imaging, comprising:
an imaging device configured to generate data comprising a plurality of sequential image frames; and
a control module configured to:
cause the imaging device to generate standard-resolution image frames at a standard-frame rate and a standard-resolution, wherein the standard frame rate delineates a reserved processing time that includes a processing time lull that the control module has reserved for processing the standard-resolution image frames but in which the control module is not processing the sequential standard-resolution image frames; and
cause the imaging device to generate one or more burst-resolution image frames at a burst-frame rate and a burst-resolution within the processing time lull, wherein the burst-resolution image frames are generated via pixel sampling at a fraction of the standard resolution.

### Claim 2 (depends on 1)

The system of claim 1, wherein the burst-resolution image frames are generated such that corresponding reconstructed image frames can be generated, at the standard-resolution and higher, from the burst-resolution image frames via image reconstruction.

### Claim 3 (depends on 1)

The system of claim 1, wherein the processing time lull is idle time between the image processing time reserved by the control module for generating the standard-resolution image frames.

### Claim 4 (depends on 1)

The system of claim 1, wherein each of the burst-resolution image frames are generated by pixel sampling corresponding image frames at random, non-overlapping, pixel locations.

### Claim 5 (depends on 4)

The system of claim 4, wherein the random, non-overlapping, pixel locations are stored in a predetermined look-up table and each burst-resolution image frame is associated with a key to the lookup table.

### Claim 6 (depends on 1)

The system of claim 1, wherein the imaging device is mounted to a vehicle surface via a wobbly mount.

### Claim 7

A method for opportunistic imaging, comprising:
generating, via an imaging device, sequential standard-resolution image frames at a standard-frame rate and a standard-resolution, wherein the standard frame rate delineates a reserved processing time that includes a processing time lull that a control module has reserved for processing the standard-resolution image frames but in which the control module is not processing the standard-resolution image frames; and
generating, via the imaging device, sequential burst-resolution image frames at a burst-frame rate and a burst-resolution within the processing time lull, wherein the burst-resolution image frames are generated via pixel sampling at a fraction of the standard resolution.

### Claim 8 (depends on 7)

The method of claim 7, wherein the burst-resolution image frames are generated such that corresponding reconstructed image frames can be generated, at the standard-resolution and higher, from the burst-resolution image frames via image reconstruction.

### Claim 9 (depends on 7)

The method of claim 7, wherein the processing time lull is idle time between the image processing time reserved for generating the standard-resolution image frames.

### Claim 10 (depends on 7)

The method of claim 7, wherein each of the burst-resolution image frames are generated by pixel sampling corresponding image frames at random, non-overlapping pixel locations.

### Claim 11 (depends on 10)

The system of claim 10, wherein the random, non-overlapping pixel locations are stored in a predetermined look-up table and each burst-resolution image frame is associated with a key to the lookup table.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
transmitting the burst-resolution image frames and the look-up table to a remote computer system; and
generating, at the remote computer system, corresponding reconstructed image frames from the burst-resolution image frames via image reconstruction based on the look-up table.

### Claim 13

An on-vehicle event detection and reporting system, comprising:
a vehicle mounted imaging device configured to capture data comprising a plurality of sequential image frames;
an event detection system configured to detect vehicle and/or driver related events based on the captured video data;
an image control module configured to, at least in response to the detected vehicle and/or driver related events:
cause the imaging device to generate standard-resolution image frames at a standard-frame rate and a standard-resolution, wherein the standard frame rate delineates a reserved processing time that includes a processing time lull that the control module has reserved for processing the standard-resolution image frames but in which the control module is not processing the sequential standard-resolution image frames, and
cause the imaging device to generate one or more burst-resolution image frames at a burst-frame rate and a burst-resolution within the processing time lull, wherein the burst-resolution image frames are generated via pixel sampling at a fraction of the standard resolution.

### Claim 14 (depends on 13)

The system of claim 13, wherein the burst-resolution image frames are generated such that corresponding reconstructed image frames can be generated from the burst-resolution image frames via image reconstruction.

### Claim 15 (depends on 14)

The system of claim 14, further comprising: a remote system configured to receive the burst-resolution image frames and to generate the corresponding reconstructed image frames therefrom via image reconstruction.

### Claim 16 (depends on 13)

The system of claim 13, wherein the processing time lull is idle time between the image processing time reserved by the control module for generating the standard-resolution image frames.

### Claim 17 (depends on 13)

The system of claim 13, wherein each of the burst-resolution image frames are generated by pixel sampling corresponding image frames at random, non-overlapping pixel locations.

### Claim 18 (depends on 17)

The system of claim 17, wherein the random, non-overlapping pixel locations are stored in a predetermined look-up table and each burst-resolution image frame is associated with a key to the lookup table.

### Claim 19 (depends on 18)

The system of claim 18, further comprising:
a remote system configured to receive the burst-resolution image frames and to generate corresponding reconstructed image frames therefrom via image reconstruction and based on the look-up table.

### Claim 20 (depends on 13)

The system of claim 13,
wherein the imaging device is mounted to the vehicle via a wobbly mount, and wherein the burst-resolution image frames are generated such that corresponding super-resolution image frames can be generated from the burst-resolution image frames via image reconstruction.
