# US 2022/0036086 A1 · Ranging system data utilization for marking of video data of interest

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036086 A1
- Document ID: US20220036086A1
- Status: Published application
- Kind: A1
- Application number: 17/374,596
- Filed: 2021-07-13
- Published: 2022-02-03
- Earliest claimed: 2019-08-14
- Assignees: Lytx, Inc.
- Applicants: Lytx, Inc.
- Inventors: Brett Hoye
- Web page: https://patentgrep.com/patent/US20220036086A1

## CPC

- G01S 13/867: {Combination of radar systems with cameras}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G09B 19/0038: {Sports}
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- G01S 13/931: of land vehicles
- G01S 2013/9323: {Alternative operation using light waves}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06V 2201/10: Recognition assisted with metadata
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system for video processing includes a ranging system hardware interface, a vehicle bus interface, and a processor. The ranging system hardware interface is configured to receive ranging system data and/or ranging system metadata. The a vehicle bus interface is configured to receive vehicle bus data and vehicle bus metadata sent from a ranging system. The processor is configured to determine video data of interest based at least in part on the ranging system data and the ranging system metadata. The ranging system data and/or the ranging system metadata data includes information not included in the vehicle bus data and vehicle bus metadata sent from the ranging system via the vehicle bus interface.

## Claims

### Claim 1

(canceled)

### Claim 2

A system for video processing, comprising:
a ranging system hardware interface configured to:
receive ranging system data, ranging system metadata, or the ranging system data and the ranging system metadata;
a vehicle bus interface configured to:
receive vehicle bus data and vehicle bus metadata sent from a ranging system;
a processor configured to:
determine video data of interest based at least in part on the ranging system data and the ranging system metadata, wherein the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata includes information not included in the vehicle bus data and vehicle bus metadata sent from the ranging system via the vehicle bus interface, wherein the video data of interest is marked for possible transfer to a server.

### Claim 3 (depends on 2)

The system as in claim 2, wherein the processor indicates to become operational in order to provide the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata.

### Claim 4 (depends on 2)

The system as in claim 2, wherein the processor indicates to power on in order to provide the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata.

### Claim 5 (depends on 2)

The system as in claim 2, wherein the ranging system hardware interface is further configured to receive video data from a vehicle camera.

### Claim 6 (depends on 2)

The system as in claim 2, wherein the ranging system comprises a video system, lidar system, or a radar system.

### Claim 7 (depends on 2)

The system as in claim 2, wherein the ranging system also comprises a detection system that identifies an object using the ranging system data.

### Claim 8 (depends on 2)

The system of claim 2, wherein the ranging system hardware interface is further configured to provide the ranging system hardware interface a power up indication.

### Claim 9 (depends on 2)

The system of claim 2, wherein the ranging system hardware interface is further configured to provide the ranging system hardware interface with a request for the data and the metadata.

### Claim 10 (depends on 2)

The system as in claim 2, wherein the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata includes object characterization data regarding an object.

### Claim 11 (depends on 10)

The system as in claim 10, wherein the object comprises at least one of: a person, a vehicle, a building, a bicycle, a scooter, a motorcycle, a truck, an adult, a child, a cone, a garbage can, a box, a pedestrian, a safety gear item, a hat, or a vest.

### Claim 12 (depends on 10)

The system as in claim 10, wherein the object characterization data comprises at least one of: a distance, a direction, a speed, a lane, a position, a driver behavior, a work behavior, a compliance behavior, a theft behavior, a vehicle entry time, a vehicle exit time, a cargo entry time, a cargo exit time, a behavior stop time, a behavior start time, an engine on time, an engine off time, a traffic state, an activity near a loading gate, an activity near a rear lift, or a safety behavior.

### Claim 13 (depends on 2)

The system of claim 2, wherein the video data of interest is used to generate video metadata that is transmitted to a server, wherein the server evaluates the video metadata to determine whether the video data of interest is to be transferred to the server.

### Claim 14 (depends on 2)

The system of claim 2, wherein the video data of interest is marked for storage.

### Claim 15 (depends on 2)

The system of claim 2, wherein the video data of interest is marked for possible transfer to a server.

### Claim 16 (depends on 2)

The system of claim 2, wherein the video data of interest is marked for coaching.

### Claim 17 (depends on 2)

The system of claim 2, wherein the video data of interest is analyzed for an operational condition.

### Claim 18 (depends on 17)

The system of claim 17, wherein the operational condition comprises one of: proper placement of cones, proper safety gear employed, proper wearing of a hat, or proper wearing of a vest.

### Claim 19 (depends on 2)

The system of claim 2, wherein the video data of interest is analyzed for a risk factor.

### Claim 20 (depends on 19)

The system of claim 19, wherein the risk factor comprises one of: one or more pedestrians near a vehicle or high traffic near the vehicle.

### Claim 21 (depends on 2)

The system of claim 2, wherein the video data of interest is analyzed for an activity taking place.

### Claim 22 (depends on 21)

The system of claim 21, wherein the activity taking place comprises one of: an activity around a loading gate, an activity around a passenger door, or an activity around a rear lift.

### Claim 23 (depends on 2)

The system of claim 2, wherein a sensor detection threshold is indicated to be changed based at least in part on an analysis of the video data of interest.

### Claim 24 (depends on 2)

The system of claim 2, wherein a risk factor model is updated based on a feedback rating of a determined risk factor.

### Claim 25 (depends on 2)

The system of claim 2, wherein an activity model is updated based on a feedback rating of an activity taking place.

### Claim 26 (depends on 2)

The system of claim 2, wherein an operational model is updated based on a feedback rating of an operation taking place.

### Claim 27

A method for video processing, comprising:
receiving ranging system data, ranging system metadata, or the ranging system data and the ranging system metadata using a ranging system hardware interface;
receiving vehicle bus data and vehicle bus metadata sent from a ranging system using a vehicle bus interface;
determining, using a processor, video data of interest based at least in part on the ranging system data and the ranging system metadata, wherein the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata includes information not included in the vehicle bus data and vehicle bus metadata sent from the ranging system via the vehicle bus interface, wherein the video data of interest is marked for possible transfer to a server.

### Claim 28

A computer program product for video processing, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:
receiving ranging system data, ranging system metadata, or the ranging system data and the ranging system metadata using a ranging system hardware interface;
receiving vehicle bus data and vehicle bus metadata sent from a ranging system using a vehicle bus interface;
determining, using a processor, video data of interest based at least in part on the ranging system data and the ranging system metadata, wherein the ranging system data, the ranging system metadata, or the ranging system data and the ranging system metadata includes information not included in the vehicle bus data and vehicle bus metadata sent from the ranging system via the vehicle bus interface, wherein the video data of interest is marked for possible transfer to a server.
