# US 2019/0154536 A1 · Quantifying gas leak rates using frame images acquired by a camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0154536 A1
- Document ID: US20190154536A1
- Status: Published application
- Kind: A1
- Application number: 16/099,648
- Filed: 2017-06-21
- Published: 2019-05-23
- Earliest claimed: 2016-08-30
- Assignees: Konica Minolta Laboratory U.S.A., Inc.
- Applicants: Konica Minolta Laboratory U.S.A., Inc.
- Inventors: Leiming Wang
- Web page: https://patentgrep.com/patent/US20190154536A1

## CPC

- G01M 3/047: {with photo-electrical detection means, e.g. using optical fibres}
- G01J 5/0014: {for sensing the radiation from gases, flames}
- G01M 3/007: {Leak detector calibration, standard leaks (G01M3/207 takes precedence)}
- G01M 3/38: by using light (G01M3/02 takes precedence)
- G01N 21/3504: for analysing gases, e.g. multi-gas analysis
- H04N 23/20: for generating image signals from infrared radiation only
- G01J 2005/0077: {Imaging}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- G01M: TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of quantifying gas leak rate includes receiving image frames acquired with a camera and including a plume from a gas leak source, determining a real-world size that each pixel represents, identifying pixels corresponding to the plume in a first image frame, calculating gas concentration path lengths of the plume for the pixels in the first image frame, calculating, based on the first image frame and a second image frame, an image velocity field of the plume including displacement vectors for the pixels, identifying, within the first image, a closed boundary enclosing the gas leak source of the plume, and calculating a first gas leak rate in the first image frame by calculating a volume rate of the plume flowing across the closed boundary based on the image velocity field, the gas concentration path lengths, and a time interval between the first and the second image frames.

## Claims

### Claim 1

A method of quantifying gas leak rate, comprising:
receiving a first plurality of image frames acquired with a first camera and comprising a plume from a gas leak source;
identifying a plurality of pixels corresponding to the plume in a first image frame of the first plurality of images frames;
calculating a plurality of gas concentration path lengths of the plume for the plurality of pixels in the first image frame;
calculating, based on the first image frame and a second image frame, an image velocity field of the plume comprising a plurality of displacement vectors for the plurality of pixels;
identifying, within the first image, a closed boundary enclosing the gas leak source of the plume;
calculating a first gas leak rate in the first image frame by calculating a volume rate of the plume flowing across the closed boundary based on:
the image velocity field;
the plurality of gas concentration path lengths; and
a time interval between the first image frame and the second image frame.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
calculating an average distance of the plurality of displacement vectors;
applying a sub-pixel flow correction method in response to the average distance being less than 1 pixel.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
calculating a second gas leak rate in the second image frame; and
calculating an average gas leak rate based on the first gas leak rate and the second gas leak rate.

### Claim 4 (depends on 1)

The method of claim 1, wherein calculating the volume rate comprises:
identifying, within the closed boundary, a first contributing pixel comprising a displacement vector that points from the first contributing pixel to outside the closed boundary;
identifying, within the closed boundary, a second contributing pixel comprising a second displacement vector that points from the second contributing pixel to outside the closed boundary;
calculating a first gas volume from the first contributing pixel by multiplying the concentration path length of the first contributing pixel by the real-world size of the first contributing pixel;
calculating a second gas volume from the second contributing pixel by multiplying the concentration path length of the second contributing pixel by the real-world size of the second contributing pixel; and
generating a total gas volume by summing the first gas volume and the second gas volume; and
dividing the total gas volume by the time interval between the first image frame and the second image frame.

### Claim 5 (depends on 1)

The method of claim 1, wherein the image velocity field of the plume is calculated by an optical flow method.

### Claim 6 (depends on 1)

The method of claim 1, wherein the image velocity field of the plume is calculated by a geometric flow method.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
post-processing the first plurality of image frames prior to calculating of the image velocity field of the plume;
calculating the gas leak rate, and
wherein the first plurality of post-processed image frames are concentration path length map images.

### Claim 8 (depends on 2)

The method of claim 2, wherein the sub-pixel flow correction method comprises:
scaling the calculated first gas leak rate by a factor of the average distance of the image velocity field at each of the plurality of pixels.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
obtaining a second plurality of image frames acquired by a camera and comprising the plume from the gas leak source,
wherein the first camera and the second camera are at different viewing angles;
calculating a second gas leak rate using the second plurality of image frames; and
averaging the first gas leak rate and the second gas leak rate.

### Claim 10 (depends on 9)

The method of claim 9, wherein the viewing angle of the first camera is orthogonal to the viewing angle of the second camera.

### Claim 11

A non-transitory computer readable medium (CRM) storing computer readable program code embodied therein that:
receives a first plurality of image frames acquired with a first camera and comprising a plume from a gas leak source;
identifies a plurality of pixels corresponding to the plume in a first image frame of the first plurality of images frames;
calculates a plurality of gas concentration path lengths of the plume for the plurality of pixels in the first image frame;
calculates, based on the first image frame and a second image frame, an image velocity field of the plume comprising a plurality of displacement vectors for the plurality of pixels;
identifies, within the first image, a closed boundary enclosing the gas leak source of the plume;
calculates a first gas leak rate in the first image frame by calculating a volume rate of the plume flowing across the closed boundary based on:
the image velocity field;
the plurality of gas concentration path lengths; and
a time interval between the first image frame and the second image frame.

### Claim 12 (depends on 11)

The non-transitory computer readable medium (CRM) of claim 11 storing computer readable program code embodied therein that further:
calculates an average distance of the plurality of displacement vectors;
applies a sub-pixel flow correction method in response to the average distance being less than 1 pixel.

### Claim 13 (depends on 11)

The non-transitory computer readable medium (CRM) of claim 11 storing computer readable program code embodied therein that further:
calculates a second gas leak rate in the second image frame; and
calculates an average gas leak rate based on the first gas leak rate and the second gas leak rate.

### Claim 14 (depends on 11)

The non-transitory computer readable medium (CRM) of claim 11 storing computer readable program code embodied therein, wherein calculating the volume rate comprises:
identifying, within the closed boundary, a first contributing pixel comprising a displacement vector that points from the first contributing pixel to outside the closed boundary;
identifying, within the closed boundary, a second contributing pixel comprising a second displacement vector that points from the second contributing pixel to outside the closed boundary;
calculating a first gas volume from the first contributing pixel by multiplying the concentration path length of the first contributing pixel by the real-world size of the first contributing pixel;
calculating a second gas volume from the second contributing pixel by multiplying the concentration path length of the second contributing pixel by the real-world size of the second contributing pixel; and
generating a total gas volume by summing the first gas volume and the second gas volume; and
dividing the total gas volume by the time interval between the first image frame and the second image frame.

### Claim 15

A system for quantifying gas leak rate, comprising:
a memory; and
a processor that:
receives a first plurality of image frames acquired with a first camera and comprising a plume from a gas leak source;
identifies a plurality of pixels corresponding to the plume in a first image frame of the first plurality of images frames;
calculates a plurality of gas concentration path lengths of the plume for the plurality of pixels in the first image frame;
calculates, based on the first image frame and a second image frame, an image velocity field of the plume comprising a plurality of displacement vectors for the plurality of pixels;
identifies, within the first image, a closed boundary enclosing the gas leak source of the plume;
calculates a first gas leak rate in the first image frame by calculating a volume rate of the plume flowing across the closed boundary based on:
the image velocity field;
the plurality of gas concentration path lengths; and
a time interval between the first image frame and the second image frame.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processor further:
calculates an average distance of the plurality of displacement vectors;
applies a sub-pixel flow correction method in response to the average distance being less than 1 pixel.

### Claim 17 (depends on 15)

The system of claim 15, wherein the processor further:
calculates a second gas leak rate in the second image frame; and
calculates an average gas leak rate based on the first gas leak rate and the second gas leak rate.

### Claim 18 (depends on 15)

The system of claim 15, wherein calculating the volume rate comprises:
identifying, within the closed boundary, a first contributing pixel comprising a displacement vector that points from the first contributing pixel to outside the closed boundary;
identifying, within the closed boundary, a second contributing pixel comprising a second displacement vector that points from the second contributing pixel to outside the closed boundary;
calculating a first gas volume from the first contributing pixel by multiplying the concentration path length of the first contributing pixel by the real-world size of the first contributing pixel;
calculating a second gas volume from the second contributing pixel by multiplying the concentration path length of the second contributing pixel by the real-world size of the second contributing pixel; and
generating a total gas volume by summing the first gas volume and the second gas volume; and
dividing the total gas volume by the time interval between the first image frame and the second image frame.
