# US 2024/0179391 A1 · Method, apparatus, device and storage medium for image processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0179391 A1
- Document ID: US20240179391A1
- Status: Published application
- Kind: A1
- Application number: 18/522,576
- Filed: 2023-11-29
- Published: 2024-05-30
- Earliest claimed: 2022-11-30
- Assignees: Lemon Inc.; Beijing Zitiao Network Technology Co., Ltd.
- Applicants: Lemon Inc.; Beijing Zitiao Network Technology Co., Ltd.
- Inventors: Yongjun Li; Can Jin; Xiaokai Li
- Web page: https://patentgrep.com/patent/US20240179391A1

## CPC

- H04N 23/61: based on recognised objects
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/73: by influencing the exposure time
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

According to embodiments of the disclosure, a method, apparatus, device, and storage medium for image processing are provided. In this method, an image sensing unit array of a camera is divided into a set of full processing units and at least one set of partial processing units based on a characteristic of a lens of the camera, and/or a current gazing point of a user of the camera. Within at least one stage of a plurality of stages of an imaging process using the camera, a processing load associated with at least some units of the partial processing units is reduced.

## Claims

### Claim 1

A method of image processing, comprising:
dividing an image sensing unit array of a camera into a set of full processing units and at least one set of partial processing units based on at least one of:
a characteristic of a lens of the camera, or
a current gazing point of a user of the camera; and
reducing a processing load associated with at least some units of the partial processing units within at least one stage of a plurality of stages of an imaging process using the camera.

### Claim 2 (depends on 1)

The method of claim 1, wherein the plurality of stages of the imaging process comprise:
exposure of the image sensing unit array,
scanning of the image sensing unit array,
transmission of data captured by the image sensing unit array,
image signal processing of data captured by the image sensing unit array.

### Claim 3 (depends on 1)

The method of claim 1, wherein reducing the processing load associated with at least some units of the partial processing units comprises:
obtaining data captured by the respective partial processing units; and
combining data captured by at least two adjacent units in the partial processing units to generate combined data, wherein the combined data is used as an exposure result of the partial processing units for subsequent processing.

### Claim 4 (depends on 3)

The method of claim 3, wherein the at least two adjacent units are determined by:
for each set of partial processing units of the at least one set of partial processing units, selecting, based on a positional relationship of the set of partial processing units relative to the set of full processing units, the number of adjacent units related to the positional relationship from the set of partial processing units.

### Claim 5 (depends on 1)

The method of claim 1, wherein reducing the processing load associated with at least some units of the partial processing units comprises:
preventing exposure of the at least some units, or
discarding data captured by the at least some units.

### Claim 6 (depends on 5)

The method of claim 5, wherein the at least some units are determined by:
for each set of partial processing units of the at least one set of partial processing units, selecting, based on a positional relationship of the set of partial processing units relative to the set of full processing units, a proportion of units related to the positional relationship from the set of partial processing units.

### Claim 7 (depends on 1)

The method of claim 1, wherein dividing the image sensing unit array of the camera into the set of full processing units and the at least one set of partial processing units comprises:
determining a relative position of the gazing point to the image sensing unit array based on an image of the user captured by a further camera; and
dividing the image sensing unit array into the set of full processing units and the at least one set of partial processing units based on the relative position and a characteristic of decay of an eyesight from the gazing point.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
determining a time latency associated with obtaining the relative position; and
initiating the at least one stage of the imaging process based on the time latency.

### Claim 9 (depends on 1)

The method of claim 1, wherein dividing the image sensing unit array of the camera into the set of full processing units and the at least one set of partial processing units comprises:
determining, based on a distortion characteristic of the lens, a first region with a distortion less than a threshold distortion and a second region with a distortion greater than the threshold distortion in the image sensing unit array;
grouping units in the first region into the set of full processing units; and
grouping units in the second region into the at least one set of partial processing units.

### Claim 10

An electronic device, comprising:
at least one processing unit; and
at least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform acts comprising:
dividing an image sensing unit array of a camera into a set of full processing units and at least one set of partial processing units based on at least one of:
a characteristic of a lens of the camera, or
a current gazing point of a user of the camera; and
reducing a processing load associated with at least some units of the partial processing units within at least one stage of a plurality of stages of an imaging process using the camera.

### Claim 11 (depends on 10)

The device of claim 10, wherein the plurality of stages of the imaging process comprise:
exposure of the image sensing unit array,
scanning of the image sensing unit array,
transmission of data captured by the image sensing unit array,
image signal processing of data captured by the image sensing unit array.

### Claim 12 (depends on 10)

The device of claim 10, wherein reducing the processing load associated with at least some units of the partial processing units comprises:
obtaining data captured by the respective partial processing units; and
combining data captured by at least two adjacent units in the partial processing units to generate combined data, wherein the combined data is used as an exposure result of the partial processing units for subsequent processing.

### Claim 13 (depends on 12)

The device of claim 12, wherein the at least two adjacent units are determined by:
for each set of partial processing units of the at least one set of partial processing units, selecting, based on a positional relationship of the set of partial processing units relative to the set of full processing units, the number of adjacent units related to the positional relationship from the set of partial processing units.

### Claim 14 (depends on 10)

The device of claim 10, wherein reducing the processing load associated with at least some units of the partial processing units comprises:
preventing exposure of the at least some units, or
discarding data captured by the at least some units.

### Claim 15 (depends on 14)

The device of claim 14, wherein the at least some units are determined by:
for each set of partial processing units of the at least one set of partial processing units, selecting, based on a positional relationship of the set of partial processing units relative to the set of full processing units, a proportion of units related to the positional relationship from the set of partial processing units.

### Claim 16 (depends on 10)

The device of claim 10, wherein dividing the image sensing unit array of the camera into the set of full processing units and the at least one set of partial processing units comprises:
determining a relative position of the gazing point to the image sensing unit array based on an image of the user captured by a further camera; and
dividing the image sensing unit array into the set of full processing units and the at least one set of partial processing units based on the relative position and a characteristic of decay of an eyesight from the gazing point.

### Claim 17 (depends on 10)

The device of claim 10, further comprising:
determining a time latency associated with obtaining the relative position; and
initiating the at least one stage of the imaging process based on the time latency.

### Claim 18 (depends on 10)

The device of claim 10, wherein dividing the image sensing unit array of the camera into the set of full processing units and the at least one set of partial processing units comprises:
determining, based on a distortion characteristic of the lens, a first region with a distortion less than a threshold distortion and a second region with a distortion greater than the threshold distortion in the image sensing unit array;
grouping units in the first region into the set of full processing units; and
grouping units in the second region into the at least one set of partial processing units.

### Claim 19

A non-transitory computer readable storage medium having stored thereon a computer program executable by a processor to implement acts comprising:
dividing an image sensing unit array of a camera into a set of full processing units and at least one set of partial processing units based on at least one of:
a characteristic of a lens of the camera, or
a current gazing point of a user of the camera; and
reducing a processing load associated with at least some units of the partial processing units within at least one stage of a plurality of stages of an imaging process using the camera.

### Claim 20 (depends on 19)

The medium of claim 19, wherein the plurality of stages of the imaging process comprise:
exposure of the image sensing unit array,
scanning of the image sensing unit array,
transmission of data captured by the image sensing unit array,
image signal processing of data captured by the image sensing unit array.
