# US 2024/0205533 A1 · Method for capturing image during video recording and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205533 A1
- Document ID: US20240205533A1
- Status: Published application
- Kind: A1
- Application number: 18/015,583
- Filed: 2022-08-22
- Published: 2024-06-20
- Earliest claimed: 2021-09-07
- Assignees: Honor Device Co., Ltd.
- Applicants: Honor Device Co., Ltd.
- Inventors: Yu WANG; Congchao ZHU; Bin XIAO
- Web page: https://patentgrep.com/patent/US20240205533A1

## CPC

- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04M 1/02: Constructional features of telephone sets
- H04M 1/72439: for image or video messaging
- H04N 1/212: {Motion video recording combined with still video recording (television signal recording H04N5/76)}
- H04N 5/00: Details of television systems (scanning details or combination thereof with generation of supply voltages H04N3/00)
- H04N 5/76: Television signal recording
- H04N 5/9201: {involving the multiplexing of an additional signal and the video signal}
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/95: Computational photography systems, e.g. light-field imaging systems
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06T 2207/30168: Image quality inspection
- H04N 23/84: for processing colour signals
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

Disclosed in this application are a method for capturing an image during video recording and an electronic device, so that image quality of a captured image is improved. The method includes: displaying a viewfinder screen, where the viewfinder screen displays a preview image stream, the preview image stream includes n frames of preview images obtained based on n frames of first images collected by a camera, the viewfinder screen includes a snapshot shutter, and the n frames of first images are stored in a first buffer queue; stopping recording a video; saving the video; when the camera collects a qth frame of first image in the n frames of first images, receiving a third operation performed by the user on the snapshot shutter; and performing image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image.

## Claims

### Claim 1

A method for capturing an image during video recording, applied to an electronic device, wherein the electronic device comprises a camera, and the method comprises:
receiving, by the electronic device, a first operation of a user, wherein the first operation is used to trigger the electronic device to start recording a video;
displaying, by the electronic device, a viewfinder screen in response to the first operation, wherein the viewfinder screen displays a preview image stream, the preview image stream comprises n frames of preview images, the preview images are obtained based on n frames of first images collected by the camera of the electronic device after the electronic device receives the first operation, the viewfinder screen further comprises a snapshot shutter, the snapshot shutter is configured to trigger the electronic device to take a snapshot, the n frames of first images are stored in a first buffer queue of the electronic device, n≥1, and n is an integer;
receiving, by the electronic device, a second operation of the user;
stopping, by the electronic device, recording the video in response to the second operation:
saving, by the electronic device, the video;
when the camera collects a qth frame of first image in the n frames of first images, receiving a third operation performed by the user on the snapshot shutter; and
performing, by the electronic device in response to the third operation, image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the performing image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image comprises:
performing, by the electronic device, image processing on an m frames of first images to obtain the captured image, wherein the m frames of first images comprise the qth frame of first image, m≥1, and m is an integer;
wherein, the image processing comprises image processing in a RAW domain and ISP image processing, the image processing in the RAW domain is image processing performed in RAW color space, the ISP image processing is image processing performed by using an ISP of the electronic device, and image quality of the captured image is better than image quality of the qth frame of first image; or
the image processing comprises the image processing in the RAW domain, the ISP image processing, and encoding processing, and the image quality of the captured image is better than the image quality of the qth frame of first image.

### Claim 3

(canceled)

### Claim 4 (depends on 2)

The method according to claim 2, wherein the performing, by the electronic device, image processing on the m frames of first images to obtain the captured image comprises:
running, by the electronic device, a preset-raw RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image, wherein the preset RAW domain image processing algorithm has a function of improving the image quality, and the preset RAW domain image processing algorithm integrates image processing functions in at least one of the RAW domain, an RGB domain, or a YUV domain, to improve the image quality before an ISP performs the image processing; and
processing, by the electronic device, the second image by using the ISP, and encoding a processed image to obtain the captured image.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the running, by the electronic device, a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running, by the electronic device, the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in the Bayer format, wherein the preset RAW domain image processing algorithm integrates some of the image processing functions in at least one of the RAW domain, the RGB domain, or the YUV domain, to improve the image quality before the ISP performs the image processing; and
the processing, by the electronic device, the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
sequentially performing, by the electronic device, the image processing in the RAW domain, the image processing in the RGB domain, and the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the running, by the electronic device, a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running, by the electronic device, the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in an RGB format, wherein the preset RAW domain image processing algorithm integrates the image processing functions in the RAW domain, to improve the image quality before the ISP performs the image processing in the RGB domain and the image processing in the YUV domain on the image; and
the processing, by the electronic device, the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
sequentially performing, by the electronic device, the image processing in the RGB domain and the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 7

(canceled)

### Claim 8 (depends on 4)

The method according to claim 4, wherein the running, by the electronic device, a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running, by the electronic device, the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in a YUV format, wherein the preset RAW domain image processing algorithm integrates the image processing functions in the RAW domain and the image processing functions in the RGB domain, to improve the image quality before the ISP performs image processing in the YUV domain on the image; and
the processing, by the electronic device, the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
performing, by the electronic device, the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 9

(canceled)

### Claim 10 (depends on 2)

The method according to claim 2, wherein the method further comprises:
processing, by the electronic device, the first image and the second image by using the ISP in a time division multiplexing manner.

### Claim at position 11

-17. (canceled)

### Claim 18 (depends on 1)

The method according to claim 1, wherein the method further comprises:
periodically performing, by the electronic device, image processing on k frames of first images buffered in the first buffer queue to obtain a second image, wherein k≥1, and k is an integer;
wherein the performing, by the electronic device in response to the third operation, image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image comprises:
performing, by the electronic device in response to the third operation, image quality enhancement on a fourth image by using a latest frame of second image obtained when the electronic device receives the third operation, to obtain a captured image, wherein the fourth image is one frame of image in the video whose time information is the same as time information of the qth frame of first image;
wherein the image quality enhancement comprises image super-resolution; and
resolution of the second image and the captured image is higher than resolution of the qth frame of first image.

### Claim 19 (depends on 18)

The method according to claim 18, wherein the periodically performing, by the electronic device, image processing on k frames of first images buffered in the first buffer queue to obtain a second image comprises:
periodically running, by the electronic device, a preset RAW domain image processing algorithm by using the k frames of first images buffered in the first buffer queue as an input to obtain a third image, wherein the preset RAW domain image processing algorithm has a function of improving the image quality; and
processing, by the electronic device, the third image by using the ISP of the electronic device to obtain the second image.

### Claim 20

An electronic device, comprising a touchscreen, a memory, a camera, a display, and one or more processors, wherein the touchscreen, the memory, the camera, and the display are coupled to the processor, the memory stores computer program code, the computer program code comprises computer instructions, and when the computer instructions are executed by the processor, the electronic device is enabled to perform the following steps:
receiving a first operation of a user, wherein the first operation is used to trigger the electronic device to start recording a video;
displaying a viewfinder screen in response to the first operation, wherein the viewfinder screen displays a preview image stream, the preview image stream comprises n frames of preview images, the preview images are obtained based on n frames of first images collected by the camera of the electronic device after the electronic device receives the first operation, the viewfinder screen further comprises a snapshot shutter, the snapshot shutter is configured to trigger the electronic device to take a snapshot, the n frames of first images are stored in a first buffer queue of the electronic device, n≥1, and n is an integer;
receiving a second operation of the user;
stopping recording the video in response to the second operation:
saving the video;
when the camera collects a qth frame of first image in the n frames of first images, receiving a third operation performed by the user on the snapshot shutter; and
performing, in response to the third operation, image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image.

### Claim 21 (depends on 20)

The electronic device according to claim 20, wherein the performing image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image comprises:
performing image processing on an m frames of first images to obtain the captured image, wherein the m frames of first images comprise the qth frame of first image, m≥1, and m is an integer;
wherein, the image processing comprises image processing in a RAW domain and ISP image processing, the image processing in the RAW domain is image processing performed in RAW color space, the ISP image processing is image processing performed by using an ISP of the electronic device, and image quality of the captured image is better than image quality of the qth frame of first image; or
the image processing comprises the image processing in the RAW domain, the ISP image processing, and encoding processing, and the image quality of the captured image is better than the image quality of the qth frame of first image.

### Claim 22 (depends on 21)

The electronic device according to claim 21, wherein the performing image processing on the m frames of first images to obtain the captured image comprises:
running a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image, wherein the preset RAW domain image processing algorithm has a function of improving the image quality, and the preset RAW domain image processing algorithm integrates image processing functions in at least one of the RAW domain, an RGB domain, or a YUV domain, to improve the image quality before an ISP performs the image processing; and
processing the second image by using the ISP, and encoding a processed image to obtain the captured image.

### Claim 23 (depends on 22)

The electronic device according to claim 22, wherein the running a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in the Bayer format, wherein the preset RAW domain image processing algorithm integrates some of the image processing functions in at least one of the RAW domain, the RGB domain, or the YUV domain, to improve the image quality before the ISP performs the image processing; and
the processing the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
sequentially performing the image processing in the RAW domain, the image processing in the RGB domain, and the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 24 (depends on 22)

The electronic device according to claim 22, wherein the running a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in an RGB format, wherein the preset RAW domain image processing algorithm integrates the image processing functions in the RAW domain, to improve the image quality before the ISP performs the image processing in the RGB domain and the image processing in the YUV domain on the image; and
the processing the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
sequentially performing the image processing in the RGB domain and the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 25 (depends on 22)

The electronic device according to claim 22, wherein the running a preset RAW domain image processing algorithm by using the m frames of first images as an input to obtain a second image comprises:
running the preset RAW domain image processing algorithm by using the m frames of first images in a Bayer format as an input to obtain the second image in a YUV format, wherein the preset RAW domain image processing algorithm integrates the image processing functions in the RAW domain and the image processing functions in the RGB domain, to improve the image quality before the ISP performs image processing in the YUV domain on the image; and
the processing the second image by using the ISP, and encoding a processed image to obtain the captured image comprises:
performing the image processing in the YUV domain on the second image by using the ISP, and encoding the processed image to obtain the captured image.

### Claim 26 (depends on 21)

The electronic device according to claim 21, wherein the electronic device is enabled to further perform the following steps:
processing the first image and the second image by using the ISP in a time division multiplexing manner.

### Claim 27 (depends on 20)

The electronic device according to claim 20, wherein the electronic device is enabled to further perform the following steps:
periodically performing image processing on k frames of first images buffered in the first buffer queue to obtain a second image, wherein k≥1, and k is an integer;
wherein the performing, in response to the third operation, image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image comprises:
performing, in response to the third operation, image quality enhancement on a fourth image by using a latest frame of second image obtained when the electronic device receives the third operation, to obtain a captured image, wherein the fourth image is one frame of image in the video whose time information is the same as time information of the qth frame of first image.

### Claim 28 (depends on 27)

The electronic device according to claim 27, wherein the image quality enhancement comprises image super-resolution; and
resolution of the second image and the captured image is higher than resolution of the qth frame of first image.

### Claim 29 (depends on 27)

The electronic device according to claim 27, wherein the periodically performing image processing on k frames of first images buffered in the first buffer queue to obtain a second image comprises:
periodically running a preset RAW domain image processing algorithm by using the k frames of first images buffered in the first buffer queue as an input to obtain a third image, wherein the preset RAW domain image processing algorithm has a function of improving the image quality; and
processing the third image by using the ISP of the electronic device to obtain the second image.

### Claim 30

A computer-readable storage medium, comprising computer instructions, wherein when the computer instructions are run on an electronic device, the electronic device is enabled to perform the following steps:
receiving a first operation of a user, wherein the first operation is used to trigger the electronic device to start recording a video;
displaying a viewfinder screen in response to the first operation, wherein the viewfinder screen displays a preview image stream, the preview image stream comprises n frames of preview images, the preview images are obtained based on n frames of first images collected by the camera of the electronic device after the electronic device receives the first operation, the viewfinder screen further comprises a snapshot shutter, the snapshot shutter is configured to trigger the electronic device to take a snapshot, the n frames of first images are stored in a first buffer queue of the electronic device, n≥1, and n is an integer;
receiving a second operation of the user;
stopping recording the video in response to the second operation;
saving the video;
when the camera collects a qth frame of first image in the n frames of first images, receiving a third operation performed by the user on the snapshot shutter; and
performing, in response to the third operation, image processing on the qth frame of first image saved in the first buffer queue to obtain a captured image.
