# US 12,015,848 B2 · Electronic device performing image stabilization and operating method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,848 B2 - Document ID: US12015848B2 - Status: Granted - Kind: B2 - Application number: 18/075,750 - Filed: 2022-12-06 - Published: 2023-03-30 - Granted: 2024-06-18 - Earliest claimed: 2021-08-10 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Wonseok Song; Kyungdong Yang; Jaemu Yun; Jiyeon Jo; Songha Choi - Web page: https://patentgrep.com/patent/US12015848B2 ## CPC - H04N 23/683: {performed by a processor, e.g. controlling the readout of an image memory} - H04N 1/2112: {using still video cameras} - H04N 23/6812: {based on additional sensors, e.g. acceleration sensors} - H04N 23/684: {performed by controlling the image sensor readout, e.g. by controlling the integration time} - H04N 23/71: Circuitry for evaluating the brightness variation - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An electronic device of an embodiment of the present document may include a camera including a lens assembly, at least one sensor configured to detect a movement of the camera or the lens assembly, and a processor electrically connected to the camera and the at least one sensor. The processor may determine an exposure value that will be applied when photographing using the camera, obtain image frames, based on the exposure value, obtain movement information on the camera or the lens assembly by using the at least one sensor while the image frames are being obtained, determine an image stabilization strength, based on the exposure value and the movement information, and perform video digital image stabilization (VDIS) for the image frames, based on the image stabilization strength. ## Claims ### Claim 1 An electronic device comprising: a camera comprising a lens assembly; at least one sensor configured to detect a movement of the camera or the lens assembly; a processor; and memory storing one or more instructions that, when executed by the processor, cause the electronic device to: determine an exposure value that will be applied when photographing using the camera, obtain image frames, based on the exposure value, obtain movement information on the camera or the lens assembly by using the at least one sensor while the image frames are being obtained, predict a blur degree, based on the exposure value and the movement information, determine an image stabilization strength, based on the predicted blur degree, and perform video digital image stabilization (VDIS) for the image frames, based on the image stabilization strength. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the movement information comprises: information on a shake of the camera, and information on a shake of the lens assembly dependent on execution of optical image stabilization (OIS). ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the one or more instructions, when executed by the processor, further cause the electronic device to: determine a first weight for the exposure value, determine a second weight for the movement information of the camera, determine a first blur degree, based on the first weight and the second weight, determine a third weight for the movement information of the lens assembly, and predict the blur degree, based on the first blur degree and the third weight. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the one or more instructions, when executed by the processor, further cause the electronic device to: determine the image stabilization strength to be lower as the predicted blur degree increases, and determine the image stabilization strength to be higher as the predicted blur degree decreases. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the predicted blur degree comprises at least one of an amount of blur, a size of blur, and a probability of provision of blur. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the one or more instructions, when executed by the processor, further cause the electronic device to cyclically perform the obtaining of the movement information, the determining of the predicted blur degree, and the determining of the image stabilization strength. ### Claim 7 (depends on 1) The electronic device of claim 1, further comprising: at least one or more cameras, wherein the one or more instructions, when executed by the processor, further cause the electronic device to: detect an event of switching a main camera from the camera to the at least one or more cameras while performing VDIS, in response to detecting the event, identify a parameter difference between the camera and the at least one or more cameras, obtain the image frames, based on the parameter difference, obtain movement information on the at least one or more cameras while obtaining the image frames, predict a second blur degree, based on the parameter difference and the movement information, determine a second image stabilization strength, based on the predicted second blur degree, and perform a second VDIS for the image frames, based on the second image stabilization strength. ### Claim 8 (depends on 7) The electronic device of claim 7, wherein the event is at least one of: a touch input, a voice input, or a physical input. ### Claim 9 (depends on 7) The electronic device of claim 7, wherein the movement information comprises movement information on at least one lens assembly comprised in the at least one or more cameras. ### Claim 10 (depends on 7) The electronic device of claim 7, wherein the parameter difference is a parameter difference related to at least one of: a field of view (FOV), an image sensor, optical image stabilization (OIS), a focal distance, auto focus (AF), or a zoom operation. ### Claim 11 (depends on 7) The electronic device of claim 7, wherein, in response to the event, the processor maintains or changes the exposure value. ### Claim 12 (depends on 1) The electronic device of claim 1, wherein the one or more instructions, when executed by the processor, further cause the electronic device to: provide a stabilization path by using the movement information of the camera or the corresponding lens assembly, and determine the image stabilization strength, based on the stabilization path. ### Claim 13 (depends on 1) The electronic device of claim 1, wherein the at least one sensor is a gyro sensor. ### Claim 14 (depends on 1) The electronic device of claim 1, wherein a movement of the electronic device is interlocked according to a movement of the camera. ### Claim 15 An electronic device comprising: a first camera comprising a first lens assembly; a second camera comprising a second lens assembly; at least one sensor for detecting a movement of the first camera, the second camera, the first lens assembly, or the second lens assembly; a processor electrically connected to the first camera, the second camera, and the at least one sensors; and memory storing one or more instructions that, when executed by the processor, cause the electronic device to: perform a first video digital image stabilization (VDIS), based on the first camera, p2 detect an event of switching a main camera from the first camera to the second camera while performing the first VDIS, identify a parameter difference between the first camera and the second camera, obtain image frames, based on the parameter difference, obtain movement information on the second camera or the second lens assembly while obtaining the image frames, predict a blur degree, based on the parameter difference and the movement information, determine an image stabilization strength, based on the predicted blur degree, and perform a second VDIS for the image frames, based on the image stabilization strength. ### Claim 16 (depends on 15) The electronic device of claim 15, wherein the event is at least one of: a touch input, a voice input, or a physical input. ### Claim 17 (depends on 15) The electronic device of claim 15, wherein the parameter difference is a parameter difference related to at least one of: a field of view (FOV), an image sensor, optical image stabilization (OIS), a focal distance, auto focus (AF), or a zoom operation. ### Claim 18 (depends on 15) The electronic device of claim 15, wherein the sensor is a gyro sensor. ### Claim 19 (depends on 18) The electronic device of claim 18, wherein the one or more instructions, when executed by the processor, further cause the electronic device to: determine the image stabilization strength to be lower as the predicted blur degree increases, and determine the image stabilization strength to be higher as the predicted blur degree decreases.