# US 2021/0241020 A1 · Method and device for processing image, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0241020 A1 - Document ID: US20210241020A1 - Status: Published application - Kind: A1 - Application number: 17/236,051 - Filed: 2021-04-21 - Published: 2021-08-05 - Earliest claimed: 2019-12-25 - Assignees: Beijing Sensetime Technology Development Co., Ltd. - Applicants: Beijing Sense Time Technology Development Co., Ltd. - Inventors: Tong LI; Wentao LIU; Chen QIAN - Web page: https://patentgrep.com/patent/US20210241020A1 ## CPC - G06T 7/13: Edge detection - G06T 3/18: Image warping, e.g. rearranging pixels individually - G06T 7/155: involving morphological operators - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06T 2207/20084: Artificial neural networks [ANN] - G06T 2207/30196: Human being; Person - G06T 2207/30201: Face - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A morphing part to be morphed and a morphing effect are acquired. Human body contour point information is acquired by detecting a human contour point of a human sideway image. A morphing region is determined according to the human contour point information and the morphing part. The morphing region is an image region to be morphed in the human sideway image. A human orientation is determined according to the human contour point information. A morphing direction of the morphing region is determined according to the human orientation and the morphing effect. Morphing is performed along the morphing direction in the morphing region. ## Claims ### Claim 1 A method for processing an image, comprising: acquiring a morphing part to be morphed in a human and a morphing effect; acquiring human contour point information by detecting a human contour point of a human sideway image; determining a morphing region according to the human contour point information and the morphing part, the morphing region being an image region to be morphed in the human sideway image; determining a human orientation according to the human contour point information; determining a morphing direction of the morphing region according to the human orientation and the morphing effect; and performing morphing along the morphing direction in the morphing region. ### Claim 2 (depends on 1) The method of claim 1, wherein determining the human orientation according to the human contour point information comprises: determining the human orientation according to human contour point information associated with the morphing part in the human contour point information. ### Claim 3 (depends on 1) The method of claim 1, wherein the morphing part is a chest, wherein determining the morphing region according to the human contour point information and the morphing part comprises: determining a first rectangular region comprising the chest according to chest contour point information in the human contour point information; and determining, according to the first rectangular region, the morphing region on which chest morphing is performed. ### Claim 4 (depends on 3) The method of claim 3, wherein determining, according to the first rectangular region, the morphing region on which chest morphing is performed comprises: determining a midpoint of a rectangle side of the first rectangular region near the human orientation, and determining a first distance between the midpoint and a center point of the first rectangular region; and determining a round region in the human sideway image as the morphing region on which chest morphing is performed, the round region being enclosed by a circle with the midpoint as a center and with a radius equaling the first distance. ### Claim 5 (depends on 4) The method of claim 4, wherein a morphing arc is formed by connecting pixels in the round region that are at equal distances to the center point of the first rectangular region, wherein the morphing arc comprises a first morphing arc and a second morphing arc, wherein an average of morphing amplitudes of pixels on the first morphing arc is greater than an average of morphing amplitudes of pixels on the second morphing arc, wherein a distance between the first morphing arc and the center of the round region is less than a distance between the second morphing arc and the center of the round region, and/or wherein pixels in the round region comprise a first pixel and a second pixel, wherein a morphing amplitude of the first pixel is greater than a morphing amplitude of the second pixel, wherein a distance between the first pixel and the center of the round region is less than a distance between the second pixel and the center of the round region. ### Claim 6 (depends on 1) The method of claim 1, wherein the morphing part is a hip, wherein determining the morphing region according to the human contour point information and the morphing part comprises: determining a second rectangular region comprising the hip and an abdomen according to hip contour point information and abdomen contour point information in the human contour point information, the second rectangular region being the morphing region. ### Claim 7 (depends on 6) The method of claim 6, wherein performing morphing along the morphing direction in the morphing region comprises: dividing, based on a central axis of the second rectangular region, the second rectangular region into a first sub-region comprising the hip and a second sub-region comprising the abdomen; performing mesh morphing on the first sub-region along the morphing direction according to a first morphing amplitude; and performing mesh morphing on the second sub-region along the morphing direction according to a second morphing amplitude, the second morphing amplitude being greater than the first morphing amplitude. ### Claim 8 (depends on 1) The method of claim 1, further comprising: determining a morphing amplitude of the morphing region according to the morphing effect, wherein performing morphing along the morphing direction in the morphing region comprises: performing morphing along the morphing direction in the morphing region according to the morphing amplitude. ### Claim 9 (depends on 1) The method of claim 1, further comprising: predicting a weight status factor of the human according to the human contour point information; determining a morphing amplitude level according to the weight status factor; and determining a morphing amplitude of the morphing part based on the morphing amplitude level and a morphing amplitude input, wherein performing morphing along the morphing direction in the morphing region comprises: performing morphing on the morphing region along the morphing direction according to the morphing amplitude. ### Claim 10 (depends on 9) The method of claim 9, wherein predicting the weight status factor of the human according to the human contour point information comprises: determining at least one first-type distance according to contour point information of at least one part in the human contour point information, the contour point information of the at least one part comprising at least one of shoulder contour point information, waist contour point information, crotch contour point information, and leg contour point information; determining at least one second-type distance according to shoulder contour point location information to crotch contour point location information in the human contour point information; and determining the weight status factor according to the at least one first-type distance and the at least one second-type distance. ### Claim 11 (depends on 10) The method of claim 10, wherein determining the weight status factor according to the at least one first-type distance and the at least one second-type distance comprises: determining a ratio of each of the at least one first-type distance to each of the at least one second-type distance; and determining the weight status factor based on a weighted average of each of the ratio as determined. ### Claim 12 (depends on 10) The method of claim 10, wherein determining the at least one second-type distance according to the shoulder contour point location information to the crotch contour point location information in the human contour point information comprises at least one of: determining one second-type distance according to left shoulder contour point location information to left crotch contour point location information in the human contour point information; determining one second-type distance according to right shoulder contour point location information to right crotch contour point location information in the human contour point information; and determining shoulder center point location information according to the left shoulder contour point location information and the right shoulder contour point location information in the human contour point information, determining crotch center point location information according to the left crotch contour point location information and the right crotch contour point location information, and determining one second-type distance according to the shoulder center point location information and the crotch center point location information. ### Claim 13 (depends on 1) The method of claim 1, wherein performing morphing along the morphing direction in the morphing region comprises performing mesh morphing on the morphing region by: dividing the morphing region into a third sub-region and a fourth sub-region, the third sub-region being a connected region with same morphing amplitudes, the fourth sub-region being a region in the morphing region other than the third sub-region; performing mesh morphing of same morphing amplitudes on the third sub-region; and performing mesh morphing of different morphing amplitudes on the fourth sub-region according to a morphing curve. ### Claim 14 (depends on 13) The method of claim 13, wherein the third sub-region is a region with a maximum morphing amplitude. ### Claim 15 (depends on 13) The method of claim 13, wherein the morphing curve is a cosine curve or a spline curve. ### Claim 16 A device for processing an image, comprising memory and a processor connected to the memory, wherein the memory is configured for storing computer-executable instructions, wherein the processor is configured for: acquiring a morphing part to be morphed in a human and a morphing effect; acquiring human contour point information by detecting a human contour point of a human sideway image; determining a morphing region according to the human contour point information and the morphing part, the morphing region being an image region to be morphed in the human sideway image; determining a human orientation according to the human contour point information; determining a morphing direction of the morphing region according to the human orientation and the morphing effect; and performing morphing along the morphing direction in the morphing region. ### Claim 17 (depends on 16) The device of claim 16, wherein the processor is configured for determining the human orientation according to the human contour point information by: determining the human orientation according to human contour point information associated with the morphing part in the human contour point information. ### Claim 18 (depends on 16) The device of claim 16, wherein the morphing part is a chest, wherein the processor is configured for determining the morphing region according to the human contour point information and the morphing part by: determining a first rectangular region comprising the chest according to chest contour point information in the human contour point information; and determining, according to the first rectangular region, the morphing region on which chest morphing is performed. ### Claim 19 (depends on 16) The device of claim 16, wherein the morphing part is a hip, wherein the processor is configured for determining the morphing region according to the human contour point information and the morphing part by: determining a second rectangular region comprising the hip and an abdomen according to hip contour point information and abdomen contour point information in the human contour point information, the second rectangular region being the morphing region. ### Claim 20 A non-transitory computer storage medium, having stored thereon computer-executable instructions which, when executed by a processor, implement: acquiring a morphing part to be morphed in a human and a morphing effect; acquiring human contour point information by detecting a human contour point of a human sideway image; determining a morphing region according to the human contour point information and the morphing part, the morphing region being an image region to be morphed in the human sideway image; determining a human orientation according to the human contour point information; determining a morphing direction of the morphing region according to the human orientation and the morphing effect; and performing morphing along the morphing direction in the morphing region.