Method, server, and computer program for performing registration between multiple images of different dimensions
Assignee3D Ons, Inc.
InventorJu Heon Seok
Life of this patent
Estimating the term…
Abstract
Provided is a method of performing registration between a plurality of images of different dimensions. The method may be performed by one or more processors of a computing device, and may include primarily positioning a three-dimensional (3D) image by identifying a first landmark in the 3D image, generating a registration image by registration between the primarily positioned 3D image and a two-dimensional (2D) image, and secondarily positioning the registration image.
Claims7
A method of performing registration between a plurality of images of different dimensions by one or more processors of a computing device, the method comprising:
- primarily positioning a three-dimensional (3D) image in a 3D space having x-axis, y-axis, and z-axis, by identifying a first landmark in the 3D image;
- generating a registration image by registration between the primarily positioned 3D image and a two-dimensional (2D) image;
- and
- secondarily positioning the registration image,
- wherein the first landmark comprises a first landmark (A), a first landmark (B), a first landmark (C), and a first landmark (D),
- wherein the first landmark (A) and the first landmark (B) are related to left and right sides of a face,
- wherein the first landmark (C) and the first landmark (D) are related to front and rear sides of the face,
- wherein the primarily positioning of the 3D image comprises:
- performing y-axis rotation about the first landmark (C) to match a z-coordinate of the first landmark (A) with a z-coordinate of the first landmark (B);
- and
- performing z-axis rotation about the first landmark (C) to match a y-coordinate of the first landmark (A) with a y-coordinate of the first landmark (B),
- wherein the generating of the registration image comprises:
- matching directions of a head and the face in the 3D image with those of the head and the face in the 2D image;
- converting a size of the 2D image on the basis of the first landmark in the 3D image and a second landmark in the 2D image;
- and
- overlapping the 3D image and the 2D image by moving the size-converted 2D image on the basis of coordinates of the first landmark in the 3D image,
- wherein the second landmark comprises a second landmark (A) and a second landmark (B) related to the front and rear sides of the face, and
- wherein the overlapping of the 3D image and the 2D image comprises:
- moving the size-converted 2D image to match coordinates of the second landmark (A) with the coordinates of the first landmark (C);
- and
- overlapping the 2D image with the 3D image so that a second straight line connecting the second landmark (A) and the second landmark (B) in the 2D image is connected and aligned with a first straight line connecting the first landmark (C) and the first landmark (D) in the 3D image,
- wherein the converting of the size of the 2D image comprises:
- identifying the first straight line connecting the first landmark (C) and the first landmark (D) in the 3D image;
- identifying the second straight line connecting the second landmark (A) and the second landmark (B) in the 2D image;
- and
- obtaining a size conversion ratio on the basis of the first straight line and the second straight line, and converting the size of the 2D image on the basis of the obtained size conversion ratio.
A method of performing registration between a plurality of images of different dimensions by one or more processors of a computing device, the method comprising:
- primarily positioning a three-dimensional (3D) image in a 3D space having x-axis, y-axis, and z-axis, by identifying a first landmark in the 3D image;
- generating a registration image by registration between the primarily positioned 3D image and a two-dimensional (2D) image;
- and
- secondarily positioning the registration image,
- wherein the first landmark comprises a first landmark (A), a first landmark (B), a first landmark (C), and a first landmark (D),
- wherein the first landmark (A) and the first landmark (B) are related to left and right sides of a face,
- wherein the first landmark (C) and the first landmark (D) are related to front and rear sides of the face,
- wherein the primarily positioning of the 3D image comprises:
- performing y-axis rotation about the first landmark (C) to match a z-coordinate of the first landmark (A) with a z-coordinate of the first landmark (B);
- and
- performing z-axis rotation about the first landmark (C) to match a y-coordinate of the first landmark (A) with a y-coordinate of the first landmark (B),
- wherein the generating of the registration image comprises:
- matching directions of a head and the face in the 3D image with those of the head and the face in the 2D image;
- converting a size of the 2D image on the basis of the first landmark in the 3D image and a second landmark in the 2D image;
- and
- overlapping the 3D image and the 2D image by moving the size-converted 2D image on the basis of coordinates of the first landmark in the 3D image,
- wherein the second landmark comprises a second landmark (A) and a second landmark (B) related to the front and rear sides of the face, and
- wherein the overlapping of the 3D image and the 2D image comprises:
- moving the size-converted 2D image to match coordinates of the second landmark (A) with the coordinates of the first landmark (C);
- and
- overlapping the 2D image with the 3D image so that a second straight line connecting the second landmark (A) and the second landmark (B) in the 2D image is connected and aligned with a first straight line connecting the first landmark (C) and the first landmark (D) in the 3D image,
- wherein the secondarily positioning of the registration image comprises secondarily positioning the registration image on the basis of a third landmark in the registration image,
- wherein the third landmark comprises a third landmark (A) related to an orbitale, a third landmark (B) related to a porion, and a third landmark (C) related to a nasion, and
- wherein the secondarily positioning of the registration image further comprises:
- performing rotation about the x-axis to cause a first line connecting the third landmark (A) and the third landmark (B) to be parallel with the y-axis;
- and
- performing parallel translation of the registration image to cause the third landmark (C) in the rotated registration image to be an origin.
Dependencies are inferred from the claim text.