Method and system for registering images containing anatomical structures

A device for registration between a first three-dimensional image acquired according to a first acquisition mode, and comprising anatomical structures of a patient, and a second two-dimensional image, acquired according to a second acquisition mode by an image acquisition device mounted on a scoping arch movable in rotation and in translation, the second image comprising a portion of the anatomical structures of said patient, the registration implementing a rigid spatial transformation defined by rotation and translation parameters,

• the device including a processor configured to implement:
• automatic detection of the anatomical structures in the two-dimensional image by application of a first detection neural network trained on a generic database,
• estimation, from the anatomical structures automatically detected in said second two-dimensional image, by application of at least one classification neural network trained beforehand on a generic database, of the rotation and translation parameters of said rigid spatial transformation, said estimation including:
• a first estimation, from said anatomical structures automatically detected in said second two-dimensional image, by application of said at least one classification neural network, of a first angle of rotation and of a second angle of rotation of said rigid spatial transformation, characterizing the position of the scoping arch, and
• a second estimation of translational parameters, of a third angle of rotation and of a zoom factor of said rigid spatial transformation, the second estimation using a result of the first estimation, and
• 3D/2D iconic registration between the first three-dimensional image and the second two-dimensional image starting from an initialization with said rigid spatial transformation.

A system for registration between a first three-dimensional image acquired according to a first acquisition mode, and comprising anatomical structures of a patient, and a second two-dimensional image, acquired according to a second acquisition mode, the system comprising:

• an image acquisition device mounted on a scoping arch movable in rotation and in translation, configured to acquire the second two-dimensional image, the second two-dimensional image comprising a portion of the anatomical structures of said patient, and
• a device for registration between the first three-dimensional image and the second two-dimensional image, the registration implementing a rigid spatial transformation defined by rotation and translation parameters, the device including a processor configured to implement:
• automatic detection of the anatomical structures in the two-dimensional image by application of a first detection neural network trained on a generic database,
• estimation, from the anatomical structures automatically detected in said second two-dimensional image, by application of at least one classification neural network trained beforehand on a generic database, of the rotation and translation parameters of said rigid spatial transformation, said estimation including:
• a first estimation, from said anatomical structures automatically detected in said second two-dimensional image, by application of said at least one classification neural network, of a first angle of rotation and of a second angle of rotation of said rigid spatial transformation, characterizing the position of the scoping arch, and
• a second estimation of translational parameters, of a third angle of rotation and of a zoom factor of said rigid spatial transformation, the second estimation using a result of the first estimation, and
• 3D/2D iconic registration between the first three-dimensional image and the second two-dimensional image starting from an initialization with said rigid spatial transformation.