# US 10,504,252 B2 · Method of, and apparatus for, registration and segmentation of medical imaging data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,252 B2 - Document ID: US10504252B2 - Status: Granted - Kind: B2 - Application number: 14/569,890 - Filed: 2014-12-15 - Published: 2016-06-16 - Granted: 2019-12-10 - Earliest claimed: 2014-12-15 - Assignees: Canon Medical Systems Corporation - Applicants: Toshiba Medical Systems Corporation - Inventors: Marco Razeto; Akinola Akinyemi; Chris McGough; Tyler Stroud - Web page: https://patentgrep.com/patent/US10504252B2 ## CPC - G06T 11/20: Drawing from basic elements - G06T 3/14: Transformations for image registration, e.g. adjusting or mapping for alignment of images - G06T 7/12: Edge-based segmentation - G06T 7/149: involving deformable models, e.g. active contour models - G06T 7/33: using feature-based methods - G06T 11/23: using straight lines or curves - A61B 6/032: {Transmission computed tomography [CT]} - A61B 6/037: {Emission tomography} - A61B 6/4085: {Cone-beams} - G06T 2207/10072: Tomographic images - G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform - G06T 2207/20128: Atlas-based segmentation - G06T 2207/30008: Bone - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract An imaging data processing apparatus comprises a registration unit configured to obtain a hierarchical registration between a reference data set and volumetric medical imaging data, the reference data set comprising a plurality of anatomical structures, wherein the hierarchical registration comprises an initial registration and at least one further registration, and the at least one further registration is obtained by the registration unit by modifying the initial registration, and a segmentation unit for segmenting at least part of the volumetric medical imaging data in dependence on the hierarchical registration. The initial registration comprises a registration between at least part of the reference data set and at least part of the volumetric medical imaging data, the at least part of the reference data set comprising a first anatomical structure or first group of anatomical structures. The at least one further registration comprises a registration between a subset of the reference data set and at least part of the volumetric medical imaging data, the subset of the reference data set comprising a second, different anatomical structure or second, different group of anatomical structures. ## Claims ### Claim 1 An imaging data processing apparatus, comprising: processing circuitry configured to obtain a hierarchical registration between a reference data set and volumetric medical imaging data, the reference data set comprising a plurality of anatomical structures, wherein the obtaining of the hierarchical registration comprises selecting, in the reference data set, a first anatomical structure or group of anatomical structures and a second, different anatomical structure or group of anatomical structures, wherein the first anatomical structure or group of anatomical structures is larger and/or more static than the second anatomical structure or group of anatomical structures; performing a first registration to obtain a first rigid or affine transformation between a first subset of the reference data set comprising the first anatomical structure or group of anatomical structures and at least a first part of the volumetric medical imaging data; segmenting the first anatomical structure or group of anatomical structures in the volumetric medical imaging data in dependence on the first registration; performing a second registration to obtain a second rigid or affine transformation between a second subset of the reference data set comprising the second anatomical structure or group of anatomical structures and at least a second part of the volumetric medical imaging data, wherein the second rigid or affine transformation is obtained by refining the first rigid or affine transformation; and segmenting the second anatomical structure or group of structures in the volumetric medical imaging data in dependence on the second registration, such that the first anatomical structure or group of anatomical structure and the second anatomical structure or group of structures are segmented in the volumetric medical Imaging data using different, successive registrations. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the hierarchical registration comprises a series of successive registrations including the first and second registrations, each successive registration comprising a modification of the initial registration or of a preceding one of the successive registrations. ### Claim 3 (depends on 2) The apparatus according to claim 2, wherein each of the successive registrations is performed with respect to a different subset of the reference data set. ### Claim 4 (depends on 2) The apparatus according to claim 2, wherein the plurality of anatomical structures comprises a plurality of wrist bones, the first registration is performed first and comprises a registration of at least one of a radius and an ulna, and the series of successive registrations comprises a registration of a group of metacarpal bones and carpal bones, and a registration of at least one carpal bone performed by modifying the registration of the group of metacarpal bones and carpal bones. ### Claim 5 (depends on 1) The apparatus according to claim 1, wherein the hierarchical registration comprises a plurality of individual registrations, each of the individual registrations comprising a registration of a respective anatomical structure or group of anatomical structures. ### Claim 6 (depends on 5) The apparatus according to claim 5, wherein the segmenting of the volumetric medical imaging data in dependence on the hierarchical registration comprises segmenting each anatomical structure or group of structures in the volumetric medical imaging data in dependence on the individual registration of that anatomical structure or group of anatomical structures. ### Claim 7 (depends on 5) The apparatus according to claim 5, wherein the processing circuitry is further configured to align each said anatomical structure or group of anatomical structures to the reference data set in dependence on the individual registration of that anatomical structure or group of anatomical structures. ### Claim 8 (depends on 1) The apparatus according to claim 1, wherein the plurality of anatomical structures comprises bones of a joint. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the hierarchical registration comprises a series of successive registrations including the first and second registrations, wherein the successive registrations are performed with respect to successively smaller bones or groups of bones. ### Claim 10 (depends on 1) The apparatus according to claim 1, wherein the first anatomical structure or group of anatomical structures is neighboring to the second anatomical structure or group of anatomical structures. ### Claim 11 (depends on 1) The apparatus according to claim 1, wherein the volumetric medical imaging data comprises a plurality of medical imaging data sets obtained from scans of a joint, each corresponding to a different position of the joint. ### Claim 12 (depends on 11) The apparatus according to claim 11, wherein the obtaining of the hierarchical registration by the processing circuitry comprises performing a respective hierarchical registration between the reference data set and each of the plurality of medical imaging data sets. ### Claim 13 (depends on 11) The apparatus according to claim 11, wherein the obtaining of the hierarchical registration by the processing circuitry comprises performing a hierarchical registration between the reference data set and a selected one of the plurality of medical imaging data sets, and wherein the processing circuitry is further configured to register each other one of the medical imaging data sets to the selected medical imaging data set. ### Claim 14 (depends on 13) The apparatus according to claim 13, wherein the processing circuitry is further configured to select the selected medical imaging data set by registering each of the plurality of medical imaging data sets to the reference data sets, determining a registration measure for each registration, and selecting the one of the plurality of data sets having the smallest registration measure. ### Claim 15 (depends on 11) The apparatus according to claim 11, wherein the segmenting of the volumetric medical imaging data by the processing circuitry comprises segmenting a selected at least one anatomical structure in each of the medical imaging data sets; wherein the processing circuitry is further configured to align the medical imaging data sets such that a position of the selected at least one anatomical structure is substantially constant in the aligned medical imaging data sets; and wherein the processing circuitry is configured to render a series of images from the aligned medical imaging data sets, thereby obtaining a series of images in which other anatomical structures appear to move relative to the selected at least one anatomical structure, which appears to remain substantially static. ### Claim 16 (depends on 1) The apparatus according to claim 1, wherein the processing circuitry is further configured to render an image from the segmented first anatomical structure or group of anatomical structures and the second anatomical structure of group of anatomical structures, the rendered image comprising a least one of an exploded view, a disarticulated view, a standard anatomical view, a neutral phase view, an image which comprises a labeled representation of at least some of the plurality of anatomical structures, and an image from which at least one of the plurality of anatomical structures has been omitted. ### Claim 17 (depends on 1) The apparatus according to claim 1, wherein the first anatomical structure or group of anatomical structure is larger than the second anatomical structure or group of anatomical structures. ### Claim 18 (depends on 1) The apparatus according to claim 1, wherein the first group of anatomical structures and the second group of anatomical structures have common members, or the second group is a sub-group of the first group. ### Claim 19 (depends on 1) The apparatus according to claim 1, wherein the reference data set comprises an atlas in which each of the plurality of anatomical structures is individually identified. ### Claim 20 (depends on 1) The image processing apparatus according to claim 1, wherein the volumetric medical imaging data comprises at least one of CT data, MR data, PET data, SPECT data, cone beam CT data, and rotational X-ray data. ### Claim 21 An imaging data processing method, comprising: obtaining a hierarchical registration between a reference data set and volumetric medical imaging data, the reference data set comprising a plurality of anatomical structures, wherein the obtaining of the hierarchical registration comprises selecting, in the reference data set, a first anatomical structure or group of anatomical structures and a second, different anatomical structure or group of anatomical structures, wherein the first anatomical structure or group of anatomical structures is larger and/or more static than the second anatomical structure or group of anatomical structures; performing a first registration to obtain a first rigid or affine transformation between a first subset of the reference data set comprising the first anatomical structure or group of anatomical structures and at least a first part of the volumetric medical imaging data; segmenting the first anatomical structure or group of anatomical structures in the volumetric medical imaging data in dependence on the first registration; performing a second registration to obtain a second rigid or affine transformation between a second subset of the reference data set comprising the second anatomical structure or group of anatomical structures and at least a second part of the volumetric medical imaging data, wherein the second rigid or affine transformation is obtained by refining the first rigid or affine transformation; and segmenting the second anatomical structure or group of structures in the volumetric medical imaging data in dependence on the second registration, such that the first anatomical structure or group of anatomical structure and the second anatomical structure or group of structures are segmented in the volumetric medical Imaging data using different, successive registrations. ### Claim 22 A non-transitory computer-readable storage medium storing a computer program comprising computer-readable instructions that are executable to perform a method comprising: obtaining a hierarchical registration between a reference data set and volumetric medical imaging data, the reference data set comprising a plurality of anatomical structures, wherein the obtaining of the hierarchical registration comprises selecting, in the reference data set, a first anatomical structure or group of anatomical structures and a second, different anatomical structure or group of anatomical structures, wherein the first anatomical structure or group of anatomical structures is larger and/or more static than the second anatomical structure or group of anatomical structures; performing a first registration to obtain a first rigid or affine transformation between a first subset of the reference data set comprising the first anatomical structure or group of anatomical structures and at least a first part of the volumetric medical imaging data; segmenting the first anatomical structure or group of anatomical structures in the volumetric medical imaging data in dependence on the first registration; performing a second registration to obtain a second rigid or affine transformation between a second subset of the reference data set comprising the second anatomical structure or group of anatomical structures and at least a second part of the volumetric medical imaging data, wherein the second rigid or affine transformation is obtained by refining the first rigid or affine transformation; and segmenting the second anatomical structure or group of structures in the volumetric medical imaging data in dependence on the second registration, such that the first anatomical structure or group of anatomical structure and the second anatomical structure or group of structures are segmented in the volumetric medical Imaging data using different, successive registrations.