# US 9,519,964 B2 · System and method for generating three-dimensional images from two-dimensional bioluminescence images and visualizing tumor shapes and locations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,964 B2 - Document ID: US9519964B2 - Status: Granted - Kind: B2 - Application number: 13/545,672 - Filed: 2012-07-10 - Published: 2013-03-21 - Granted: 2016-12-13 - Earliest claimed: 2005-09-12 - Assignees: Rutgers, The State University of New Jersey - Applicants: Dimitris Metaxas; Debabrata Banerjee; Xiaolei Huang - Inventors: Dimitris Metaxas; Debabrata Banerjee; Xiaolei Huang - Web page: https://patentgrep.com/patent/US9519964B2 ## CPC - G06T 7/0012: {Biomedical image inspection} - G06T 7/593: from stereo images - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A system and methods for generating 3D images from 2D bioluminescent images and visualizing tumor locations are provided. A plurality of 2D bioluminescent images of a subject are acquired using any suitable bioluminescent imaging system. The 2D images are registered to align each image and to compensate for differences between adjacent images. After registration, corresponding features are identified between consecutive sets of 2D images. For each corresponding feature identified in each set of 2D images, an orthographic projection model is applied, such that rays are projected through each point in the feature. The intersection points of the rays are plotted in a 3D image space. All of the 2D images are processed in the same manner, such that a resulting 3D image of a tumor is generated. ## Claims ### Claim 1 A method for generating a three dimensional image from a plurality of two-dimensional bioluminescence images, comprising: acquiring a plurality of two-dimensional bioluminescence images using an imaging system; processing the plurality of two-dimensional bioluminescence images so that adjacent images are aligned with each other; identifying at least one feature common to each of the plurality of two-dimensional bioluminescence images; and applying an orthographic projection model to the at least one feature of each of the plurality of two-dimensional bioluminescence images to generate a three-dimensional image of the at least one feature. ### Claim 2 (depends on 1) The method of claim 1, wherein the step of acquiring the plurality of two-dimensional bioluminescence images comprises taking a first two-dimensional bioluminescence image of a subject at a first location using an imaging system. ### Claim 3 (depends on 2) The method of claim 2, further comprising rotating a subject at a predetermined angle and taking a second two-dimensional image of a subject. ### Claim 4 (depends on 1) The method of claim 1, wherein the step of applying the orthographic projection model to the at least one feature comprises identifying feature points in the plurality of two-dimensional bioluminescence images corresponding to the at least one feature. ### Claim 5 (depends on 4) The method of claim 4, further comprising projecting rays through the feature points. ### Claim 6 (depends on 5) The method of claim 5, further comprising plotting an intersection point of the rays in the three-dimensional image. ### Claim 7 (depends on 4) The method of claim 4, further comprising projecting visual hulls through the feature points. ### Claim 8 (depends on 7) The method of claim 7, further comprising plotting an intersection point of the visual hulls in the three-dimensional image. ### Claim 9 (depends on 1) The method of claim 1, further comprising registering the three-dimensional image with a reference image to visualize a location of the at least one feature. ### Claim 10 A system for generating a three-dimensional image from a plurality of two-dimensional bioluminescence images, comprising: an imaging system for acquiring a plurality of two-dimensional bioluminescence images; means for processing the plurality of two-dimensional bioluminescence images so that adjacent images are aligned with each other; means for identifying at least one feature common to each of the plurality of two-dimensional bioluminescence images; and an orthographic projection model applied to the at least one feature of each of the plurality of two-dimensional bioluminescence images to generate a three-dimensional image of the at least one feature. ### Claim 11 (depends on 10) The system of claim 10, wherein the imaging system acquires a first two-dimensional bioluminescence image of a subject at a first location. ### Claim 12 (depends on 11) The system of claim 11, wherein the imaging system rotates a subject at a predetermined angle and acquires a second two-dimensional bioluminescence image of a subject. ### Claim 13 (depends on 10) The system of claim 10, wherein the orthographic projection model identifies feature points in the plurality of two-dimensional bioluminescence images corresponding to the at least one feature. ### Claim 14 (depends on 13) The system of claim 13, wherein the orthographic projection model projects rays through the feature points. ### Claim 15 (depends on 14) The system of claim 14, wherein the orthographic projection model plots an intersection point of the rays in the three-dimensional image. ### Claim 16 (depends on 13) The system of claim 13, wherein the orthographic projection model projects visual hulls through the feature points. ### Claim 17 (depends on 16) The system of claim 16, wherein the orthographic projection model plots an intersection point of the visual hulls in the three-dimensional image. ### Claim 18 (depends on 10) The system of claim 10, further comprising means for registering the three dimensional image with a reference image to visualize a location of the at least one feature. ### Claim 19 A method for visualizing a three-dimensional tumor location, comprising: acquiring a plurality of two-dimensional bioluminescence images of a tumor using an imaging system; processing the plurality of two-dimensional bioluminescence images so that adjacent images are aligned with each other; identifying at least one feature common to each of the plurality of two-dimensional bioluminescence images; applying an orthographic projection model to the at least one feature of each of the plurality of two-dimensional bioluminescence images to generate a three-dimensional image of the tumor; and registering the three-dimensional image with a reference image to visualize a location of the tumor. ### Claim 20 (depends on 19) The method of claim 19, wherein the step of acquiring the plurality of two-dimensional bioluminescence images comprises taking a first two-dimensional bioluminescence image of a subject at a first location using an imaging system. ### Claim 21 (depends on 20) The method of claim 20, further comprising rotating a subject at a predetermined angle and taking a second two-dimensional bioluminescence image of a subject. ### Claim 22 (depends on 19) The method of claim 19, wherein the step of applying the orthographic projection model to the at least one feature comprises identifying feature points in the plurality of two-dimensional bioluminescence images corresponding to the at least one feature. ### Claim 23 (depends on 22) The method of claim 22, further comprising projecting rays through the feature points. ### Claim 24 (depends on 23) The method of claim 23, further comprising plotting an intersection point of the rays in the three-dimensional image. ### Claim 25 (depends on 22) The method of claim 22, further comprising projecting visual hulls through the feature points. ### Claim 26 (depends on 25) The method of claim 25, further comprising plotting an intersection point of the visual hulls in the three-dimensional image. ### Claim 27 (depends on 19) The method of claim 19, further comprising segmenting specific features of the plurality of two-dimensional bioluminescence images. ### Claim 28 A system for visualizing a three-dimensional tumor location, comprising: an imaging system for acquiring a plurality of two-dimensional bioluminescence images of a tumor; means for processing the plurality of two-dimensional bioluminescence images so that adjacent images are aligned with each other; means for identifying at least one feature common to each of the plurality of two-dimensional bioluminescence images; an orthographic projection model applied to the at least one feature of each of the plurality of two-dimensional bioluminescence images to generate a three-dimensional image of the tumor; and means for registering the three-dimensional image with a reference image to visualize a location of the tumor. ### Claim 29 (depends on 28) The system of claim 28, wherein the imaging system acquires a first two-dimensional bioluminescence image of a subject at a first location. ### Claim 30 (depends on 28) The system of claim 28, wherein the imaging system rotates a subject at a predetermined angle and acquires a second two-dimensional bioluminescence image of a subject. ### Claim 31 (depends on 28) The system of claim 28, wherein the orthographic projection model identifies feature points in the plurality of two-dimensional bioluminescence images corresponding to the at least one feature. ### Claim 32 (depends on 31) The system of claim 31, wherein the orthographic projection model projects rays through the feature points. ### Claim 33 (depends on 32) The system of claim 32, wherein the orthographic projection model plots an intersection point of the rays in the three-dimensional image. ### Claim 34 (depends on 31) The system of claim 31, wherein the orthographic projection model projects visual hulls through the feature points. ### Claim 35 (depends on 34) The system of claim 34, wherein the orthographic projection model plots an intersection point of the visual hulls in the three-dimensional image. ### Claim 36 (depends on 33) The system of claim 33, further comprising means for segmenting specific features of the plurality of two-dimensional bioluminescence images.