Information processing apparatus and information processing method

An information processing apparatus comprising:

• a data storing unit configured to store data, indicating a shape of an object to be measured, for estimating a position-and-orientation of the object;
• a first image input unit configured to input a first image captured by an imaging apparatus at a first time, wherein a position of the imaging apparatus is fixed;
• an approximate position-and-orientation obtaining unit configured to obtain, as a first position-and-orientation of the object, an approximate position-and-orientation of the object, when the first image is captured by the imaging apparatus;
• a second image input unit configured to input a second image captured by the imaging apparatus at a second time being different from the first time;
• an acquisition unit configured to acquire relative position-and-orientation information between the first position-and-orientation of the object and a second position-and-orientation of the object, wherein the second position-and-orientation of the object is a position and orientation of the object when the second image is captured;
• an association unit configured to associate the data indicating the shape of the object with the object included in the first image based on the first position-and-orientation of the object and a position-and-orientation of the imaging apparatus, and associate the data indicating the shape of the object with the object included in the second image based on the second position-and-orientation of the object and the position-and-orientation of the imaging apparatus;
• and
• a calculation unit configured to calculate, based on a result of the association unit, a position-and-orientation of the object,
• wherein the first image input unit, the approximate position-and-orientation obtaining unit, the second image input unit, the acquisition unit, the association unit, and the calculation unit are implemented by at least one processor in the information processing apparatus.

An information processing method comprising:

• storing data, indicating a shape of an object to be measured, for estimating a position-and-orientation of the object;
• obtaining an approximate position-and-orientation of the object;
• inputting a first image including the object, captured by a movable imaging apparatus at a first time;
• obtaining a first position-and-orientation of the movable imaging apparatus when the first image is captured;
• inputting a second image captured by the movable imaging apparatus at a second time being different from the first time;
• acquiring relative position-and-orientation information between the first position-and-orientation and a second position-and-orientation, wherein the second position-and-orientation is a position-and-orientation of the movable imaging apparatus when the second image is captured;
• obtaining the second position-and-orientation of the movable imaging apparatus based on the first position-and-orientation and the relative position-and-orientation information;
• associating the data indicating the shape of the object with the object included in the first image based on the first position-and-orientation of the movable imaging apparatus and the approximate position-and-orientation of the object and associate the data indicating the shape of the object with the object included in the second image based on the second position-and-orientation of the movable imaging apparatus and the approximate position-and-orientation of the object;
• and
• calculating a position-and-orientation of the object, based on a result of the associating.

An information processing method comprising:

• storing data, indicating a shape of an object to be measured, for estimating a position-and-orientation of the object;
• inputting a first image captured by an imaging apparatus at a first time, wherein a position of the imaging apparatus is fixed;
• obtaining, as a first position-and-orientation of the object, an approximate position-and-orientation of the object, when the first image is captured by the imaging apparatus;
• inputting a second image captured by the imaging apparatus at a second time being different from the first time;
• acquiring relative position-and-orientation information between the first position-and-orientation and a second position-and-orientation of the object, wherein the second position-and-orientation of the object is a position and orientation of the object when the second image is captured;
• associating the data indicating the shape of the object with the object included in the first image based on the first position-and-orientation of the object and a position-and-orientation of the imaging apparatus and associate the data indicating the shape of the object with the object included in the second image based on the second position-and-orientation of the object and the position-and-orientation of the imaging apparatus;
• and
• calculating, based on the associating, a position-and-orientation of the object.

A non-transitory computer-readable storage medium storing a program for causing a computer to execute an information processing method comprising:

• storing data, indicating a shape of an object to be measured, for estimating a position-and-orientation of the object;
• obtaining an approximate position-and-orientation of the object;
• inputting a first image including the object, captured by a movable imaging apparatus at a first time;
• obtaining a first position-and-orientation of the movable imaging apparatus when the first image is captured;
• inputting a second image captured by the movable imaging apparatus at a second time being different from the first time;
• acquiring relative position-and-orientation information in the first position-and-orientation and a second position-and-orientation;
• obtaining the second position-and-orientation of the movable imaging apparatus based on the first position-and-orientation and the relative position-and-orientation information;
• associating the data indicating the shape of the object with the object included in the first image based on the first position-and-orientation of the movable imaging apparatus and the approximate position-and-orientation of the object, and associating the data indicating the shape of the object with the object included in the second image based on the second position-and-orientation of the movable imaging apparatus and the approximate position-and-orientation of the object;
• and
• calculating a position-and-orientation of the object, based on a result of the associating.

A non-transitory computer-readable storage medium storing a program for causing a computer to execute an information processing method comprising:

• storing data, indicating a shape of an object to be measured, for estimating a position-and-orientation of the object;
• inputting a first image captured by an imaging apparatus at a first time, wherein a position of the imaging apparatus is fixed;
• obtaining, as a first position-and-orientation of the object, an approximate position-and-orientation of the object, when the first image is captured by the imaging apparatus;
• inputting a second image captured by the imaging apparatus at a second time being different from the first time;
• acquiring relative position-and-orientation information between the first position-and-orientation and a second position-and-orientation of the object, wherein the second position-and-orientation of the object is a position and orientation of the object when the second image is captured;
• associating the data indicating the shape of the object with the object included in the first image based on the first position-and-orientation of the object and a position-and-orientation of the imaging apparatus and associate the data indicating the shape of the object with the object included in the second image based on the second position-and-orientation of the object and the position-and-orientation of the imaging apparatus;
• and
• calculating, based on the associating, a position-and-orientation of the object.

An information processing apparatus comprising:

• a model data obtaining unit configured to obtain model data of an object to be measured and to be held by a holding unit, wherein the model data includes a first feature of the object and a second feature of the object, wherein the second feature is different from the first feature;
• a first image input unit configured to input a first image obtained by a first imaging apparatus at a first time;
• a first obtaining unit configured to obtain a first approximate relative position and orientation information between the first imaging apparatus and the object at a first time;
• a second image input unit configured to input a second image obtained by a second imaging apparatus at a second time being different from the first time, wherein the second image includes information different from the first image;
• a second obtaining unit configured to obtain a second approximate relative position and orientation between the second imaging apparatus and the object based on the first approximate relative position and orientation and information by a controller of a robot arm;
• an association unit configured to associate the first feature with a feature included in the first image based on the first approximate relative position and orientation information and associate the second feature with a feature included in the second image based on the second approximate relative position and orientation information;
• and
• a calculation unit configured to calculate a position and orientation of the object, based on a result of the association unit,
• wherein the model data obtaining unit, the two-dimensional image input unit, the first obtaining unit, the second image input unit, the second obtaining unit, the association unit, and the calculation unit are implemented by at least one processor in the information processing apparatus.