Image processing apparatus, method and system

An image processing apparatus comprising:

• tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image;
• displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said tree-structure data memory means;
• receiving means for receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to said image processing apparatus;
• changing means for changing the tree-structure data stored in said tree-structure data memory means, based on the indication information received by said receiving means;
• and
• re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said changing means.

An image processing method which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, said method comprising:

• a displaying step of displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means;
• a processing step of processing at least one of the shape data and the light space data both displayed;
• a changing step of changing the tree-structure data stored in the tree-structure data memory means, based on the processing content in said processing step;
• a re-displaying step of re-displaying the virtual three-dimensional space, based on the data changing content in said changing step;
• an indication information generating step of generating indication information indicating the changing content of the tree-structure data, based on the processing content in said processing step;
• and
• a transmitting step of transmitting the indication information generated in said indication information generating step to an another information processing apparatus connected to the image processing apparatus.

An image processing method which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, said method comprising:

• a displaying step of displaying a virtual three- dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means;
• a receiving step of receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to the image processing apparatus;
• a changing step of changing the tree-structure data stored in the tree-structure data memory means, based on the indication information received in said receiving step;
• and
• a re-displaying step of re-displaying the virtual three-dimensional space, based on the data changing content in said changing step.

A computer-readable memory medium which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, and which stores a computer program including:

• a displaying module for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means;
• a processing module for processing at least one of the shape data and the light space data both displayed;
• a changing module for changing the tree-structure data stored in the tree-structure data memory means, based on the processing content;
• a re-displaying module for re-displaying the virtual three-dimensional space, based on the data changing content;
• an indication information generating module for generating indication information indicating the changing content of the tree-structure data, based on the processing content;
• and
• a transmitting module for transmitting the generated indication information to an another information processing apparatus connected to the image processing apparatus.

A computer-readable memory medium which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, and which stores a computer program including:

• a displaying module for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means;
• a receiving module for receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to the image processing apparatus;
• a changing module for changing the tree-structure data stored in the tree-structure data memory means, based on the received indication information;
• and
• a re-displaying module for re-displaying the virtual three-dimensional space, based on the data changing content.

An image processing system in which a first terminal equipment is connected to a second terminal equipment through a server, comprising:

• said first terminal equipment further comprising,
• first tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image,
• first displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said first tree-structure data memory means,
• processing means for processing at least one of the shape data and the light space data both displayed,
• first changing means for changing the tree-structure data stored in said first tree-structure data memory means, based on the processing content by said processing means,
• first re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said first changing means,
• indication information generating means for generating indication information indicating the changing content of the tree-structure data, based on the processing content by said processing means, and
• first transmitting means for transmitting the indication information generated by said indication information generating means to said server connected to said first terminal equipment;
• said server further comprising,
• first receiving means for receiving the indication information transmitted from said first terminal equipment, and
• second transmitting means for transmitting the indication information received by said first receiving means to said second terminal equipment;
• and
• said second terminal equipment further comprising,
• second tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image,
• second displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said second tree-structure data memory means,
• second receiving means for receiving the indication information indicating the changing content of the tree-structure data, transmitted from said server connected to said second terminal equipment,
• second changing means for changing the tree-structure data stored in said second tree-structure data memory means, based on the indication information received by said second receiving means, and
• second re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said second changing means.

An image processing system in which a first terminal equipment and a second terminal equipment are connected to each other, comprising:

• said first terminal equipment further comprising,
• first tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image,
• first displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said first tree-structure data memory means,
• processing means for processing at least one of the shape data and the light space data both displayed,
• first changing means for changing the tree-structure data stored in said first tree-structure data memory means, based on the processing content by said processing means,
• first re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said first changing means,
• indication information generating means for generating indication information indicating the changing content of the tree-structure data, based on the processing content by said processing means, and
• transmitting means for transmitting the indication information generated by said indication information generating means to said second terminal equipment connected to said first terminal equipment;
• and
• said second terminal equipment further comprising,
• second tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image,
• second displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said second tree-structure data memory means,
• receiving means for receiving the indication information indicating the changing content of the tree-structure data, transmitted from said first terminal equipment connected to said second terminal equipment,
• second changing means for changing the tree-structure data stored in said second tree-structure data memory means, based on the indication information received by said receiving means, and
• second re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said second changing means.