Function extension device, function extension method, computer-readable recording medium, and integrated circuit

A function extension method of incorporating a body in a real space into an extended real space, and setting a function to the body,

• the method comprising:
• an object recognition step of a function extension device recognizing, from real-space video data acquired by a video input device, a body included in the video data, and recognizing a type of recognized body and a position of the recognized body in the real space;
• a function setting step of a function extension device retaining function information in which is prescribed a function configured from a pair of operation and processing that can be set for each type of body, and referring to the function information when a body is recognized in the object recognition step, and then setting a function to the recognized body based on the type of recognized body;
• an input recognition step of a function extension device recognizing an input operation that has been performed by a user in the real space and an input position in the real space where the input operation has been performed;
• a selection determination step of a function extension device determining a selected body that has been selected by the user as the body to be operated, based on the position of the body in the real space recognized by the object recognition step and the input position in the real position recognized in the input recognition step;
• an operation determination step of a function extension device determining the operation of the user by using the input operation recognized in the input recognition step;
• a processing determination step of a function extension device determining the processing for the operation that has been determined in the operation determination step among the operations configuring the function set in the function setting unit to the selected body selected by the selection determination step;
• and
• an execution step of a function extension device executing the processing determined in the processing determination step.

A computer-readable recording medium which stores a function extension program for causing a computer to function as a function extension device for incorporating a body in a real space into an extended real space, and setting a function to the body,

• the program causing the computer to function as:
• an object recognition unit which recognizes, from real-space video data acquired by a video input device, a body included in the video data, and recognizes a type of recognized body and a position of the recognized body in the real space;
• a function setting unit which retains function information in which is prescribed a function configured from a pair of operation and processing that can be set for each type of body, refers to the function information when a body is recognized by the object recognition unit, and sets a function to the recognized body based on the type of recognized body;
• an input recognition unit which recognizes an input operation performed by a user in the real space and an input position in the real space where the input operation has been performed;
• a selection determination unit which determines a selected body selected by the user as the body to be operated, based on the position of the body in the real space recognized by the object recognition unit and the input position in the real position recognized by the input recognition unit;
• an operation determination unit which determines the operation of the user by using the input operation recognized by the input recognition unit;
• a processing determination unit which determines the processing for the operation determined by the operation determination unit among the operations configuring the function set by the function setting unit to the selected body selected by the selection determination unit;
• and
• an execution unit which executes the processing determined by the processing determination unit.

An integrated circuit of a function extension device for incorporating a body in a real space into an extended real space, and setting a function to the body,

• the integrated circuit comprising:
• an object recognition unit which recognizes, from real-space video data acquired by a video input device, a body included in the video data, and recognizes a type of recognized body and a position of the recognized body in the real space;
• a function setting unit which retains function information in which is prescribed a function configured from a pair of operation and processing that can be set for each type of body, refers to the function information when a body is recognized by the object recognition unit, and sets a function to the recognized body based on the type of recognized body;
• an input recognition unit which recognizes an input operation performed by a user in the real space and an input position in the real space where the input operation has been performed;
• a selection determination unit which determines a selected body selected by the user as the body to be operated, based on the position of the body in the real space recognized by the object recognition unit and the input position in the real position recognized by the input recognition unit;
• an operation determination unit which determines the operation of the user by using the input operation recognized by the input recognition unit;
• a processing determination unit which determines the processing for the operation determined by the operation determination unit among the operations configuring the function set by the function setting unit to the selected body selected by the selection determination unit;
• and
• an execution unit which executes the processing determined by the processing determination unit.