US 9,001,152 B2 · Information processing apparatus, information processing method, and program

Abstract

An information processing apparatus including an imaged image input unit inputting an imaged image of a facility imaged in an imaging device to a display control unit, a measurement information input unit inputting measurement information measured by a sensor provided in the facility from the sensor to a creation unit, a creation unit creating a virtual image representing a status of an outside or inside of the facility based on the measurement information input by the measurement information input unit, and a display control unit overlaying and displaying the virtual image created in the creation unit and the imaged image input by the imaged image input unit on a display device.

Claims17

Dependent claims

An information providing apparatus having a display unit and connected communicably to a storage unit, the information providing apparatus comprising:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination unit determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the information providing apparatus which is defined in advance;
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input unit inputting a video imaged in an imaging device,
wherein the display control unit calculates conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space by analyzing the video input by the input unit, calculates range coordinates corresponding to the dangerous range information based on coordinates of the dangerous target position information in the coordinate system of the real space, and applies the conversion information to the calculated range coordinates to generate the dangerous range image.

6 more elements

An information providing apparatus having a display unit and connected communicably to a storage unit, the information providing apparatus comprising:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination unit determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the information providing apparatus which is defined in advance;
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input unit inputting a video imaged in an imaging device,
wherein the display control unit calculates conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space by analyzing the video input by the input unit, determines coordinates of a marker indicating a reference position added to the determined dangerous target in the coordinate system of the real space, calculates range coordinates corresponding to the dangerous range information originating at the determined coordinates, and applies the conversion information to the calculated range coordinates to generate the dangerous range image.

6 more elements

An information providing apparatus having a display unit and connected communicably to a storage unit, the information providing apparatus comprising:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination unit determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the information providing apparatus which is defined in advance;
and
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein the reading unit further reads movement schedule information indicating a schedule of the dangerous target to move, which is stored in the storage unit, and
when the display control unit determines that the dangerous target does not exist in the visual field, if the display control unit determines that the dangerous target is approaching the information providing apparatus based on the movement schedule information read in the reading unit, and the apparatus position information and a current time, the display control unit generates an image notifying of a danger due to the dangerous target and displays the image on the display unit.

5 more elements

An information providing apparatus having a display unit and connected communicably to a storage unit, the information providing apparatus comprising:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination unit determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the information providing apparatus which is defined in advance;
and
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein the display control unit generates the dangerous range image and displays the image on the display unit when a distance to the dangerous target is equal to or less than a predetermined threshold.

4 more elements

An information providing method executed by an information providing apparatus having a display unit and connected communicably to a storage unit, the information providing method comprising:

a reading step of reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining step of obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining step of obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining step of obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination step of determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining step, the direction information obtained in the direction information obtaining step, the posture information obtained in the posture information obtaining step, and visual field information of the information providing apparatus which is defined in advance;
a display control step of determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading step, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input step of inputting a video imaged in an imaging device,
wherein, in the display control step, conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space is calculated by analyzing the video input in the input step, range coordinates corresponding to the dangerous range information is calculated based on coordinates of the dangerous target position information in the coordinate system of the real space, and the conversion information is applied to the calculated range coordinates to generate the dangerous range image.

6 more elements

An information providing method executed by an information providing apparatus having a display unit and connected communicably to a storage unit, the information providing method comprising:

a reading step of reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining step of obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining step of obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining step of obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination step of determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining step, the direction information obtained in the direction information obtaining step, the posture information obtained in the posture information obtaining step, and visual field information of the information providing apparatus which is defined in advance;
a display control step of determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading step, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input step of inputting a video imaged in an imaging device,
wherein, in the display control step, conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space is calculated by analyzing the video input by the input unit, coordinates of a marker indicating a reference position added to the determined dangerous target in the coordinate system of the real space is determined, range coordinates corresponding to the dangerous range information originating at the determined coordinates is calculated, and the conversion information is applied to the calculated range coordinates to generate the dangerous range image.

6 more elements

An information providing method executed by an information providing apparatus having a display unit and connected communicably to a storage unit, the information providing method comprising:

a reading step of reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining step of obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining step of obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining step of obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination step of determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining step, the direction information obtained in the direction information obtaining step, the posture information obtained in the posture information obtaining step, and visual field information of the information providing apparatus which is defined in advance;
and
a display control step of determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading step, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein, in the reading step, movement schedule information indicating a schedule of the dangerous target to move, which is stored in the storage unit, is further read, and
in the display control step, when it is determined that the dangerous target does not exist in the visual field, if it is determined that the dangerous target is approaching the information providing apparatus based on the movement schedule information read in the reading step, and the apparatus position information and a current time, an image notifying of a danger due to the dangerous target is generated and displayed on the display unit.

5 more elements

An information providing method executed by an information providing apparatus having a display unit and connected communicably to a storage unit, the information providing method comprising:

a reading step of reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining step of obtaining apparatus position information calculated from information indicating a position of the information providing apparatus which is detected in a position detection device;
a direction information obtaining step of obtaining direction information calculated from information indicating a direction of the information providing apparatus which is detected in a direction detection device;
a posture information obtaining step of obtaining posture information calculated from information indicating a posture of the information providing apparatus which is detected in a posture detection device;
a determination step of determining a visual field of the information providing apparatus based on the apparatus position information obtained in the position information obtaining step, the direction information obtained in the direction information obtaining step, the posture information obtained in the posture information obtaining step, and visual field information of the information providing apparatus which is defined in advance;
and
a display control step of determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading step, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein, in the display control step, the dangerous range image is generated and displayed on the display unit when a distance to the dangerous target is equal to or less than a predetermined threshold.

4 more elements

A program causing a computer having a display unit and connected communicably to a storage unit to function as:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the computer which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the computer which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the computer which is detected in a posture detection device;
a determination unit determining a visual field of the computer based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the computer which is defined in advance;
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input unit inputting a video imaged in an imaging device,
wherein the display control unit calculates conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space by analyzing the video input by the input unit, calculates range coordinates corresponding to the dangerous range information based on coordinates of the dangerous target position information in the coordinate system of the real space, and applies the conversion information to the calculated range coordinates to generate the dangerous range image.

6 more elements

A program causing a computer having a display unit and connected communicably to a storage unit to function as:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the computer which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the computer which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the computer which is detected in a posture detection device;
a determination unit determining a visual field of the computer based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the computer which is defined in advance;
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit;
and
an input unit inputting a video imaged in an imaging device,
wherein the display control unit calculates conversion information correlating a conversion between a coordinate system of a real space and a coordinate system of a display space by analyzing the video input by the input unit, determines coordinates of a marker indicating a reference position added to the determined dangerous target in the coordinate system of the real space, calculates range coordinates corresponding to the dangerous range information originating at the determined coordinates, and applies the conversion information to the calculated range coordinates to generate the dangerous range image.

6 more elements

A program causing a computer having a display unit and connected communicably to a storage unit to function as:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the computer which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the computer which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the computer which is detected in a posture detection device;
a determination unit determining a visual field of the computer based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the computer which is defined in advance;
and
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein the reading unit further reads movement schedule information indicating a schedule of the dangerous target to move, which is stored in the storage unit, and
when the display control unit determines that the dangerous target does not exist in the visual field, if the display control unit determines that the dangerous target is approaching the information providing apparatus based on the movement schedule information read in the reading unit, and the apparatus position information and a current time, the display control unit generates an image notifying a danger due to the dangerous target and displays the image on the display unit.

5 more elements

A program causing a computer having a display unit and connected communicably to a storage unit to function as:

a reading unit reading dangerous range information indicating a dangerous range of each state of a dangerous target having a changing operating state, wherein the dangerous range changes depending on the operating state of the dangerous target, and dangerous target position information indicating a position of the dangerous target, which are stored in the storage unit;
a position information obtaining unit obtaining apparatus position information calculated from information indicating a position of the computer which is detected in a position detection device;
a direction information obtaining unit obtaining direction information calculated from information indicating a direction of the computer which is detected in a direction detection device;
a posture information obtaining unit obtaining posture information calculated from information indicating a posture of the computer which is detected in a posture detection device;
a determination unit determining a visual field of the computer based on the apparatus position information obtained in the position information obtaining unit, the direction information obtained in the direction information obtaining unit, the posture information obtained in the posture information obtaining unit, and visual field information of the computer which is defined in advance;
and
a display control unit determining a dangerous target included in the visual field based on the apparatus position information, the direction information, the posture information, and the dangerous range information and the dangerous target position information which are read in the reading unit, and generating a dangerous range image for the determined dangerous target and displaying the image on the display unit, wherein the display control unit generates the dangerous range image and displays the image on the display unit when a distance to the dangerous target is equal to or less than a predetermined threshold.

4 more elements

Dependencies are inferred from the claim text.

Information processing apparatus, information processing method, and program

Life of this patent

Information processing apparatus, information processing method, and program

Life of this patent

Abstract

Claims17