System, portable terminal device, server, program, and method for viewing confirmation

A portable terminal device used to confirm that a user of the portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted places, the portable terminal device including a portable-terminal control unit, a portable-terminal communication unit, an image capturing unit, a portable-terminal storage unit, and a position-information obtaining unit, the portable terminal device being characterized in that the portable-terminal control unit:

• obtains portable-terminal position information by using the position-information obtaining unit;
• compares an image of a space captured by the image capturing unit with a reference-posted-material image stored in the portable-terminal storage unit, the reference-posted-material image being an image of posted material, thereby determining whether or not the posted material in the reference-posted-material image is captured within a predetermined area in the image of the captured space;
• captures a viewed image, which is an image of a space including the posted material captured within the area as well as a peripheral portion of the posted material, if it is determined that the posted material is captured within the area;
• generates, by comparing the image of the posted material in the viewed image with the reference-posted-material image for the posted material, normalization information for normalizing the viewed image with reference to the reference-posted-material image;
• and
• sends a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information to a server by using the portable-terminal communication unit.

A server used to confirm that a user of a portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted places, wherein the portable terminal device sends a viewing confirmation request including a viewed image, normalization information, and portable-terminal position information, the viewed image includes an image of posted material posted in a predetermined place as well as a peripheral portion thereof, the normalization information is information for normalizing the viewed image, the portable-terminal position information is information indicating the position of the portable terminal device, the server including a server control unit, a server communication unit, and a server storage unit that stores authenticated images about the posted material in the individual posted places in association with position information of the posted places, the server being characterized in that the server control unit:

• receives a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information by using the server communication unit;
• determines whether or not the viewed image included in the viewing confirmation request has been tampered with;
• determines the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image has been tampered with;
• generates a normalized image obtained by normalizing the viewed image on the basis of the normalization information in the case where it is determined that the viewed image has not been tampered with;
• selects one or more authenticated images corresponding to the viewed image from among the authenticated images stored in the server storage unit, on the basis of the portable-terminal position information and the position information associated with the authenticated images;
• compares the normalized image with the one or more selected authenticated images to compute similarities between the normalized image and the authenticated images;
• determines whether or not the viewed image is valid on the basis of the similarities,
• determines the viewing by the user as valid viewing in the case where it is determined that the viewed image is valid, and
• determines the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image is not valid.

A non-transitory computer-readable medium storing a program used to confirm that a user of a portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted places, the program causing the portable terminal device, including a portable-terminal communication unit, an image capturing unit, a portable-terminal storage unit, and a position-information obtaining unit, to:

• obtain portable-terminal position information by using the position-information obtaining unit;
• compare an image of a space captured by the image capturing unit with a reference-posted-material image stored in the portable-terminal storage unit, the reference-posted-material image being an image of posted material, thereby determining whether or not the posted material in the reference-posted-material image is captured within a predetermined area in the image of the captured space;
• capture a viewed image, which is an image of a space including the posted material captured within the area as well as a peripheral portion of the posted material, if it is determined that the posted material is captured within the area;
• generate, by comparing the image of the posted material in the viewed image with the reference-posted-material image for the posted material, normalization information for normalizing the viewed image with reference to the reference-posted-material image;
• and
• send a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information to a server by using the portable-terminal communication unit.

A non-transitory computer-readable medium storing a program used to confirm that a user of a portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted, places, wherein the portable terminal device sends a viewing confirmation request including a viewed image, normalization information, and portable-terminal position information, the viewed image includes an image of posted material posted in a predetermined place as well as a peripheral portion thereof, the normalization information is information for normalizing the viewed image, the portable-terminal position information is information indicating the position of the portable terminal device, and the program causing a server, including a server communication unit and a server storage unit that stores authenticated images about the posted material in the individual posted places in association with position information of the posted places, to:

• receive a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information by using the server communication unit;
• determine whether or not the viewed image included in the viewing confirmation request has been tampered with;
• determine the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image has been tampered with;
• generate a normalized image obtained by normalizing the viewed image on the basis of the normalization information in the case where it is determined that the viewed image has not been tampered with;
• select one or more authenticated images corresponding to the viewed image from among the authenticated images stored in the server storage unit, on the basis of the portable-terminal position information and the position information associated with the authenticated images;
• compare the normalized image with, the one or more selected authenticated images to compute similarities between the normalized image and the authenticated images;
• determine whether or not the viewed image is valid on the basis of the similarities;
• determine the viewing by the user as valid viewing in the case where it is determined that the viewed image is valid;
• and
• determine the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image is not valid.

A method used to confirm that a user of a portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted places, the method being executed by the portable terminal device, including a portable-terminal communication unit, an image capturing unit, a portable-terminal storage unit, and a position-information obtaining unit, the method comprising:

• obtaining portable-terminal position information by using the position-information obtaining unit;
• comparing an image of a space captured by the image capturing unit with a reference-posted-material image stored in the portable-terminal storage unit, the reference-posted-material image being an image of posted material, thereby determining whether or not the posted material in the reference-posted-material image is captured within a predetermined area in the image of the captured space;
• capturing a viewed image, which is an image of a space including the posted material captured within the area as well as a peripheral portion of the posted material, if it is determined that the posted material is captured within the area;
• generating, by comparing the image of the posted material in the viewed image with the reference-posted-material image for the posted material, normalization information for normalizing the viewed image with reference to the reference-posted-material image;
• and
• sending a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information to a server by using the portable-terminal communication unit.

A method used to confirm that a user of a portable terminal device has viewed posted material posted in a plurality of places by visiting one of the posted places, the method being executed by a server, wherein the portable terminal device sends a viewing confirmation request including a viewed image, normalization information, and position information of the posted material included in the viewed image, the position information being based on portable-terminal position information, the viewed image includes an image of posted material posted in a predetermined place as well as a peripheral portion thereof, the normalization information is information for normalizing the viewed image, the portable-terminal position information is information indicating the position of the portable terminal device, and the server includes a server communication unit and a server storage unit that stores authenticated images about the posted material in the individual posted places in association with position information of the posted places, the method comprising:

• receiving a viewing confirmation request including the viewed image, the normalization information, and the portable-terminal position information by using the server communication unit;
• determining whether or not the viewed image included in the viewing confirmation request has been tampered with;
• determining the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image has been tampered with;
• generating a normalized image obtained by normalizing the viewed image on the basis of the normalization information in the case where it is determined that the viewed image has not been tampered with;
• selecting one or more authenticated images corresponding to the viewed image from among the authenticated images stored in the server storage unit, on the basis of the portable-terminal position information and the position information associated with the authenticated images;
• comparing the normalized image with the one or more selected authenticated images to compute similarities between the normalized image and the authenticated images;
• determining whether or not the viewed image is valid on the basis of the similarities;
• determining the viewing by the user as valid viewing in the case where it is determined that the viewed image is valid;
• and
• determining the viewing by the user as illegitimate viewing in the case where it is determined that the viewed image is not valid.