# US 2019/0318076 A1 · Augmented reality object providing method and server using image authentication

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318076 A1
- Document ID: US20190318076A1
- Status: Published application
- Kind: A1
- Application number: 16/343,173
- Filed: 2017-10-19
- Published: 2019-10-17
- Earliest claimed: 2016-10-19
- Assignees: Jong Yoon CHUN
- Inventors: Sol Jee CHUN; Youngwook KIM
- Web page: https://patentgrep.com/patent/US20190318076A1

## CPC

- H04L 67/131: Protocols for games, networked simulations or virtual reality
- G06F 16/444: {Spatial browsing, e.g. 2D maps, 3D or virtual spaces}
- G06F 21/36: by graphic or iconic representation
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/029: Location-based management or tracking services
- A63F 2300/8082: Virtual reality
- G06T 2200/24: involving graphical user interfaces [GUIs]
- H04M 2203/359: Augmented reality
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

The present invention relates to an augmented reality object providing method and server using image authentication and, more specifically, to an augmented reality object providing method and server using image authentication, wherein an augmented reality object is registered using a first real-world image captured by a first mobile terminal and an input message, and according to the registration of the augmented reality object, a notification message is transmitted to a second mobile terminal corresponding to recipient information, so as to allow a second user of the second mobile terminal to experience augmented reality by outputting the registered augmented reality object in a second real-world image captured by the second mobile terminal.

## Claims

### Claim 1

An augmented reality object providing method using image authentication, comprising:
a first mobile terminal information reception step in which an augmented reality object providing server receives, from a first mobile terminal, a captured first real-world image, first location information on a first location in which the first real-world image has been captured, user set image information selected in the first real-world image, an input message, and at least one recipient information;
an image setting step in which the augmented reality object providing server sets a user set image included in the first real-world image as a first image by using the user set image information;
an augmented reality object registration step in which the augmented reality object providing server registers the input message inputted by a first user of the first mobile terminal as an augmented reality object for the first image;
a notification message transmission step in which the augmented reality object providing server generates a notification message and transmits the notification message to a second mobile terminal corresponding to the recipient information;
a second mobile terminal information reception step in which the augmented reality object providing server receives, from the second mobile terminal, a captured second real-world image and second location information on a second location in which the second real-world image has been captured;
a user authentication step in which the augmented reality object providing server determines whether the second mobile terminal corresponds to the recipient information;
a location comparison step in which the augmented reality object providing server determines whether the first location information on the first location in which the first real-world image has been captured and the second location information on the second location in which the second real-world image has been captured are within a preset critical range;
an image comparison step in which the augmented reality object providing server determines whether a second image corresponding to the first image exists in the second real-world image; and
an augmented reality object transmission step in which, if it is determined that the second mobile terminal corresponds to the recipient information in the user authentication step, the first location information and the second location information are within the preset critical range in the location comparison step, and the second image corresponding to the first image exists in the image comparison step, the augmented reality object providing server transmits the augmented reality object corresponding to the first image to the second mobile terminal such that the augmented reality object is outputted in the second real-world image of the second mobile terminal.

### Claim 2 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the location comparison step, the first location information is included in attribution information of the first real-world image and the second location information is included in attribution information of the second real-world image.

### Claim 3 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the user set image information includes at least one of a name of the user set image, a location of the user set image, an outmost edge of the user set image, and the user set image.

### Claim 4 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the input message is data inputted to or stored in the first mobile terminal and includes at least one of text, image, animation, and sound (including voice).

### Claim 5 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the notification message transmission step, the notification message includes at least one of the first location information on the first location in which the first real-world image has been captured and the first image.

### Claim 6 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the first mobile terminal information reception step, the recipient information is recipient information included in at least one of applications installed in the first mobile terminal.

### Claim 7 (depends on 6)

The augmented reality object providing method using image authentication according to claim 6, wherein, in the notification message transmission step, the notification message is transmitted through an application server of an application corresponding to the recipient information.

### Claim 8 (depends on 1)

The augmented reality object providing method using image authentication according to claim 1, wherein, in the notification message transmission step, the augmented reality object providing server compares current location information received from the second mobile terminal with the first location information, and if a distance between the current location information and the first location information is within a critical region, the augmented reality object providing server transmits the generated notification message to the second mobile terminal.

### Claim 9

An augmented reality object providing server using image authentication, comprising:
a storage receives, from a first mobile terminal, a first real-world image, first location information on a first location in which the first real-world image has been captured, user set image information selected in the first real-world image, an input message, and at least one recipient information;
a controller that sets a user set image included in the first real-world image as a first image by using the user set image information, and registers the input message inputted by a first user of the first mobile terminal as an augmented reality object for the first image;
a notification message generator that generates a notification message;
a message transmitter that transmits the notification message to a second mobile terminal corresponding to the recipient information;
a user authenticator that determines whether the second mobile terminal corresponds to the recipient information if a captured second real-world image and second location information on a second location in which the second real-world image has been captured are received from the second mobile terminal;
a location comparator that determines whether the first location information and the second location information are within a preset critical range if the captured second real-world image and the second location information on the second location in which the second real-world image has been captured are received from the second mobile terminal; and
an image comparator that determines whether a second image corresponding to the first image exists in the second real-world image if the captured second real-world image and the second location information on the second location in which the second real-world image has been captured are received from the second mobile terminal; and
wherein, if the user authenticator determines that the second mobile terminal corresponds to the recipient information, the location comparator determines that the first location information and the second location information are within the preset critical range, and the image comparator determines that the second image corresponding to the first image exists, the message transmitter transmits the augmented reality object corresponding to the first image to the second mobile terminal such that the augmented reality object is outputted in the second real-world image of the second mobile terminal.

### Claim 10 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein the first location information is included in attribution information of the first real-world image and the second location information is included in attribution information of the second real-world image.

### Claim 11 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein the user set image information includes at least one of a name of the user set image, a location of the user set image, an outmost edge of the user set image, and the user set image.

### Claim 12 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein the input message is data inputted to or stored in the first mobile terminal and includes at least one of text, image, animation, and sound (including voice).

### Claim 13 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein the notification message includes at least one of the first location information on the first location in which the first real-world image has been captured and the first image.

### Claim 14 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein the recipient information is recipient information included in at least one of applications installed in the first mobile terminal.

### Claim 15 (depends on 14)

The augmented reality object providing server using image authentication according to claim 14, wherein the message transmitter transmits the notification message through an application server of an application corresponding to the recipient information.

### Claim 16 (depends on 9)

The augmented reality object providing server using image authentication according to claim 9, wherein, if the location comparator compares current location information received from the second mobile terminal with the first location information and determines that a distance between the current location information and the first location information is within a critical region, the message transmitter additionally transmits the notification message to the second mobile terminal.
