# US 2017/0286406 A1 · Method and computer readable recording medium for providing translation using image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0286406 A1
- Document ID: US20170286406A1
- Status: Published application
- Kind: A1
- Application number: 15/212,541
- Filed: 2016-07-18
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: Naver Corporation
- Applicants: Naver Corporation
- Inventors: Jun Seok Kim; Hyoung Gyu Lee; Joong Hwi Shin; Jae Song Lee
- Web page: https://patentgrep.com/patent/US20170286406A1

## CPC

- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06F 3/018: {Input/output arrangements for oriental characters}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04855: Interaction with scrollbars
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/54: Browsing; Visualisation therefor
- G06F 40/42: Data-driven translation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for providing an original sentence and a translation for the original sentence in a user terminal, includes: presenting, by the user terminal, a plurality of images to a user; verifying, by the user terminal, an image selected by the user among the plurality of images; obtaining, by the user terminal, an original sentence corresponding to the image selected by the user and a translation sentence for the image from a database; and providing, by the user terminal, the original sentence corresponding to the selected image and the translation for the original sentence together with the selected image.

## Claims

### Claim 1

A method for providing an original sentence and a translation for the original sentence in a user terminal, the method comprising:
presenting, by the user terminal, a plurality of images to a user;
verifying, by the user terminal, an image selected by the user among the plurality of images;
obtaining, by the user terminal, an original sentence corresponding to the image selected by the user and a translation for the original sentence from a database; and
providing, by the user terminal, the original sentence corresponding to the selected image and the translation for the original sentence together with the selected image.

### Claim 2 (depends on 1)

The method of claim 1, wherein in the presenting of the plurality of images, the user terminal adjusts and provides or recommends deployment of some or all of the plurality of images based on the information about the user.

### Claim 3 (depends on 2)

The method of claim 2, wherein in the presenting of the plurality of images, the user terminal adjusts and provides or recommends deployment of some or all of the plurality of images by using positional information of the user.

### Claim 4 (depends on 2)

The method of claim 2, wherein in the presenting of the plurality of images, the user terminal adjusts and provides or recommends deployment of some or all of the plurality of images based on the past image selection history of the user.

### Claim 5 (depends on 1)

The method of claim 1, wherein in the presenting of the plurality of images,
when the user positions a pointer indicating a specific region on a specific image on a screen of the user terminal, the user terminal presents a part or the entirety of an original sentence or a translation sentence corresponding to the specific image on the screen.

### Claim 6 (depends on 1)

The method of claim 1, wherein in the obtaining of the original sentence and the translation for the original sentence, the user terminal transmits information on the image selected by the user to the server and thereafter, receives from the server the original sentence corresponding to the selected image and the translation for the original sentence, which are obtained by searching the database.

### Claim 7 (depends on 1)

The method of claim 1, wherein the user terminal keeps a history of the user modifying the original sentence or the translation sentence in the past, and modifies and provides the original sentence corresponding to the selected image or the translation for the original sentence based on the history of the user modifying the original sentence or the translation sentence in the past.

### Claim 8 (depends on 1)

The method of claim 1, wherein the presenting of the image includes:
receiving, by the user terminal, a keyword input by the user; and
searching and presenting, by the user terminal, an image associated with the keyword.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
downloading and storing, by the user terminal, at least some data in the database from a server.

### Claim 10

A method for providing a translation, in which a server provides an original sentence and a translation for the original sentence, the method comprising:
receiving, by the server, information on an image selected by a user among a plurality of images presented in the user terminal from the user terminal;
obtaining, by the server, an original sentence corresponding to the image selected by the user and a translation for the original sentence from a database; and
transmitting, by the server, information on the original sentence corresponding to the image selected by the user and the translation for the original sentence to the user terminal.

### Claim 11

A computer readable recording medium having a program for providing an original sentence and a translation for the original sentence to execute the following steps:
presenting, by the user terminal, a plurality of images to a user;
verifying, by the user terminal, an image selected by the user among the plurality of images;
obtaining, by the user terminal, an original sentence corresponding to the image selected by the user and a translation for the original sentence from a database; and
providing, by the user terminal, the original sentence corresponding to the selected image and the translation for the original sentence together with the selected image.
