Method, apparatus, and system for providing interpretation result using visual information

An apparatus for providing an interpretation result using visual information, the apparatus comprising:

• a visual information receiver configured to acquire a spatial domain image including line-of-sight information of a user and gaze position information in the spatial domain image;
• a visual information converter configured to segment the acquired spatial domain image into a plurality of images, detect text areas including text for each of the segmented images, determine, among text blocks, each of which is a text recognition result for each of the detected text areas, a text block corresponding to the gaze position information, and convert a first language included in the determined text block into a second language that is a target language;
• and
• an interpretation result provider configured to provide the user with a conversion result of the second language,
• wherein the visual information converter is configured to combine text blocks consecutively located within predetermined sections adjacent to each other into one text block and assign a unique number to the text block or the combined text block, and
• wherein the visual information converter is configured to recognize the text block corresponding to the unique number assigned in previous visual information as the same text block for a certain period of time.

A system for providing an interpretation result using visual information, the system comprising:

• a communicator configured to acquire a spatial domain image including line-of-sight information of a user and gaze position information in the spatial domain image from an external device;
• a memory in which a program for recognizing text on the basis of the spatial domain image and the gaze position information and provide an interpretation result for the recognized text is stored;
• a processor configured to execute the program stored in the memory to:
• segment the acquired spatial domain image into a plurality of images;
• detect text areas including text for each of the segmented images;
• determine, among text blocks, each of which is a text recognition result for each of the detected text areas, a text block corresponding to the gaze position information;
• and convert a first language included in the determined text block into a second language that is a target language;
• and
• a device configured to provide the user with a conversion result of the second language,
• wherein the processor is configured to combine text blocks consecutively located within predetermined sections adjacent to each other into one text block and assign a unique number to the text block or the combined text block, and
• wherein the processor is configured to recognize the text block corresponding to the unique number assigned in previous visual information as the same text block for a certain period of time.