US 12,762,876 B2Granted

Identification device, identification method, and identification program

AssigneeNTT, Inc.

InventorsShiro Ogasawara, Hajime Nakajima, Fumihiro Yokose, Hidetaka Koya

Life of this patent

Estimating the term…

Loading patent…

Abstract

An identification device (10) includes a first identification unit (151a) that identifies first screen data including an image of a screen of an application and information regarding a screen component object that is an object of an element included in the screen, and outputs a first identification result associated with sample screen data that is screen data to be referred to, a derivation unit (152a) that derives a sample screen model used for identification in a virtualization environment on the basis of the sample screen data and the first identification result, and a second identification unit (153a) that identifies second screen data including an image of the screen and not including information regarding the screen component object, and outputs a second identification result associated with a sample screen model.

Claims17

Dependent claims

An identification device comprising a processor configured to execute operations comprising:

identifying first screen data including an image of a screen of an application and information regarding a screen component object that is an object of an element included in the screen, wherein the first screen data further includes a first character string and a drawing area of a screen component object having the first character string as an attribute by determining equivalence using information regarding the screen component object;
outputting a first identification result associated with sample screen data that is screen data to be referred to, wherein the screen component object is associated with each piece of the sample screen data determined to have the equivalence;
identifying, on a basis of the sample screen data and the first identification result, second screen data including an image of the screen and not including information regarding the screen component object by identifying a second character string and a drawing area of the second character string data using optical character recognition processing on the second screen data, wherein the identifying the second character string is based on a drawing area of the second character string and relative arrangement relationship for respective drawing areas of the second character string;
and
outputting a second identification result associated with the sample screen data.

2 more elements

An identification method, comprising:

identifying first screen data including an image of a screen of an application and information regarding a screen component object that is an object of an element included in the screen, wherein the first screen data further includes a first character string and a drawing area of a screen component object having the first character string as an attribute by determining equivalence using information regarding the screen component object;
outputting a first identification result associated with sample screen data that is screen data to be referred to, wherein the screen component object is associated with each piece of the sample screen data determined to have the equivalence;
identifying second screen data including an image of the screen and not including information regarding the screen component object by identifying a second character string and a drawing area of the second character string data using optical character recognition processing on the second screen data, wherein the identifying the second character string is based on a drawing area of the second character string and relative arrangement relationship for respective drawing areas of the second character string;
and
outputting a second identification result associated with the sample screen data.

2 more elements

A computer-readable non-transitory recording medium storing a computer-executable program instructions that when executed by a processor cause a computer system to execute operations comprising:

identifying first screen data including an image of a screen of an application and information regarding a screen component object that is an object of an element included in the screen, wherein the first screen data further includes a first character string and a drawing area of a screen component object having the first character string as an attribute by determining equivalence using information regarding the screen component object;
outputting a first identification result associated with sample screen data that is screen data to be referred to, wherein the screen component object is associated with each piece of the sample screen data determined to have the equivalence;
identifying second screen data including an image of the screen and not including information regarding the screen component object by identifying a second character string and a drawing area of the second character string data using optical character recognition processing on the second screen data, wherein the identifying the second character string is based on a drawing area of the second character string and relative arrangement relationship for respective drawing areas of the second character string;
and
outputting a second identification result associated with the sample screen data.

2 more elements

Dependencies are inferred from the claim text.