# US 2017/0287445 A1 · Information display apparatus, information display system, control method thereof, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0287445 A1 - Document ID: US20170287445A1 - Status: Published application - Kind: A1 - Application number: 15/630,510 - Filed: 2017-06-22 - Published: 2017-10-05 - Earliest claimed: 2012-12-29 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Yoshihiro Naganawa - Web page: https://patentgrep.com/patent/US20170287445A1 ## CPC - G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) - G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 2207/30204: Marker - G09G 2320/106: Determination of movement vectors or equivalent parameters within the image - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An information display system capable of reducing a trouble about display caused by display of content information corresponding to numerous markers and reducing process loads and a control method of the information display system are provided. In this system, a movement speed and a movement direction of a client apparatus operated by a user are detected, and a size and a position of a marker recognition area for recognizing a marker in an imaged image are determined according to the detected movement speed and the detected movement direction. Then, the content information corresponding to the marker recognized in the marker recognition area is superposed on the imaged image and output to a display screen. ## Claims ### Claim at position 1 1-13. (canceled) ### Claim 14 An information display apparatus which superposes information on an imaged image and displays the information and the imaged image, the apparatus comprising: at least one processor programmed to cause the apparatus to: detect, with a sensor, a movement direction of the imaged image relative to an imaging target; determine a location of a target area within the imaged image, based on the detected movement direction, wherein the location of the target area is shifted within the imaged image in the detected movement direction; recognize an object of one or more objects in the imaged image; and superpose, on the imaged image, information related to the object when the object of the plurality of objects is in the target area, and not superpose, on the imaged image, the information related to the object when the object of the plurality of objects is outside the target area, wherein, in a case where a ratio of the one or more objects existing in the imaged image does not exceed a threshold value, the whole imaged image is determined as the target area, the one or more objects recognizable in the imaged image are recognized, and the information related to the recognized one or more objects in the imaged image is superposed on the imaged image. ### Claim 15 (depends on 14) The information display apparatus according to claim 14, wherein a speed of movement of the imaged image is further detected, and in a case where the detected speed is equal to or lower than a first threshold value, the location of the target area is determined as a first area which is located near a center of the imaged image, and, in a case where the detected speed exceeds the first threshold value, the location of the target area is determined as a second area which is shifted within the imaging target in the detected movement direction. ### Claim 16 (depends on 15) The information display apparatus according to claim 15, wherein, in a case where the detected speed exceeds a second threshold value larger than the first threshold value, the target area is determined as a third area which is narrower than the second area. ### Claim 17 (depends on 14) The information display apparatus according to claim 14, wherein the object in the imaged image existing in the target area at a changed position within the imaged image is recognized. ### Claim 18 An information display apparatus which superposes information on an imaged image and displays the information and the imaged image, the apparatus comprising: at least one processor programmed to cause the apparatus to: detect, with a sensor, a movement direction of the imaged image relative to an imaging target; determine a location of a target area within the imaged image, based on the detected movement direction, wherein the location of the target area is shifted within the imaged image in the detected movement direction; recognize an object of one or more objects in the imaged image; in a case where the number of the one or more objects existing in the imaged image exceeds a threshold value, preferentially superpose, on the imaged image, information related to the object being in the target area, and suppress superposition of information related to the object being outside the target area, on the imaged image; and in a case where the number of the one or more objects existing in the imaged image does not exceed the threshold value, suppress superposition of information related to the object recognizable in the whole of the imaged image, on the imaged image. ### Claim 19 (depends on 18) The information display apparatus according to claim 18, wherein a speed of movement of the imaged image is further detected, and in a case where the detected speed is equal to or lower than a first threshold value, the location of the target area is determined as a first area which is located near a center of the imaged image, and, in a case where the detected speed exceeds the first threshold value, the location of the target area is determined as a second area which is shifted within the imaging target in the detected movement direction. ### Claim 20 (depends on 19) The information display apparatus according to claim 19, wherein, in a case where the detected speed exceeds a second threshold value larger than the first threshold value, the target area is determined as a third area which is narrower than the second area. ### Claim 21 (depends on 18) The information display apparatus according to claim 18, wherein the object in the imaged image existing in the target area at a changed position within the imaged image is recognized. ### Claim 22 An information display apparatus which superposes information on an image and displays the information and the imaged image, the apparatus comprising: at least one processor programmed to cause the apparatus to: detect a movement direction of the image relative to a target; determine a location of a target area within the image, based on the detected movement direction, wherein the location of the target area is shifted within the image in the detected movement direction; recognize an object of one or more objects in the image; in a case where the number of the one or more objects existing in the image exceeds a threshold value, preferentially superpose, on the image, information related to the object being in the target area and suppress superposition of information related to the object being outside the target area, on the image; and in a case where the number of the one or more objects existing in the image does not exceed the threshold value, suppress superposition of information related to the object recognizable in the whole of the image, on the image. ### Claim 23 (depends on 22) The information display apparatus according to claim 22, wherein a speed of movement of the image is further detected, and in a case where the detected speed is equal to or lower than a first threshold value, the location of the target area is determined as a first area which is located near a center of the imaged image, and, in a case where the detected speed exceeds the first threshold value, the location of the target area is determined as a second area which is shifted within the imaging target in the detected movement direction. ### Claim 24 (depends on 23) The information display apparatus according to claim 23, wherein, in a case where the detected speed exceeds a second threshold value larger than the first threshold value, the target area is determined as a third area which is narrower than the second area. ### Claim 25 (depends on 22) The information display apparatus according to claim 22, wherein the object in the imaged image existing in the target area at a changed position within the image is recognized. ### Claim 26 An information display apparatus which superposes information on an image and displays the information and the image, the apparatus comprising: at least one processor programmed to cause the apparatus to: detect a movement speed of the image relative to a target; determine a first area located near a center of the image as a location of a target area in a case where the movement speed is equal to or lower than a first threshold value, wherein the location of the target area is shifted within the image based on a movement of the image; recognize an object of one or more objects in the image; in a case where the number of the one or more objects existing in the image exceeds a threshold value, preferentially superpose, on the image, information related to the object being in the target area and suppress superposition of information related to the object being outside the target area, on the image; and in a case where the number of the one or more objects existing in the image does not exceed the threshold value, suppress superposition of information related to the object recognizable in the whole of the image, on the image. ### Claim 27 (depends on 26) The information display apparatus according to claim 26, wherein, in a case where the movement speed exceeds the first threshold value, a second area which is narrow than the first area and located near the center of the image is determined as the location of the target area. ### Claim 28 An information display method which superposes information on an imaged image and displays the information and the imaged image, the method comprising: detecting, with a sensor, a movement direction of the imaged image relative to an imaging target; determining a location of a target area within the imaged image, based on the detected movement direction, wherein the location of the target area is shifted within the imaged image in the detected movement direction; recognizing an object of one or more objects in the imaged image; and superposing, on the imaged image, information related to the object when the object is in the target area, and not superposing, on the imaged image, the information related to the object when the object is outside the target area, wherein, in a case where a ratio of the one or more objects existing in the imaged image does not exceed a threshold value, the whole imaged image is determined as the target area, the one or more objects recognizable in the imaged image are recognized, and the information related to the recognized one or more objects in the imaged image is superposed on the imaged image. ### Claim 29 An information display method which superposes information on an imaged image and displays the information and the imaged image, the method comprising: detecting, with a sensor, a movement direction of the imaged image relative to an imaging target; determining a location of a target area within the imaged image, based on the detected movement direction, wherein the location of the target area is shifted within the imaged image in the detected movement direction; recognizing an object of one or more objects in the imaged image; in a case where the number of the one or more objects existing in the imaged image exceeds a threshold value, preferentially superposing, on the imaged image, information related to the object being in the target area and suppressing superposition of information related to the object being outside the target area, on the imaged image; and in a case where the number of the one or more objects existing in the imaged image does not exceed the threshold value, suppressing superposition of information related to the object recognizable in the whole of the imaged image, on the imaged image. ### Claim 30 An information display method which superposes information on an image and displays the information and the image, the method comprising: detecting a movement direction of the image relative to a target; determining a location of a target area within the image, based on the detected movement direction, wherein the location of the target area is shifted within the image in the detected movement direction; recognizing an object of one or more objects in the image; in a case where the number of the one or more objects existing in the image exceeds a threshold value, preferentially superposing, on the image, information related to the object being in the target area and suppressing superposition of information related to the object being outside the target area, on the image; and in a case where the number of the one or more objects existing in the image does not exceed the threshold value, suppressing superposition of information related to the object recognizable in the whole of the image, on the image. ### Claim 31 An information display method which superposes information on an image and displays the information and the image, the method comprising: detecting a movement speed of the image relative to a target; determining a first area located near a center of the image as a location of a target area in a case where the movement speed is equal to or lower than a first threshold value, wherein the location of the target area is shifted within the image based on a movement of the image; recognizing an object of one or more objects in the image; in a case where the number of the one or more objects existing in the image exceeds a threshold value, preferentially superposing, on the image, information related to the object being in the target area and suppressing superposition of information related to the object being outside the target area, on the image; and in a case where the number of the one or more objects existing in the image does not exceed the threshold value, suppressing superposition of information related to the object recognizable in the whole of the image, on the image. ### Claim 32 A non-transitory computer-readable storage medium which stores a computer-executable program to achieve an information display method which superposes information on an imaged image and displays the information and the image, the method comprising: detecting, with a sensor, a movement direction of the imaged image relative to an imaging target; determining a location of a target area within the imaged image, based on the detected movement direction, wherein the location of the target area is shifted within the imaged image in the detected movement direction; recognizing an object of one or more objects in the imaged image; in a case where the number of the one or more objects existing in the imaged image exceeds a threshold value, preferentially superposing, on the imaged image, information related to the object being in the target area and suppressing superposition of information related to the object being outside the target area, on the imaged image; and in a case where the number of the one or more objects existing in the imaged image does not exceed the threshold value, suppressing superposition of information related to the object recognizable in the whole of the imaged image, on the imaged image.