# US 2019/0318503 A1 · Non-transitory computer-readable storage medium, display apparatus, head-mounted display apparatus, and marker > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0318503 A1 - Document ID: US20190318503A1 - Status: Published application - Kind: A1 - Application number: 16/454,195 - Filed: 2019-06-27 - Published: 2019-10-17 - Earliest claimed: 2016-12-28 - Assignees: MegaHouse Corporation - Applicants: MegaHouse Corporation - Inventors: Takaaki HAMA - Web page: https://patentgrep.com/patent/US20190318503A1 ## CPC - G06F 3/012: {Head tracking input arrangements} - G06T 7/74: {involving reference images or patches} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 27/017: {Head mounted} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038) - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0141: {characterised by the informative content of the display} - G06T 2207/30204: Marker - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract From a moving image obtained by capturing a marker, a change of a shape of an image region of the marker is detected. A shape of a display image is controlled in accordance with the change and a display screen of the display apparatus is caused to display the display image after the controlling. ## Claims ### Claim 1 A non-transitory computer-readable storage medium storing a computer program for causing a computer of a display apparatus to function as: a detection unit configured to detect, from a moving image obtained by capturing a marker, a change of a shape of an image region of the marker; and a display control unit configured to control a shape of a display image in accordance with the change detected by the detection unit and cause a display screen of the display apparatus to display the display image after the controlling. ### Claim 2 (depends on 1) The medium according to claim 1, wherein the display control unit, in a case where the detection unit first detects the image region of the marker from the moving image after activation of the display apparatus, causes the display screen to display a base display image which is a display image that has a base shape. ### Claim 3 (depends on 2) The medium according to claim 2, wherein the display control unit, in accordance with a change from the shape of the image region of the marker that the detection unit first detected from the moving image, generates a display image obtained by changing the shape of the base display image, and causes the display screen to display the generated display image. ### Claim 4 (depends on 3) The medium according to claim 3, wherein the display control unit obtains a parameter representing a change from the shape of the image region of the marker that the detection unit first detected from the moving image, generates a display image that is obtained by changing the shape of the base display image using the obtained parameter, and causes the display screen to display the generated display image. ### Claim 5 (depends on 1) The medium according to claim 1, wherein the detection unit obtains the moving image from a camera that the display apparatus has. ### Claim 6 (depends on 1) The medium according to claim 1, wherein the display apparatus is a smart phone. ### Claim 7 A display apparatus, comprising: a detection unit configured to detect, from a moving image obtained by capturing a marker, a change of a shape of an image region of the marker; and a display control unit configured to control a shape of a display image in accordance with the change detected by the detection unit and cause a display screen of the display apparatus to display the display image after the controlling. ### Claim 8 A head-mounted display apparatus having a display apparatus, the display apparatus comprising: a detection unit configured to detect, from a moving image obtained by capturing a marker, a change of a shape of an image region of the marker; and a display control unit configured to control a shape of a display image in accordance with the change detected by the detection unit and cause a display screen of the display apparatus to display the display image after the controlling. ### Claim 9 A marker in which a first rectangle and a second rectangle, which results from shrinking and rotating the first rectangle in order for the second rectangle to be inscribed in the first rectangle, are arranged, wherein a defined mark is arranged in the second rectangle.