# US 2021/0240316 A1 · Non-transitory computer-readable medium and device for book display > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0240316 A1 - Document ID: US20210240316A1 - Status: Published application - Kind: A1 - Application number: 17/238,208 - Filed: 2021-04-23 - Published: 2021-08-05 - Earliest claimed: 2019-06-07 - Assignees: CELSYS, Inc. - Applicants: Celsys, Inc. - Inventors: Tomoaki YOKOTSUKA; Shusaku FURUSHIMA - Web page: https://patentgrep.com/patent/US20210240316A1 ## CPC - G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The disclosed technique provides a non-transitory computer-readable medium storing a book display program which causes a computer to execute instructions comprising: receiving a command to change a display image of a virtual book displayed on a display unit from an operator, the book including a content; generating display control information to be applied to the display unit and used to control transition of the display image of the book; and three-dimensionally or two-dimensionally displaying the book based on the display control information. The generating display control information includes: obtaining a display state of the book; and selecting one of command conversion rules based on at least the display state, the one command conversion rule selected to be applied to the received command and used to generate the display control information. ## Claims ### Claim 1 A non-transitory computer-readable medium storing a book display program which causes a computer to execute instructions comprising: receiving a command to change a display image of a virtual book displayed on a display unit from an operator, wherein the book including a content; generating a display control information to be applied to the display unit and used to control transition of the display image of the book; and three-dimensionally or two-dimensionally displaying the book based on the display control information, wherein the generating the display control information includes: obtaining a display state of the book; and selecting one of command conversion rules based on at least the display state, wherein the one command conversion rule selected is applied to the received command and used to generate the display control information. wherein when the display state indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes the book to be displayed such that, when the command is a command to execute display transition of page turning, a display region is moved from one side to the other side of a spread in a middle of page turning such that the content of a page on the back side of a virtual sheet including a turned page is substantially entirely displayed before the content of a page facing the page on the back side is substantially entirely displayed. ### Claim 2 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, which causes the computer to execute instructions further comprising recognizing a state of the content, wherein the generating the display control information generates the display control information by also using the recognized state of the content. ### Claim 3 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, which causes the computer to execute instructions further comprising recognizing a state of a hardware included in a device configured to display the book, wherein the generating the display control information generates the display control information by also using the recognized state of the hardware. ### Claim 4 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, wherein when the display state indicates that the book is displayed at a predetermined magnification ratio or more, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes the content to be slid and displayed in response to a flick/swipe command. ### Claim 5 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, wherein when the display state, which is three-dimensional display state, indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes display transition of page turning of the book or display transition from the one page to the other page to be executed in response to a tap command or a flick/swipe command in a crosswise direction and that causes a direction of viewing the page mainly displayed after the execution of the display transition to be changed to reduce difficulty in viewing a side portion of the content in the page due to curving of the page. ### Claim 6 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, wherein when the display state, which is three-dimensional display state, indicates that left and right pages of the book are displayed as a spread or that the content of one of the left and right pages is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes the book to be displayed such that the display image of the book is three-dimensionally turned in response to a series of commands inputted after flick or swipe in an upper/lower direction until finger is removed. ### Claim 7 (depends on 1) The non-transitory computer-readable medium storing a book display program according to claim 1, wherein when the display state, which is three-dimensional display state, indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed and that the book is displayed as viewed along a line of sight tilted at a predetermined angle or more with respect to a plane parallel to a cover of the book, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes display transition of page turning of the book or display transition from the one page to the other page is executed in response to a tap command or a flick/swipe command in a crosswise direction and causes the display image of the book to be changed to an image in which the book is viewed from substantially front of a page at a predetermined magnification ratio. ### Claim 8 (depends on 2) The non-transitory computer-readable medium storing a book display program according to claim 2, wherein when the state of the content indicates that the book includes a portion of the content spanning across opened left and right pages of the book, the generating the display control information generates the display control information such that the left and right pages are displayed in a spread state. ### Claim 9 (depends on 3) The non-transitory computer-readable medium storing a book display program according to claim 3, wherein when the state of the hardware indicates that a display screen has a long width with an aspect ratio wider than a predetermined aspect ratio, the generating the display control information generates the display control information that disables selection of a display mode of displaying only one of left and right pages of the book on the display unit. ### Claim 10 (depends on 3) The non-transitory computer-readable medium storing a book display program according to claim 3, wherein when the state of the hardware indicates that slight movement of the hardware in a direction parallel to a plane of a display screen, the generating the display control information generates the display control information that causes a display position of the book to be moved such that the slight movement is canceled out. ### Claim 11 A non-transitory computer-readable medium storing a book display program which causes a computer to execute instructions comprising: receiving a command to change a display image of a virtual book displayed on a display unit from an operator, wherein the book including a content; generating a display control information to be applied to the display unit and used to control transition of the display image of the book; and three-dimensionally or two-dimensionally displaying the book based on the display control information, wherein the generating the display control information includes: obtaining a display state of the book; and selecting one of command conversion rules based on at least the display state, wherein the one command conversion rule selected is applied to the received command and used to generate the display control information, wherein when the display state indicates that left and right pages of the book are displayed as a spread and the content of the left and right pages is substantially entirely displayed or that the content of one of the left and right pages is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, and when the book is displayed magnified with a magnification ratio and the magnification ratio is within the predetermined range, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes display transition of page turning of the book or display transition from one page to the other page is executed in response to a tap command or a flick/swipe command in a crosswise direction with the magnification ratio maintained. ### Claim 12 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, which causes the computer to execute instructions further comprising recognizing a state of the content, wherein the generating the display control information generates the display control information by also using the recognized state of the content. ### Claim 13 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, which causes the computer to execute instructions further comprising recognizing a state of a hardware included in a device configured to display the book, wherein the generating the display control information generates the display control information by also using the recognized state of the hardware. ### Claim 14 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, wherein when the display state indicates that the book is displayed at a predetermined magnification ratio or more, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes the content to be slid and displayed in response to a flick/swipe command. ### Claim 15 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, wherein when the display state, which is three-dimensional display state, indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes display transition of page turning of the book or display transition from the one page to the other page to be executed in response to a tap command or a flick/swipe command in a crosswise direction and that causes a direction of viewing the page mainly displayed after the execution of the display transition to be changed to reduce difficulty in viewing a side portion of the content in the page due to curving of the page. ### Claim 16 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, wherein when the display state, which is three-dimensional display state, indicates that left and right pages of the book are displayed as a spread or that the content of one of the left and right pages is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes the book to be displayed such that the display image of the book is three-dimensionally turned in response to a series of commands inputted after flick or swipe in an upper/lower direction until finger is removed. ### Claim 17 (depends on 11) The non-transitory computer-readable medium storing a book display program according to claim 11, wherein when the display state, which is three-dimensional display state, indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed and that the book is displayed as viewed along a line of sight tilted at a predetermined angle or more with respect to a plane parallel to a cover of the book, the selecting one of command conversion rules includes selecting the command conversion rule according to which the book display program generates the display control information that causes display transition of page turning of the book or display transition from the one page to the other page is executed in response to a tap command or a flick/swipe command in a crosswise direction and causes the display image of the book to be changed to an image in which the book is viewed from substantially front of a page at a predetermined magnification ratio. ### Claim 18 (depends on 12) The non-transitory computer-readable medium storing a book display program according to claim 12, wherein when the state of the content indicates that the book includes a portion of the content spanning across opened left and right pages of the book, the generating the display control information generates the display control information such that the left and right pages are displayed in a spread state. ### Claim 19 (depends on 13) The non-transitory computer-readable medium storing a book display program according to claim 13, wherein when the state of the hardware indicates that a display screen has a long width with an aspect ratio wider than a predetermined aspect ratio, the generating the display control information generates the display control information that disables selection of a display mode of displaying only one of left and right pages of the book on the display unit. ### Claim 20 (depends on 13) The non-transitory computer-readable medium storing a book display program according to claim 13, wherein when the state of the hardware indicates that slight movement of the hardware in a direction parallel to a plane of a display screen, the generating the display control information generates the display control information that causes a display position of the book to be moved such that the slight movement is canceled out. ### Claim 21 A book display device comprising: a command receiver configured to receive a command to change a display image of a virtual book displayed on a display unit from an operator, wherein the book including a content; a display control information generator configured to generate a display control information to be applied to the display unit and used to control transition of the display image of the book; and the display unit configured to three-dimensionally or two-dimensionally display the book based on the display control information, wherein the display control information generator includes: a display state obtainer configured to obtain a display state of the book; and a command conversion rule selector configured to select one of command conversion rules based on at least the display state, wherein the one command conversion rule selected is applied to the received command and used to generate the display control information, wherein when the display state indicates that the content of one of left and right pages of the book is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, the command conversion rule selector selects the command conversion rule to generates the display control information that causes the book to be displayed such that, when the command is a command to execute display transition of page turning, a display region is moved from one side to the other side of a spread in a middle of page turning such that the content of a page on the back side of a virtual sheet including a turned page is substantially entirely displayed before the content of a page facing the page on the back side is substantially entirely displayed. ### Claim 22 A book display device comprising: a command receiver configured to receive a command to change a display image of a virtual book displayed on a display unit from an operator, wherein the book including a content; a display control information generator configured to generate a display control information to be applied to the display unit and used to control transition of the display image of the book; and the display unit configured to three-dimensionally or two-dimensionally display the book based on the display control information, wherein the display control information generator includes: a display state obtainer configured to obtain a display state of the book; and a command conversion rule selector configured to select one of command conversion rules based on at least the display state, wherein the one command conversion rule selected is applied to the received command and used to generate the display control information, wherein when the display state indicates that left and right pages of the book are displayed as a spread and the content of the left and right pages is substantially entirely displayed or that the content of one of the left and right pages is substantially entirely displayed and the content of the other page is not displayed or is partially displayed, and when the book is displayed magnified with a magnification ratio and the magnification ratio is within the predetermined range, the command conversion rule selector selects the command conversion rule to generates the display control information that causes display transition of page turning of the book or display transition from one page to the other page in response to a tap command or a flick/swipe command in a crosswise direction with the magnification ratio maintained.