# US 11,029,759 B2 · Haptic movable display for spatial correlation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,759 B2 - Document ID: US11029759B2 - Status: Granted - Kind: B2 - Application number: 16/135,011 - Filed: 2018-09-19 - Published: 2020-03-19 - Granted: 2021-06-08 - Earliest claimed: 2018-09-19 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Hyun Kyu Seo; Mark E. Podlaseck; Jonathan H. Connell, II - Web page: https://patentgrep.com/patent/US11029759B2 ## CPC - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/03: Arrangements for converting the position or the displacement of a member into a coded form - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Embodiments of the present invention provides methods, computer program products, and a system for determining and displaying an image selected from a plurality of images based on a physical displacement of a device. Embodiments of the present invention can be used to generate a composite model based on a collected plurality of images. Embodiments of the present invention can be used to determine an image for display selected from the generated composite model based on a physical displacement of a device. ## Claims ### Claim 1 A computer-implemented method comprising: generating a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and determining an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model, wherein determining the image further comprises: determining a range of displacement of the device; mapping the generated composite model to the determined range of displacement; identifying a location of the device within the range of displacement; and identifying an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: displaying the determined image of the generated composite model corresponding to the starting position for the device; and generating haptic feedback based on metadata associated with the displayed image. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device. ### Claim 4 (depends on 2) The computer-implemented method of claim 2 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising: a first servomechanism connected to a foundation, a strut having a first end and a second end, wherein the first end is operatively connected to the first servomechanism and the second end is operatively connected to a second servomechanism, wherein the second servomechanism includes an attachment point for the device, wherein the first and the second servomechanism includes force-feedback mechanisms, generate haptic feedback, and measure joint angles of the cantilever arm. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein a third dimension is selected from a group consisting of time, distance, and wavelength. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein determining a range of displacement of the device and identifying a location of the device within the range of displacement is based on video footage of the device or a user. ### Claim 7 A computer program product comprising: one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising: program instructions to generate a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and program instructions to determine an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model wherein the program instructions to determine the image further comprise instructions to: determine a range of displacement of the device; map the generated composite model to the determined range of displacement; identify a location of the device within the range of displacement; and identify an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model. ### Claim 8 (depends on 7) The computer program product of claim 7, further comprising: program instructions to display the determined image of the generated composite model corresponding to the starting position for the device; and program instructions to generate haptic feedback based on metadata associated with the displayed image. ### Claim 9 (depends on 8) The computer program product of claim 8, wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device. ### Claim 10 (depends on 8) The computer program product of claim 8 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising: a first servomechanism connected to a foundation, a strut having a first end and a second end, wherein the first end is operatively connected to the first servomechanism and the second end is operatively connected to a second servomechanism, wherein the second servomechanism includes an attachment point for the device, wherein the first and the second servomechanism includes force-feedback mechanisms, generate haptic feedback, and measure joint angles of the cantilever arm. ### Claim 11 (depends on 7) The computer program product of claim 7, wherein a third dimension is selected from a group consisting of time, distance, and wavelength. ### Claim 12 (depends on 7) The computer program product of claim 7, wherein the program instructions to determine a range of displacement of the device and identifying a location of the device within the range of displacement is based on video footage of the device or a user. ### Claim 13 A computer system comprising: one or more computer processors; one or more computer readable storage media; and program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising: program instructions to generate a composite model comprising a collected plurality of images, wherein each image among the collected plurality of images has an image that spans across a first and a second and an assigned value associated with a third dimension; and program instructions to determine an image of the generated composite model that serves as the image displayed in a starting position of a device based on a physical displacement of the device with respect to a reference position of the device and the generated composite model wherein the program instructions to determine the image further comprise instructions to: determine a range of displacement of the device; map the generated composite model to the determined range of displacement; identify a location of the device within the range of displacement; and identify an image among the collected plurality of images corresponding to the identified location of the device within the range of displacement based on the mapped composite model. ### Claim 14 (depends on 13) The computer system of claim 13, further comprising: program instructions to display the determined image of the generated composite model corresponding to the starting position for the device; and program instructions to generate haptic feedback based on metadata associated with the displayed image. ### Claim 15 (depends on 14) The computer system of claim 14, wherein the determined image is displayed on a display interface integrated with the device, wherein a haptic device receives the generated haptic feedback that is integrated with the device. ### Claim 16 (depends on 14) The computer system of claim 14 wherein the determined image is displayed on a display interface integrated with the device, the device is attached to a cantilever arm comprising: a first servomechanism connected to a foundation, a strut having a first end and a second end, wherein the first end is operatively connected to the first servomechanism and the second end is operatively connected to a second servomechanism, wherein the second servomechanism includes an attachment point for the device, wherein the first and the second servomechanism includes force-feedback mechanisms, generate haptic feedback, and measure joint angles of the cantilever arm. ### Claim 17 (depends on 13) The computer system of claim 13, wherein a third dimension is selected from a group consisting of time, distance, and wavelength.