# US 2018/0322687 A1 · Apparatus and method for providing interactive content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0322687 A1 - Document ID: US20180322687A1 - Status: Published application - Kind: A1 - Application number: 15/895,869 - Filed: 2018-02-13 - Published: 2018-11-08 - Earliest claimed: 2017-05-02 - Assignees: Electronics and Telecommunications Research Institute - Applicants: Electronics and Telecommunications Research Institute - Inventors: Hang-Kee KIM; Ki-Suk LEE; Ki-Hong KIM - Web page: https://patentgrep.com/patent/US20180322687A1 ## CPC - G06T 15/20: Perspective computation - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 7/536: from perspective effects, e.g. by using vanishing points - G06T 19/003: {Navigation within 3D models or images} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Disclosed herein are an apparatus and method for providing interactive content. The apparatus for providing interactive content includes an object classification unit for classifying content to be output into a view-independent background and view-dependent objects, a viewpoint association unit for determining viewpoints of users who are to be interactively associated with respective view-dependent objects and interactively associating the viewpoints of the users with the view-dependent objects, a rendering unit for generating a background-visualized image by rendering the view-independent background with respect to a hot spot, and generating object-visualized images by rendering the view-dependent objects based on the viewpoints interactively associated with respective view-dependent objects, and an output unit for outputting the background-visualized image and the object-visualized images. ## Claims ### Claim 1 An apparatus for providing interactive content, comprising: an object classification unit for classifying content to be output into a view-independent background and view-dependent objects; a viewpoint association unit for determining viewpoints of users who are to be interactively associated with respective view-dependent objects, and interactively associating the viewpoints of the users with the view-dependent objects; a rendering unit for generating a background-visualized image by rendering the view-independent background with respect to a hot spot, and generating object-visualized images by rendering the view-dependent objects based on viewpoints interactively associated with respective view-dependent objects; and an output unit for outputting the background-visualized image and the object-visualized images. ### Claim 2 (depends on 1) The apparatus of claim 1, further comprising an interaction calculation unit for calculating whether interaction between background objects, included in the view-independent background, and the view-dependent objects has occurred, and calculating an effect of the interaction using bounding volumes corresponding to collision ranges of the background objects, wherein the rendering unit generates the background-visualized image and the object-visualized images by reflecting the effect of the interaction based on the calculation by the interaction calculation unit. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein: the rendering unit is configured to, when the background-visualized image is generated, determine hiding of the background objects and sizes of the background objects using a depth map corresponding to the view-independent background, and the bounding volumes are determined in accordance with the sizes of the corresponding background objects. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the rendering unit is configured to, when the object-visualized image is generated, determine sizes and locations of the view-dependent objects in consideration of the view-independent background and traveling directions based on the viewpoints interactively associated with respective view-dependent objects. ### Claim 5 (depends on 4) The apparatus of claim 4, wherein the rendering unit is configured to determine changes in sizes of view-dependent interactive objects for interaction with the background objects depending on traveling of the view-dependent interactive objects in consideration of depths of the background objects in the depth map, corresponding to traveling directions of the view-dependent interactive objects. ### Claim 6 (depends on 5) The apparatus of claim 5, wherein the output unit is configured to output the object-visualized images such that the object-visualized images are overlaid on the background-visualized image. ### Claim 7 (depends on 6) The apparatus of claim 6, wherein the interaction calculation unit calculates the effect of the interaction using one or more of types of the view-dependent interactive objects, effects assigned to the view-dependent interactive objects, states of the background objects, and a location of a collision with each bounding volume. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the viewpoints are determined depending on locations and directions of pupils, heads, faces or eyes corresponding to the users. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the rendering unit is configured to, when the object-visualized images are generated, perform stereoscopic rendering using a binocular disparity. ### Claim 10 A method for providing interactive content, comprising: classifying content to be output into a view-independent background and view-dependent objects; determining viewpoints of users who are to be interactively associated with respective view-dependent objects and interactively associating the viewpoints of the users with the view-dependent objects; generating a background-visualized image by rendering the view-independent background with respect to a hot spot, and generating object-visualized images by rendering the view-dependent objects based on the viewpoints interactively associated with respective view-dependent objects; and outputting the background-visualized image and the object-visualized images. ### Claim 11 (depends on 10) The method of claim 10, further comprising calculating whether interaction between background objects, included in the view-independent background, and the view-dependent objects has occurred, and calculating an effect of the interaction using bounding volumes corresponding to collision ranges of the background objects, wherein generating the background-visualized image and the object-visualized images is configured to generate the background-visualized image and the object-visualized images by reflecting the effect of the interaction based on the calculation by the interaction calculation unit. ### Claim 12 (depends on 11) The method of claim 11, wherein: generating the background-visualized image and the object-visualized images is configured to, when the background-visualized image is generated, determine hiding of the background objects and sizes of the background objects using a depth map corresponding to the view-independent background, and the bounding volumes are determined in accordance with the sizes of the corresponding background objects. ### Claim 13 (depends on 12) The method of claim 12, wherein generating the background-visualized image and the object-visualized images is configured to, when the object-visualized image is generated, determine sizes and locations of the view-dependent objects in consideration of the view-independent background and traveling directions based on the viewpoints interactively associated with respective view-dependent objects. ### Claim 14 (depends on 13) The method of claim 13, wherein generating the background-visualized image and the object-visualized images is configured to determine changes in sizes of view-dependent interactive objects for interaction with the background objects depending on traveling of the view-dependent interactive objects in consideration of depths of the background objects in the depth map, corresponding to traveling directions of the view-dependent interactive objects. ### Claim 15 (depends on 14) The method of claim 14, wherein outputting the background-visualized image and the object-visualized images is configured to output the object-visualized images such that the object-visualized images are overlaid on the background-visualized image. ### Claim 16 (depends on 15) The method of claim 15, wherein calculating the effect of the interaction is configured to calculate the effect of the interaction using one or more of types of the view-dependent interactive objects, effects assigned to the view-dependent interactive objects, states of the background objects, and a location of a collision with each bounding volume. ### Claim 17 (depends on 16) The method of claim 16, wherein the viewpoints are determined depending on locations and directions of pupils, heads, faces or eyes corresponding to the users. ### Claim 18 (depends on 17) The method of claim 17, wherein generating the background-visualized image and the object-visualized images is configured to, when the object-visualized images are generated, perform stereoscopic rendering using a binocular disparity.