# US 10,321,124 B2 · Display of a visual representation of a view > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,321,124 B2 - Document ID: US10321124B2 - Status: Granted - Kind: B2 - Application number: 15/106,789 - Filed: 2014-01-10 - Published: 2017-07-06 - Granted: 2019-06-11 - Earliest claimed: 2014-01-10 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Leo Kärkkäinen; Mikko Uusitalo; Akos Vetek - Web page: https://patentgrep.com/patent/US10321124B2 ## CPC - H04N 13/361: Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 15/08: Volume rendering - H04N 13/156: Mixing image signals - H04N 13/344: with head-mounted left-right displays - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 13/395: with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes - H04N 13/398: Synchronisation thereof; Control thereof - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method comprising determining a view from a location, the view comprising visual information that is perceivable along a direction extending from the location, causing display of a visual representation of the view on a display such that the view is viewable by a user at a focal depth, determining a different view from the location, the different view comprising visual information that is perceivable along a different direction extending from the location, and causing display of a visual representation of the different view on the display such that the different view is viewable by the user at a different focal depth is disclosed. ## Claims ### Claim 1 An apparatus, comprising: at least one processor; and at least one memory comprising computer program code, the memory and the computer program code configured to, executed by the processor, cause the apparatus to perform at least the following: determination of a view captured by a camera module of a device, the camera module positioned in a first orientation, the first view comprising visual information that is perceivable along a first direction extending from a location of the device; causation of display of a visual representation of the view on a display such that the first view is viewable by a user at a focal depth; determination of a different view captured by the camera module or a different camera module of the device, positioned in a different orientation from that of the first orientation, the different view comprising visual information that is perceivable along a different direction extending from the location of the device; and causation of display of a visual representation of the different view on the display such that the different view is viewable by the user at a different focal depth while the first view is viewable by the user at the first focal depth, wherein at least one of the different view or the first view at least partially precludes the other of the different view or the first view. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the display is a see-through display, and the first view is visual information indicative of a non-unitary magnification of visual information that is perceivable along the direction from the location. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the memory comprises computer program code configured to, executed by the processor, cause the apparatus to perform receipt of camera visual information that is perceivable along the direction from a camera module, wherein determination of the view is based at least in part on the camera visual information. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the memory comprises computer program code configured to, executed by the processor, cause the apparatus to perform receipt of camera visual information, from a camera module, that is perceivable along the different direction from the location, wherein determination of the different view is based at least in part on the camera visual information. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the different view is a panoramic visual representation that further comprises visual information that is perceivable along another direction that bisects the direction and the different direction. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the memory comprises computer program code configured to, executed by the processor, cause the apparatus to perform: determination of a gaze depth of the user; and determination that the gaze depth corresponds with the different focal depth, wherein causation of display of the visual representation of the different view is based, at least in part, on the determination that the gaze depth corresponds with the different focal depth. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the memory comprises computer program code configured to, executed by the processor, cause the apparatus to perform: determination of a gaze depth of the user; and determination that the gaze depth corresponds with the focal depth, wherein causation of display of the visual representation of the view is based, at least in part, on the determination that the gaze depth corresponds with the focal depth. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the memory comprises computer program code configured to, executed by the processor, cause the apparatus to perform: determination of a third view from a different location, the third view comprising visual information that is perceivable along a third direction extending from the different location; and causation of display of a visual representation of the third view on the display such that the third view is viewable by the user at a third focal depth. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the location is a geographic location of the apparatus, determination of the first view from the location comprises determination of the first view from the geographic location of the apparatus, and determination of the different view from the location comprises determination of the different view from the geographic location of the apparatus. ### Claim 10 A method comprising: determining a first view captured by a camera module of a device, the camera module positioned in a first orientation, the first view comprising visual information that is perceivable along a first direction extending from a location of the device; causing display of a visual representation of the view on a display such that the first view is viewable by a user at a first focal depth; determining a different view captured by the camera module or a different camera module of the device, positioned in a different orientation from that of the first orientation, the different view comprising visual information that is perceivable along a different direction extending from the location of the device; and causing display of a visual representation of the different view on the display such that the different view is viewable by the user at a different focal depth while the first view is viewable by the user at the first focal depth, wherein at least one of the different view or the first view at least partially precludes the other of the different view or the first view. ### Claim 11 (depends on 10) The method of claim 10, further comprising receiving camera visual information that is perceivable along the direction from the camera module, wherein determination of the first view is based at least in part on the camera visual information. ### Claim 12 (depends on 10) The method of claim 10, further comprising receiving camera visual information, from the camera module, that is perceivable along the different direction from the location, wherein determination of the different view is based at least in part on the camera visual information. ### Claim 13 (depends on 10) The method of claim 10, further comprising: determining a gaze depth of a user; and determining that the gaze depth corresponds with the different focal depth, wherein causation of display of the visual representation of the different view is based, at least in part, on the determination that the gaze depth corresponds with the different focal depth. ### Claim 14 (depends on 10) The method of claim 10, further comprising: determining a gaze depth of the user; and determining that the gaze depth corresponds with the first focal depth, wherein causation of display of the visual representation of the view is based, at least in part, on the determination that the gaze depth corresponds with the first focal depth. ### Claim 15 (depends on 10) The method of claim 10, further comprising: determining a third view from a different location, the third view comprising visual information that is perceivable along a third direction extending from the different location; and causing display of a visual representation of the third view on the display such that the third view is viewable by the user at a third focal depth. ### Claim 16 (depends on 10) The method of claim 10, wherein the location is a geographic location of the apparatus, determination of the first view from the location comprises determination of the first view from the geographic location of the apparatus, and determination of the different view from the location comprises determination of the different view from the geographic location of the apparatus. ### Claim 17 At least one computer-readable medium encoded with instructions that, when executed by a processor, perform: determining a first view captured by a camera module of a device, the camera module positioned in a first orientation, the first view comprising visual information that is perceivable along a first direction extending from a location of the device; causing display of a visual representation of the view on a display such that the first view is viewable by a user at a first focal depth; determining a different view captured by the camera module or a different camera module of the device, positioned in a different orientation from that of the first orientation, the different view comprising visual information that is perceivable along a different direction extending from the location of the device; and causing display of a visual representation of the different view on the display such that the different view is viewable by the user at a different focal depth while the first view is viewable by the user at the first focal depth, wherein at least one different view or the first view at least partially precludes the other of the different view or the first view. ### Claim 18 (depends on 17) The medium of claim 17, further encoded with instructions that, when executed by a processor, perform: determining a gaze depth of the user; and determining that the gaze depth corresponds with the different focal depth, wherein causation of display of the visual representation of the different view is based, at least in part, on the determination that the gaze depth corresponds with the different focal depth. ### Claim 19 (depends on 17) The medium of claim 17, further encoded with instructions that, when executed by a processor, perform: determining a gaze depth of the user; and determining that the gaze depth corresponds with the first focal depth, wherein causation of display of the visual representation of the view is based, at least in part, on the determination that the gaze depth corresponds with the first focal depth. ### Claim 20 (depends on 17) The medium of claim 17, further encoded with instructions that, when executed by a processor, perform: determining a third view from a different location, the third view comprising visual information that is perceivable along a third direction extending from the different location; and causing display of a visual representation of the third view on the display such that the third view is viewable by the user at a third focal depth.