# US 2019/0246094 A1 · Switching between Multidirectional and Limited Viewport Video Content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246094 A1
- Document ID: US20190246094A1
- Status: Published application
- Kind: A1
- Application number: 16/261,224
- Filed: 2019-01-29
- Published: 2019-08-08
- Earliest claimed: 2018-02-05
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Sujeet Shyamsundar Mate; Igor Danilo Diego Curcio
- Web page: https://patentgrep.com/patent/US20190246094A1

## CPC

- H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- H04L 65/80: Responding to QoS
- H04N 21/2365: Multiplexing of several video streams
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones}
- H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4347: {Demultiplexing of several video streams}
- H04N 21/43637: {involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114)}
- H04N 21/44004: {involving video buffer management, e.g. video decoder buffer or video display buffer}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44016: {involving splicing one content stream with another content stream, e.g. for substituting a video clip}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 21/23439: {for generating different versions}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

This specification describes a method comprising: in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing limited viewport video content corresponding to multidirectional video content to viewing the multidirectional video content: determining transition content for transitioning between a current viewport associated with the content being viewed and a landing viewport associated with the content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein the length of the transition content depends on an angular distance between the current viewport and the landing viewport; and outputting the transition content for display.

## Claims

### Claim 1

A method comprising:
in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing the limited viewport video content, corresponding to the multidirectional video content, to viewing the multidirectional video content:
determining transition content for transitioning between a current viewport associated with the multidirectional video content or the limited viewport video content being viewed and a landing viewport associated with the multidirectional video content or the limited viewport video content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein length of the transition content depends on an angular distance between the current viewport and the landing viewport; and
outputting the transition content for display.

### Claim 2

A computer-readable medium having computer-readable code stored thereon, the computer readable code, when executed by at least one processor, causing performance of:
in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing the limited viewport video content corresponding to the multidirectional video content to viewing the multidirectional video content:
determining transition content for transitioning between a current viewport associated with the multidirectional video content or the limited viewport video content being viewed and a landing viewport associated with the multidirectional video content or the limited viewport video content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein length of the transition content depends on an angular distance between the current viewport and the landing viewport; and
outputting the transition content for display.

### Claim 3

Apparatus comprising:
at least one processor; and
at least one memory including computer program code, which when executed by the at least one processor, causes the apparatus, in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing the limited viewport video content corresponding to the multidirectional video content to viewing the multidirectional video content, to:
determine transition content for transitioning between a current viewport associated with the multidirectional video content or the limited viewport video content being viewed and a landing viewport associated with the multidirectional video content or the limited viewport video content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein length of the transition content depends on an angular distance between the current viewport and the landing viewport; and
output the transition content for display.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the length of the transition content further depends on a predetermined angular speed for transition from an angular position associated with the current viewport to an angular position associated with the landing viewport.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the transition content comprises a series of spatial portions of the multidirectional video content which are spatially located between the current viewport and the landing viewport.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein at least a portion of the multidirectional content is stored in a buffer, and wherein the multidirectional content stored in the buffer is updated based on the current viewport and the landing viewport.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein spatial extent of the multidirectional video content stored in the buffer is dependent on angular position associated with the current viewport and the angular position associated with the landing viewport.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein duration of the multidirectional video content stored in the buffer is dependent on angular position associated with the current viewport and the angular position associated with the landing viewport.

### Claim 9 (depends on 3)

The apparatus of claim 3, wherein the transition content comprises a sequence of frames, each having an associated angular position, wherein the angular position associated with the frames gradually varies from an angular position corresponding with, or nearer to, the angular position of the current viewport to an angular position corresponding with, or nearer to, the angular position of the landing viewport.

### Claim 10 (depends on 3)

The apparatus of claim 3, wherein the current viewport is configured to be viewed on the apparatus, the landing viewport is configured to be viewed on another apparatus, and the outputting the transition content is for display on the other apparatus.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the apparatus comprises a limited viewport display device and the other apparatus comprises a variable viewport display device.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the current viewport comprises a planar representation of, or corresponding to, a spatial portion of the multidirectional video content.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein to output the transition content, the apparatus is further caused to transmit the transition content to the other apparatus.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the apparatus is further caused to detect the user switching from viewing the multidirectional video content or the limited viewport video content being viewed on the apparatus to viewing the multidirectional video content or the limited viewport video content to be viewed on the other apparatus, and wherein to detect the content being switched, the apparatus is further caused to detect the user activating the other apparatus or putting on the other apparatus.

### Claim 15 (depends on 3)

The apparatus of claim 3, wherein the apparatus comprises a television, a video projector, a mobile phone, a laptop, a personal computer or a tablet computer and/or wherein the other apparatus comprises a head mounted display, an augmented reality device, or a virtual reality device.

### Claim 16 (depends on 10)

The apparatus of claim 10, wherein the apparatus comprises a variable viewport display device and the other apparatus comprises a limited viewport display device.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the landing viewport on the other apparatus comprises a planar representation of a portion of the multidirectional video content.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the apparatus is configured to communicate information indicative of the current viewport to the other apparatus.

### Claim 19 (depends on 16)

The apparatus of claim 16, wherein the apparatus is further caused to detect the user switching between viewing the multidirectional video content or the limited viewport video content being viewed on the apparatus and viewing the multidirectional video content or the limited viewport video content to be viewed on the other apparatus, and wherein to detect the content being switched, the apparatus is further caused to detect the user deactivating or taking off the apparatus.

### Claim 20 (depends on 10)

The apparatus of claim 10, wherein the other apparatus comprises a television, a video projector, a mobile phone, a laptop, a personal computer or a tablet computer and/or wherein the apparatus comprises a head mounted display, an augmented reality device or a virtual reality device.
