Methods and systems for conversion, playback and tagging and streaming of spherical images and video
AssigneeDiplloid Inc.
InventorsSean Geoffrey RAMSAY, Adam Russell Hunter, Demosthenes Kandylis
Life of this patent
Estimating the term…
Abstract
Methods and systems for the conversion, playback, tagging and streaming of spherical images or spherical image sequences are provided. High field of view images and videos can be converted into spherical images and spherical images sequences. These images and image sequences can be viewed on a display devices and hyperlinked tags and objects can be placed on the sphere within the video and linked to additional content.
Claims54
A method of displaying at least one spherical image each image comprising a plurality of pixels, the method comprising:
- a) generating a notional sphere;
- b) receiving the at least one spherical image;
- c) associating each pixel of the at least one spherical image with spherical coordinates of the notional sphere;
- d) displaying on a display device a two dimensional area of the spherical image, the two dimensional area being associated to a first position on the notional sphere;
- and
- e) repositioning the two dimensional area displayed on the display device within the at least one spherical image to a second position on the notional sphere.
A computer system for displaying at least one spherical image each image comprising a plurality of pixels, the computer system comprising:
- a) a digital electronic circuit;
- b) a display device;
- and
- c) at least one computer-readable storage medium operatively coupled to the digital electronic circuit, said at least one computer-readable storage medium containing a representation of at least one set of computer instructions that, when executed by said digital electronic circuit, causes the computer system to perform the operations of:
- i) generating a notional sphere,
- ii) receiving the at least one spherical image,
- iii) associating each pixel of the at least one spherical image with spherical coordinates of the notional sphere,
- iv) displaying, on the display device, a two dimensional area of the spherical image, the two dimensional area being associated to a first position on the notional sphere, and
- v) repositioning the two dimensional area displayed on the display device within the at least one spherical image area to a second position on the notional sphere.
A method for converting a high field of view video from at least one camera into a spherical image sequence, the method comprising the steps of:
- a) deriving at least one image from the camera each image comprising a plurality of pixels, each image having an image timecode, wherein the at least one image defines an image plane representing a field of view from a unique point along an optical axis that is substantially perpendicular to the image plane;
- b) assigning a spherical coordinate on a notional sphere to each pixel in the at least one image according to a cylindrical projection aligned with the image plane for the at least one image;
- c) using the spherical coordinates to assign colours derived from the pixels to pixel positions in a spherical image according to a spherical image template, wherein the notional sphere is substantially centred on the unique point, and the image plane of the at least one image is substantially tangential to the notional sphere, and wherein the cylindrical projection is aligned with the image plane for the at least one image by a notional cylinder of the cylindrical projection having its cylinder wall substantially tangential to the image plane and its longitudinal axis intersecting the unique point along the optical axis;
- and
- d) storing each of the at least one images as an ordered directory in a computer readable storage medium.
A computer system for converting a high field of view video from at least one camera into a spherical image sequence, the computer system comprising:
- a) a digital electronic circuit;
- b) at least one computer-readable storage medium operatively coupled to the digital electronic circuit, said at least one computer-readable storage medium containing a representation of at least one set of computer instructions that, when executed by said digital electronic circuit, causes the computer system to perform the operations of:
- i) deriving at least one image from the camera each image comprising a plurality of pixels, each image having an image timecode, wherein the at least one image defines an image plane representing a field of view from a unique point along an optical axis that is substantially perpendicular to the image plane,
- ii) assigning a spherical coordinate on a notional sphere to each pixel in the at least one image according to a cylindrical projection aligned with the image plane for the at least one image,
- iii) using the spherical coordinates to assign colours derived from the pixels to pixel positions in a spherical image according to a spherical image template, wherein the notional sphere is substantially centred on the unique point, and the image plane of the at least one image is substantially tangential to the notional sphere, and wherein the cylindrical projection is aligned with the image plane for the at least one image by a notional cylinder of the cylindrical projection having its cylinder wall substantially tangential to the image plane and its longitudinal axis intersecting the unique point along the optical axis, and
- iv) storing each of the at least one images as an ordered directory in the computer-readable storage medium.
A method of streaming a video image sequence comprising a plurality of frame images from at least one server, the method comprising:
- a) selecting the video image sequence for viewing on a display device;
- b) requesting, via a communication interface, at least one frame image file based on timing information, each frame image file comprising at least one of the plurality of frame images,
- c) receiving, from the at least one server, the at least one frame image file;
- d) displaying, on the display device, the at least one frame image of the frame image file as a video;
- e) receiving subsequent frame image files from the at least one server;
- and
- f) displaying, on the display device, the frame images of the subsequent frame image files.
A computer system for streaming a video image sequence comprising a plurality of frame images from at least one server, the computer system comprising:
- a) a digital electronic circuit;
- b) a display device;
- c) a communication interface;
- and
- d) at least one computer-readable storage medium operatively coupled to the digital electronic circuit, said at least one computer-readable storage medium containing a representation of at least one set of computer instructions that, when executed by said digital electronic circuit, causes the computer system to perform the operations of:
- i) selecting the video image sequence for viewing on a display device,
- ii) requesting, via the communication interface, at least one frame image file based on timing information, each frame image file comprising at least one of the plurality of frame images,
- iii) receiving, from the at least one server, the at least one frame image file,
- iv) displaying, on the display device, the at least one frame image of the frame image file as a video,
- v) receiving subsequent frame image files from the at least one server, and
- vi) displaying, on the display device, the frame images of the subsequent frame image files.
A method of streaming a video image sequence comprising a plurality of frame images to a user device, the method comprising:
- a) receiving a request from the user device for a frame image file, the frame image file comprising at least one of the frame images, based on timing information;
- b) rendering the frame images of the frame image file based on a manifest file and saving a rendered frame image file to the computer readable storage medium;
- c) transferring, to the user device, the rendered frame image file;
- d) rendering frame images of subsequent frame image files based on the manifest file and saving subsequent rendered frame image files to the computer readable storage medium;
- and
- e) transferring, to the user device, the subsequent rendered frame image files.
A computer system for streaming a video image sequence comprising a plurality of frame images to a user device, the computer system comprising:
- a) a digital electronic circuit;
- b) at least one computer-readable storage medium operatively coupled to the digital electronic circuit, said at least one computer-readable storage medium containing a representation of at least one set of computer instructions that, when executed by said digital electronic circuit, causes the computer system to perform the operations of:
- i) receiving a request from the user device for a frame image file, the frame image file comprising at least one of the frame images, based on timing information,
- ii) rendering the frame images of the frame image file based on a manifest file and saving a rendered frame image file to the computer readable storage medium,
- iii) transferring, to the user device, the rendered frame image file;
- iv) rendering frame images of subsequent frame image files based on the manifest file and saving subsequent rendered frame image files to the computer readable storage medium, and
- v) transferring, to the user device, the subsequent rendered frame image files.
Dependencies are inferred from the claim text.