# US 9,883,117 B2 · Method and apparatus for creating motion effect for image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,883,117 B2 - Document ID: US9883117B2 - Status: Granted - Kind: B2 - Application number: 14/440,481 - Filed: 2012-11-06 - Published: 2015-09-10 - Granted: 2018-01-30 - Earliest claimed: 2012-11-06 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Sami Niemi - Web page: https://patentgrep.com/patent/US9883117B2 ## CPC - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - G06F 3/0412: {Digitisers structurally integrated in a display} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/0485: Scrolling or panning - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites - G11B 27/105: {of operating discs} - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)} - H04N 5/265: Mixing - H04N 5/4448: {for frame-grabbing} - H04N 21/4318: {by altering the content in the rendering process, e.g. blanking, blurring or masking an image region (image enhancement or restoration in general G06T5/00)} - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/8153: {comprising still images, e.g. texture, background image} - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06T 2207/10004: Still image; Photographic image - H04N 2101/00: Still video cameras - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract A method includes maintaining images and associated video streams; detecting a swipe gesture of a user on a touch sensitive display, wherein the swipe gesture comprises direction and speed information; and selecting an image based on the direction information of the swipe gesture. The method includes adjusting a playback of an associated video stream based on the direction and the speed information of the swipe gesture; providing the associated video stream on the display during the swipe gesture, for creating a motion effect relating to the image; and providing the image on the display after the swipe gesture. ## Claims ### Claim 1 An apparatus, comprising: a touch sensitive display; a processor; a memory including computer program code; the memory and the computer program code configured to, with the processor, cause the apparatus to: maintain images comprising a first image and a second image in consecutive order for user browsing and associated video streams; detect a swipe gesture of a user on the touch sensitive display, wherein the swipe gesture comprises direction and speed information; select the second image based on the direction information of the swipe gesture; provide a transition from the first image to the second image synchronized with the speed and the direction of the swipe gesture, wherein a video stream associated to the second image is displayed during the transition; adjust a playback of the associated video stream based on the direction and the speed information of the swipe gesture; provide the associated video stream on the display during the swipe gesture, for creating a motion effect relating to the second image; and provide the second image on the display after the swipe gesture. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the associated video stream comprises a series of video image frames, and the second image being comprised by one of the video image frames. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the associated video stream comprises a series of still images, and the second image being comprised by one of the still images. ### Claim 4 (depends on 1) The apparatus of claim 1, further comprising: a camera; and the memory and the computer program code further configured to, with the processor, cause the apparatus to: capture the images and the associated video streams using the camera. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the memory and the computer program code further configured to, with the processor, cause the apparatus to: provide the first image in a first window on the display; and provide the video stream associated to the second image in a second window on the display. ### Claim 6 (depends on 5) The apparatus of claim 5, wherein the first and second window slide on the display in response to the swipe gesture. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the memory and the computer program code further configured to, with the processor, cause the apparatus to: provide, when no swipe gesture being detected, the first image in a first window on the display; and provide, when swipe gesture being detected, the video stream associated to the second image in a second window on the display. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the memory and the computer program code further configured to, with the processor, cause the apparatus to: provide, when swipe gesture being detected, the video stream associated to the first image in the first window on the display. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the memory and the computer program code further configured to, with the processor, cause the apparatus to: maintain a first image and a second image in consecutive order for user browsing; and provide a transition from the first image to the second image synchronized with the speed and the direction of the swipe gesture, wherein a video stream associated to the first image displayed during the transition. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the transition comprises sliding the video stream associated to the second image, into the display, synchronized with the speed and the direction of the swipe gesture and blending into the second image as the swipe gesture is ended. ### Claim 11 (depends on 1) The apparatus of claim 1, wherein adjusting the playback of the associated video stream comprises at least one of the following: adjusting a playback speed based on the speed information of the swipe gesture; and adjusting a playback direction based on the direction information of the swipe gesture. ### Claim 12 (depends on 1) The apparatus of claim 1, further comprising: a camera; and the memory and the computer program code further configured to, with the processor, cause the apparatus to: capture a plurality of consecutive images using the camera; select an image of the plurality of consecutive images; and generate the associated video stream for the selected image using at least two of the plurality of consecutive images. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the selected image is one of the following: a first image of the plurality of consecutive images; an intermediate image of the plurality of consecutive images; and a last image of the plurality of consecutive images. ### Claim 14 (depends on 12) The apparatus of claim 12, wherein selecting the image of the plurality of consecutive images is done by the user. ### Claim 15 A method for creating a motion effect relating to an image comprising: maintaining images comprising a first image and a second image in consecutive order for user browsing and associated video streams; detecting a swipe gesture of a user on a touch sensitive display, wherein the swipe gesture comprises direction and speed information; selecting the second image based on the direction information of the swipe gesture; providing a transition from the first image to the second image synchronized with the speed and the direction of the swipe gesture, wherein a video stream associated to the second image is displayed during the transition, adjusting a playback of the associated video stream based on the direction and the speed information of the swipe gesture; providing the associated video stream on the display during the swipe gesture, for creating a motion effect relating to the second image; and providing the second image on the display after the swipe gesture. ### Claim 16 (depends on 15) The method of claim 15, wherein the associated video stream comprises a series of video image frames, and the second image being comprised by one of the video image frames. ### Claim 17 A computer program product comprising a non-transitory computer readable medium having computer executable program code stored thereon which, when executed by at least one controller of an apparatus, causes the apparatus to: maintain images comprising a first image and a second image in consecutive order for user browsing and associated video streams; detect a swipe gesture of a user on a touch sensitive display, wherein the swipe gesture comprises direction and speed information; select the second image based on the direction information of the swipe gesture; provide a transition from the first image to the second image synchronized with the speed and the direction of the swipe gesture, wherein a video stream associated to the second image is displayed during the transition; adjust a playback of the associated video stream based on the direction and the speed information of the swipe gesture; provide the associated video stream on the display during the swipe gesture, for creating a motion effect relating to the second image; and provide the second image on the display after the swipe gesture.