# US 10,120,565 B2 · Methods and devices for presenting interactive media items > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,565 B2 - Document ID: US10120565B2 - Status: Granted - Kind: B2 - Application number: 14/933,940 - Filed: 2015-11-05 - Published: 2016-02-25 - Granted: 2018-11-06 - Earliest claimed: 2014-02-14 - Assignees: Facebook, Inc. - Applicants: Facebook, Inc. - Inventors: Scott Snibbe; Graham McDermott; Justin Ponczek; Spencer Schoeben; Jesse Fulton - Web page: https://patentgrep.com/patent/US10120565B2 ## CPC - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/0412: {Digitisers structurally integrated in a display} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06Q 30/0241: Advertisements - G06T 11/60: Creating or editing images; Combining images with text - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract The various embodiments described herein include methods and systems for presenting interactive media items. In one aspect, a method includes publishing, by a server system, an interactive media item, the publishing comprising providing access for a playback of the interactive media item based on metadata for the interactive media item. The metadata is generated using information associated with the interactive media item and including a mapping of an effect parameter for a first effect of the one or more effects to a touch input gesture. Playback includes, in response to detecting a first user input gesture corresponding to the touch input gesture, applying the first effect to the presented interactive media item. The applying of the first effect includes determining the effect parameter according to one or more characteristics of the first user input gesture, based on the mapping of the effect parameter to the touch input gesture. ## Claims ### Claim 1 A method of presenting interactive media items, comprising: at a server system, receiving information associated with an interactive media item, the information associated with the interactive media item including information identifying an audio file, information identifying at least one visual media file, and information on one or more effects; and publishing, by the server system, the interactive media item, the publishing comprising providing access for a playback of the interactive media item based on metadata for the interactive media item, the metadata for the interactive media item generated using the information associated with the interactive media item and including a mapping of an effect parameter for a first effect of the one or more effects to a touch input gesture, wherein the playback comprises: in response to user selection of the interactive media item, presenting the interactive media item on a display; and in response to detecting a first user input gesture corresponding to the touch input gesture, applying the first effect to the presented interactive media item, the applying of the first effect comprising determining the effect parameter according to one or more characteristics of the first user input gesture, based on the mapping of the effect parameter to the touch input gesture. ### Claim 2 (depends on 1) The method of claim 1, wherein presenting the interactive media item comprises: concurrently playing back at least a portion of the audio file in synchronization with display of the at least one visual media file. ### Claim 3 (depends on 2) The method of claim 2, wherein applying the first effect to the presented interactive media item comprises applying the first effect to at least one of: the at least a portion of the audio file being played back; and at least a portion of the at least one visual media file being displayed. ### Claim 4 (depends on 1) The method of claim 1, further comprising obtaining, from the metadata for the interactive media item, metadata information identifying the one or more effects and linking at least one effect of the one or more effects to a particular gesture type, the metadata information including the mapping of the effect parameter to the touch input gesture. ### Claim 5 (depends on 1) The method of claim 1, further comprising, providing, by the server system, the one or more effects in connection with the presenting of the interactive media item. ### Claim 6 (depends on 1) The method of claim 1, further comprising obtaining the metadata for the interactive media item in connection with the presenting of the interactive media item, the metadata including first information identifying a first location corresponding to the audio file, second information identifying a second location corresponding to the one or more visual media files, and third information identifying the one or more effects. ### Claim 7 (depends on 6) The method of claim 6, further comprising: obtaining at least a portion of the audio file from the first location based on the first information; and obtaining the at least one visual media file based on the second information. ### Claim 8 (depends on 1) The method of claim 1, wherein the one or more effects are controllable using one or more controls on an overlay of the presented interactive media item. ### Claim 9 (depends on 1) The method of claim 1, wherein the effect parameter of the first effect is modified according to one or more characteristics of a second user input gesture corresponding to the touch input gesture, the second user input gesture occurring after the first user input gesture. ### Claim 10 (depends on 1) The method of claim 1, wherein the one or more effects are selected from a group comprising: one or more audio effects; one or more visual effects; and one or more audiovisual effects. ### Claim 11 (depends on 1) The method of claim 1, wherein the one or more characteristics of the first user input gesture include at least one of: a location of the first user input gesture, and a gesture type of the first user input gesture. ### Claim 12 (depends on 1) The method of claim 1, wherein the first effect modifies one or more parameters of the presented interactive media item on a pixel-by-pixel basis. ### Claim 13 (depends on 1) The method of claim 1, wherein the first effect modifies a geometry of at least a portion of the presented interactive media item based at least in part on a predetermined form of geometric distortion. ### Claim 14 (depends on 1) The method of claim 1, wherein the first effect modifies the temporal order or speed of at least a portion of the presented interactive media item. ### Claim 15 (depends on 1) The method of claim 1, wherein the first effect modifies at least a portion of presented interactive media item with one or more digital signal processing filters. ### Claim 16 (depends on 1) The method of claim 1, wherein the first effect generates synthetic music based on one or more algorithms for automated music production. ### Claim 17 (depends on 1) The method of claim 1, wherein the first effect generates musical information via one or more synthesized instruments based at least in part on one or more characteristics of the first user input gesture. ### Claim 18 (depends on 1) The method of claim 1, wherein at least a subset of the one or more characteristics of the first user input gesture determines a choice in a video-game experience, wherein the interactive media item corresponds to the video-game experience. ### Claim 19 (depends on 1) The method of claim 1, further comprising: storing, by the server system, the metadata for the interactive media item in a metadata database in response to the receiving of the information associated with the interactive media item. ### Claim 20 A server system, comprising: one or more processors; and memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for: receiving information associated with an interactive media item, the information associated with the interactive media item including information identifying an audio file, information identifying at least one visual media file, and information on one or more effects; and publishing, by the server system, the interactive media item, the publishing comprising providing access for a playback of the interactive media item based on metadata for the interactive media item, the metadata for the interactive media item generated using the information associated with the interactive media item and including a mapping of an effect parameter for a first effect of the one or more effects to a touch input gesture, wherein the playback comprises: in response to user selection of the interactive media item, presenting the interactive media item on a display; and in response to detecting a first user input gesture corresponding to the touch input gesture, applying the first effect to the presented interactive media item, the applying of the first effect comprising determining the effect parameter according to one or more characteristics of the first user input gesture, based on the mapping of the effect parameter to the touch input gesture. ### Claim 21 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by one or more processors, cause the one or more processors to: receive information associated with an interactive media item, the information associated with the interactive media item including information identifying an audio file, information identifying at least one visual media file, and information on one or more effects; and publish the interactive media item, the publishing comprising providing access for a playback of the interactive media item based on metadata for the interactive media item, the metadata for the interactive media item generated using the information associated with the interactive media item and including a mapping of an effect parameter for a first effect of the one or more effects to a touch input gesture, wherein the playback comprises: in response to user selection of the interactive media item, presenting the interactive media item on a display; and in response to detecting a first user input gesture corresponding to the touch input gesture, applying the first effect to the presented interactive media item, the applying of the first effect comprising determining the effect parameter according to one or more characteristics of the first user input gesture, based on the mapping of the effect parameter to the touch input gesture.