# US 10,503,824 B2 · Video on charts > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,503,824 B2 - Document ID: US10503824B2 - Status: Granted - Kind: B2 - Application number: 15/339,245 - Filed: 2016-10-31 - Published: 2017-05-04 - Granted: 2019-12-10 - Earliest claimed: 2015-11-02 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: John Campbell; Jim Sun; Samuel C. Radakovitz; Matthew Hart Fichtner; Christian Canton - Web page: https://patentgrep.com/patent/US10503824B2 ## CPC - G06F 40/18: of spreadsheets (form-filling G06F40/174) - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 40/106: Display of layout of documents; Previewing - G06T 11/26: Drawing of charts or graphs - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - H04L 43/045: for graphical visualisation of monitoring data - H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] - H04L 65/70: Media network packetisation - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems and methods for charting videos and/or attributes of videos associated with a spreadsheet are provided. For instance, when a video is associated with a spreadsheet, the video may be treated as a new type of data within the spreadsheet. In some aspects, a plurality of videos may be associated with a spreadsheet, e.g., within a single cell or a range of cells. In aspects, the videos themselves, as well as video data (e.g., raw pixel data for each video frame, modulated data representing soundwaves of an audio file, etc.), video attributes (e.g., frame rate, aspect ratio, duration, resolution, bits per frame, video size, synchronization data, etc.), frame attributes (e.g., aspect ratio, color space, bitrate, etc.), audio attributes (e.g., pitch, volume, speed, etc.), and/or spreadsheet data (e.g., values in cells, user comments, etc.) may be incorporated into a chart using a spreadsheet charting function, either automatically or by user selection. ## Claims ### Claim 1 A system comprising: at least one processing unit; and at least one memory storing computer executable instructions that, when executed by the at least one processing unit, cause the system to perform a method, the method comprising: receiving a selection of one or more cells within a spreadsheet; identifying at least one video associated with the selected one or more cells, wherein the at least one video is associated with one or more parameters; extracting one or more values for at least one parameter from the at least one video; receiving a selection of a charting function; and creating a chart by charting the one or more values of the at least one parameter of the at least one video. ### Claim 2 (depends on 1) The system of claim 1, wherein the at least one video is associated with at least one cell within the selected one or more cells. ### Claim 3 (depends on 1) The system of claim 1, wherein the at least one video is associated with at least one cell related to the selected one or more cells. ### Claim 4 (depends on 3) The system of claim 3, wherein the at least one cell related to the selected one or more cells is in the same row or column as at least one cell within the selected one or more cells. ### Claim 5 (depends on 1) The system of claim 1, wherein the one or more parameters comprise one or more video attributes selected from the group consisting of: a frame rate; an aspect ratio; a duration; a resolution; bits per frame; video size; audio synchronization data; subtitle data; a color space; a frequency; an amplitude; a sampling rate; a codec; a bitrate; a volume; a pitch; a speed; a channel; an audio effect; an artist; a creation date; a creation time; a file size; and a duration. ### Claim 6 (depends on 1) The system of claim 1, wherein the one or more parameters comprise video data comprising one or more of: an array of pixel values for rendering each frame of the at least one video; and modulated data for reproducing soundwaves of an audio track. ### Claim 7 (depends on 1) The system of claim 1, the computer executable instructions further causing the system to incorporate the at least one video into the chart, wherein incorporating the at least one video into the chart further comprises: incorporating a visual representation of the at least one video into the chart; and in response to receiving a selection of the visual representation, playing the at least one video within the chart. ### Claim 8 (depends on 7) The system of claim 7, further comprising: receiving a selection of the visual representation; and in response to receiving a selection of the visual representation, providing one or more play controls comprising one or more of: a control for playing the at least one video; a control for skipping back within the at least one video; a control for skipping forward within the at least one video; a control for pausing the at least one video; a control for rewinding the at least one video; a control for fast forwarding the at least one video; and a control for stopping the at least one video. ### Claim 9 (depends on 1) The system of claim 1, wherein the at least one video includes subtitles. ### Claim 10 (depends on 9) The system of claim 9, further comprising incorporating the subtitles into the chart. ### Claim 11 A system comprising: at least one processing unit; and at least one memory storing computer executable instructions that, when executed by the at least one processing unit, cause the system to: receive a selection of one or more cells within a spreadsheet, wherein the one or more cells contain data; identify at least one video associated with the selected one or more cells, wherein the video relates to the data; receive a selection of a charting function; create a chart based on the data; and incorporate a visual representation of the at least one video into the chart, wherein the visual representation includes a play control for playing the video from the chart. ### Claim 12 (depends on 11) The system of claim 11, wherein the at least one video is associated with one or more parameters, the computer executable instructions further causing the system to: receive a change to at least one parameter of the at least one video within the spreadsheet; and automatically apply the change to the at least one video incorporated into the chart. ### Claim 13 (depends on 12) The system of claim 12, wherein incorporating the at least one video into the chart comprises at least one of: displaying a visual representation of the at least one video as a data point within the chart; and displaying a visual representation of the at least one video within at least a portion of a bar within the chart. ### Claim 14 (depends on 13) The system of claim 13, further comprising: receiving a selection of the visual representation; and in response to receiving a selection of the visual representation, displaying one or more play controls comprising one or more of: a control for playing the at least one video; a control for skipping back within the at least one video; a control for skipping forward within the at least one video; a control for pausing the at least one video; a control for rewinding the at least one video; a control for fast forwarding the at least one video; and a control for stopping the at least one video. ### Claim 15 (depends on 14) The system of claim 14, further comprising: receiving a selection of the visual representation; and in response to receiving a selection of the visual representation, displaying at least one parameter associated with the at least one video. ### Claim 16 A method implemented by a computer system for charting one or more parameters of a video, the method comprising: receiving a selection of one or more cells within a spreadsheet; identifying at least one video associated with the selected one or more cells; receiving a selection of a charting function; extracting one or more values for one or more parameters from the at least one video; and creating a chart based at least in part on the one or more values of the one or more parameters. ### Claim 17 (depends on 16) The method of claim 16, wherein the one or more parameters comprise one or more video attributes selected from the group consisting of: a frame rate; an aspect ratio; a duration; a resolution; bits per frame; video size; audio synchronization data; subtitle data; a color space; a frequency; an amplitude; a sampling rate; a codec; a bitrate; a volume; a pitch; a speed; a channel; an audio effect; an artist; a creation date; a creation time; a file size; and a duration. ### Claim 18 (depends on 16) The method of claim 16, wherein the one or more parameters comprise video data comprising one or more of: an array of pixel values for rendering each frame of the at least one video; and modulated data for reproducing soundwaves of an audio track. ### Claim 19 (depends on 16) The method of claim 16, wherein at least two videos are associated with the selected one or more cells, further comprising: charting at least one parameter of a first video versus at least one parameter of a second video. ### Claim 20 (depends on 16) The method of claim 16, wherein the one or more parameters are retrieved from metadata associated with the at least one video. ### Claim 21 (depends on 16) The method of claim 16, wherein the one or more parameters are retrieved from a compound data type associated with the at least one video. ### Claim 22 (depends on 21) The method of claim 21, wherein the compound data type comprises the at least one video and the one or more parameters in a structured format. ### Claim 23 (depends on 16) The method of claim 16, wherein the one or more parameters are not displayed within the spreadsheet.