System and method for combining computer-based educational content recording and video-based educational content recording
AssigneeUdacity, Inc.
InventorKatlyn Ann Reichelt
Life of this patent
Estimating the term…
Abstract
An interactive learning tool that combines computer-based educational content recordings and video-based educational content recordings.
Claims36
A composite lecture video generation system comprising:
- a mobile device operable to generate a screen capture video, based on display output being output from a display screen of the mobile device, the screen capture video including display output corresponding to graphical markings;
- a video camera module operable to generate an audio-visual recording of the display screen, the graphical markings, and one or more physical objects positioned between the video camera and the display screen;
- and
- a composite lecture video generator operable to:
- process the screen capture video to increase a transparency of one or more white portions of the screen capture video;
- synchronize a timing and an orientation of the processed screen capture video with a timing and an orientation of the audio-visual recording, by matching, for each of one or more video frames of the processed screen capture video, the graphical markings included in the corresponding video frame of the processed screen capture video with the graphical markings recorded in a specific video frame of the audio-visual recording;
- and
- superimpose the synchronized processed screen capture video over the synchronized audio-visual recording to generate a composite lecture video, the composite lecture video including the graphical markings included in the screen capture video superimposed over the graphical markings recorded in the audio-visual recording.
A composite lecture video generator comprising:
- a mobile device interface module operable to receive a screen capture video from a mobile device, the screen capture video being generated by the mobile device based on display output being output from a display screen of the mobile device, the screen capture video including display output corresponding to graphical markings;
- a video camera interface module operable to receive, from a video camera, an audio-visual recording of the display screen, the graphical markings, and one or more physical objects positioned between the video camera and the display screen;
- and
- a processing module operable to:
- process the screen capture video to increase a transparency of one or more white portions of the screen capture video;
- synchronize a timing and an orientation of the processed screen capture video with a timing and an orientation of the audio-visual recording, by matching, for each of one or more video frames of the processed screen capture video, the graphical markings included in the corresponding video frame of the processed screen capture video with the graphical markings recorded in a specific video frame of the audio-visual recording;
- and
- superimpose the synchronized processed screen capture video over the synchronized audio-visual recording to generate a composite lecture, the composite lecture video including the graphical markings included in the screen capture video superimposed over the graphical markings recorded in the audio-visual recording.
A method for generating a composite lecture video, the method comprising:
- receiving a screen capture video from a mobile device, the screen capture video being generated by the mobile device based on display output being output from a display screen of the mobile device, the screen capture video including display output corresponding to graphical markings;
- receiving, from a video camera, an audio-visual recording of the display screen, the graphical markings, and one or more physical objects positioned between the video camera and the display screen;
- processing the screen capture video to increase a transparency of one or more white portions of the screen capture video;
- synchronizing a timing and an orientation of the processed screen capture video with a timing and an orientation of the audio-visual recording, by matching, for each of one or more video frames of the processed screen capture video, the graphical markings included in the corresponding video frame of the processed screen capture video with the graphical markings recorded in a specific video frame of the audio-visual recording;
- and
- superimposing the synchronized processed screen capture video over the synchronized audio-visual recording to generate a composite lecture, the composite lecture video including the graphical markings included in the screen capture video superimposed over the graphical markings recorded in the audio-visual recording.
An article of manufacture including a non-transitory machine readable storage device that stores a data structure produced using a process comprising:
- producing a first sequence of first frames that each encompass a view of a planar region;
- wherein producing the first frames includes recording within the first sequence of first frames a displaying of graphics within the planar region as the graphics are displayed from a viewpoint in which an object is disposed between the viewpoint and the planar region so as to obscure at least a portion of the displayed graphics;
- producing a second sequence of second frames that each encompass a view of the graphics within the planar region;
- wherein producing the second frames includes recording within the second sequence of second frames the displaying of graphics within the planar region;
- processing the second sequence of second frames to increase a transparency of one or more white portions of the second sequence of second frames;
- synchronizing the first and second sequences of frames to identify correlated pairs of first and second frames, by matching, for each of one or more video frames of the first sequence of first frames, the graphics included in the corresponding video frame of the first sequence of first frames with the graphics recorded in a specific video frame of the second sequence of second frames;
- and
- superposing the graphics or portions thereof shown in the processed second sequence of second frames with respect to portions of the object shown in the first sequence of first frames that obscure such graphics or portions thereof.
An article of manufacture including a non-transitory machine readable storage device comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
- generating a sequence of frames that each encompasses a view of a planar region and that show graphics displayed within the region from a viewpoint in which an object is shown disposed between the viewpoint and the region and in which images of the graphics or portions thereof are shown superposed with respect to portions of the object that otherwise would obscure such graphics or portions thereof;
- processing the images of the graphics or portions thereof to increase a transparency of one or more white portions of the images;
- and
- synchronizing a timing and an orientation of the images with a timing and an orientation of the sequence of frames, by matching, for each of one or more video frames associated with the images, the graphics or portions thereof included in the corresponding video frame associated with the images with the graphics recorded in a specific video frame of the sequence of frames.
An electronic display device comprising:
- one or more processors configured to display a sequence of image frames that each encompasses a view of a planar region and that show graphics displayed within the region from a viewpoint in which an object is shown disposed between the viewpoint and the region and in which images of the graphics or portions thereof are shown superposed with respect to portions of the object that otherwise would obscure such graphics or portions thereof,
- wherein the images of the graphics or portions thereof are processed to increase a transparency of one or more white portions of the images, and
- wherein a timing and an orientation of the images is synchronized with a timing and an orientation of the sequence of image frames, by matching, for each of one or more video frames associated with the images, the graphics or portions thereof included in the corresponding video frame associated with the images with the graphics recorded in a specific video frame of the sequence of image frames.
Dependencies are inferred from the claim text.