Back to results
US 10,373,510 B2Granted
Apparatus, method, and system of insight-based cognitive assistant for enhancing user's expertise in learning, review, rehearsal, and memorization
AssigneeFuvi Cognitive Network Corp.
InventorPhu-Vinh Nguyen
Life of this patent
Estimating the term…
Abstract
A personal intuition-based cognitive assistant system includes one or more components which may be worn by a user as a camera-headset, one or more sensors that capture an intuitive state of the user, a camera that capture videos, a processor that provides a cognitive navigating map for the captured videos based on the captured intuitive states of the user, and an inputter that input notes, comments to the videos linked by cognitive navigating map, and a memory to store all components of the information with links and identified cognitive map.
Claims16
A personal emotion-based learning assistant system comprising:
- at least one data capture apparatus which captures data comprising synchronized visual and audio information and which captures corresponding cognitive signals generated from a user;
- and
- at least one display apparatus configured to:
- output multi-component information of the visual and audio information in different display areas of the at least one display apparatus, wherein the different display areas comprise:
- at least one first video playing area in which a video of the visual and audio information is played, and
- at least one second additional information area in which a plurality of synchronized text and symbol scrolling segments are displayed, wherein the plurality of synchronized text and symbol scrolling segments comprise at least one of the visual and audio information converted to text and symbols and are displayed synchronously with the played video;
- generate and display, on at least one of the first video playing area and the second additional information area, a plurality of indicators synchronized with the displayed text and symbol segments;
- divide the data captured by the at least one data capture apparatus into a plurality of segments;
- for each of the plurality of segments, determine a first cognitive state and a second cognitive state of the user, from among a plurality of types of cognitive states and a first level of the determined first cognitive state and a second level of the determined second cognitive state, from among a plurality of levels of the cognitive states,
- wherein the first cognitive state is determined based on the cognitive signals generated from the user during the capturing of the data by the data capture apparatus,
- wherein the second cognitive state is determined based on the cognitive signals generated from the user during replay of the data in the at least one first video playing area,
- wherein the plurality of indicators indicate the first cognitive state and the second cognitive state for a corresponding segment from among the plurality of segments.
9 more elements
A personal emotion-based learning assistant method comprising:
- capturing, by at least one data capture apparatus, data comprising synchronized visual and audio information;
- capturing, by the at least one data capture apparatus, cognitive signals generated from a user corresponding to the captured data;
- outputting multi-component information of the captured synchronized visual and audio information in different display areas, wherein the different display areas comprise:
- at least one first video playing area in which a video of the captured synchronized visual and audio information is played, and
- at least one second additional information area in which a plurality of synchronized text and symbol scrolling segments are displayed, wherein the plurality of synchronized text and symbol scrolling segments comprise at least one of the captured synchronized visual and audio information converted to text and symbols and are displayed synchronously with the played video;
- generating and displaying, by at least one display apparatus, on at least one of the first video playing area and the second additional information area, a plurality of indicators synchronized with the displayed text and symbol segments;
- dividing the data captured by the at least one data capture apparatus into a plurality of segments;
- and
- for each of the plurality of segments, determining a first cognitive state and a second cognitive state of the user, from among a plurality of types of cognitive states and determining a first level of the determined first cognitive state and a second level of the determined second cognitive state, from among a plurality of levels of the cognitive states,
- wherein the first cognitive state is determined based on the cognitive signals generated from the user during the capturing of the data by the data capture apparatus,
- wherein the second cognitive state is determined based on the cognitive signals generated from the user during a replay of the data in the at least one first video playing area, and
- wherein the plurality of indicators indicate the first cognitive state and the second cognitive state for a corresponding segment from among the plurality of segments.
9 more elements
A non-transitory computer readable recording medium storing therein a personal emotion-based cognitive assistant method, which when executed by a computer causes the computer to:
- control at least one data capture apparatus to capture data comprising synchronized visual and audio information;
- control the at least one data capture apparatus to capture cognitive signals generated from a user corresponding to the captured data;
- output multi-component information of the visual and audio information in different display areas,
- wherein the different display areas comprise:
- at least one first video playing area in which a video of the visual and audio information is played, and
- at least one second additional information area in which synchronized text and symbol scrolling segments are displayed, wherein the synchronized text and symbol scrolling segments comprise at least one of the visual and audio information converted to text and symbols and are displayed synchronously with the played video;
- generate and display on at least one of the first video playing area and the second additional information area, a plurality of indicators synchronized with the displayed synchronized text and symbol segments;
- divide the data captured by the at least one data capture apparatus into a plurality of segments;
- and
- for each of the plurality of segments, determine a first cognitive state of the user and a second cognitive state of the user, from among a plurality of types of cognitive states and determine a first level of the cognitive state and a second level of the cognitive state, from among a plurality of levels of the cognitive state,
- wherein the first cognitive state is determined based on the cognitive signals generated from the user during the capturing of the data by the data capture apparatus,
- wherein the second cognitive state is determined based on the cognitive signals generated from the user during a replay of the data in the at least one first video playing area, and
- wherein the plurality of indicators indicate the first cognitive state and the second cognitive state for a corresponding segment from among the plurality of segments.
10 more elements
Dependencies are inferred from the claim text.