Gesture based annotations

#Meetings involve multiple participants and interactions in different modes between the participants. It may be of interest to make a record of at least some interactions that take place in a meeting. Meeting transcripts or meeting minutes have been popularly used to record verbal aspects of communication in a meeting. Traditionally, transcripts of a meeting may be made by a person present in the meeting. Currently, transcripts may be generated by recording the conversation in a meeting and converting it to text using speech recognition technology. Meeting videos may also be recorded in some cases for future reference. To contextualize or complement text in a transcript, annotations can be used. Annotations may be, for example, indicators of emphasis, speech directed towards a particular person, requests, orders etc. Annotations to text transcribed using speech recognition, if supported, may either be done manually or be based upon verbal cues by a speaker. Manual annotations may include a person inputting or selecting an annotation using an input device. Verbal cue based annotation may include speech recognition of a verbal cue. A verbal cue may be associated with a particular annotation. In the event a verbal cue is detected, transcribed text corresponding to a time period around the verbal cue may be annotated with the corresponding annotation.

#This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

#In an embodiment a device to convert conversations from a meeting to text and annotate the text is shown. In an embodiment a conversation converter is disclosed, comprising a processor, and a storage medium comprising a set of instructions. The set of instructions causes a processor to receive an audio recording containing speech of a participant of a meeting, receive a video of the participant, identify the participant, convert the audio recording of the participant to a digital text, develop a skeletal map of the participant, recognize a gesture of the participant from the skeletal maps, and detect and identify a target of the gesture. Based on the target and the gesture, the conversation converter determines an annotation for the digital text corresponding to a point of time of the gesture.

#The present description will be better understood from the following detailed description read in light of the accompanying drawings, wherein:

#FIG. 1 illustrates a schematic representation of a device to record and annotate meeting transcripts according to an embodiment;

#FIG. 2 illustrates a schematic representation of a device to record and annotate meeting transcripts according to another embodiment;

#Like reference numerals are used to designate like parts in the accompanying drawings.

#The detailed description provided below in connection with the appended drawings is intended as a description of the embodiments and is not intended to represent the only forms in which the embodiment may be constructed or utilized. However, the same or equivalent functions and structures may be accomplished by different embodiments.

#FIG. 1 shows a schematic illustration of a device 200 to record and annotate meeting transcriptions according to an embodiment. The device 200 may comprise at least one camera 201, at least one microphone 203, at least one processor 202 and at least one storage 204 comprising instructions that cause the processor to implement functionality described herein. The storage 204 may, among other instructions, comprise a skeletal mapping module 219. According to an embodiment, the device 200 may record and annotate meeting transcripts in real time. In some embodiments, the device 200 may also record and annotate transcripts from a previously recorded session where the recording includes both video and audio. According to an embodiment, a meeting may include any verbal exchange or interaction between at least two persons. A meeting may, for example, be a business or office meeting, an informal gathering, a social event, a lecture, a seminar etc.