# US 2014/0153900 A1 · Video processing apparatus and method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0153900 A1 - Document ID: US20140153900A1 - Status: Published application - Kind: A1 - Application number: 14/078,782 - Filed: 2013-11-13 - Published: 2014-06-05 - Earliest claimed: 2012-12-05 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Toshiyuki Tanaka - Web page: https://patentgrep.com/patent/US20140153900A1 ## CPC - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed herein is a video processing apparatus and method. The video processing apparatus includes a first video capture unit that captures an image of a user. The video processing apparatus further includes an analysis unit that recognizes the user's face from a first video captured by the first video capture unit, and analyzes a feature of the user's face. The video processing apparatus further includes an evaluation value calculation unit that calculates an evaluation value based on the analyzed feature of the user's face, when capturing or displaying a second video. The video processing apparatus also includes a recording unit that records the evaluation value to be mapped to a timeline of the second video. The video processing apparatus also includes a video editing unit that extracts a partial video from the second video based on the evaluation value to generate a video summary. ## Claims ### Claim 1 A video processing apparatus comprising: a first video capture unit that captures an image of a user; an analysis unit that recognizes the user's face from a first video captured by the first video capture unit, and analyzes a feature of the user's face; an evaluation value calculation unit that calculates an evaluation value based on the analyzed feature of the user's face, when capturing or displaying a second video; a recording unit that records the evaluation value to be mapped to a timeline of the second video; and a video editing unit that extracts a partial video from the second video based on the evaluation value to generate a video summary. ### Claim 2 (depends on 1) The video processing apparatus of claim 1, further comprising a second video capture unit that captures the second video; wherein the evaluation calculation unit calculates the evaluation value when the second video capture unit captures the second video. ### Claim 3 (depends on 2) The video processing apparatus of claim 2, wherein the evaluation value calculation unit extracts a facial expression factor based on the feature of the user's face analyzed from the first video, when the second video capture unit captures the second video. ### Claim 4 (depends on 1) The video processing apparatus of claim 1, wherein the video editing unit sequentially extracts a partial video of a timeline section, in which the evaluation value is greater than a threshold value, to generate the video summary. ### Claim 5 (depends on 4) The video processing apparatus of claim 4, wherein the video editing unit changes the threshold value such that a total time of the partial video corresponds to a predetermined editing time, thereby extracting the partial video. ### Claim 6 (depends on 4) The video processing apparatus of claim 4, wherein the video editing unit sequentially extracts the partial video of a buffered timeline section obtained by adding buffer times before, after, or both before and after the timeline section in which the evaluation value is greater than the threshold value. ### Claim 7 (depends on 1) The video processing apparatus of claim 1, wherein the evaluation value calculation unit extracts a facial expression factor based on one or more predetermined rules. ### Claim 8 (depends on 7) The video processing apparatus of claim 7, wherein the evaluation value calculation unit extracts, based on the one or more predetermined rules, the facial expression factor as at least one of a factor of eyes becoming narrow, a factor of the eyes being opened wide, a factor of corners of the eyes slanting downward, a factor of a mouth being opened, or a factor of corners of the mouth slanting upward, in the facial expression. ### Claim 9 (depends on 7) The video processing apparatus of claim 7, wherein the one or more predetermined rules are defined to give a high importance to a selected factor which is determined as greatly affecting an expression change of the user's face. ### Claim 10 (depends on 1) The video processing apparatus of claim 1, wherein the recording unit records, as metadata, the evaluation value in a video file of the second video. ### Claim 11 (depends on 1) The video processing apparatus of claim 1, wherein the recording unit records the evaluation value as a separate file that corresponds to a video file of the second video in a one-to-one relationship. ### Claim 12 A video processing method comprising: capturing at least one image of a user when capturing or displaying a second video; recognizing the user's face from the at least one image of the user, and analyzing a feature of the user's face; extracting a facial expression factor for the user's face based on the analyzed feature of the user's face to calculate an evaluation value; recording the evaluation value to be mapped to a timeline of the second video; and extracting a partial video from the second video based on the evaluation value to generate a video summary for the second video. ### Claim 13 (depends on 12) The video processing method of claim 12, further comprising capturing the second video, wherein the calculating of the evaluation value includes calculating the evaluation value when capturing the second video. ### Claim 14 (depends on 12) The video processing method of claim 12, wherein the generating of the video summary comprises sequentially extracting a partial video of a timeline section, in which the evaluation value is greater than a threshold value, to generate the video summary. ### Claim 15 (depends on 14) The video processing method of claim 14, wherein the generating of the video summary comprises changing the threshold value such that a total time of the partial video corresponds to a predetermined editing time, thereby extracting the partial video. ### Claim 16 (depends on 14) The video processing method of claim 14, wherein the generating of the video summary comprises sequentially extracting the partial video of a buffered timeline section obtained by adding buffer times before, after, or both before and after the timeline section in which the evaluation value is greater than the threshold value. ### Claim 17 (depends on 12) The video processing method of claim 12, wherein the calculating of an evaluation value comprises extracting a facial expression factor based on one or more predetermined rules. ### Claim 18 (depends on 17) The video processing method of claim 17, wherein the one or more predetermined rules are defined to give a high importance to a selected factor which is determined as greatly affecting an expression change of the user's face. ### Claim 19 (depends on 12) The video processing method of claim 12, wherein the recording comprises recording, as metadata, the evaluation value in a video file of the second video. ### Claim 20 (depends on 12) The video processing method of claim 12, wherein the recording comprises recording the evaluation value as a separate file that corresponds to a video file of the second video in a one-to-one relationship. ### Claim 21 A non-transitory computer-readable recording medium that stores computer program codes for executing a video processing method when read out and executed by a processor, the video processing method comprising: capturing at least one image of a user when capturing or displaying a second video; recognizing the user's face from the at least one image of the user, and analyzing a feature of the user's face; extracting a facial expression factor for the user's face based on the analyzed feature of the user's face to calculate an evaluation value; recording the evaluation value to be mapped to a timeline of the second video; and extracting a partial video from the second video based on the evaluation value to generate a video summary for the second video.