# US 9,438,805 B2 · Terminal device and image capturing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,805 B2 - Document ID: US9438805B2 - Status: Granted - Kind: B2 - Application number: 13/904,757 - Filed: 2013-05-29 - Published: 2013-12-12 - Granted: 2016-09-06 - Earliest claimed: 2012-06-08 - Assignees: Sony Corporation; Sony Mobile Communications Inc. - Applicants: Sony Mobile Communications, Inc. - Inventors: Susumu Takatsuka; Tetsuya Naruse; Yuji Ide - Web page: https://patentgrep.com/patent/US9438805B2 ## CPC - H04N 23/611: where the recognised objects include parts of the human body - G06F 3/005: {Input arrangements through a video camera} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing apparatus that acquires image data captured by an image capturing device; performs an analysis on the image data prior to cropping the image data for display to detect a specified image from the image data; generates an image for display by cropping the image data; controls a display to display the image for display; and executes predetermined processing when the specified image is detected in the image data as a result of performing the analysis on the image data prior to the cropping. ## Claims ### Claim 1 An information processing apparatus, comprising: circuitry configured to acquire moving image data captured by a moving image capturing device; generate a moving image for display by cropping the moving image data; perform an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display; control a display to display the generated moving image after cropping the moving image data for display; and execute predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and the circuitry is configured to control the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display. ### Claim 2 (depends on 1) The information processing apparatus of claim 1, further comprising: the moving image capturing device configured to capture the moving image data. ### Claim 3 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to rotate the base to which the information processing apparatus is coupled; and control the base to rotate based on the detected gesture made by the hand. ### Claim 4 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to perform a zoom operation corresponding to the moving image for display; and control the display to enlarge the moving image for display based on the detected gesture made by the hand. ### Claim 5 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to perform a moving image capture operation; and control the moving image capturing device to capture a moving image based on the detected gesture made by the hand. ### Claim 6 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a tip of a user's finger being pointed upright and rotated in a clockwise or counter clockwise direction; and control the display to enlarge or reduce a size of the moving image for display based on the detected gesture made by the hand. ### Claim 7 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to rotate the base to which the information processing apparatus is coupled; and control the base to rotate based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data. ### Claim 8 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to the command to change the tilt angle of the base to which the information processing apparatus is coupled; and control the base to tilt based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data. ### Claim 9 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to perform a zoom operation corresponding to the moving image for display; and control the display to enlarge the moving image for display based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data. ### Claim 10 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is configured to: compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to perform a moving image capture operation; and control the moving image capturing device to capture a moving image based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data. ### Claim 11 (depends on 1) The information processing apparatus of claim 1, wherein the predetermined processing comprises determining that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to change a tilt angle of a base to which the information processing apparatus is coupled, and controlling the base to tilt based on the detected gesture made by the hand. ### Claim 12 A method performed by an information processing apparatus, the method comprising: acquiring moving image data captured by a moving image capturing device; generating a moving image for display by cropping the moving image data; performing an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display; controlling a display to display the generated moving image after cropping the moving image data for display; and executing predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and the controlling includes controlling the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display. ### Claim 13 A non-transitory computer-readable medium including computer-program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to: acquire moving image data captured by a moving image capturing device; generate a moving image for display by cropping the moving image data; perform an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display; control a display to display the generated moving image after cropping the moving image data for display; and execute predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and the control of the display includes controlling the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display.