# US 8,571,378 B2 · Image capturing apparatus and recording method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,571,378 B2 - Document ID: US8571378B2 - Status: Granted - Kind: B2 - Application number: 12/066,762 - Filed: 2006-07-19 - Published: 2009-05-28 - Granted: 2013-10-29 - Earliest claimed: 2005-09-13 - Assignees: Sony Corporation - Applicants: Naoki Morimoto - Inventors: Naoki Morimoto - Web page: https://patentgrep.com/patent/US8571378B2 ## CPC - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)} - G11B 27/322: {used signal is digitally coded} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 21/8455: {involving pointers to the content, e.g. pointers to the I-frames of the video stream} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract When setting of marking on recording data is performed, the marking is automatically performed at a suitable position corresponding to a status during image capturing. While recording of captured images is being performed, a status of a zoom operation, a moving pattern of a camera, and a feature value of video/audio signals are monitored, and a time point at which a predetermined change has occurred regarding this monitored state is detected. A predetermined data position based on this detected time point is then set as a marking position. Setting information of the marking position is stored in a structure of management information, and is stored in a storage section together with the recording data. ## Claims ### Claim 1 An image capturing apparatus, comprising: an image pickup section configured to acquire a plurality of successive images through image capturing; a storage section configured to store the acquired images as moving image information; and a control section having a processor and configured to execute instructions to: detect a change in a predetermined state of the image capturing apparatus during acquisition of the images, the change in the predetermined state comprising a change in a spatial position of the image capturing apparatus; identify, in response to the detected change in the predetermined state, a first temporal position within the moving image information, the first temporal position corresponding to the detected change in the predetermined state; determine, within the moving image information, a second temporal position at which a magnitude of the change in spatial position exceeds a threshold value, the second temporal position corresponding to an effect of the detected change within the moving image information; determine whether a difference between the first and second temporal positions exceeds a threshold time period; and when difference exceeds the threshold time period, generate a signal to store information associated with the predetermined state at the second temporal position within the moving image information. ### Claim 2 (depends on 1) The image capturing apparatus of claim 1, wherein: the image pickup section comprises a view angle changing unit for changing an angle of view of an optical system for capturing the images; and the control section is further configured to detect, as the change in the predetermined state of the image capturing apparatus, an occurrence of a predetermined change in the angle of view. ### Claim 3 (depends on 1) The image capturing apparatus of claim 1, further comprising: a movement detecting section for detecting movement of the image capturing apparatus, wherein the control section is further configured to detect, as the change in the predetermined state of the image capturing apparatus, an occurrence of a predetermined movement of the apparatus. ### Claim 4 (depends on 1) The image capturing apparatus of claim 1, wherein: the image pickup section is further configured to determine information indicative of a distance between an apparatus and a subject that is utilized in an auto focus control operation; and the control section is further configured to detect, as the change in the predetermined state of the image capturing apparatus, an occurrence of a predetermined change in the distance. ### Claim 5 (depends on 1) The image capturing apparatus of claim 1, wherein the control section is further configured to detect, as the change in the predetermined state of the image capturing apparatus, an occurrence of a predetermined change in a feature value in the acquired images. ### Claim 6 (depends on 1) The image capturing apparatus of claim 1, comprising: a sound pickup section for detecting sound as audio information, wherein the control section is further configured to detect, as the change in the predetermined state of the image capturing apparatus, an occurrence of a predetermined change in a feature value in the audio information. ### Claim 7 (depends on 1) The image capturing apparatus of claim 1, comprising: a position detecting section for determining a position of the apparatus, wherein the change in spatial position corresponds to a displacement between the determined apparatus position and a reference position of the apparatus. ### Claim 8 (depends on 7) The image capturing apparatus of claim 7, wherein the control section is further configured to determine that the displacement between the determined and reference positions is equal to or greater than a threshold value, or is equal to or smaller than the threshold value. ### Claim 9 (depends on 7) The image capturing apparatus of claim 7, wherein the reference position corresponds to a prior position of the apparatus. ### Claim 10 (depends on 7) The image capturing apparatus of claim 7, wherein the reference position corresponds to a position of the apparatus specified through a specifying operation. ### Claim 11 (depends on 1) The image capturing apparatus of claim 1, wherein the second temporal position occurs at a predetermined time after the first temporal position. ### Claim 12 (depends on 1) The image capturing apparatus of claim 1, wherein the second temporal position occurs at a predetermined time before the first temporal position. ### Claim 13 (depends on 1) The image capturing apparatus of claim 1, further comprising: a display processing section configured to generate a signal to display at least a portion of the moving image information to a user, the displayed moving image information reflecting the predetermined state information at the second temporal position. ### Claim 14 (depends on 1) The image capturing apparatus of claim 1, further comprising: a display processing section configured to playback the moving image information from the second temporal position. ### Claim 15 (depends on 1) The apparatus of claim 1, wherein the control section is further configured to: receive information indicate of a current spatial position of the apparatus; and compute the change in spatial position of the apparatus based on the received information and at least one prior spatial position of the apparatus. ### Claim 16 (depends on 1) The apparatus of claim 1, wherein the change in the predetermined state of the apparatus further comprises a change in a complexity of the moving image information. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein: the moving image information is compressed in accordance with a corresponding compression coefficient; and the control section is further configured to compute the complexity based a correlation between the compression coefficient and an amount of moving image information compressed using the coefficient. ### Claim 18 (depends on 1) The apparatus of claim 1, wherein: the change in the predetermined state of the apparatus corresponds to an action taken by a user of the apparatus at the first temporal position; and the second temporal position identifies a portion of the moving picture information that includes an outcome of the user action. ### Claim 19 A method, comprising: acquiring a plurality of successive images through image capturing; storing, in a storage medium, the acquired images to generate moving image information; detecting a change in spatial position of an image capturing apparatus during acquisition of the images; in response to the detected change in the spatial position, identifying, using a processor, a first temporal position within the moving image information; determining, within the moving image information, a second temporal position at which a magnitude of the change in spatial position exceeds a threshold value, the second temporal position corresponding to an effect of the detected change within the moving image information; determining whether a difference between the first and second temporal positions exceeds a threshold time period; and when difference exceeds the threshold time period, generating a signal to store information associated with the predetermined state at the second temporal position within the moving image information. ### Claim 20 (depends on 19) The method of claim 19, wherein the second temporal position occurs at a predetermined time after the first temporal position. ### Claim 21 (depends on 19) The method of claim 19, wherein the second temporal position occurs at a predetermined time before the first temporal position. ### Claim 22 A tangible, non-transitory computer-readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method comprising the steps of: acquiring a plurality of successive images through image capturing; storing, in a storage medium, the acquired images to generate moving image information; detecting a change in a spatial position of an image capturing apparatus during acquisition of the images; identifying, in response to the detected change in the spatial position, a first temporal position within the moving image information; determining, within the moving image information, a second temporal position at which a magnitude of the change in spatial position exceeds a threshold value, the second temporal position corresponding to an effect of the detected change within the moving image information; determining whether a difference between the first and second temporal positions exceeds a threshold time period; and when difference exceeds the threshold time period, generating a signal to store information associated with the predetermined state at the second temporal position within the moving image information. ### Claim 23 (depends on 22) The computer-readable medium of claim 22, wherein the second temporal position occurs at a predetermined time after the first temporal position. ### Claim 24 (depends on 22) The computer-readable medium of claim 22, wherein the second temporal position occurs at a predetermined time before the first temporal position.