# US 2019/0174112 A1 · Information processing apparatus and control method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174112 A1 - Document ID: US20190174112A1 - Status: Published application - Kind: A1 - Application number: 16/202,472 - Filed: 2018-11-28 - Published: 2019-06-06 - Earliest claimed: 2017-12-06 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Daichi Adachi - Web page: https://patentgrep.com/patent/US20190174112A1 ## CPC - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation - H04N 13/139: Format conversion, e.g. of frame-rate or size - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/234: Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs - H04N 23/60: Control of cameras or camera modules - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An information processing apparatus, which transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, obtains an image based on image capturing by an image capturing apparatus, obtains camera viewpoint information about at least one of a position and orientation of the image capturing apparatus, obtains virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint, reduces an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information, and transmits the image with the reduced information amount to the image processing apparatus. ## Claims ### Claim 1 An information processing apparatus that transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, the apparatus comprising: an image obtaining unit configured to obtain an image based on image capturing by an image capturing apparatus; a first obtaining unit configured to obtain camera viewpoint information about at least one of a position and orientation of the image capturing apparatus; a second obtaining unit configured to obtain virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint; a reduction unit configured to reduce an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information; and a transmission unit configured to transmit the image with the reduced information amount to the image processing apparatus. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the camera viewpoint information includes information indicating an orientation of an optical axis of the image capturing apparatus, the virtual viewpoint information includes information indicating an orientation of an optical axis of the virtual viewpoint, and the reduction unit determines, based on a difference between the orientation of the optical axis of the image capturing apparatus and the orientation of the optical axis of the virtual viewpoint, whether to reduce the information amount of the obtained image. ### Claim 3 (depends on 2) The apparatus according to claim 2, wherein the second obtaining unit obtains pieces of virtual viewpoint information about a plurality of virtual viewpoints, and the reduction unit determines, based on a difference between the orientation of the optical axis of the image capturing apparatus and each of orientations of optical axes of the plurality of virtual viewpoints, whether to reduce the information amount of the obtained image. ### Claim 4 (depends on 3) The apparatus according to claim 3, wherein if the difference is larger than a predetermined value, the reduction unit reduces the information amount of the obtained image. ### Claim 5 (depends on 4) The apparatus according to claim 4, wherein the reduction unit reduces information about a color and/or shape of the obtained image. ### Claim 6 (depends on 4) The apparatus according to claim 4, wherein the reduction unit reduces information about an object included in the obtained image. ### Claim 7 (depends on 6) The apparatus according to claim 6, wherein the reduction unit performs processing of reducing information about a color and/or shape of the object. ### Claim 8 (depends on 4) The apparatus according to claim 4, wherein the reduction unit reduces a frame rate of the obtained image. ### Claim 9 An information processing apparatus comprising: a first obtaining unit configured to obtain information about at least one of a position and orientation of each of a plurality of image capturing apparatuses that capture an object from a plurality of different directions; a second obtaining unit configured to obtain information about at least one of a position and orientation of a virtual viewpoint; a reduction unit configured to reduce, based on information about at least one of the position and orientation of each of the plurality of image capturing apparatuses and at least one of the position and orientation of the virtual viewpoint, an information amount of a captured image selected from captured images of the plurality of image capturing apparatuses; and a control unit configured to control to store, in a memory, the captured image with the information amount reduced by the reduction unit. ### Claim 10 (depends on 9) The apparatus according to claim 9, wherein the control unit writes, in the memory of a storage device connected to the information processing apparatus, the captured image with the information amount reduced by the reduction unit. ### Claim 11 (depends on 9) The apparatus according to claim 9, wherein the memory is provided, and the control unit writes, in the memory, the captured image with the information amount reduced by the reduction unit. ### Claim 12 A control method for an information processing apparatus that transmits, to an image processing apparatus for generating a virtual viewpoint image, at least some of a plurality of images based on image capturing from a plurality of different directions, the method comprising: obtaining an image based on image capturing by an image capturing apparatus; obtaining camera viewpoint information about at least one of a position and orientation of the image capturing apparatus; obtaining virtual viewpoint information about at least one of a position and orientation of the virtual viewpoint; reducing an information amount of the obtained image based on the camera viewpoint information and the virtual viewpoint information; and transmitting the image with the reduced information amount to the image processing apparatus. ### Claim 13 A control method for an information processing apparatus, comprising: obtaining information about at least one of a position and orientation of each of a plurality of image capturing apparatuses that capture an object from a plurality of different directions; obtaining information about at least one of a position and orientation of a virtual viewpoint; reducing an information amount of a captured image selected from captured images of the plurality of image capturing apparatuses based on information about at least one of the position and orientation of each of the plurality of image capturing apparatuses and at least one of the position and orientation of the virtual viewpoint; and writing, in a storage device, the captured image with the reduced information amount.