# US 12,118,259 B2 · Information processing apparatus and information processing method for adjusting display based on presence or absence of an object in a space > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,259 B2 - Document ID: US12118259B2 - Status: Granted - Kind: B2 - Application number: 17/796,306 - Filed: 2021-02-10 - Published: 2023-05-11 - Granted: 2024-10-15 - Earliest claimed: 2020-03-23 - Assignees: Ricoh Company, Ltd. - Applicants: Kanta Shimizu - Inventors: Kanta Shimizu - Web page: https://patentgrep.com/patent/US12118259B2 ## CPC - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof - H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects - H04N 23/11: for generating image signals from visible and infrared light wavelengths - H04N 23/51: Housings - H04N 23/60: Control of cameras or camera modules - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An information processing apparatus for outputting three-dimensional information that is determined based on received light includes an image capture unit configured to capture two-dimensional image information; and an output unit configured to output the two-dimensional image information for displaying, and the three-dimensional information associated with coordinates of the two-dimensional image information. ## Claims ### Claim 1 An information processing apparatus for outputting three- dimensional information that is determined based on received light, the information processing apparatus comprising: image capture circuitry configured to capture two-dimensional image information; a projector configured to project light to a space; a light receiver configured to receive light reflected from one or more objects existing in the space; display control circuitry configured to instruct a display to display differently in accordance with presence or absence of a specific object; and determination circuitry configured to determine that the specific object is present when a charge amount caused by the light received by the light receiver is saturated and a charge amount of a pixel of the image capture circuitry is not saturated. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the output circuitry outputs the two-dimensional image information before outputting the three-dimensional information. ### Claim 3 (depends on 2) The information processing apparatus according to claim 2, wherein the output circuitry outputs the two-dimensional image information before determining the three-dimensional information. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the output circuitry instructs a display to display the two-dimensional image information. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, further comprising the display. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the output circuitry is configured to output the two-dimensional image to one output destination, which is different from another output destination to which the three-dimensional information is output. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, further comprising: a projector configured to project light to a space; a light receiver configured to receive light reflected from one or more objects existing in the space; and three-dimensional information determination circuitry configured to determine the three-dimensional information based on an output from the light receiver. ### Claim 8 (depends on 7) The information processing apparatus according to claim 7, wherein the three-dimensional information determination circuitry determines the three-dimensional information based on the output of the light receiver, and the two-dimensional image information. ### Claim 9 (depends on 8) The information processing apparatus according to claim 8, further comprising another image capture circuitry, wherein the three-dimensional information determination circuitry determines the three- dimensional information based on the output of the light receiver, the two-dimensional image information, and another two-dimensional image information captured by the another image capture circuitry. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, further comprising: another image capture circuitry, and a three-dimensional information determination circuitry configured to determine the three-dimensional information based on the two-dimensional image information, and another two-dimensional image information captured by the another image capture circuitry. ### Claim 11 (depends on 1) The information processing apparatus according to claim 1, wherein the three-dimensional information includes full-view spherical three-dimensional information. ### Claim 12 (depends on 1) The information processing apparatus according to claim 1, further comprising the display. ### Claim 13 (depends on 1) The information processing apparatus according to claim 1, wherein the display control circuitry instructs the display to set a display position of the specific object in accordance with a position of the specific object in the space. ### Claim 14 (depends on 1) The information processing apparatus according to claim 1, wherein the display control circuitry instructs the display to display image information captured by the image capture circuitry, and instructs the display to display identification information identifying the specific object on the image information by superimposing the identification information on the image information. ### Claim 15 (depends on 1) The information processing apparatus according to claim 1, further comprising: output circuitry configured to output the two-dimensional image information for displaying, and the three-dimensional information associated with coordinates of the two-dimensional image information. ### Claim 16 A method of processing information comprising: capturing two-dimensional image information; projecting light to a space; receiving light, at a light receiver, reflected from one or more objects existing in the space; instructing a display to display differently in accordance with presence or absence of a specific object; and determining that the specific object is present when a charge amount caused by the light received by the light receiver is saturated and a charge amount of a pixel of the image capture circuitry is not saturated. ### Claim 17 (depends on 16) The method according to claim 16, further comprising: outputting the two-dimensional image information for displaying; and outputting three-dimensional information, determined based on received light and associated with coordinates of the two-dimensional image information. ### Claim 18 A non-transitory computer-readable medium storing computer-readable instructions that, when executed by processing circuitry, cause the processing circuitry to perform a method comprising: determining that a specific object is present when a charge amount caused by light received by a light receiver is saturated and a charge amount of pixel of image capture circuitry is not saturated; and instructing a display to display differently in accordance with presence or absence of the specific object.