# US 2026/0065584 A1 · System and method for rendering a reflection for a virtual object in an electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2026/0065584 A1 - Document ID: US20260065584A1 - Status: Published application - Kind: A1 - Application number: 19/301,277 - Filed: 2025-08-15 - Published: 2026-03-05 - Earliest claimed: 2024-08-27 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: K Vikas GOWDA; Ankit DHIMAN; Shubham MONGA; Basavaraja Shanthappa VANDROTTI; Lokesh Rayasandra BOREGOWDA; Kihwan KIM - Web page: https://patentgrep.com/patent/US20260065584A1 ## CPC - G06T 15/506: {Illumination models} - G06T 15/04: Texture mapping - G06T 15/06: Ray-tracing - G06T 15/20: Perspective computation - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method for rendering a reflection for a virtual object in an electronic device is provided. The method includes obtaining one or more red, green, and blue (RGB) frames and a depth-map associated with an augmented reality (AR) scene visualized in the electronic device for a user, determining one or more reflective surfaces in the AR scene based on the obtained RGB frames and the depth-map, identifying a type of the determined one or more reflective surfaces in the AR scene, generating a reflection map for the determined one or more reflective surfaces based on a placement of the virtual object, the identified type of the determined one or more reflective surfaces, and applying the generated reflection map on the determined one or more reflective surfaces to render the reflection for the virtual object in the electronic device. ## Claims ### Claim 1 A method for controlling an electronic device, the method comprising: obtaining at least one image frame and depth information associated with an augmented reality (AR) scene provided through the electronic device; determining one or more reflective surfaces in the AR scene, based on the obtained at least one image and the depth information; identifying a type of the determined one or more reflective surfaces in the AR scene; generating a reflection map for the one or more reflective surfaces based on a placement of the virtual object, and the identified type of the one or more reflective surfaces, and applying the generated reflection map on the one or more reflective surfaces to render reflection for the virtual object through the electronic device. ### Claim 2 (depends on 1) The method of claim 1, wherein the obtaining of the at least one image frame and the depth information comprises: forming a 3-dimensional (3D) mesh for a plurality of 3D points provided in the AR scene based on the at least one image frame and the depth information of the AR scene, and extracting a plurality of noisy 3D points with missing depth in the formed 3D mesh. ### Claim 3 (depends on 2) The method of claim 2, further comprising: locating a plurality of 2-dimensional (2D) points associated with the plurality of 3D points on the at least one image frame, and generating a feature map based on the plurality of 2D points. ### Claim 4 (depends on 3) The method of claim 3, wherein the determining of the one or more reflective surfaces in the AR scene comprises: analyzing the feature map and the at least one image frame by a feature descriptor operation to generate a plurality of 2D points associated with the one or more reflective surfaces; re-projecting the generated plurality of 2D points in a plurality of 3D points associated with the one or more reflective surfaces by a reflective surface map generator; and grouping the plurality of 3D points to provide the one or more reflective surfaces. ### Claim 5 (depends on 1) The method of claim 1, further comprises detecting the placement of the virtual object in the AR scene provided through the electronic device after the at least one image frame and the depth information are obtained. ### Claim 6 (depends on 1) The method of claim 1, wherein the identifying of the type of the one or more reflective surfaces comprises analyzing the at least one image frame and the one or more reflective surfaces by identifying the type of the one or more reflective surfaces from a plurality of predetermined types of the one or more reflective surfaces. ### Claim 7 (depends on 6) The method of claim 6, wherein the plurality of predetermined types includes at least one of a mirror type, a metallic type, a matte type, or a glossy type. ### Claim 8 (depends on 1) The method of claim 1, wherein the generating of the reflection map comprises generating the reflection map by a reflective ray tracer operation using at least one parameter, wherein the at least one parameter comprises at least one of a semantic cue, a depth cue, or material cue, wherein the semantic cue is provided from the one or more reflective surfaces, wherein the depth cue is provided from the depth information associated with the AR scene, and wherein the material cue is provided from the identified type of the one or more reflective surfaces. ### Claim 9 (depends on 8) The method of claim 8, further comprising: analyzing the one or more reflective surfaces, the identified type, and the obtained depth information of the AR scene; estimating a surface normal to the one or more reflective surfaces based on the analyzed one or more reflective surfaces, the type, and the depth information; estimating a viewing frustum associated with the obtained depth information based on a viewing angle of the AR scene and a position of the one or more reflective surfaces; and generating the reflection map for the one or more reflective surfaces based on the estimated viewing frustum, wherein the reflection map includes a reflective surface rendering color. ### Claim 10 (depends on 9) The method of claim 9, further comprising: updating the reflection map based on the viewing frustum of the AR scene from the electronic device. ### Claim 11 (depends on 10) The method of claim 10, further comprising: projecting a ray by the one or more reflective surfaces based on the surface normal and a direction of viewing of the AR scene for each pixel of the one or more reflective surfaces; determining an intersection of the projected ray with the virtual object to estimate a color, from the reflective surface rendering color, corresponding to a blending mask; attenuating the estimated color based on one or more material properties of the virtual object; and applying the reflection map by matting the attenuated estimated color using the reflective surface rendering map, and the reflective surface rendering color on a real frame of the AR scene. ### Claim 12 (depends on 1) The method of claim 1, wherein the rendering of the reflection for the virtual object comprises: placing the virtual object in an estimated viewing frustum of the one or more reflective surfaces; and updating the one or more reflective surfaces by a reflective ray tracer operation by rendering the reflection for the virtual object. ### Claim 13 An electronic device, comprising: memory, comprising one or more storage media, storing instructions; and at least one processor communicatively coupled with the memory, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: obtain at least one image frame and a depth information associated with an augmented reality (AR) scene provided through the electronic device for a user, determine one or more reflective surfaces in the AR scene, based on the at least one image frame and the depth information, identify a type of the one or more reflective surfaces in the AR scene, generate a reflection map for the one or more reflective surfaces based on a placement of the virtual object, and the identified type of the one or more reflective surfaces, and apply the generated reflection map on the one or more reflective surfaces to render reflection of the virtual object through the electronic device. ### Claim 14 (depends on 13) The electronic device of claim 13, wherein, to obtain the at least one image frame and the depth information, the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: form a 3-dimensional (3D) mesh for a plurality of 3D points provided through the AR scene based on the at least one image frame and the depth information of the AR scene; and extract a plurality of noisy 3D points with missing depth in the formed 3D mesh. ### Claim 15 (depends on 14) The electronic device of claim 14, wherein the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: locate a plurality of 2-dimensional (2D) points associated with the plurality of 3D points on the at least one image frame; and generate a feature map based on the located plurality of 2D points. ### Claim 16 (depends on 15) The electronic device of claim 15, wherein, to determine the one or more reflective surfaces in the AR scene, the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: analyze the generated feature map and the at least one image frame by a feature descriptor operation to generate a plurality of 2D points associated with the one or more reflective surfaces; re-project the plurality of 2D points in a plurality of 3D points associated with the one or more reflective surfaces by a reflective surface map generator; and group the plurality of 3D points to provide the one or more reflective surfaces. ### Claim 17 (depends on 13) The electronic device of claim 13, wherein, after the at least one image frame and the depth information are obtained, the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: detect the placement of the virtual object in the AR scene provided through the electronic device. ### Claim 18 (depends on 13) The electronic device of claim 13, wherein, to identify the type of the determined one or more reflective surfaces, the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: analyze the at least one image frame and the one or more reflective surfaces by identifying the type of the one or more reflective surfaces from a plurality of predetermined types of the one or more reflective surfaces. ### Claim 19 (depends on 18) The electronic device of claim 18, wherein the plurality of predetermined types includes at least one of a mirror type, a metallic type, a matte type, or a glossy type. ### Claim 20 (depends on 13) The electronic device of claim 13, wherein, to generate the reflection map, the instructions, when executed by the at least one processor individually or collectively, further cause the electronic device to: generate the reflection map by a reflective ray tracer operation by using at least one parameter, wherein the at least one parameter comprises at least one of a semantic cue, a depth cue, or material cue, wherein the semantic cue is provided from the one or more reflective surfaces, wherein the depth cue is provided from the depth information associated with the AR scene, and wherein the material cue is provided from the identified type of the one or more reflective surfaces.