# US 10,502,580 B2 · Method and apparatus for providing augmented reality function in electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,502,580 B2 - Document ID: US10502580B2 - Status: Granted - Kind: B2 - Application number: 15/936,769 - Filed: 2018-03-27 - Published: 2018-09-27 - Granted: 2019-12-10 - Earliest claimed: 2017-03-27 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Nari Choi; Jin-Ho Choi - Web page: https://patentgrep.com/patent/US10502580B2 ## CPC - G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G01C 21/3647: {Guidance involving output of stored or live camera images or video streams} - G01C 21/3682: {output of POI information on a road map (G01C21/3614, G01C21/3685 take precedence)} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 7/185: {from a mobile camera, e.g. for remote control} - G01C 21/3667: {Display of a road map (G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635)} - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and an apparatus for providing an augmented reality (AR) function of showing virtual information objects overlaid on a real image or background (for example, a real world) as one image in an electronic device are provided. The electronic device includes a camera, a display for displaying an AR screen, and at least one processor functionally connected to the camera module and the display. The at least one processor is configured to implement an AR function, determine a plurality of contents according to a set criterion in a view direction of a user, group the plurality of contents into at least one group, generate a group card corresponding to the plurality of contents and a single card corresponding to a single content based on a grouping result, and display the group card and the single card mapped to a real object on the AR screen. ## Claims ### Claim 1 An electronic device comprising: a camera; a display to display an augmented reality (AR) screen; and at least one processor functionally connected to the camera and the display, wherein the at least one processor is configured to: implement an AR function, display a menu area for selecting a category of content and a range of view, determine a plurality of contents according to a set criterion in a view direction of a user, group the plurality of contents into at least one group based on the selected category of content and the selected range of view, generate a group card corresponding to the plurality of contents and a single card corresponding to a single content based on a grouping result, and display the group card and the single card mapped to a real object on the AR screen. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the set criterion comprises a criterion related to same direction, same line, or same angle in the view direction. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the set criterion is set based on at least one z-axis in the view direction. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the at least one processor is further configured to: obtain detailed information related to the real object in response to implementation of the AR function; determine the plurality of contents according to the set criterion in the view direction of the user based on at least some of the detailed information; group the plurality of contents and generate the group card corresponding to the plurality of contents according to the set criterion; and generate the single card corresponding to the single content according to the set criterion. ### Claim 5 (depends on 4) The electronic device of claim 4, wherein the at least one processor is further configured to generate the group card in any one type among: a group type of displaying a plurality of information cards corresponding to individual contents belonging to a plurality of contents as one group, a badge type comprising a badge object indicating information on a number of grouped contents, and a highlighting type of displaying the group card based on an effect for distinguishing the group card from the single card. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the at least one processor is further configured to group all of the plurality of contents corresponding to the set criterion in the view direction. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein the at least one processor is further configured to group at least some contents among the plurality of contents corresponding to the set criterion based on an overlapping degree of the plurality of contents corresponding to the set criterion in the view direction. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the at least one processor is further configured to: display a detail page associated with a plurality of contents grouped based on a first user interaction by the group card; and switch to and display an information card displayed by the group card based on a second user interaction by the group card. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the at least one processor is further configured to display a user-location map based on an interaction related to a state change of the electronic device. ### Claim 10 (depends on 9) The electronic device of claim 9, wherein the map comprises a map obtained by capturing a certain range based on a user location and by providing the certain range as an image. ### Claim 11 An operation method of an electronic device, the method comprising: implementing an augmented reality (AR) function and displaying an AR screen; displaying a menu area for selecting a category of content and a range of view; determining a plurality of contents according to a set criterion in a view direction of a user; grouping the plurality of contents into at least one group based on the selected category of content and the selected range of view; generating a group card corresponding to the plurality of contents, and a single card corresponding to a single content based on a grouping result; and displaying the group card and the single card mapped to a real object on the AR screen. ### Claim 12 (depends on 11) The method of claim 11, wherein the set criterion comprises a criterion related to same direction, same line, or same angle in the view direction. ### Claim 13 (depends on 12) The method of claim 12, wherein the set criterion is set based on at least one z-axis in the view direction. ### Claim 14 (depends on 11) The method of claim 11, wherein the generating of the group card comprises: obtaining detailed information related to the real object in response to implementation of the AR function; determining the plurality of contents according to the set criterion in the view direction of the user based on at least some of the detailed information; grouping the plurality of contents and generating the group card corresponding to the plurality of contents according to the set criterion; and generating the single card corresponding to the single content according to the set criterion. ### Claim 15 (depends on 14) The method of claim 14, wherein the generating of the group card further comprises: generating the group card in any one type among: a group type of displaying a plurality of information cards corresponding to individual contents belonging to a plurality of contents as one group, a badge type comprising a badge object indicating information on a number of grouped contents, and a highlighting type of displaying the group card based on an effect for distinguishing the group card from the single card. ### Claim 16 (depends on 11) The method of claim 11, wherein the grouping of the plurality of contents comprises grouping all of the plurality of contents corresponding to the set criterion in the view direction. ### Claim 17 (depends on 11) The method of claim 11, wherein the grouping of the plurality of contents comprises grouping at least some contents among the plurality of contents corresponding to the set criterion based on an overlapping degree of the plurality of contents corresponding to the set criterion in the view direction. ### Claim 18 (depends on 11) The method of claim 11, further comprising: displaying a detail page associated with a plurality of contents grouped based on a first user interaction by the group card; and switching to and displaying an information card displayed by the group card based on a second user interaction by the group card. ### Claim 19 (depends on 11) The method of claim 11, further comprising: displaying a user-location map based on an interaction related to a state change of the electronic device. ### Claim 20 (depends on 11) The method of claim 11, wherein at least one of the group card or the single card is superimposed on an image being photographed or viewed by a camera of the electronic device, and wherein the image is displayed on a display of the electronic device.