# US 2021/0344872 A1 · Personal digital assistance and virtual reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0344872 A1 - Document ID: US20210344872A1 - Status: Published application - Kind: A1 - Application number: 17/202,499 - Filed: 2021-03-16 - Published: 2021-11-04 - Earliest claimed: 2013-03-15 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment LLC. - Inventors: John Cronin - Web page: https://patentgrep.com/patent/US20210344872A1 ## CPC - H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 16/243: {Natural language query formulation} - G06F 16/9537: Spatial or temporal dependent retrieval, e.g. spatiotemporal queries - G06F 16/9538: Presentation of query results - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04L 67/131: Protocols for games, networked simulations or virtual reality - H04N 7/183: {for receiving images from a single remote source} - A63F 2300/8082: Virtual reality - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A virtual reality network provides access to a number of virtual reality representations, each virtual reality representation representing a location in a virtual universe and defined by VR data stored on the network. The VR data can be in a simplified data format and include data from an intelligent personal assistant and knowledge navigator (IPAKN). A database stores the network address and the location in the universe of each virtual reality representation. A database server provides access to the database. The database server generates a list of locations in response to a location query from a visitor, and provides the network address of the virtual reality representation of a selected location. A visitor connects to the database server with a client host to visit the locations in the virtual universe. ## Claims ### Claim 1 (canceled) ### Claim 1 (canceled) ### Claim 2 A method for modifying virtual reality (VR) representations, the method comprising: storing a plurality of VR data sets in one or more VR data servers, each VR data set defining each VR representation of a real-world location; receiving one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation accessed by the user device; querying one or more web sources based on the user-generated content, wherein query results include current information from the web sources; modifying a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the associated VR data set stored at one or more of the VR data servers; generating a display of a map of the real-world locations represented by a corresponding one of the plurality of VR data sets, wherein the map includes an icon indicating that the current information associated with the location is available; receiving a selection from a visitor device specifying the location; and transmitting the modified VR data set to the visitor device, wherein the VR representation of the location is generated at the visitor device in accordance with the modified data set that includes the current information from the query results. ### Claim 3 (depends on 1) The method of claim 1, wherein the generated VR representation of the location and the map of the real-world locations are displayed simultaneously by the visitor device. ### Claim 4 (depends on 1) The method of claim 1, further comprising receiving a query via one or more widgets displayed with the VR representation, wherein querying the web sources is based on the received query. ### Claim 5 (depends on 3) The method of claim 3, further comprising accessing the information associated with the queried web sources via the widgets. ### Claim 6 (depends on 1) The method of claim 1, further comprising generating an icon in the VR representation that indicates one or more characteristics of the VR representation. ### Claim 7 (depends on 1) The method of claim 1, further comprising updating the VR data servers based on the modified VR data set. ### Claim 8 (depends on 1) The method of claim 1, wherein the map includes an icon indicating that each query result associated with each of the locations is available. ### Claim 9 (depends on 1) The method of claim 1, wherein modifying the VR data set includes adding an image data superimposed to the VR data set. ### Claim 10 (depends on 1) The method of claim 1, wherein the user-generated content includes voice data, wherein querying the one or more web sources includes searching the web sources based on a question indicated by the voice data. ### Claim 11 (depends on 1) The method of claim 1, further comprising organizing a plurality of user-generated content from one or more user devices, the user-generated content organized by the VR data servers to connect one or more VR representations. ### Claim 12 A system for modifying virtual reality (VR) representations, the system comprising: one or more VR data servers that stores a plurality of VR data sets, each VR data set defining each VR representation of a real-world location; a personal assistant server that: receives one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation accessed by the user device; and queries one or more web sources based on the user-generated content, wherein the query results include current information from the web sources; and a host server that: modifies a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the associated VR data set stored at one or more of the VR data servers; generates a display of a map of the real-world locations represented by a corresponding one of the plurality of VR data sets, wherein the map includes an icon indicating that the current information associated with the location is available; receives a selection from a visitor device specifying the location; and transmits the modified VR data set to the visitor device, wherein the VR representation of the location is generated at the visitor device in accordance with the modified data set that includes the current information from the query results. ### Claim 13 (depends on 12) The system of claim 12, wherein the visitor device displays the generated VR representation of the location and the map of the real-world locations simultaneously. ### Claim 14 (depends on 12) The system of claim 12, wherein the personal assistant server receives a query via one or more widgets displayed with the VR representation, wherein querying the web sources is based on the received query. ### Claim 15 (depends on 14) The system of claim 14, wherein the widget allows access to the information associated with the queried web sources. ### Claim 16 (depends on 12) The system of claim 12, wherein the visitor device displays an icon in the VR representation that indicates one or more characteristics of the VR representation. ### Claim 17 (depends on 12) The system of claim 12, wherein the VR data server updates the plurality of data sets based on the modified VR data set. ### Claim 18 (depends on 12) The system of claim 12, wherein the map includes an icon indicating that each query result associated with each of the locations is available. ### Claim 19 (depends on 12) The system of claim 12, wherein the host server modifies the VR data set by adding an image data superimposed to the VR data set. ### Claim 20 (depends on 12) The system of claim 12, wherein the user generated content includes voice data, wherein querying the one or more web sources includes searching the web sources based on a question indicated by the voice data. ### Claim 21 (depends on 12) The system of claim 12, wherein the VR server organizes a plurality of user-generated content from one or more user devices to connect one or more VR representations. ### Claim 22 A non-transitory computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for modifying virtual reality (VR) representations, the method comprising: storing a plurality of VR data sets in one or more VR data servers, each VR data set defining each VR representation of a real-world location; receiving one or more sets of user-generated content from a user device of a user, the user-generated content regarding a location associated with a VR representation accessed by the user device; querying one or more web sources based on the user-generated content, wherein the query results include current information from the web sources; modifying a VR data set associated with the location based on the query results, wherein the user-generated content and query results are added to the associated VR data set stored at one or more of the VR data servers; generates a display of a map of the real-world locations represented by a corresponding one of the plurality of VR data sets, wherein the map includes an icon indicating that the current information associated with the location is available; receiving a selection from a visitor device specifying the location; and transmitting the modified VR data set to the visitor device, wherein the VR representation of the location is generated at the visitor device in accordance with the modified data set that includes the current information from the query results.