# US 2019/0318535 A1 · Display data processing method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318535 A1
- Document ID: US20190318535A1
- Status: Published application
- Kind: A1
- Application number: 16/455,250
- Filed: 2019-06-27
- Published: 2019-10-17
- Earliest claimed: 2016-12-27
- Assignees: Cloudminds (Shenzhen) Robotics Systems Co., Ltd.
- Applicants: CloudMinds (Shenzhen) Robotics Systems Co., Ltd.
- Inventors: Kai Wang; Shiguo Lian; Luowei Wang
- Web page: https://patentgrep.com/patent/US20190318535A1

## CPC

- G06F 16/904: Browsing; Visualisation therefor (for navigating the web G06F16/954; browsing optimisation for the web G06F16/957)
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 15/20: Perspective computation
- G06V 20/20: in augmented reality scenes
- G06T 2210/61: Scene description
- G06T 2215/16: Using real world measurements to influence rendering
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The embodiment of the present application discloses a display data processing method and apparatus, and relates to the technical field of image processing. Display data including global environmental information may be generated to represent a whole situation of an environment where a user is located to background service personnel, so that the background service personnel may globally understand the environment where the user is located. The method includes: collecting scene information of a local scene in an environment where a user is located; detecting a predetermined target in the local scene in the scene information, and generating visual data, wherein the visual data include the predetermined target; and superposing the visual data with an environmental model of the environment, and generating display data of a specified perspective, the display data include the environmental model and the predetermined target. The embodiment of the present application is applied to display data processing.

## Claims

### Claim 1

A display data processing method, comprising:
collecting scene information of a local scene in an environment where a user is located;
detecting a predetermined target in the local scene in the scene information, and generating visual data, wherein the visual data include the predetermined target; and
superposing the visual data with an environmental model of the environment, and generating display data, the display data include the environmental model and the predetermined target.

### Claim 2 (depends on 1)

The method according to claim 1, wherein,
the method further comprises: receiving a perspective instruction sent by a client; and
the superposing the visual data with an environmental model of the environment and generating display data comprises: superposing the visual data with the environmental model of the environment, and generating the display data of the specified perspective according to the perspective instruction.

### Claim 3 (depends on 2)

The method according to claim 2, wherein,
the specified perspective comprises any of the following: a first person user perspective, a first person observation perspective, a first person free perspective, a first person panoramic perspective, a third person fixed perspective and a third person free perspective; and
wherein, when the specified perspective comprises any of the first person observation perspective, the third person fixed perspective and the third person free perspective, the display data contains a virtual user model.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the method further comprises:
obtaining environmental data collected in the environment, and performing spatial reconstruction on the environmental data to generate the environmental model.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the obtaining environmental data collected in the environment comprises: collecting the environmental data in the environment by using at least one sensor, and the sensor is a depth sensor, a laser radar or an image sensor.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the collecting scene information of a local scene in an environment where a user is located comprises: collecting the scene information of the local scene in the environment where the user is located by using at least one sensor, and the sensor is an image sensor, an ultrasonic radar or a sound sensor.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the visual data are characters and/or a physical model.

### Claim 8 (depends on 1)

The method according to claim 1, wherein the predetermined target at least comprises one or more of the following items: a user location, a user gesture, a specific target around the user, a travel route of the user.

### Claim 9

An electronic device, comprising: a memory, a communication interface and a processor, the memory and the communication interface are coupled to the processor, the memory is configured to store a computer executive code, the processor is configured to execute the computer executive code to control the execution of a display data processing method, and the communication interface is configured to perform data transmission between a display data processing apparatus and an external device, wherein the display data processing method includes:
collecting scene information of a local scene in an environment where a user is located;
detecting a predetermined target in the local scene in the scene information, and generating visual data, wherein the visual data include the predetermined target; and
superposing the visual data with an environmental model of the environment, and generating display data, the display data include the environmental model and the predetermined target.

### Claim 10

A computer storage medium, for storing a computer software instruction used by a display data processing apparatus and comprising a program code designed to execute a display data processing method including:
collecting scene information of a local scene in an environment where a user is located;
detecting a predetermined target in the local scene in the scene information, and generating visual data, wherein the visual data include the predetermined target; and
superposing the visual data with an environmental model of the environment, and generating display data, the display data include the environmental model and the predetermined target.
