# US 2019/0246162 A1 · Method and apparatus for presenting and controlling panoramic image, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246162 A1
- Document ID: US20190246162A1
- Status: Published application
- Kind: A1
- Application number: 16/390,171
- Filed: 2019-04-22
- Published: 2019-08-08
- Earliest claimed: 2017-03-28
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Dan YANG; Xian Jun Wang; You Zhou; Yi Xie; Gang Xu; Jia Qu
- Web page: https://patentgrep.com/patent/US20190246162A1

## CPC

- H04N 21/4222: {Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415)}
- H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones}
- H04N 21/42208: {Display device provided on the remote control}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/436: Interfacing a local distribution network, e.g. communicating with another STB {or one or more peripheral devices} inside the home
- H04N 21/43637: {involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114)}
- H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)}
- H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N 21/4781: {Games}
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for presenting and controlling a panoramic image is provided. The method includes: sending a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the mobile terminal, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content; obtaining a description parameter indicating a position of the mobile terminal in three-dimensional space; and sending the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

## Claims

### Claim 1

A method for presenting and controlling a panoramic image, performed by at least one processor of a mobile terminal, the method comprising:
sending, by the at least one processor, a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the mobile terminal, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content;
obtaining, by the at least one processor, a description parameter indicating a position of the mobile terminal in three-dimensional space in response to an operation of the mobile terminal; and
sending, by the at least one processor, the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the description parameter comprises a location change parameter and a posture change parameter,
wherein the adjustment parameter comprises a viewing-angle adjustment parameter and a viewpoint adjustment parameter,
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space in response to the operation of the mobile terminal comprises:
obtaining the location change parameter in response to a movement operation of the mobile terminal; and
obtaining the posture change parameter in response to a rotation operation of the mobile terminal, and
wherein the sending the description parameter to the media content server comprises:
sending the location change parameter and the posture change parameter to the media content server, wherein the media content server determines the viewpoint adjustment parameter of the panoramic image in the panoramic space according to the location change parameter, determines the viewing-angle adjustment parameter of the panoramic image in the panoramic space according to the posture change parameter, and sends the viewpoint adjustment parameter and the viewing-angle adjustment parameter to the smart television, and wherein the smart television adjusts a viewpoint of the panoramic image according to the viewpoint adjustment parameter and adjusts a viewing angle of the panoramic image according to the viewing-angle adjustment parameter.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the description parameter comprises a location change parameter,
wherein M network access points are disposed in the three-dimensional space, M being an integer that is greater than or equal to 3, and
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining coordinates of a reference point location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the reference point location;
determining coordinates of a current location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the description parameter comprises a location change parameter, and
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining wireless signal strengths of a network access point that are received by the mobile terminal at a plurality of locations, and storing coordinates of each of the plurality of locations and a corresponding wireless signal strength in an associated manner;
determining a first wireless signal strength of the network access point received by the mobile terminal at a reference point location;
determining a second wireless signal strength of the network access point received by the mobile terminal at a current location;
at the current location, separately searching the stored wireless signal strengths for wireless signal strengths closest to the first wireless signal strength and the second wireless signal strength, and using location coordinates of locations corresponding to the found wireless signal strengths respectively closest to the first wireless signal strength and the second wireless signal strength as coordinates of the reference point location and coordinates of the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the description parameter comprises a posture change parameter, and
wherein the obtaining the description parameter of the mobile terminal in three-dimensional space comprises:
determining a reference point deflection angle and a current deflection angle of the mobile terminal according to a sensor parameter obtained from a gyroscope; and
determining the posture change parameter of the mobile terminal according to the reference point deflection angle and the current deflection angle of the mobile terminal.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the method further comprises:
receiving panoramic image data from the media content server; and
presenting the panoramic image.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the method further comprises:
receiving the adjustment parameter from the media content server; and
adjusting the panoramic image according to the adjustment parameter.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the method further comprises presenting prompt information received from the media content server to prompt a user of the mobile terminal whether to present the panoramic image.

### Claim 9

An apparatus for presenting and controlling a panoramic image, the apparatus comprising:
at least one memory configured to store computer program code; and
at least one processor configured to access the at least one memory and operate as instructed by the computer program code, the computer program code including:
trigger instruction sending code configured to cause the at least one processor to send a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the apparatus, and the panoramic image trigger instruction causes the smart television to present the panoramic image corresponding to currently presented media content;
obtaining code configured to cause the at least one processor to obtain a description parameter indicating a position of the apparatus in three-dimensional space in response to an operation of the apparatus, and
sending code configured to cause the at least one processor to send the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the description parameter comprises a location change parameter and a posture change parameter,
wherein the adjustment parameter comprises a viewing-angle adjustment parameter and a viewpoint adjustment parameter,
wherein the obtaining code is further configured to cause the at least one processor to obtain the location change parameter in response to a movement operation of the apparatus, and obtain the posture change parameter in response to a rotation operation of the apparatus, and
wherein the sending code is further configured to cause the at least one processor to send the location change parameter and the posture change parameter to the media content server, wherein the media content server determines the viewpoint adjustment parameter of the panoramic image in the panoramic space according to the location change parameter, determines the viewing-angle adjustment parameter of the panoramic image in the panoramic space according to the posture change parameter, and sends the viewpoint adjustment parameter and the viewing-angle adjustment parameter to the smart television, and wherein the smart television adjusts a viewpoint of the panoramic image according to the viewpoint adjustment parameter and adjusts a viewing angle of the panoramic image according to the viewing-angle adjustment parameter.

### Claim 11 (depends on 9)

The apparatus according to claim 9, wherein the description parameter comprises a location change parameter,
wherein M network access points are disposed in the three-dimensional space, M being an integer that is greater than or equal to 3, and
wherein the computer program code further includes determining code configured to cause the at least one processor to:
determine coordinates of a reference point location and coordinates of a current location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the apparatus at the reference point location;
determine coordinates of the current location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the apparatus at the current location; and
determine the location change parameter of the apparatus in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

### Claim 12 (depends on 9)

The apparatus according to claim 9, wherein the description parameter comprises a location change parameter, and
wherein the computer program code further includes determining code configured to cause the at least one processor to:
determine wireless signal strengths of a network access point that are received by the apparatus at a plurality of locations, and store coordinates of each of the plurality of locations and a corresponding wireless signal strength in an associated manner;
determine a first wireless signal strength of the network access point received by the apparatus at a reference point location;
determine a second wireless signal strength of the network access point received by the apparatus;
separately search, at a current location, the stored wireless signal strengths for wireless signal strengths closest to the first wireless signal strength and the second wireless signal strength, and using location coordinates of locations corresponding to the found wireless signal strengths respectively closest to the first wireless signal strength and the second wireless signal strength as coordinates of the reference point location and coordinates of the current location; and
determine the location change parameter of the apparatus in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

### Claim 13 (depends on 9)

The apparatus according to claim 9, wherein the description parameter comprises a posture change parameter, and
wherein the obtaining code is further configured to cause the at least one processor to:
determine a reference point deflection angle and a current deflection angle of the apparatus according to a sensor parameter obtained from a gyroscope; and
determine the posture change parameter of the apparatus according to the reference point deflection angle and the current deflection angle of the apparatus.

### Claim 14 (depends on 9)

The apparatus according to claim 9, wherein the computer program code further includes receiving code configured to cause the at least one processor to receive panoramic image data from the media content server and present the panoramic image.

### Claim 15 (depends on 14)

The apparatus according to claim 14, wherein the computer program code further includes:
adjustment parameter receiving code configured to cause the at least one processor to receive the adjustment parameter sent by the media content server; and
adjusting code configured to cause the at least one processor to adjust the panoramic image according to the adjustment parameter.

### Claim 16 (depends on 14)

The apparatus according to claim 14, wherein the computer program code further includes presenting code configured to cause the at least one processor to prompt a user of the apparatus whether to present the panoramic image.

### Claim 17

One or more non-transitory storage media storing computer readable instructions, the computer readable instructions, when executed by one or more processors of a mobile terminal, cause the mobile terminal to:
send a panoramic image trigger instruction to a media content server in response to a panoramic image trigger operation, wherein the panoramic image trigger instruction causes the media content server to send the panoramic image trigger instruction to a smart television bound with the mobile terminal, and the panoramic image trigger instruction causes the smart television to present a panoramic image corresponding to currently presented media content;
obtain a description parameter indicating a position of the mobile terminal in three-dimensional space in response to an operation of the mobile terminal; and
send the description parameter to the media content server, wherein the media content server determines an adjustment parameter of the panoramic image in panoramic space according to the description parameter and sends the adjustment parameter to the smart television, and the smart television adjusts the panoramic image according to the adjustment parameter.

### Claim 18 (depends on 17)

The one or more non-transitory storage media according to claim 17, wherein the description parameter comprises a location change parameter and a posture change parameter,
wherein the adjustment parameter comprises a viewing-angle adjustment parameter and a viewpoint adjustment parameter,
wherein the computer readable instructions further cause the one or more processors to obtain the description parameter of the mobile terminal by:
obtaining the location change parameter in response to a movement operation of the mobile terminal; and
obtaining the posture change parameter in response to a rotation operation of the mobile terminal, and
wherein the computer readable instructions further cause the one or more processors to send the description parameter to the media content server by:
sending the location change parameter and the posture change parameter to the media content server, wherein the media content server determines the viewpoint adjustment parameter of the panoramic image in the panoramic space according to the location change parameter, determines the viewing-angle adjustment parameter of the panoramic image in the panoramic space according to the posture change parameter, and sends the viewpoint adjustment parameter and the viewing-angle adjustment parameter to the smart television, and wherein the smart television adjusts a viewpoint of the panoramic image according to the viewpoint adjustment parameter and adjusts a viewing angle of the panoramic image according to the viewing-angle adjustment parameter.

### Claim 19 (depends on 17)

The one or more non-transitory storage media according to claim 17, wherein the description parameter comprises a location change parameter,
wherein M network access points are disposed in the three-dimensional space, M being an integer that is greater than or equal to 3, and
wherein the computer readable instructions further cause the one or more processors to obtain the description parameter of the mobile terminal by:
determining coordinates of a reference point location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the reference point location;
determining coordinates of a current location according to M wireless signal strengths that respectively correspond to the M network access points and that are received by the mobile terminal at the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.

### Claim 20 (depends on 17)

The one or more non-transitory storage media according to claim 17, wherein the description parameter comprises a location change parameter, and
wherein the computer readable instructions further cause the one or more processors to obtain the description parameter of the mobile terminal by:
determining wireless signal strengths of a network access point that are received by the mobile terminal at a plurality of locations, and storing coordinates of each of the plurality of locations and a corresponding wireless signal strength in an associated manner;
determining a first wireless signal strength of the network access point received by the mobile terminal at a reference point location;
determining a second wireless signal strength of the network access point received by the mobile terminal at a current location;
at the current location, separately searching the stored wireless signal strengths for wireless signal strengths closest to the first wireless signal strength and the second wireless signal strength, and using location coordinates of locations corresponding to the found wireless signal strengths respectively closest to the first wireless signal strength and the second wireless signal strength as coordinates of the reference point location and coordinates of the current location; and
determining the location change parameter of the mobile terminal in the three-dimensional space according to the coordinates of the reference point location and the coordinates of the current location.