# US 2019/0059070 A1 · Indoor positioning method and system based on wireless receiver and camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0059070 A1
- Document ID: US20190059070A1
- Status: Published application
- Kind: A1
- Application number: 15/760,230
- Filed: 2017-05-16
- Published: 2019-02-21
- Earliest claimed: 2017-01-18
- Assignees: Shenzhen University
- Applicants: Shenzhen University
- Inventors: Kaishun Wu; Jun XU; Lu WANG; Yongpan ZOU
- Web page: https://patentgrep.com/patent/US20190059070A1

## CPC

- H04W 64/006: {with additional information processing, e.g. for direction or speed determination}
- G01S 3/043: {Receivers}
- G01S 3/74: Multi-channel systems specially adapted for direction-finding, i.e. having a single antenna system capable of giving simultaneous indications of the directions of different signals (systems in which the directions of different signals are determined sequentially and displayed simultaneously G01S3/04, G01S3/14)
- G01S 5/02585: {at least one of the measurements being a non-radio measurement}
- G01S 5/12: by co-ordinating position lines of different shape, e.g. hyperbolic, circular, elliptical or radial
- H04B 7/0626: {Channel coefficients, e.g. channel state information [CSI]}
- H04N 23/60: Control of cameras or camera modules
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds}
- H04W 4/33: for indoor environments, e.g. buildings
- H04W 64/00: Locating users or terminals {or network equipment} for network management purposes, e.g. mobility management
- G01S 2205/02: Indoor
- H04W 84/12: WLAN [Wireless Local Area Networks]
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04B: TRANSMISSION
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The invention provides an indoor positioning method and system based on a wireless receiver and a camera, belonging to the field of positioning technology. The method in the invention comprises the following steps: a wireless receiver detects a query WIFI signal transmitted by a target device and extracts a MAC address and CSI of the target device from a query WIFI signal; a server captures the MAC address and the CSI of the target device from the wireless receiver, calculates an incident angle of the target device and the wireless receiver and sends a photographing instruction to a camera which photographs an image and uploads the image to the server; the server obtains the distance between the wireless receiver and the target device through the image pixels, and calculates the position information of the target device according to the coordinates of the wireless receiver. The invention realizes the accurate positioning of the target device by using only a wireless receiver and a camera, so that the cost can be controlled and a real-time calculation can be ensured; the combination of the two beneficial effects can help achieve good positioning results.

## Claims

### Claim 1

An indoor positioning method based on a wireless receiver and a camera, comprising the following steps:
S1: the wireless receiver detects a query WIFI signal transmitted by a target device;
S2: the wireless receiver extracts a media access control (MAC) address and channel state information (CSI) used for identifying the target device from a query WIFI signal, and uploads the CSI to a server;
S3: the server calculates an incident angle of the target device and the wireless receiver according to the CSI uploaded by the wireless receiver, and at the same time sends a photographing instruction to the camera which photographs an image and uploads the image to the server;
S4: the server obtains a distance between the wireless receiver and the target device through the image pixels, and calculates the position information of the target device according to coordinates of the wireless receiver.

### Claim 2 (depends on 1)

The indoor positioning method as claimed in claim 1, wherein the number of the wireless receiver and the camera is one respectively.

### Claim 3 (depends on 2)

The indoor positioning method as claimed in claim 2, wherein in Step S1, the target device comprises a smart phone, and the positioning of a target population is completed according to the target population carrying the smart phone.

### Claim 4 (depends on 1)

The indoor positioning method as claimed in claim 1, wherein in Step S1, the wireless receiver comprises a WIFI probe, a WIFI wireless listener and a wireless receiver.

### Claim 5 (depends on 4)

The indoor positioning method as claimed in claim 4, wherein in Step S2, the CSI extraction method comprises:
S21: channel state data are collected, wherein the initial channel state data comprise the channel state data values of M subcarriers in N spatial streams, both N and M being natural numbers greater than 1;
S22: for each spatial stream, an average value of the channel state data values of P consecutive subcarriers at a same time point is obtained and used as the CSI value, P being a natural number greater than 1 and less than M;
S23: the CSI value is modified by using a least square best fit algorithm.

### Claim 6 (depends on 5)

The indoor positioning method as claimed in claim 5, wherein in Step S3, the method for calculating the incident angle of the target device to the wireless receiver on the server side is as follows:
S31: eigenvalue and eigenvector factorization is performed for the CSI matrix contained in the acquired data packet;
S32: a basis function of a multi-signal classification algorithm is constructed by using the eigenvalue;
S33: the incident angle θ in the range of 0 to 360 degrees is scanned by using a basis function, and a flight time τ in the range of 1 to 20 nanoseconds is scanned; for each pair of independent variables (θ, τ), when the dependent variable of the base function has a peak, an actual incident path corresponding to the independent variable is obtained;
S34: detach the smallest independent variable of τ, and the corresponding θ value in the independent variable is the incident angle θ of the target device to the wireless receiver.

### Claim 7 (depends on 6)

The indoor positioning method as claimed in claim 6, wherein in Step S4, a method for calculating the distance between the target device and the wireless receiver is as follows:
S41: the corresponding relationship between the distance and the pixels in the image is calculated according to known wireless receiver and camera positions;
S42: the wireless receiver is taken as a starting point and a human search algorithm is performed along the angle θ to identify the position of a human body, that is, the position of a target;
S43: an actual distance between the target and the wireless receiver is calculated according to the pixels of the human body and the wireless receiver.

### Claim 8

A system for indoor positioning, comprising:
a target device for sending a query WIFI signal;
a wireless receiver for detecting a query WIFI signal transmitted by a target device and extracting a MAC address and CSI from a query WIFI signal;
a camera for photographing an indoor image and uploading the image to a server;
a server for calculating an incident angle of a target device and a wireless receiver and sending a photographing instruction to a camera; and the distance between the wireless receiver and the target device is obtained through the image pixels; and the position information of the target device is calculated according to the position of the wireless receiver.

### Claim 9 (depends on 8)

The system as claimed in claim 8, wherein the number of the wireless receiver and the camera is one respectively.

### Claim 10 (depends on 8)

The system as claimed in claim 8, wherein the target device comprises a smart phone, and the positioning of a target population is completed according to the target population carrying the smart phone; the wireless receiver comprises a WIFI probe, a WIFI wireless listener and a wireless receiver.
