# US 12,604,002 B2 · Method and encoder for encoding lidar data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,604,002 B2 - Document ID: US12604002B2 - Status: Granted - Kind: B2 - Application number: 18/659,067 - Filed: 2024-05-09 - Published: 2024-12-05 - Granted: 2026-04-14 - Earliest claimed: 2023-06-05 - Assignees: Axis AB - Applicants: Axis AB - Inventors: Viktor Edpalm; Niklas Hansson - Web page: https://patentgrep.com/patent/US12604002B2 ## CPC - G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46) - H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks - G01S 7/4808: {Evaluating distance, position or velocity data} - G01S 7/4817: {relating to scanning} - G01S 17/89: for mapping or imaging - G06T 9/001: {Model-based coding, e.g. wire frame} - G06T 9/004: {Predictors, e.g. intraframe, interframe coding} - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/172: the region being a picture, frame or field - H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/597: specially adapted for multi-view video sequence encoding - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method for encoding lidar data where subsequent frames of lidar data to be encoded are received. Each frame of lidar data comprises a number of lidar return signals for each of a plurality of rays emitted at a respective elevation and azimuth angle by a lidar, and each lidar return signal includes lidar measurement values. Each frame of lidar data is then represented as an image frame of a video sequence, wherein, for each ray of the plurality of rays of the frame of lidar data, lidar measurement values of different lidar return signals are represented in different image portions of the image frame. The different image portions are stacked after each other in a row direction or a column direction of the image frame. The video sequence is then encoded using video encoding. ## Claims ### Claim 1 A method for encoding lidar data, comprising: receiving subsequent frames of lidar data to be encoded, each frame of lidar data comprising a number of lidar return signals for each of a plurality of rays emitted at a respective elevation and azimuth angle by a lidar, each lidar return signal including lidar measurement values comprising a measurement value of a first parameter, a measurement value of a second parameter, and a measurement value of a third parameter, representing each frame of lidar data as an image frame of a video sequence, whereby for each ray of the plurality of rays of the frame of lidar data, lidar measurement values of different lidar return signals are represented in different image portions of the image frame, the different image portions being stacked after each other in a row direction or a column direction of the image frame, wherein each image portion has a pixel grid corresponding to elevation and azimuth angles and pixel values formed from the lidar measurement values of the lidar return signals represented in that image portion, wherein the pixel values of an image portion are formed from the lidar measurement values by interpolating the lidar measurement values from the elevation and azimuth angles of the plurality of rays to the pixel grid of the image portion, wherein the measurement value of the first parameter is represented in a first color channel of the image frame, the measurement value of the second parameter is represented in a second color channel of the image frame, and the measurement value of the third parameter is represented in a third color channel of the image frame, and encoding the video sequence using video encoding. ### Claim 2 (depends on 1) The method of claim 1, wherein for each ray of the plurality of rays of the frame of lidar data, which lidar return signal to have its lidar measurement values represented in which image portion is determined depending on the lidar measurement values of the lidar return signal. ### Claim 3 (depends on 1) The method of claim 1, wherein the lidar measurement values of each lidar return signal include a range value, and for each ray of the plurality of rays of the frame of lidar data, the measurement values of a lidar return signal having a largest range value are represented in a first image portion, and measurement values of a lidar return signal having a second largest range value are represented in a second image portion. ### Claim 4 (depends on 2) The method of claim 2, wherein the lidar measurement values of each lidar return signal include a doppler shift value, and the determination of which lidar return signal to have its measurement values represented in which image portion depends on similarity in doppler shift values of lidar return signals of different rays. ### Claim 5 (depends on 1) The method of claim 1, wherein at least two of the different image portions are encoded as different slices or tiles. ### Claim 6 (depends on 1) The method of claim 1, wherein, when encoding the video sequence, different levels of compression are applied to at least two of the image portions. ### Claim 7 (depends on 1) The method of claim 1, wherein the lidar measurement values includes a measurement value of a first parameter which is represented using a first number of bits, and wherein pixel values in the image frame are represented by a second number of bits which is lower than the first number of bits, wherein, for each image portion, a first subset of the first number of bits is represented in a first sub-portion of the image portion and a second subset of the first number of bits is represented in a second sub-portion of the image portion, and wherein the second sub-portion of the image portion is stacked after the first sub-portion of the image portion in one of said row direction or column direction of the image frame. ### Claim 8 (depends on 7) The method of claim 7, wherein the first subset of bits and the second subset of bits are odd and even bits, respectively. ### Claim 9 (depends on 7) The method of claim 7, wherein the first subset of bits includes the most significant bits and the second subset of bits includes the least significant bits, and wherein one or more ancillary bits are appended to the first subset of bits prior to encoding. ### Claim 10 (depends on 7) The method of claim 7, wherein the first sub-portion and the second sub-portion of at least one image portion are encoded as different slices or tiles. ### Claim 11 (depends on 7) The method of claim 7, wherein, when encoding the video sequence, a lower level of compression is applied to the first sub-portion compared to the second sub-portion of at least one image portion. ### Claim 12 An encoder for encoding lidar data, comprising circuitry configured to implement: an input interface function configured to receive subsequent frames of lidar data to be encoded, each frame of lidar data comprising a number of lidar return signals for each of a plurality of rays emitted at a respective elevation and azimuth angle by a lidar, each lidar return signal including lidar measurement values comprising a measurement value of a first parameter, a measurement value of a second parameter, and a measurement value of a third parameter, an image frame generating function configured to represent each frame of lidar data as an image frame of a video sequence, whereby for each ray of the plurality of rays of the frame of lidar data, lidar measurement values of different lidar return signals are represented in different image portions of the image frame, the different image portions being stacked after each other in a row direction or a column direction of the image frame, wherein each image portion has a pixel grid corresponding to elevation and azimuth angles and pixel values formed from the lidar measurement values of the lidar return signals represented in that image portion, wherein the pixel values of an image portion are formed from the lidar measurement values by interpolating the lidar measurement values from the elevation and azimuth angles of the plurality of rays to the pixel grid of the image portion, wherein the measurement value of the first parameter is represented in a first color channel of the image frame, the measurement value of the second parameter is represented in a second color channel of the image frame, and the measurement value of the third parameter is represented in a third color channel of the image frame, and an encoding function configured to encode the video sequence using video encoding. ### Claim 13 A non-transitory computer-readable medium comprising computer code instructions which, when executed by a device having processing capability, cause the device to carry out a method for encoding lidar data, comprising: receiving subsequent frames of lidar data to be encoded, each frame of lidar data comprising a number of lidar return signals for each of a plurality of rays emitted at a respective elevation and azimuth angle by a lidar, each lidar return signal including lidar measurement values comprising a measurement value of a first parameter, a measurement value of a second parameter, and a measurement value of a third parameter, representing each frame of lidar data as an image frame of a video sequence, whereby for each ray of the plurality of rays of the frame of lidar data, lidar measurement values of different lidar return signals are represented in different image portions of the image frame, the different image portions being stacked after each other in a row direction or a column direction of the image frame, wherein each image portion has a pixel grid corresponding to elevation and azimuth angles and pixel values formed from the lidar measurement values of the lidar return signals represented in that image portion, wherein the pixel values of an image portion are formed from the lidar measurement values by interpolating the lidar measurement values from the elevation and azimuth angles of the plurality of rays to the pixel grid of the image portion, wherein the measurement value of the first parameter is represented in a first color channel of the image frame, the measurement value of the second parameter is represented in a second color channel of the image frame, and the measurement value of the third parameter is represented in a third color channel of the image frame, and encoding the video sequence using video encoding.