# US 2025/0148747 A1 · Information processing device and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148747 A1
- Document ID: US20250148747A1
- Status: Published application
- Kind: A1
- Application number: 18/835,944
- Filed: 2023-01-30
- Published: 2025-05-08
- Earliest claimed: 2022-02-15
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: KUNIAKI NODA; TAKAYUKI SAKAMOTO
- Web page: https://patentgrep.com/patent/US20250148747A1

## CPC

- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G01B 11/24: for measuring contours or curvatures
- G06T 7/11: Region-based segmentation
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/64: Three-dimensional [3D] objects
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present technology relates to an information processing device and an information processing method that achieve an improvement in accuracy of object detection using a three-dimensional point cloud. The information processing device includes a segmentation unit that executes segmentation of a point cloud including a plurality of ranging points on the basis of a distance between the ranging points to partition the point cloud into a plurality of segments, an object detection unit that executes object detection processing on the basis of a captured image obtained by capturing an image of an observation region where the point cloud has been observed, and a segment correction unit that corrects the segments on the basis of a result of the object detection processing. The present technology is applicable to, for example, an object detection device.

## Claims

### Claim 1

An information processing device comprising:
a segmentation unit that executes segmentation of a first point cloud including a plurality of ranging points on a basis of a distance between the ranging points to partition the first point cloud into a plurality of segments;
an object detection unit that executes object detection processing on a basis of a captured image obtained by capturing an image of an observation region where the first point cloud has been observed; and
a segment correction unit that corrects the segments on a basis of a result of the object detection processing.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the object detection unit detects an object region where an object appears in the captured image, and
the segment correction unit groups, into a same segment, the ranging points corresponding to the same object region but belonging to the different segments.

### Claim 3 (depends on 2)

The information processing device according to claim 2, wherein
the object detection unit recognizes a type of an object in the object region, the information processing device further comprising a shape recognition unit that recognizes a shape of an object corresponding to each of the segments using an object shape model corresponding to a type of the object corresponding to the segment.

### Claim 4 (depends on 2)

The information processing device according to claim 2, wherein
the object detection unit detects the object region having a rectangular shape.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein
the segment correction unit groups, into one segment, a plurality of the segments corresponding to the same object region.

### Claim 6 (depends on 4)

The information processing device according to claim 4, wherein
the segment correction unit groups, into one segment, a plurality of the segments corresponding to the same object region in a case where a plurality of the segments satisfies a geometric constraint condition.

### Claim 7 (depends on 4)

The information processing device according to claim 4, wherein
in a case where there is the segment corresponding to a transparent region or a reflective region of an object among a plurality of the segments corresponding to the same object region, the segment correction unit interpolates the ranging points in a surface region of the object corresponding to the transparent region or the reflective region, and groups, into one segment, the segment corresponding to the surface region of the object among a plurality of the segments and the segment including the ranging points that have been interpolated.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein
the transparent region is a region that is seen through a transparent portion of a surface of the object, and
the reflective region is a region of the surface of the object that exhibits specular reflection.

### Claim 9 (depends on 2)

The information processing device according to claim 2, wherein
the object detection unit executes semantic segmentation on the captured image.

### Claim 10 (depends on 1)

The information processing device according to claim 1, further comprising a point cloud extraction unit that generates the first point cloud including the ranging points corresponding to a three-dimensional object by removing the ranging points corresponding to a plane from a second point cloud generated on a basis of a range image indicating distance values of the ranging points in the observation region.

### Claim 11

An information processing method comprising:
executing segmentation of a point cloud including a plurality of ranging points on a basis of a distance between the ranging points to partition the point cloud into a plurality of segments;
executing object detection processing on a basis of a captured image obtained by capturing an image of an observation region where the point cloud has been observed; and
correcting the segments on a basis of a result of the object detection processing.
