# US 2026/0087776 A1 · Selective multi-view deep model for 3d object classification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087776 A1
- Document ID: US20260087776A1
- Status: Published application
- Kind: A1
- Application number: 18/891,586
- Filed: 2024-09-20
- Published: 2026-03-26
- Earliest claimed: 2024-09-20
- Assignees: King Fahd University of Petroleum and Minerals; Saudi Data and Artificial Intelligence Authority (SDAIA)
- Applicants: King Fahd University of Petroleum and Minerals; Saudi Data and Artificial Intelligence Authority (SDAIA)
- Inventors: Mona Saleh Ahmad ALZAHRANI; Muhammad USMAN; Saeed ANWAR; Tarek Ahmed Helmy EL-BASSUNY
- Web page: https://patentgrep.com/patent/US20260087776A1

## CPC

- G06V 10/764: using classification, e.g. of video objects
- B25J 9/1669: {characterised by special application, e.g. multi-arm co-operation, assembly, grasping}
- B25J 9/1697: {Vision controlled systems}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/82: using neural networks
- G06V 20/64: Three-dimensional [3D] objects
- H04N 13/351: for displaying simultaneously
- G06V 2201/06: Recognition of objects for industrial automation
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A selective multi-view method and a 3D object recognition subsystem for 3D object classification. The method includes inputting, by a 3D imaging sensor, a 3D data representation of a 3D object, extracting, by processing circuitry, multiple view images from the 3D data representation of the 3D object, selecting, by the processing circuitry, a most influential view based on an assignment of importance scores using a Cosine similarity method between visual features detected by at least one pre-trained convolutional neural network (CNN). The method further includes predicting, by the processing circuitry, a classification of the 3D object based on the selected most influential view and outputting, by the processing circuitry, a class of the 3D object. The subsystem may be implemented for a robotic pick and place manipulator.

## Claims

### Claim 1

A selective multi-view method for 3D object classification, comprising:
inputting, by a 3D imaging sensor, a 3D data representation of a 3D object;
extracting, by processing circuitry, multiple view images from the 3D data representation of the 3D object;
selecting, by the processing circuitry, a most influential view based on an assignment of importance scores using a Cosine similarity method between visual features detected by at least one pre-trained convolutional neural network (CNN);
predicting, by the processing circuitry, a classification of the 3D object based on the selected most influential view; and
outputting, by the processing circuitry, a class of the 3D object.

### Claim 2 (depends on 1)

The method of claim 1, further comprising controlling a robotic manipulator to grasp the 3D object based on the object class.

### Claim 3 (depends on 1)

The method of claim 1, further comprising feature extracting, by the at least one pre-trained CNN ψ, a stack of feature maps fmi of a detected visual feature from the extracted multiple view images Vi before the predicting by a classification model.

### Claim 4 (depends on 3)

The method of claim 3, further comprising comparing feature vectors obtained by the feature extracting based on their similarity using the Cosine Similarity, and assigning an importance score to each feature vector.

### Claim 5 (depends on 4)

The method of claim 4, further comprising determining the importance score I of each feature vector fv as a Cosine distance between current fvi and all other feature vectors.

### Claim 6 (depends on 5)

The method of claim 5, further comprising selecting the feature vector with highest importance score, Most Similar View (MSV), as the most influential view.

### Claim 7 (depends on 5)

The method of claim 5, further comprising selecting the feature vector with lowest importance score, Most Dissimilar View (MDV), as the most influential view.

### Claim 8 (depends on 1)

The method of claim 1, wherein the extracting step extracts the multiple view images from a perspective of an arrangement of a plurality of virtual cameras arranged at positions irregularly spherical around the 3D object.

### Claim 9 (depends on 1)

The method of claim 1, wherein the extracting step extracts the multiple view images from a perspective of an arrangement of a plurality of virtual cameras arranged at positions in a circle around the 3D object.

### Claim 10 (depends on 1)

The method of claim 1, further comprising classifying, by a fully connected layer, the 3D object.

### Claim 11

A 3D object recognition subsystem for a robotic pick and place manipulator, comprising:
a 3D imaging sensor obtaining a 3D data representation of a 3D object;
processing circuitry configured to
extract multiple view images from the 3D data representation of the 3D object,
select a most influential view based on an assignment of importance scores using a Cosine similarity method between visual features detected by at least one pre-trained convolutional neural network (CNN),
predict a classification of the 3D object based on the selected most influential view,
output a class of the 3D object, and
control the robotic manipulator to grasp the 3D object based on the object class.

### Claim 12 (depends on 11)

The subsystem of claim 11, wherein the processing circuitry is further configured to extract the multiple view images from a perspective of an arrangement of a plurality of virtual cameras.

### Claim 13 (depends on 11)

The subsystem of claim 11, wherein the processing circuitry is further configured to extract by the at least one pre-trained CNN ψ, a stack of feature maps fmi of the detected visual feature from the extracted multiple view images Vi before the predicting by a classification model.

### Claim 14 (depends on 11)

The subsystem of claim 11, wherein the processing circuitry is further configured to
compare feature vectors obtained by the feature extraction based on their similarity using the Cosine Similarity, and
assign an importance score to each feature vector.

### Claim 15 (depends on 14)

The subsystem of claim 14, wherein the processing circuitry is further configured to determine the importance score I of each feature vector fv as a Cosine distance between current fvi and all other feature vectors.

### Claim 16 (depends on 15)

The subsystem of claim 15, wherein the processing circuitry is further configured to select the feature vector with highest importance score, Most Similar View (MSV), as the most influential view.

### Claim 17 (depends on 15)

The subsystem of claim 15, wherein the processing circuitry is further configured to select the feature vector with lowest importance score, Most Dissimilar View (MDV), as the most influential view.

### Claim 18 (depends on 12)

The subsystem of claim 12, wherein the arrangement of the plurality of virtual cameras is virtual cameras arranged at positions irregularly spherical around the 3D object.

### Claim 19 (depends on 12)

The subsystem of claim 12, wherein the arrangement of the plurality of virtual cameras is virtual cameras arranged at positions in a circle around the 3D object.

### Claim 20 (depends on 11)

The subsystem of claim 11, wherein the processing circuitry is further configured to classify, by a fully connected layer, the 3D object.
