# US 2020/0393689 A1 · Information processing apparatus and surface roughness acquisition method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0393689 A1
- Document ID: US20200393689A1
- Status: Published application
- Kind: A1
- Application number: 16/771,936
- Filed: 2017-12-22
- Published: 2020-12-17
- Earliest claimed: 2017-12-22
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Shinya Wada
- Web page: https://patentgrep.com/patent/US20200393689A1

## CPC

- G02B 27/0068: {having means for controlling the degree of correction, e.g. using phase modulators, movable elements (controlling the phase of light using moving or deformable elements G02B26/06)}
- G01B 11/30: for measuring roughness or irregularity of surfaces
- G02B 27/286: {for controlling or changing the state of polarisation, e.g. transforming one polarisation state into another (G02B5/3083 takes precedence; light guide coupling means utilising polarising elements G02B6/34)}
- G06V 10/141: Control of illumination
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing apparatus determines a plurality of sampling points in a range of a target object's silhouette having different specular reflectances in polarization images in a plurality of azimuths, extracts polarization luminance at the sampling points in question, and derives change in luminance relative to the polarization azimuth, thus acquiring, as a phase angle, the azimuth that provides the highest luminance. Then, the information processing apparatus evaluates a characteristic of the change in phase angle relative to the change in the specular reflectance, thus identifying a subject's surface roughness. Further, the information processing apparatus generates data to be output by performing a process according to the surface roughness and outputs the generated data.

## Claims

### Claim 1

An information processing apparatus comprising:
an image acquisition section adapted to acquire data of polarization images in a plurality of azimuths;
a phase angle acquisition section adapted to not only derive change in polarization luminance representing a subject's silhouette relative to the azimuth by using the polarization images but also acquire the azimuth that provides a maximum value of the polarization luminance as a phase angle;
a surface roughness acquisition section adapted to acquire surface roughness of the subject by evaluating a characteristic of the phase angle with respect to change in the specular reflectance in accordance with a given reference; and
an output data generation section adapted to generate data according to the surface roughness and output the generated data.

### Claim 2 (depends on 1)

The information processing apparatus of claim 1, wherein the surface roughness acquisition section evaluates, as a characteristic of the phase angle, a parameter representing how mildly or steeply change in the phase angle occurs relative to the change in the specular reflectance.

### Claim 3 (depends on 1)

The information processing apparatus of claim 1, wherein
the phase angle acquisition section acquires the phase angles at a plurality of positions having different specular reflectances in the subject's silhouette, and
the surface roughness acquisition section evaluates the characteristic by acquiring the specular reflectances at the plurality of positions and then representing the change in the phase angle relative to the specular reflectance.

### Claim 4 (depends on 1)

The information processing apparatus of claim 1, wherein
the phase angle acquisition section acquires the phase angles in a range of the subject's silhouette where the specular reflectance varies monotonously, and
the surface roughness acquisition section evaluates the characteristic of the phase angle by representing the change in the phase angle relative to a position in the range.

### Claim 5 (depends on 4)

The information processing apparatus of claim 4, wherein the surface roughness acquisition section evaluates the characteristic after adjusting the change in the phase angle relative to the position on a basis of a normal vector distribution on a surface of the subject.

### Claim 6 (depends on 1)

The information processing apparatus of claim 1, wherein
the phase angle acquisition section acquires the phase angle in a range of the subject's silhouette where a difference in luminance is equal to or greater than a given value, and
the surface roughness acquisition section evaluates the characteristic of the phase angle by representing the change in the phase angle relative to the luminance.

### Claim 7 (depends on 1)

The information processing apparatus of claim 1, wherein
the image acquisition section acquires video data of the polarization images in which a state in which the specular reflectance of the subject changes is captured,
the phase angle acquisition section acquires, from a plurality of image frames of the video, the phase angles at positions of the subject's silhouette where the specular reflectance changes monotonously, and
the surface roughness acquisition section evaluates the characteristic of the phase angle by representing the change in the phase angle relative to time.

### Claim 8 (depends on 1)

The information processing apparatus of claim 1, wherein the surface roughness acquisition section refers to a lookup table associating a parameter representing the characteristic of the phase angle with the surface roughness and acquires the surface roughness of the subject on a basis of a value of the parameter acquired on a basis of the polarization images.

### Claim 9 (depends on 1)

The information processing apparatus of claim 1, wherein the surface roughness acquisition section acquires the relative surface roughness with respect to a reference by comparing a reference value of the parameter representing the characteristic of the phase angle and a value of the parameter acquired on a basis of the polarization images.

### Claim 10 (depends on 1)

The information processing apparatus of claim 1, further comprising: a spatial information acquisition section adapted to acquire information regarding a state of a light source on a basis of the surface roughness of the subject and a luminance distribution of the subject's silhouette.

### Claim 11 (depends on 1)

The information processing apparatus of claim 1, further comprising:
a spatial information acquisition section adapted to acquire, by using information regarding the change in the phase angle relative to the change in the specular reflectance and on a basis of the phase angle at a position of the subject's silhouette, the specular reflectance at the position.

### Claim 12

A surface roughness acquisition method by an information processing apparatus, comprising:
acquiring data of polarization images in a plurality of azimuths;
not only deriving change in polarization luminance representing a subject's silhouette relative to the azimuth by using the polarization images but also acquiring the azimuth that provides a maximum value of the polarization luminance as a phase angle;
acquiring surface roughness of the subject by evaluating a characteristic of the phase angle with respect to change in the specular reflectance in accordance with a given reference; and
generating data according to the surface roughness and outputting the generated data.

### Claim 13

A non-transitory, computer readable storage medium containing a computer program, which when executed by a computer, causes the computer to carry out actions, comprising:
acquiring data of polarization images in a plurality of azimuths;
not only deriving change in polarization luminance representing a subject's silhouette relative to the azimuth by using the polarization images but also acquiring the azimuth that provides a maximum value of the polarization luminance as a phase angle;
acquiring surface roughness of the subject by evaluating a characteristic of the phase angle with respect to change in the specular reflectance in accordance with a given reference; and
generating data according to the surface roughness and outputting the generated data.
