Image processing apparatus and image processing method for generating a sound image
AssigneeNissan Motor Co., Ltd.
InventorsSatoru Hirose, Toru Takagi
Life of this patent
Estimating the term…
Abstract
An image processing apparatus includes a controller. The controller calculates a fundamental frequency component included in sound data and a harmonic component corresponding to the fundamental frequency component, converts the fundamental frequency component and the harmonic component into image data, and generates a sound image where the fundamental frequency component and the harmonic component converted into the image data are arranged adjacent each other.
Claims7
An image processing apparatus for acquiring sound data from a machine and analyzing the sound data that have been acquired, the image processing apparatus comprising:
- a controller configured to:
- transform the sound data to a frequency domain;
- calculate a fundamental frequency component included in the sound data and a harmonic component corresponding to the fundamental frequency component, wherein the fundamental frequency is calculated based on a difference of frequencies between peaks in the frequency domain and a frequency of a first peak in the frequency domain;
- and
- convert the fundamental frequency component and the harmonic component that have been calculated into image data;
- generate a sound image comprising a two-dimensional matrix including the fundamental frequency component, the harmonic component, and other frequency components that have been converted into the image data arranged into predetermined areas, the arrangement based on the fundamental frequency component, and
- determine, using a machine learning model generated with labelled sound images having a first fundamental frequency the same as the fundamental frequency, whether an abnormality is present in the machine using the sound image,
- wherein in the sound image the fundamental frequency component and the harmonic component that have been converted into the image data are arranged adjacent each other,
- wherein the two-dimensional matrix having a predetermined area set for each frequency component.
A method of determining an abnormality in a machine, comprising:
- acquiring sound data of the machine;
- transforming the sound data to a frequency domain forming frequency data;
- calculating a fundamental frequency component included in the sound data and a harmonic component corresponding to the fundamental frequency component, wherein the fundamental frequency is calculated based on a difference of frequencies between peaks in the frequency data and a frequency of a first peak in the frequency data;
- converting the fundamental frequency component and the harmonic component that have been calculated into image data;
- generating a sound image comprising a two-dimensional matrix including the fundamental frequency component, the harmonic component, and other frequency components that have been converted into image data arranged into predetermined areas, the arrangement based on the fundamental frequency component, and
- determining, using a machine learning model generated with labelled sound images having a first fundamental frequency the same as the fundamental frequency, whether an abnormality is present in the machine using the sound image,
- wherein in the sound image the fundamental frequency component and the harmonic component that have been converted into the image data are arranged adjacent each other,
- wherein the two-dimensional matrix having a predetermined area set for each frequency component.
Dependencies are inferred from the claim text.