Back to results
US 12,687,520 B2Granted
Information processing device and information processing method
AssigneeSony Group Corporation
InventorJustinas Miseikis
Life of this patent
Estimating the term…
Abstract
An information processing device, comprising circuitry configured to: obtain sound data representing a sound of an environment of a recording device; and classify, based on the sound data, a ground surface of the environment.
Claims12
An information processing device, comprising circuitry configured to:
- obtain sound data representing a sound generated by interaction between a contact object and a ground surface of an environment of a recording device,
- obtain sensor data representing at least one of a movement and vibration of the recording device,
- classify, based on the sound data and the sensor data, the ground surface of the environment using an artificial neural network trained using a plurality of ground-truth sound data portions, each ground-truth sound data portion acquired during a known movement state on a ground surface having known physical characteristics, the artificial neural network being trained to distinguish between different ground surface types, conditions, and damages based on audio properties of the sound data, wherein the artificial neural network is adaptable to different contact object materials using transfer learning,
- obtain location data representing a location of the recording device,
- associate a classification result of the ground surface with the location, and
- provide the associated location and classification result as side information in a digital map to enabling route planning that considers ground surface conditions based on physical properties of the ground surface that are determinable from the sound generated by the interaction between the contact object and the ground surface.
3 more elements
An information processing method, comprising:
- obtaining sound data representing a sound generated by interaction between a contact object and a ground surface of an environment of a recording device;
- classifying, based on the sound data and the sensor data, the ground surface of the environment using an artificial neural network trained using a plurality of ground-truth sound data portions, each ground-truth sound data portion acquired during a known movement state on a ground surface having known physical characteristics, the artificial neural network being trained to distinguish between different ground surface types, conditions, and damages based on audio properties of the sound data, wherein the artificial neural network is adaptable to different contact object materials using transfer learning;
- obtaining location data representing a location of the recording device;
- associating a classification result of the ground surface with the location;
- and
- providing the associated location and classification result as side information in a digital map to enabling route planning that considers ground surface conditions based on physical properties of the ground surface that are determinable from the sound generated by the interaction between the contact object and the ground surface.
3 more elements
Dependencies are inferred from the claim text.