# US 2015/0104049 A1 · Acoustic device, augmented reality acoustic device, acoustic system, acoustic processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104049 A1
- Document ID: US20150104049A1
- Status: Published application
- Kind: A1
- Application number: 14/479,756
- Filed: 2014-09-08
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Assignees: Fujitsu Limited
- Applicants: Fujitsu Limited
- Inventors: Masahide NODA; Takashi Ohno
- Web page: https://patentgrep.com/patent/US20150104049A1

## CPC

- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An acoustic device includes: a memory; and a processor coupled to the memory. The processor executes a process including: first determining, based on a state of a user, an arbitrary object from among objects around the user as an object that is watched by the user; second determining the watched object as a target when a predetermined determination time elapses from a timing at which the arbitrary object is determined as the watched object; generating, when the watched object is determined as the target, acoustic signals for outputting audio of a sound generator corresponding to the target in association with a position of the target; and making, based on a difference between a moving direction of the user and a direction of a body of the user, an adjustment to reduce remaining time until when the predetermined determination time elapses.

## Claims

### Claim 1

An acoustic device comprising:
a memory; and
a processor coupled to the memory, wherein the processor executes a process including:
first determining, based on a state of a user, an arbitrary object from among objects around the user as an object that is watched by the user;
second determining the watched object as a target when a predetermined determination time elapses from a timing at which the arbitrary object is determined as the watched object;
generating, when the watched object is determined as the target, acoustic signals for outputting audio of a sound generator corresponding to the target in association with a position of the target; and
making, based on a difference between a moving direction of the user and a direction of a body of the user, an adjustment to reduce remaining time until when the predetermined determination time elapses.

### Claim 2 (depends on 1)

The acoustic device according to claim 1, wherein
the making includes making, per predetermined cycle, an adjustment to reduce the remaining time and setting the adjusted remaining time as a new determination time, and
the second determining includes determining, when the new determination time that is set by the adjuster elapses, the watched object as the target.

### Claim 3 (depends on 1)

The acoustic device according to claim 1, wherein the first determining includes determining, based on the moving direction of the user and the direction of the body of the user, the arbitrary object as the object that is watched by the user.

### Claim 4 (depends on 3)

The acoustic device according to claim 3, wherein the making includes reducing, when an object positioned in a direction other than the moving direction is determined as the object that is watched by the user at the first determining, the remaining time based on the difference between the moving direction of the user and the direction of the body of the user.

### Claim 5 (depends on 4)

The acoustic device according to claim 4, wherein the making includes reducing the remaining time based on an angle that is formed by the moving direction of the user and the direction of the body of the user.

### Claim 6 (depends on 1)

The acoustic device according to claim 1, wherein
the process further includes setting coordinates of a position in which a sound generator corresponding to the object watched by the user is virtually oriented, and
the setting includes setting the coordinates of the position of the sound generator such that the sound generator corresponding to the watched object gets close to the user in accordance with the remaining time.

### Claim 7 (depends on 1)

The acoustic device according to claim 1, wherein
the first determining includes determining, when a watching behavior of the user is detected, an object positioned in a direction other than the moving direction as an object that is watched by the user, and
the making includes further reducing the remaining time when the object positioned in the direction other than the moving direction is determined as the object that is watched by the watching behavior of the user at the first determining.

### Claim 8 (depends on 7)

The acoustic device according to claim 7, wherein the first determining includes detecting, as the watching behavior of the user, a behavior of stopping while moving in the moving direction of the user.

### Claim 9 (depends on 7)

The acoustic device according to claim 7, wherein the first determining includes detecting, as the watching behavior of the user, a behavior with which a distance between a hand of the user and an ear of the user is made shorter than a predetermined distance.

### Claim 10

An acoustic system comprising:
a terminal device that is carried by a user; and
an acoustic device that provides the terminal device with acoustic signals including audio from a sound generator corresponding to an object around the user, wherein
the terminal device includes:
a memory; and
a processor coupled to the memory, wherein the processor executes a process including:
detecting a state of the user; and
outputting the acoustic signals, and
the acoustic device includes:
a memory; and
a processor coupled to the memory, wherein the processor executes a process including:
first determining, based on the state of the user, an arbitrary object from among objects around the user as an object that is watched by the user;
second determining the watched object as a target when a predetermined determination time elapses from a timing at which the arbitrary object is determined as the watched object;
generating, when the watched object is determined as the target, acoustic signals for outputting audio of a sound generator corresponding to the target in association with a position of the target; and
making, based on a difference between a moving direction of the user and a direction of a body of the user, an adjustment to reduce remaining time until when the predetermined determination time elapses.

### Claim 11

An acoustic processing method comprising:
first determining, based on a state of a user, an arbitrary object from among objects around the user as an object that is watched by the user, using a processor;
second determining the watched object as a target when a predetermined determination time elapses from a timing at which the arbitrary object is determined as the watched object, using the processor;
when the watched object is determined as the target, generating acoustic signals for outputting audio of a sound generator corresponding to the target in association with a position of the target, using the processor; and
based on a difference between a moving direction of the user and a direction of a body of the user, making an adjustment to reduce remaining time until when the predetermined determination time elapses, using the processor.

### Claim 12

A non-transitory computer-readable recording medium having stored therein a program that causes a computer to execute an acoustic process comprising:
first determining, based on a state of a user, an arbitrary object from among objects around the user as an object that is watched by the user;
second determining the watched object as a target when a predetermined determination time elapses from a timing at which the arbitrary object is determined as the watched object;
when the watched object is determined as the target, generating acoustic signals for outputting audio of a sound generator corresponding to the target in association with a position of the target; and
based on a difference between a moving direction of the user and a direction of a body of the user, making an adjustment to reduce remaining time until when the predetermined determination time elapses.
