Back to results
US 9,959,783 B2Granted
Converting audio to haptic feedback in an electronic device
AssigneeApple Inc.
InventorGregory F. Hughes
Life of this patent
Estimating the term…
Abstract
In general, in one aspect, a method performed by one or more processes executing on a computer systems includes receiving an audio signal comprising a range of audio frequencies including high frequencies and low frequencies, converting a first portion of the range of audio frequencies into haptic data, shifting a second portion of the range of audio frequencies down to lower audio frequencies, and presenting at least one of the converted first portion and the shifted second portion to a human user. Other implementations of this aspect include corresponding systems, apparatus, and computer program products.
Claims57
A method, comprising:
- at an electronic device with one or more audio output generators and one or more haptic output generators:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the one or more haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal;
- wherein the respective audio signal includes a plurality of audio tracks, the method including deriving the respective haptic output from a first track of the plurality of the audio tracks of the respective audio signal, and deriving the respective audio output from a second track, different from the first track, of the respective audio signal.
4 more elements
An electronic device comprising:
- one or more audio output generators;
- one or more haptic output generators that are distinct from the one or more audio output generators;
- one or more input devices;
- and
- a processor configured to execute instructions, stored in a non-transitory machine-readable medium, to cause the electronic device to perform operations comprising:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the one or more haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal;
- wherein the respective audio signal includes a plurality of audio tracks, and the processor is configured to execute instructions to cause the electronic device to perform operations further including deriving the respective haptic output from a first track of the plurality of the audio tracks of the respective audio signal, and deriving the respective audio output from a second track, different from the first track, of the respective audio signal.
8 more elements
A non-transitory computer readable storage medium storing one or more programs, wherein execution of the one or more programs by an electronic device having one or more audio output generators, one or more haptic output generators that are distinct from the one or more audio output generators, and one or more input devices, causes the electronic device to perform operations comprising:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the one or more haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal;
- wherein the respective audio signal includes a plurality of audio tracks, and execution of the one or more programs by the electronic device causes the electronic device to perform operations further including deriving the respective haptic output from a first track of the plurality of the audio tracks of the respective audio signal, and deriving the respective audio output from a second track, different from the first track, of the respective audio signal.
3 more elements
A method, comprising:
- at an electronic device with one or more audio output generators and a plurality of haptic output generators:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the plurality of haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal, including using a first haptic output generator of the plurality of haptic output generators to generate a first subset of the respective haptic output and using a second haptic output generator of the plurality of haptic output generators to generate a second subset of the respective haptic output.
3 more elements
An electronic device, comprising:
- one or more audio output generators;
- a plurality of haptic output generators that are distinct from the one or more audio output generators;
- one or more input devices;
- and
- a processor configured to execute instructions, stored in a non-transitory machine-readable medium, to cause the electronic device to perform operations comprising:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the plurality of haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal, including using a first haptic output generator of the plurality of haptic output generators to generate a first subset of the respective haptic output and using a second haptic output generator of the plurality of haptic output generators to generate a second subset of the respective haptic output.
7 more elements
A non-transitory computer readable storage medium storing one or more programs, wherein execution of the one or more programs by an electronic device having one or more audio output generators, a plurality of haptic output generators that are distinct from the one or more audio output generators, and one or more input devices, causes the electronic device to perform operations comprising:
- detecting the occurrence of an event that corresponds to a respective audio signal;
- in response to detecting the occurrence of the event, concurrently:
- outputting, via the one or more audio output generators, a respective audio output that corresponds to a first portion of the respective audio signal;
- and
- outputting, via the plurality of haptic output generators, a respective haptic output that is generated based on a second portion of the respective audio signal that is different from the first portion of the respective audio signal, including using a first haptic output generator of the plurality of haptic output generators to generate a first subset of the respective haptic output and using a second haptic output generator of the plurality of haptic output generators to generate a second subset of the respective haptic output.
2 more elements
Dependencies are inferred from the claim text.