System and method for audio guide
AssigneeUniversal City Studios LLC
InventorsAlvaro Javier Lazaro Aguilar, Weiyi He, Ambar Aballo Ruiz, Paige Lynette Reiter, Thomas Owen Williams, Howard Bruce Mall
Life of this patent
Estimating the term…
Abstract
A method of providing audio descriptions of landmarks includes causing a user device to capture an image via an imaging sensor of the user device, comparing the captured image to a reference image to identify a landmark that appears in the captured image, providing a prompt requesting a description associated with the identified landmark to a large language model (LLM), receiving an audio file of the description associated with the identified landmark, and providing the audio file of the description associated with the identified landmark to the one or more user devices.
Claims20
An audio guide system, comprising:
- a portable device associated with a guest, wherein the portable device comprises an imaging sensor configured to capture an image;
- a beacon configured to:
- detect a presence of the portable device in an area;
- query the portable device based on detecting the presence of the portable device in the area;
- and
- cause the imaging sensor of the portable device to capture the image in response to the query;
- and
- a computing device comprising:
- processing circuitry;
- and
- memory, accessible by the processing circuitry and storing instructions that, when executed by the processing circuitry, cause the processing circuitry to perform operations comprising:
- receiving the captured image;
- comparing the captured image to a reference image to identify a landmark that appears in the captured image;
- generating a prompt requesting a description associated with the identified landmark;
- providing the prompt to a large language model (LLM);
- receiving, from the LLM, the description associated with the identified landmark;
- providing the description associated with the identified landmark to a text-to-speech model;
- receiving an audio file of the description associated with the identified landmark from the text-to-speech model;
- and
- providing the audio file of the description associated with the identified landmark to the portable device, wherein the portable device is configured to play the audio file in response to receipt of the audio file.
A method of providing audio descriptions associated with landmarks, the method comprising:
- detecting, via a beacon, a presence of a user device in an area;
- querying, via the beacon, the user device based on detecting the presence of the user device in the area;
- causing, via the beacon, the user device to capture an image via an imaging sensor of the user device in response to the query;
- comparing the captured image to a reference image to identify a landmark that appears in the captured image;
- providing, to a large language model (LLM), a prompt requesting a description associated with the identified landmark;
- receiving an audio file of the description associated with the identified landmark;
- and
- providing the audio file of the description associated with the identified landmark to the user device.
A non-transitory computer readable medium storing instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations comprising:
- detecting, via a beacon, a presence of a portable device in an area;
- querying, via the beacon, the portable device based on detecting the presence of the portable device in the area;
- causing, via the beacon, the imaging sensor of the portable device to capture the image in response to the query;
- receiving the captured image from the portable device;
- comparing the captured image to a reference image to identify a landmark that appears in the captured image;
- providing, to a large language model (LLM), a prompt requesting a description associated with the identified landmark;
- receiving, from the LLM, the description associated with the identified landmark;
- providing the description associated with the identified landmark to a text-to-speech model;
- receiving an audio file of the description associated with the identified landmark from the text-to-speech model;
- and
- providing the audio file of the description associated with the identified landmark to a user device, wherein the user device is configured to play the audio file in response to receipt of the audio file.
Dependencies are inferred from the claim text.