# US 2024/0185835 A1 · System for assisting the blind in financial management

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0185835 A1
- Document ID: US20240185835A1
- Status: Published application
- Kind: A1
- Application number: 18/076,144
- Filed: 2022-12-06
- Published: 2024-06-06
- Earliest claimed: 2022-12-06
- Assignees: Hillming Company Limited
- Applicants: Hillming Company Limited
- Inventors: Hillming LI
- Web page: https://patentgrep.com/patent/US20240185835A1

## CPC

- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G06Q 20/3674: {involving authentication}
- G06Q 20/40145: {Biometric identity checks}
- G06V 10/764: using classification, e.g. of video objects
- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- G06V 2201/10: Recognition assisted with metadata
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system for assisting the blind in financial management is used for mobile phones, computers, and other communication terminals to operate without relying on eyesight, and dealing with related commodity transactions, online shopping, taxi service, food delivery, takeaway order, fee payment, membership services, purchasing services, sending red envelopes, buying and selling services, leasing services, payment, collection, transfer, refund, currency exchange, account inquiry, e-wallet management, stock securities investment, foreign exchange fund trading, futures real estate and/or other related finance and other mobile banking services.

## Claims

### Claim 1

A system for assisting the blind in financial management, comprising an intelligent interpretation module for converting information into speech, which includes at least a pre-defined data database and a speech prompt device;
an interactive verification module, which connects to a biometric data source of the user, and collects the real time biometric to compare with the biometric data for completing the verification and issuing the verification result;
an interactive input module, which includes a voice and/or a handwriting input for the user outputting the operation commands or inputting message;
a payment gateway, which holds the blind user's e-wallet, the e-wallet binds with the band account and/or credit card and/or payment account;
an intelligent assistant module, which embeds with an intelligent processing program including a multiple modality algorithm; the intelligent assistant connects with a video capture device and/or an audio capture device, processes and analyses the information of the capture device, and then obtains the corresponding information and transmits to an intelligent interpretation module to provide speech prompt to the blind user; the blind user controls the interactive input module to operate according to the speech prompt and be authenticated through the interactive verification module for the payment module completing the financial management operation.

### Claim 2 (depends on 1)

The system for assisting the blind in financial management of claim 1, wherein the interactive verification module comprising a face recognition module and/or a voice recognition module and/or a fingerprint recognition module and/or a palmprint recognition module and/or a security token.

### Claim 3 (depends on 1)

The system for assisting the blind in financial management of claim 1, wherein the e-wallet binds with the user's email and/or mobile phone number.

### Claim 4 (depends on 1)

The system for assisting the blind in financial management of claim 1, wherein the multiple modality algorithm comprising computer vision processing of images and text and natural language processing;
the computer vison processing includes following steps:
a. obtains real time visual signals through video capture device, including images and videos;
b. pre-processes the visual signals;
c. detects objects of visual signals;
d. tracks the objects;
e. processes images and classifies objects;
f. obtains metadata of the objects;
the natural language processing includes: after processing by the computer vision, the metadata is input and processed which is divided into structured text analysis processing and semantic understanding processing; the verbal command inputs for voice recognition processing and transmits to a natural language understanding processing; an AI center, which is used to input and synthesise all the above processing information to form tasks, output the information of the task to intact with the user, process natural language processing, and finally send the guide voice to the user by the intelligent interpretation module.
