# US 10,873,837 B2 · Smart device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,873,837 B2
- Document ID: US10873837B2
- Status: Granted
- Kind: B2
- Application number: 16/252,543
- Filed: 2019-01-18
- Published: 2020-01-02
- Granted: 2020-12-22
- Earliest claimed: 2018-05-25
- Applicants: Bao Tran; Ha Tran
- Inventors: Bao Tran; Ha Tran
- Web page: https://patentgrep.com/patent/US10873837B2

## CPC

- H04W 4/38: for collecting sensor information
- A42B 3/0433: {Detecting, signalling or lighting devices}
- A42B 3/046: {Means for detecting hazards or accidents}
- A42B 3/30: Mounting radio sets or communication systems
- A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)}
- A61B 5/6804: {Garments; Clothes}
- A63B 24/0006: {Computerised comparison for qualitative assessment of motion sequences or the course of a movement}
- A63B 24/0021: {Tracking a path or terminating locations}
- A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance}
- A63B 24/0075: {Means for generating exercise programmes or schemes, e.g. computerized virtual trainer, e.g. using expert databases}
- A63B 43/004: {electrically conductive, e.g. for automatic arbitration}
- A63B 60/46: Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
- A63B 69/36: for golf
- A63B 69/38: for tennis {(A63B61/006, A63B69/0073 and A63B69/0097 take precedence)}
- A63B 71/06: Indicating or scoring devices for games or players {, or for other sports activities}
- A63B 71/145: {Boxing gloves}
- A63F 11/00: Game accessories of general use
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- B33Y 10/00: Processes of additive manufacturing
- G01L 5/0052: {measuring forces due to impact (G01L5/0061, G01L5/14 take precedence; impact testing of structures G01M7/08; impact testing of material G01N3/00)}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06K 19/025: {the material being flexible or adapted for folding, e.g. paper or paper-like materials used in luggage labels, identification tags, forms or identification documents carrying RFIDs (methods for testing the genuineness of valuable papers, e.g. banknotes or passports G07D7/00; constructional features of booklets and the like B42D)}
- G06K 19/07762: {the adhering arrangement making the record carrier wearable, e.g. having the form of a ring, watch, glove or bracelet (record carriers for insertion in the human body for medical purposes A61B90/00; record carriers adapted for attachment to animals A01K11/00)}
- G06Q 40/08: Insurance
- G06V 20/20: in augmented reality scenes
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G09B 19/003: {Repetitive work cycles; Sequence of movements}
- G09B 19/0038: {Sports}
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04Q 9/00: Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
- H04W 84/18: Self-organising networks, e.g. ad-hoc networks or sensor networks
- A61B 5/0022: {Monitoring a patient using a global network, e.g. telephone networks, internet}
- A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20)
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/053: Measuring electrical impedance or conductance of a portion of the body
- A61B 5/0533: Measuring galvanic skin response
- A61B 5/4872: {Body fat}
- A61B 5/6806: {Gloves}
- A61B 5/6895: {Sport equipment}
- A61B 2503/10: Athletes
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- A63B 21/072: Dumb-bells, bar-bells or the like {, e.g. weight discs having an integral peripheral handle}
- A63B 21/0724: {Bar-bells; Hand bars}
- A63B 21/0726: {Dumb bells, i.e. with a central bar to be held by a single hand, and with weights at the ends}
- A63B 69/0002: {for baseball}
- A63B 69/0026: {for ice-hockey}
- A63B 69/0028: {for running, jogging or speed-walking (movable endless bands A63B22/02)}
- A63B 69/0048: {for mountaineering, e.g. climbing-walls, grip elements for climbing-walls}
- A63B 69/0071: {for basketball}
- A63B 69/02: for fencing {, e.g. means for indicating hits}
- A63B 69/06: for rowing or sculling
- A63B 69/16: for cycling {, i.e. arrangements on or for real bicycles}
- A63B 69/3632: {Clubs or attachments on clubs, e.g. for measuring, aligning (A63B69/3614 takes precedence; clubs for swinging exercises in general A63B15/00)}
- A63B 71/085: {Mouth or teeth protectors (A63B71/081 takes precedence)}
- A63B 71/10: for the head ({A63B71/081 takes precedence } ; in the form of caps or hats A42B1/08; helmets A42B3/00)
- A63B 71/1216: {for the genital area}
- A63B 71/1291: {for the neck}
- A63B 71/141: {in the form of gloves}
- A63B 2071/1233: {for the hip}
- A63B 2071/125: {for the knee}
- A63B 2071/1283: {for the foot}
- A63B 2208/0204: Standing on the feet
- A63B 2220/12: Absolute positions, e.g. by using GPS
- A63B 2220/13: Relative positions
- A63B 2220/16: Angular positions
- A63B 2220/20: Distances or displacements
- A63B 2220/24: Angular displacement
- A63B 2220/30: Speed
- A63B 2220/40: Acceleration
- A63B 2220/51: Force
- A63B 2220/53: Force of an impact, e.g. blow or punch
- A63B 2220/56: Pressure
- A63B 2220/72: Temperature
- A63B 2220/74: Atmospheric pressure
- A63B 2220/75: Humidity
- A63B 2220/76: Wind conditions
- A63B 2220/803: Motion sensors
- A63B 2220/806: Video cameras
- A63B 2220/807: Photo cameras
- A63B 2220/833: Sensors arranged on the exercise apparatus or sports implement
- A63B 2220/836: Sensors arranged on the body of the user
- A63B 2225/30: Maintenance
- A63B 2225/50: Wireless data transmission, e.g. by radio transmitters or telemetry
- A63B 2225/54: Transponders, e.g. RFID
- A63B 2225/74: with powered illuminating means, e.g. lights
- A63B 2230/04: heartbeat characteristics, e.g. ECG, blood pressure modulations
- A63B 2230/06: heartbeat rate only
- A63B 2230/50: temperature
- A63B 2230/60: muscle strain, i.e. measured on the user
- A63B 2230/70: body fat
- A63B 2243/0025: Football
- A63B 2243/0037: Basketball
- A63B 2243/0054: Bowling, i.e. ten-pin bowling
- A63B 2243/0066: Rugby; American football
- A63B 2243/007: American football
- A63B 2243/0095: Volleyball
- A63B 2244/102: Boxing
- A63B 2244/18: Skating
- A63B 2244/19: Skiing
- A63B 2244/20: Swimming
- A63B 2244/203: Diving
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16Y 10/65: Entertainment or amusement; Sports
- H04B 1/04: Circuits
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04Q 2209/40: using a wireless architecture
- H04W 88/02: Terminal devices
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- A42B: HATS; HEAD COVERINGS (headbands A41D20/00; head-scarves A41D23/00)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- B33Y: ADDITIVE MANUFACTURING, i.e. MANUFACTURING OF THREE-DIMENSIONAL [3D] OBJECTS BY ADDITIVE DEPOSITION, ADDITIVE AGGLOMERATION OR ADDITIVE LAYERING, e.g. BY 3D PRINTING, STEREOLITHOGRAPHY OR SELECTIVE LASER SINTERING
- G01L: MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE (weighing G01G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04Q: SELECTING (switches, relays, selectors H01H; wireless communication networks H04W)
- G16Y: INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- H04B: TRANSMISSION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

An Internet of Thing (IoT) device includes a body with a processor, a camera and a wireless transceiver coupled to the processor.

## Claims

### Claim 1

A method for determining real-time vehicle operation cost for a driver during a trip, comprising:
mounting cameras on a vehicle to monitor traffic data, wherein at least one camera determines distances of neighboring objects from the camera;
generating a 3D model and determining obstacle information from nearby cars;
adjusting the 3D model based on the weather information and weather impact on sensors;
generating a comprehensive 3D model with traffic flow information;
collecting data from vehicle sensors monitoring vehicle operation and collecting vehicle driver behavior data including a driver emotional state, contextual information, driver history, and real-time driving information based on operation of the vehicle by the driver;
determining a real-time rate of operating the vehicle based on the adjusted 3D model traffic and vehicle speed, wherein each item of driver behavior data is weighted in determining the real-time rate or cost;
displaying the determined real-time rate to the driver.

### Claim 2 (depends on 1)

The method of claim 1, wherein the real-time rate comprises a real-time cost of vehicle use or loss of use.

### Claim 3 (depends on 1)

The method of claim 1, comprising displaying the real-time rate as a number or a color.

### Claim 4 (depends on 1)

The method of claim 1, comprising providing feedback to the driver in real-time or as a collective summary presented after a driving session is complete.

### Claim 5 (depends on 1)

The method of claim 1, comprising providing an on-board driver monitoring device in the vehicle to collect real-time data.

### Claim 6 (depends on 5)

The method of claim 5, wherein the monitoring device comprises a vehicles engine control unit/module (ECU/ECM), a transmission control unit (TCU), a power train control unit (PCU), on-board diagnostics (OBD), and one or more sensors and processors associated with a transmission system.

### Claim 7 (depends on 1)

The method of claim 1, comprising gathering data from the vehicle for a determination of how the vehicle is being driven in real-time.

### Claim 8 (depends on 1)

The method of claim 1, comprising gathering data identifying a route taken by the driver, a speed driven, a time of the trip, a weather condition during the trip, road traffic during the trip, and cell phone usage during the trip.

### Claim 9 (depends on 1)

The method of claim 1, comprising includes mounting cameras on left, right, front, back sides of the vehicle to monitor the traffic information.

### Claim 10 (depends on 1)

The method of claim 1, comprising detecting distances of nearby objects using one or more cameras.

### Claim 11 (depends on 1)

The method of claim 1, comprising capturing images of road views including potential collision events, proximity to neighboring car(s), frequency of brake usage, frequency of hard brakes.

### Claim 12 (depends on 1)

The method of claim 1, comprising using the camera for capturing driver behavior including of texting and use of phone while driving, speech of driver shouting or cursing at other drivers or other occupants, indications of intoxication, sleepiness, alcohol level, mood, aggressiveness.

### Claim 13 (depends on 1)

The method of claim 1, comprising detecting a driver emotional state.

### Claim 14 (depends on 1)

The method of claim 1, comprising detecting a driver emotional state with a camera and a microphone.

### Claim 15 (depends on 1)

The method of claim 1, comprising detecting a driver emotional state with a body sensor.

### Claim 16 (depends on 1)

The method of claim 1, comprising updating the real-time rate determination with data from insurance sites, insurance providers, driver insurance history.

### Claim 17 (depends on 1)

The method of claim 1, comprising updating the real-time rate determination based on a driver social media data feed or a search engine query with a driver name.

### Claim 18 (depends on 1)

The method of claim 1, comprising applying voice recognition to determine a user emotional state.

### Claim 19 (depends on 1)

The method of claim 1, comprising recommending a loss provider to underwrite a risk-of-loss policy based on the determined real-time operation of the vehicle including speed, driver behavior data, and traffic flow including speed.

### Claim 20

A system, comprising:
a vehicle;
cameras coupled to the vehicle body on a plurality of locations including a left side, a right side, a front side, and a back side to capture a plurality of views and wherein at least one camera captures and determines distances of the neighboring objects from the camera and generates an integrated 3D model with obstacle information from nearby cars, wherein the 3D model is adjusted based on the weather information and weather impact on sensors;
sensors to detect driver emotion and driver behavior;
a processor coupled to the cameras and the sensors and to a wireless transceiver;
code to use the determined distances of the neighboring objects and the driver behavior to determine a risk of loss from driver behavior and 3D model, wherein each item of driver behavior data can have a different weight assigned weight in determining the real-time rate or cost.