# US 10,311,343 B2 · Apparatus and method for surface and subsurface tactile sensation imaging > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,343 B2 - Document ID: US10311343B2 - Status: Granted - Kind: B2 - Application number: 15/914,317 - Filed: 2018-03-07 - Published: 2018-11-15 - Granted: 2019-06-04 - Earliest claimed: 2010-07-09 - Assignees: Temple University of the Commonwealth System of Higher Education - Applicants: TEMPLE UNIVERSITY—Of The Commonwealth System of Higher Education - Inventors: Chang-Hee Won - Web page: https://patentgrep.com/patent/US10311343B2 ## CPC - A61B 5/0053: {by applying pressure, e.g. compression, indentation, palpation, grasping, gauging} - A61B 5/442: {Evaluating skin mechanical properties, e.g. elasticity, hardness, texture, wrinkle assessment} - A61B 5/444: {Evaluating skin marks, e.g. mole, nevi, tumour, scar} - G01L 1/247: {using distributed sensing elements, e.g. microcapsules (along a single optical fibre G01L1/242)} - G02B 6/0013: {Means for improving the coupling-in of light from the light source into the light guide (coupling light into light guides in general G02B6/42)} - G02B 6/0045: {by shaping at least a portion of the light guide} - G02B 6/12002: {Three-dimensional structures} - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 5/7267: {involving training the classification device} - A61B 2562/0233: Special features of optical sensors or probes classified in A61B5/00 - G01L 1/24: by measuring variations of optical properties of material when it is stressed, e.g. by photoelastic stress analysis {using infrared, visible light, ultraviolet} - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G01L: MEASURING FORCE, STRESS, TORQUE, WORK, MECHANICAL POWER, MECHANICAL EFFICIENCY, OR FLUID PRESSURE (weighing G01G) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A tactile sensor, computer readable medium, methods of using and manufacturing the tactile sensor, and methods and apparatuses for processing the information generated by the tactile sensor. The tactile sensor includes a planar optical waveguide comprised of a flexible and transparent layer; a light configured to direct light into the optical waveguide; a light sensor or an imager facing the optical waveguide and configured to generate signals from light scattered out of the optical waveguide; and a controller which may be configured to generate an image of the object and characteristics of the object. The waveguide may be configured so that some of the light directed into the optical waveguide is scattered out of the waveguide if the waveguide is deformed by being pressed against the object. A finite element and a neural network are used to estimate mechanical characteristics of the objects. ## Claims ### Claim 1 A tactile sensor for generating an image of an object, the tactile sensor comprising: an optical waveguide comprised of at least a first portion that is flexible and a second portion that is adjacent to the first portion and provides the optical waveguide with rigidity, wherein at least part of the first portion is transparent so as to permit light to pass out of the first portion and into the second portion; at least two sources of light configured to direct light into the optical waveguide, one of the light sources being mounted to a side of the waveguide opposite from the other light source such that when activated each of the light sources directs light into the waveguide toward the other light source; and a light sensor facing the optical waveguide and configured to generate signals from light scattered out of the optical waveguide, wherein the waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first portion when the first portion is deformed, and wherein the first portion is deformed by the tactile sensor being pressed against the object. ### Claim 2 (depends on 1) The tactile sensor of claim 1 wherein the second portion is a frame positioned between the first portion and the light sensor. ### Claim 3 (depends on 2) The tactile sensor of claim 2 wherein the frame supports the first portion of the optical waveguide around a circumference of the optical waveguide. ### Claim 4 (depends on 3) The tactile sensor of claim 3 wherein the frame is opaque. ### Claim 5 (depends on 1) The tactile sensor of claim 1 wherein the second portion is a rigid transparent layer that permits passage of light from the first portion to the light sensor. ### Claim 6 (depends on 1) The tactile sensor of claim 1 wherein the optical waveguide has a shape suitable for pressing against tissue, and wherein the shape of the optical waveguide provides rigidity for supporting the flexibility of the first portion. ### Claim 7 (depends on 6) The tactile sensor of claim 6 wherein the shape is planar, oval, polygonal, or disk. ### Claim 8 (depends on 7) The tactile sensor of claim 7 wherein the second portion is planar. ### Claim 9 (depends on 1) The tactile sensor of claim 1 wherein the second portion has a different refractive index than a refractive index of the first portion. ### Claim 10 (depends on 9) The tactile sensor of claim 9 wherein the refractive index of the second portion is less than the refractive index of the first portion. ### Claim 11 (depends on 1) The tactile sensor of claim 1 wherein the first portion and the second portion are the same material. ### Claim 12 (depends on 1) The tactile sensor of claim 1 wherein the first portion and the second portion are different materials. ### Claim 13 (depends on 12) The tactile sensor of claim 12 wherein the first portion is silicone elastomer and the second portion is glass or plastic. ### Claim 14 (depends on 13) The tactile sensor of claim 13 wherein the silicone elastomer is PDMS. ### Claim 15 (depends on 1) The tactile sensor of claim 1, further comprising a diffuser associated with each light source for diffusing the light emitted by the light source. ### Claim 16 (depends on 1) The tactile sensor of claim 1, further comprising a controller configured to calculate and display a physical characteristic of the object based on changes in the light received by the light sensor. ### Claim 17 A method for calculating an elasticity of an object using a tactile sensor, the method comprising: capturing a first image of the object with the tactile sensor comprising: an optical waveguide comprised of at least a flexible first portion that is at least partially transparent so as to permit light to pass out of the first portion; at least one source of light configured to direct light into the optical waveguide; and a light sensor facing the optical waveguide and configured to generate signals from light scattered out of the optical waveguide, wherein the waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first portion when the first portion is deformed, and wherein the first portion is deformed by the tactile sensor being pressed against the object with a first force applied to the object; capturing a second image of the object with the tactile sensor wherein the first portion is deformed by the tactile sensor being pressed against the object with a second force applied to the object; calculating a stress placed on the object in the first image and a stress placed on the object in the second image; calculating a strain placed on the object using the first image and the second image; and calculating an elasticity of the object. ### Claim 18 A tactile sensor for generating an image of an object, the tactile sensor comprising: an optical waveguide comprised of at least a flexible first portion that is at least partially transparent so as to permit light to pass out of the first portion; at least two sources of light configured to direct light into the optical waveguide, one of the light sources being mounted to a side of the waveguide opposite from the other light source such that when activated each of the light sources directs light into the waveguide toward the other light source; a light sensor facing the optical waveguide and configured to generate signals from light scattered out of the optical waveguide; and a controller configured to display an image of the object based on the signals from the light sensor, wherein the waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first portion when the first portion is deformed, and wherein the first portion is deformed by the tactile sensor being pressed against the object. ### Claim 19 (depends on 18) The tactile sensor of claim 18, wherein the optical waveguide further comprises a second portion that is adjacent to the first portion and provides the optical waveguide with rigidity, wherein light to passes out of the first portion and into the second portion. ### Claim 20 (depends on 18) The tactile sensor of claim 18, further comprising a diffuser associated with each light source for diffusing the light emitted by the light source. ### Claim 21 A tactile sensor for generating an image of an object, the tactile sensor comprising: an optical waveguide comprised of at least a first portion that is flexible and a second portion that is adjacent to the first portion and provides the optical waveguide with rigidity, wherein at least part of the first portion is transparent so as to permit light to pass out of the first portion and into the second portion; at least one source of light configured to direct light into the optical waveguide; and a light sensor facing the optical waveguide and configured to generate signals from light scattered out of the optical waveguide, wherein the waveguide is configured so that at least some of the light directed into the optical waveguide is scattered out of the first portion when the first portion is deformed, and wherein the first portion is deformed by the tactile sensor being pressed against the object further comprising a controller configured to determine and display at least one of an elasticity of the object, a hardness of the object, a Young's Modulus of the object, a shear modulus of the object, and a malignancy determination of the object. ### Claim 22 (depends on 21) The tactile sensor of claim 21 wherein the controller is further configured to diagnose the object based on a ratio of a calculated Young's Modulus to a calculated shear modulus. ### Claim 23 (depends on 21) The tactile sensor of claim 21, further comprising a diffuser to diffuse the light emitted by the light source. ### Claim 24 (depends on 21) The tactile sensor of claim 21 wherein the controller is further configured to compare a captured first image of the object having a first force applied to the object with a captured second image of the object having a second force applied to the object and to calculate the elasticity of the object based on comparing the object in the first image with the object in the second image and based on the first force and the second force.