# US 10,481,396 B2 · Imaging device and imaging method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,481,396 B2 - Document ID: US10481396B2 - Status: Granted - Kind: B2 - Application number: 14/779,968 - Filed: 2013-12-04 - Published: 2016-04-14 - Granted: 2019-11-19 - Earliest claimed: 2013-06-28 - Assignees: Beijing Zhigu Rui Tuo Tech Co., Ltd - Applicants: Beijing Zhigu Rui Tuo Tech Co., Ltd - Inventors: Lin Du; Hongjiang Zhang - Web page: https://patentgrep.com/patent/US10481396B2 ## CPC - G02B 27/0172: {characterised by optical features} - G02B 27/017: {Head mounted} - G02B 27/0179: {Display position adjusting means not related to the information to be displayed} - G02B 2027/0127: {comprising devices increasing the depth of field} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract An apparatus includes: an imaging lens module, used to image at least one object, and including a plurality of subregions having adjustable imaging parameters; a position sensing module, used to obtain position information of at least one object relative to an imaging apparatus; an information processing module, used to determine an imaging parameter of a corresponding subregion of the imaging lens module according to the position information of at least one object relative to the imaging apparatus; and a lens adjustment module, used to adjust the imaging parameter of the corresponding subregion of the imaging lens module according to the determined imaging parameter. The apparatus can adjust an imaging parameter for regions corresponding to a plurality of target objects at different distances in a visual field, and enable a user to watch objects at different distances in a visual field comfortably, thereby improving user experience. ## Claims ### Claim 1 An imaging apparatus, comprising: an imaging lens module configured to project at least one image, directly to at least one eye of a user, of multiple objects at different distances from the apparatus, and comprising a plurality of subregions, wherein the imaging lens module comprises at least one lens, imaging parameters of each of the plurality of subregions are adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module; a processor, communicatively coupled to a memory that stores computer-executable instructions, that executes or facilitates execution of the computer-executable instructions to perform operations comprising: obtain position information of the multiple objects relative to the apparatus; determine the imaging parameters of multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions; and adjust, concurrently, the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: learn corresponding imaging parameters associated with the at least one eye of the user acquiring expected images of objects at a plurality of distances, and obtain refractive examination information corresponding to the at least one eye of the user. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the operations further comprise: determine an imaging parameter of the imaging parameters of at least one corresponding subregion for each object based on a respective distance of each object relative to the imaging lens module and the refractive examination information. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the further operations further comprise: obtain other imaging parameters of other subregions between subregions corresponding to each object using a two-dimensional interpolation. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: determine respective distances of the multiple objects relative to the imaging lens module based on the position information of the multiple objects relative to the imaging apparatus. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: determine the multiple subregions corresponding to the multiple objects on the imaging lens module. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: determine a relative position relationship among the imaging lens module, the position sensing module, and the at least one eye of the user. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein operations further comprise: determine an imaging parameter of the imaging parameters of a corresponding subregion of the multiple corresponding subregions of the imaging lens module based on movement gesture information of the imaging apparatus. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the operations further comprise: predict another imaging parameter of another corresponding subregion of the multiple objects at a next moment after a current moment based on relative movement gesture information of the imaging apparatus and the multiple objects, and the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the multiple objects at the current moment. ### Claim 10 (depends on 8) The apparatus of claim 8, wherein the operations further comprise: adjust respective imaging parameters of each subregion, of the multiple corresponding subregions, of the imaging lens module to a set common imaging parameter when a movement speed of the imaging apparatus is determined to exceed a set threshold value. ### Claim 11 (depends on 8) The apparatus of claim 8, wherein the operations further comprise: adjust respective imaging parameters of each subregion, of the multiple corresponding subregions, of the imaging lens module to a mean value of imaging parameters of the multiple corresponding subregions of the imaging lens module at a previous moment when a movement speed of the imaging apparatus is determined to exceed a set threshold value. ### Claim 12 (depends on 8) The apparatus of claim 8, wherein the operations further comprise: acquire the movement gesture information of the imaging apparatus. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the movement gesture information of the imaging apparatus comprises at least one of relative movement gesture information of the imaging apparatus and the multiple objects, or movement speed information of the imaging apparatus. ### Claim 14 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: perform smoothing processing of time on respective current imaging parameters of each subregion of the multiple corresponding subregions based on history information of the imaging parameter of each subregion. ### Claim 15 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: perform smoothing processing of space on the imaging parameter of each subregion of the multiple corresponding subregions based on the imaging parameter of each subregion of the imaging lens module. ### Claim 16 (depends on 1) The apparatus of claim 1, wherein an imaging parameter of the imaging parameters of a subregion of the multiple subregions comprises at least one of a shape or a refractive index of a lens of the multiple corresponding subregions. ### Claim 17 (depends on 1) The apparatus of claim 1, wherein the plurality of subregions of the imaging lens module are distributed in an array. ### Claim 18 (depends on 17) The apparatus of claim 17, wherein the plurality of subregions are distributed in a rectangular array. ### Claim 19 (depends on 17) The apparatus of claim 17, wherein the plurality of subregions are distributed in a radially concentric array. ### Claim 20 (depends on 1) The apparatus of claim 1, wherein the operations further comprise: acquire position and depth information of the multiple objects relative to the imaging apparatus. ### Claim 21 (depends on 1) The apparatus of claim 1, further comprising: an image sensor configured to acquire image information of the multiple objects. ### Claim 22 (depends on 1) The apparatus of claim 1, wherein the imaging apparatus is eyeglasses. ### Claim 23 A method, comprising: obtaining, by a system comprising a processor, position information of multiple objects at different distances relative to an imaging apparatus; determining, by the system, imaging parameters of multiple subregions of an imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions, wherein the imaging lens module comprises at least one lens and is used to project at least one image, directly to at least one eye of a user, of the multiple objects, and further comprises a plurality of subregions, wherein the imaging parameters of each of the plurality of subregions are adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module; and adjusting, by the system concurrently, the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters. ### Claim 24 (depends on 23) The method according to claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises: determining corresponding imaging parameters of the imaging parameters in response to acquisition of expected images of the-multiple objects at a plurality of distances by the at least one eye of a user, and obtaining refractive examination information corresponding to the at least one eye of a user. ### Claim 25 (depends on 24) The method of claim 24, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises: determining an imaging parameter of the imaging parameters of at least one corresponding subregion for each object based on a respective distance of each object relative to the imaging lens module and the refractive examination information. ### Claim 26 (depends on 25) The method of claim 25, wherein other imaging parameters of other subregions between the plurality of subregions corresponding to each object are obtained through a two-dimensional interpolation. ### Claim 27 (depends on 23) The method of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises: determining distances of the multiple objects relative to the imaging lens module based on the position information of the multiple objects relative to the imaging apparatus. ### Claim 28 (depends on 23) The method of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises: determining the multiple subregions corresponding to the multiple objects on the imaging lens module. ### Claim 29 (depends on 23) The method according to of claim 23, wherein the determining the imaging parameters of the multiple subregions of the imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus comprises: determining a relative position relationship among the imaging lens module, the position sensing module, and the at least one eye of the user. ### Claim 30 (depends on 23) The method of claim 23, further comprising: determining, by the system, an imaging parameter of the imaging parameters of a corresponding subregion of the multiple corresponding subregions of the imaging lens module based on movement gesture information of the imaging apparatus. ### Claim 31 (depends on 30) The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises: predicting the imaging parameter of the corresponding subregion of the multiple objects at a next moment after a current moment based on relative movement gesture information of the imaging apparatus and the multiple objects, and the imaging parameter of the corresponding subregions of the multiple corresponding subregions of the multiple objects at the current moment. ### Claim 32 (depends on 30) The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises: adjusting respective imaging parameters of each subregion of the plurality of subregions of the imaging lens module to a set common imaging parameter in response to determining a movement speed of the imaging apparatus has exceeded a set threshold value. ### Claim 33 (depends on 30) The method of claim 30, wherein the determining the imaging parameter of the corresponding subregion of the multiple corresponding subregions of the imaging lens module based on the movement gesture information of the imaging apparatus comprises: adjusting respective imaging parameters of each subregion of the plurality of subregions of the imaging lens module to a mean value of imaging parameters of the plurality of subregions of the imaging lens module at a previous moment in response to determining a movement speed of the imaging apparatus has exceeded a set threshold value. ### Claim 34 (depends on 30) The method of claim 30, further comprising: acquiring, by the system, the movement gesture information of the imaging apparatus. ### Claim 35 (depends on 34) The method of claim 34, wherein the movement gesture information of the imaging apparatus comprises at least one of relative movement gesture information of the imaging apparatus and the object, or movement speed information of the imaging apparatus. ### Claim 36 (depends on 23) The method of claim 23, further comprising: performing, by the system, smoothing processing of time on a respective current imaging parameter of each subregion of the plurality of subregions based on history information of the imaging parameter of each subregion. ### Claim 37 (depends on 23) The method of claim 23, further comprising: performing, by the system, smoothing processing of space on the imaging parameter of each subregion of the plurality of subregions based on the imaging parameter of each subregion of the imaging lens module. ### Claim 38 (depends on 23) The method of claim 23, wherein an imaging parameter of the imaging parameters of a subregion of the multiple subregions comprises at least one of a shape or a refractive index of a lens of the multiple corresponding subregions. ### Claim 39 (depends on 23) The method of claim 23, wherein the plurality of subregions of the imaging lens module is distributed in an array. ### Claim 40 (depends on 39) The method of claim 39, wherein the plurality of subregions is distributed in a rectangular array. ### Claim 41 (depends on 39) The method of claim 39, wherein the plurality of subregions are distributed in a radially concentric array. ### Claim 42 (depends on 23) The method of claim 23, wherein the obtaining the position information of the multiple objects at different distances relative to the imaging apparatus comprises: acquiring, by the system, position and depth information of the multiple objects relative to the imaging apparatus. ### Claim 43 (depends on 23) The method of claim 23, wherein the obtaining the position information of the multiple objects at different distances relative to the imaging apparatus comprises: acquiring image information of the multiple objects. ### Claim 44 A non-transitory computer readable medium comprising executable instructions that, in response to execution, cause a device comprising a processor to perform operations, comprising: obtaining position information of multiple objects relative to an imaging apparatus; determining imaging parameters of multiple subregions of an imaging lens module corresponding to the multiple objects based on the position information of the multiple objects relative to the imaging apparatus, wherein each of the multiple objects corresponds to one or more subregions of the multiple subregions, wherein the imaging lens module comprises at least one lens and is used to project at least one image, directly to at least one eye of a user, of the multiple objects, and further comprises a plurality of subregions, wherein the imaging parameters of each of the plurality of subregions is adjustable, and the plurality of subregions are subregions physically independent from each other, or logical subregions obtained by logically dividing one physically integral imaging lens module; and adjusting, concurrently, the imaging parameters of multiple subregions of the imaging lens module corresponding to the multiple objects respectively based on the imaging parameters. ### Claim 45 (depends on 22) The method of claim 22, wherein if the distance between an object and the imaging apparatus is 1 m, the imaging parameter of the subregion corresponding to the object corresponds to the refractivity of −5.75; and if the distance between an object and the imaging apparatus is 0.8 m, the optimal refractivity corresponding to the distance of 0.8 m is obtained through an interpolation method according to corresponding optimal refractivities of 0.5 m and 1 m. ### Claim 46 (depends on 44) The non-transitory computer readable medium of claim 44, wherein the multiple subregions of the imaging lens module are distributed in an array. ### Claim 47 (depends on 46) The non-transitory computer readable medium of claim 46, wherein the multiple subregions are distributed in a rectangular array. ### Claim 48 (depends on 46) The non-transitory computer readable medium of claim 46, wherein the plurality of subregions are distributed in a radially concentric array.