# US 10,375,360 B2 · State estimation apparatus, state estimation method, integrated circuit, and non-transitory computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,360 B2 - Document ID: US10375360B2 - Status: Granted - Kind: B2 - Application number: 14/950,302 - Filed: 2015-11-24 - Published: 2016-06-16 - Granted: 2019-08-06 - Earliest claimed: 2014-12-11 - Assignees: MegaChips Corporation; Kyushu Institute of Technology - Applicants: MegaChips Corporation; Kyushu Institute of Technology - Inventors: Hiromu Hasegawa; Norikazu Ikoma - Web page: https://patentgrep.com/patent/US10375360B2 ## CPC - H04N 7/181: {for receiving images from a plurality of remote sources} - G06T 7/277: involving stochastic approaches, e.g. using Kalman filters - G06T 7/292: Multi-camera tracking - G06T 2207/10016: Video; Image sequence - G06T 2207/20076: Probabilistic image processing - G06T 2207/30244: Camera pose - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A state estimation apparatus obtains observation data sets for a tracking target object, and estimates an internal state of the object using likelihoods obtained from the observation data sets and the reliability of each observation data set. A first observation obtaining unit obtains first observation data. A second observation obtaining unit obtains second observation data. A first likelihood obtaining unit obtains a first likelihood based on the first observation data. A second likelihood obtaining unit obtains a second likelihood based on the second observation data. A likelihood combining unit obtains a combined likelihood based on the first and second likelihoods, first reliability data indicating the reliability of the first observation data, and second reliability data indicating the reliability of the second observation data. A posterior probability distribution obtaining unit obtains posterior probability distribution data indicating a probability distribution of the internal state of the observation target at current time t from the combined likelihood and predictive probability distribution data. ## Claims ### Claim 1 A state estimation apparatus for estimating an internal state of an observation target, the state estimation apparatus comprising: circuitry including at least a processor and a memory, the circuitry configured to: obtain first observation data from an observable event at predetermined time intervals; obtain second observation data from the observable event at predetermined time intervals; store an initial value for generating prior probability distribution data in an initial state; in states other than the initial state, perform prediction using, as prior probability distribution data at current time t, posterior probability distribution data obtained at preceding time t−1 indicating a probability distribution of the internal state of the observation target to obtain predictive probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t, wherein the prior probability distribution data is generated based on the initial value during the initial state; obtain a first likelihood based on the first observation data; obtain a second likelihood based on the second observation data; obtain a combined likelihood based on the first likelihood, the second likelihood, first reliability data indicating reliability of the first observation data, and second reliability data indicating reliability of the second observation data; obtain posterior probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t from the combined likelihood and the predictive probability distribution data; obtain the first reliability data; obtain the second reliability data, wherein the circuitry obtains: first detection accuracy data indicating detection accuracy of the first observation data, second detection accuracy data indicating detection accuracy of the second observation data, the first reliability data is based on the first detection accuracy data, and the second reliability data is based on the second detection accuracy data; and obtain one or more sensor detection values based on a predetermined physical quantity that is detected by one or more sensors, wherein the circuitry obtains; first corrected reliability data by correcting the first reliability data based on the sensor detection value obtained, second corrected reliability data by correcting the second reliability data based on the sensor detection value obtained, and the combined likelihood based on the first corrected reliability data and the second corrected reliability data. ### Claim 2 (depends on 1) The state estimation apparatus according to claim 1, wherein the first reliability data is a first fixed value, and the second reliability data is a second fixed value. ### Claim 3 (depends on 1) The state estimation apparatus according to claim 1, wherein the first reliability data is binary data, and the second reliability data is another binary data. ### Claim 4 (depends on 1) The state estimation apparatus according to claim 1, wherein the first reliability data is a first set of continuous values, and the second reliability data is a second set of continuous values. ### Claim 5 A state estimation apparatus for estimating an internal state of an observation target, the state estimation apparatus comprising: circuitry including at least a processor and a memory, the circuitry configured to: obtain first observation data from an observable event at predetermined time intervals; obtain second observation data from the observable event at predetermined time intervals; store an initial value for generating prior probability distribution data in an initial state; in states other than the initial state, perform prediction using, as prior probability distribution data at current time t, posterior probability distribution data obtained at preceding time t−1 indicating a probability distribution of the internal state of the observation target to obtain predictive probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t, wherein the prior probability distribution data is generated based on the initial value during the initial state; obtain a first likelihood based on the first observation data; obtain a second likelihood based on the second observation data; obtain a combined likelihood based on the first likelihood, the second likelihood, first reliability data indicating reliability of the first observation data, and second reliability data indicating reliability of the second observation data; obtain posterior probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t from the combined likelihood and the predictive probability distribution data obtain the first reliability data; obtain the second reliability data, wherein the circuitry obtains: first detection accuracy data indicating detection accuracy of the first observation data, second detection accuracy data indicating detection accuracy of the second observation data, the first reliability data is based on the first detection accuracy data, and the second reliability data is based on the second detection accuracy data; and obtain one or more sensor detection values based on a predetermined physical quantity that is detected by one or more sensors, wherein the circuitry obtains: the first reliability data based on the sensor detection value obtained and the first detection accuracy data, and the second reliability data based on the sensor detection value obtained and the second detection accuracy data. ### Claim 6 A state estimation method for estimating an internal state of an observation target, the method comprising: obtaining first observation data from an observable event at predetermined time intervals; obtaining second observation data from the observable event at predetermined time intervals; storing an initial value for generating prior probability distribution data in an initial state; in states other than the initial states, performing prediction using, as prior probability distribution data at current time t, posterior probability distribution data obtained at preceding time t−1 indicating a probability distribution of an internal state of an observation target to obtain predictive probability distribution data indicating a probability distribution of the internal state of the observation target at the current time t, wherein the prior probability distribution data is generated based on the initial value during the initial state; obtaining a first likelihood based on the first observation data; obtaining a second likelihood based on the second observation data; obtaining a combined likelihood based on the first likelihood, the second likelihood, first reliability data indicating reliability of the first observation data, and second reliability data indicating reliability of the second observation data; obtaining posterior probability distribution data indicating a probability distribution of the internal state of the observation target at the current time t from the combined likelihood and the predictive probability distribution data; obtaining the first reliability data; obtaining the second reliability data by obtaining: first detection accuracy data indicating detection accuracy of the first observation data, second detection accuracy data indicating detection accuracy of the second observation data, the first reliability data being based on the first detection accuracy data, and the second reliability data being based on the second detection accuracy data; and obtaining one or more sensor detection values based on a predetermined physical quantity that is detected by one or more sensors by obtaining: first corrected reliability data by correcting the first reliability data based on the sensor detection value obtained, second corrected reliability data by correcting the second reliability data based on the sensor detection value obtained, and the combined likelihood based on the first corrected reliability data and the second corrected reliability data. ### Claim 7 (depends on 6) A non-transitory computer-readable storage medium having stored thereon a program that enables a computer to implement the state estimation method according to claim 6. ### Claim 8 A state estimation method for estimating an internal state of an observation target, the method comprising: obtaining first observation data from an observable event at predetermined time intervals; obtaining second observation data from the observable event at predetermined time intervals; storing an initial value for generating prior probability distribution data in an initial state; in states other than the initial states, performing prediction using, as prior probability distribution data at current time t, posterior probability distribution data obtained at preceding time t−1 indicating a probability distribution of the internal state of the observation target to obtain predictive probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t, wherein the prior probability distribution data is generated based on the initial value during the initial state; obtaining a first likelihood based on the first observation data; obtaining a second likelihood based on the second observation data; obtaining a combined likelihood based on the first likelihood, the second likelihood, first reliability data indicating reliability of the first observation data, and second reliability data indicating reliability of the second observation data; obtaining posterior probability distribution data indicating the probability distribution of the internal state of the observation target at the current time t from the combined likelihood and the predictive probability distribution data; obtaining the first reliability data; obtaining the second reliability data by obtaining: first detection accuracy data indicating detection accuracy of the first observation data, second detection accuracy data indicating detection accuracy of the second observation data, the first reliability data being based on the first detection accuracy data, and the second reliability data being based on the second detection accuracy data; obtaining one or more sensor detection values based on a predetermined physical quantity that is detected by one or more sensors by obtaining: the first reliability data based on the sensor detection value obtained and the first detection accuracy data, and the second reliability data based on the sensor detection value obtained and the second detection accuracy data. ### Claim 9 (depends on 8) A non-transitory computer-readable storage medium having stored thereon a program that enables a computer to implement the state estimation method according to claim 8.