A recursive state estimator in the presence of state inequality constraints
Transcript of A recursive state estimator in the presence of state inequality constraints
International Journal of Control, Automation, and Systems (2011) 9(2):237-248 DOI 10.1007/s12555-011-0205-4
http://www.springer.com/12555
A Recursive State Estimator in the Presence of State Inequality Constraints
Mohamed Fahim Hassan, Mohamed Zribi*, and Hamed M. K. Alazemi
Abstract: This paper proposes an optimal recursive estimator to estimate the states of a stochastic dis-
crete time linear dynamic system when the states of the system are constrained with inequality con-
straints. The case when the constraints are strictly satisfied is treated independently from the case when
some of the constraints are violated. For the first case, the well known Kalman filter estimator is used.
In the second case, an algorithm which uses a series of successive orthogonalizations on the measure-
ment subspaces is employed to obtain the optimal estimate. It is shown that the proposed estimator has
several attractive properties such that it is an unbiased estimator. More importantly, compared to other
estimator found in the literature, the proposed estimator needs less computational efforts, is numerical-
ly more stable and it leads to a smaller variance. To show the effectiveness of the proposed estimator,
several simulation results are presented and discussed.
Keywords: Inequality constraints, Kalman filter, recursive estimation.
1. INTRODUCTION
The Kalman Filter has been extensively used to
estimate the states of physical systems. The applications
of Kalman filters are wide and diverse; they cover areas
such as computer vision, navigation, missile tracking, etc.
However, the state variables of physical systems are
generally constrained by equality and inequality
constraints. Examples of systems whose states are
constrained include robotic systems, biomedical systems,
chemical processes, navigation, etc.
Several researchers have worked on the design of state
estimations when the states of the system are constrained
either by equality constraints or inequality constraints or
both [1-6,8-16,19,21-31]. For example, Wen and
Durrant-Whyte [30] reduced the model of the system by
substituting the equality constraints into the model of the
system. Therefore, the constrained problem is reduced to
an unconstrained one. However, the proposed scheme
cannot handle the case of inequality constraints; also the
physical meaning of some of the states will be lost. Some
researchers such as [29] dealt with equality constraints as
measurements which are not corrupted with noise. They
used the same state equation while they augmented the
measurement equation. Again, this method can not
handle the inequality constraints case. Simon and Chia
[24] incorporated state equality constraints in the Kalman
filter; they projected the unconstrained solution onto the
state constraint surface. Another approach of handling
the equality constraint is through putting restrictions on
the gain of the Kalman filter so that the updated state
estimate satisfies the constraints [5].
The paper proposes a recursive estimator to estimate
the states of linear dynamic systems in the presence of
state inequality constraints. The usual Kalman filter is
used when the constraints are strictly satisfied. However,
when some of the constraints are violated, the proposed
algorithm uses a series of successive orthogonalizations
on the measurement subspaces to obtain the optimal
estimate. Simulation results are presented to show the
effectiveness of the proposed algorithm.
The paper is organized as follows. Section 2 gives the
motivation of our research as well as examples of some
engineering and non-engineering problems in which
constraints are imposed either due to physical reasons or
design objectives. For completeness of the presentation,
Section 3 gives some background material needed for the
paper. Section 4 describes the statement of the estimation
problem. Section 5 presents the development of the
optimal recursive estimator; the algorithm which can be
used to implement the proposed estimator is also
provided. The simulation results of two illustrative
examples are presented and discussed in Section 6.
Finally, some concluding remarks are given in Section 7.
2. MOTIVATION OF THE PROBLEM
Many practical engineering and non-engineering
problems are subject to constraints on the states and/or
the control. These constraints are due to physical
limitations and/or imposed constraints by the designer in
order to keep safe, acceptable and economically viable
operations. In this section, we describe some engineering
and non-engineering systems which are subject to
constraints.
The first example is related to biological pollution in
© ICROS, KIEE and Springer 2011
__________
Manuscript received March 7, 2009; April 21, 2010; acceptedSeptember 24, 2010. Recommended by Editorial Board memberSungshin Kim under the direction of Editor Young Il lee. Mohamed Fahim Hassan and Mohamed Zribi are with theElectrical Engineering Department, Kuwait University, P.O. Box5969, Safat 13060 Kuwait (e-mails: {m.fahim, mohamed.zribi}@ku.edu.kw). Hamed M. K. Alazemi is with the Computer Engineering De-partment, Kuwait University, P.O. Box 5969 Safat 13060, Kuwait(e-mail: [email protected]).
* Corresponding author.
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
238
streams. This pollution is mainly the result of the
damping of sewage, fertilizers, industrial wastes in water
streams [9]. These nutrients over-stimulate the growth of
bacteria (BOD) which use up dissolved oxygen (DO) as
they decompose. This contributes in harmfully affecting
the respiration ability of fish and other invertebrates
which reside in the water body. Three options are
available in controlling wastewater in order to satisfy the
constraints imposed by water authorities standards (BOD
concentration must be less or equal to a certain upper
limit; while DO concentration must be greater than or
equal a certain lower bound). In the first one, wastewater
is treated at a fixed level, stored in tanks and discharged
in a controlled manner into the water body. This option
imposes other physical constraints on the system. More
specifically, the volume of the treated wastewater in the
tanks must not be less than zero and it must not exceed
the capacity of the tanks to avoid overflow. In the second
option, wastes are discharged in the stream with a
constant rate and pollution control is carried out through
variable waste treatment. However, increasing the
treatment levels beyond certain limits will dramatically
increase the cost. Such an economical aspect imposes an
upper limit on the level of treatment (control). In the
third option, the above two techniques are combined
together which will lead to a nonlinear dynamic model
[10].
Another example of systems which are subject to
constraints on the states and/or the control is the problem
dealing with the analysis and design of controllers for
active queue management (AQM) routers supporting
transmission control protocol (TCP). A two state
dynamic fluid-flow model of TCP is used [13]. The first
state variable of the model is the average TCP window
size W (packets); and the second state variable is the
average queue length (packets). However, in this model
the size of the window must be within the upper and
lower bounds imposed physically on the window size
(0≤W ≤Wm) [13].
A third example of systems which are subject to
constraints on the states and/or the control is related to
interconnected power systems. For these systems, it is
unlikely that the outputs of the generation at any instant
of time will exactly be equal to the load of the system.
As a result, the frequency is not constant and it changes
continuously. If the frequency falls by more than 1 Hz,
the reduced speed of the power station pumps, fans, etc
may reduce the station output and a serious situation will
arise. To avoid this problem, a lower bound has to be
imposed on the frequency of the system [11].
In addition to the systems mentioned above, other
systems which are subject to constraints on the states
and/or the control can be found in the literature.
Examples of such systems include: the two state
continuous stirred tank reactor (CSTR) [17], the batch
reactor [17], the tracking of a land based vehicle [24] and
the tracking of a vehicle along circular roads [31].
Most of these systems are stochastic by nature, and not
all the state variables are available for direct
measurements. Therefore, it is necessary, to reconstruct
these states through an observer. However, in order to
keep track of the actual states of the system, it is neces-
sary to take into consideration the imposed constraints on
the system while designing such an observer. For this
reason, the problem of state estimation with constraints
has attracted many researchers and it is also the
motivation of the work to be developed in this paper.
3. BACKGROUND
It is well known that one of the most important
properties of the Kalman filter is its recursive nature.
This property arises from the fact that the existing
estimator is updated according to the received new set of
measurements. More precisely, the updating process is
based on the component of the new data which is
orthogonal to the old data set.
The actual orthogonalization procedure used in the
Kalman filter is based on the following theorems [18],
[7].
Theorem 1: Let β be a member of the space H of
random variables which is a closed subspace of L2, and
let 1
β̂ denote its orthogonal projection on a closed
subspace Y1 of H (thus 1
β̂ is the best estimate of β in
Y1). Let y2 be an m-vector of random variables
generating a subspace Y2 of H and let ŷ2 denote the m-
dimensional vector of the projections of the components
of y2 onto Y1 (thus ŷ2 is the vector of best estimates of y2
onto Y1). Also, let ỹ2=y - ŷ2. Then the projection of β on
to the subspace 1 2Y Y⊕ denoted by ˆ,β is given by:
β̂ =1
1 2 2 2 2
ˆ ,T Ty y y yβ β
−
+ E E� � � �
where E is the expected value.
The proof of Theorem 1 is given in [18].
The above equation can be interpreted as β̂ is 1
β̂
plus the best estimate of β in the subspace 2Y�
generated by ỹ2.
Accordingly, if we have a discrete time system which
is represented by the following state equation:
( 1) ( 1 ) ( ) ( 1 ) ( )x k k k x k k k w k+ = Φ + , + Γ + , (1)
with the output of the system given by:
( 1) ( 1) ( 1) ( 1),y k H k x k v k+ = + + + + (2)
where ( 1) n
x k + ∈ℜ is the state vector, ( 1 )k kΦ + , ∈
,
n n×
ℜ ( 1 ) n m
k k×
Γ + , ∈ℜ are the system matrices;
( ) m
w k ∈ℜ and ( ) pv k ∈ℜ are uncorrelated zero-mean
gaussian white noise sequences with positive semi-
definite covariance matrices Q and R respectively. Also,
( ) py k ∈ℜ is the output vector, and ( 1) p nH k
×
+ ∈ℜ is
the measurement matrix.
Consider the Hilbert space Y formed by the
measurement vectors y(k) (k=1,2,…). At the instant k+1,
A Recursive State Estimator in the Presence of State Inequality Constraints
239
this space is denoted by Y(k+1). The optimal minimum
variance estimator ˆ( 1 1)x k k+ | + is given by:
ˆ( 1 1) [ ( 1) ( 1)]
[ ( 1) ( )]
[ ( 1) ( 1 )],
x k k x k Y k
x k Y k
x k y k k
+ | + = + | +
= + |
+ + | + |
E
E
E �
(3)
where
( 1 ) ( 1) [ ( 1) ( )].y k k y k y k Y k+ | = + − + |E� (4)
Equation (3) is the algebraic form of the geometric
result of Theorem 1.
Now, let’s assume that the vector y(k+1) is
decomposed into N sub-vectors, i.e.,
1 2( 1) [ ( 1) ( 1) ( 1)].T T T T
Ny k y k y k y k+ = + + +� (5)
Then the optimal estimate ˆ( 1 1)x k k+ | + is obtained
after a succession of orthogonal projections of x(k+1) in
the Hilbert space generated by: [2,3]
1
1 2
2 1
3
{ ( ) ( 1 ) ( 1 1)
( 1 1) ( 1 1)},N
N
Y k k k k kY Y
Y k k Y k k−
⊕ + | ⊕ + | +
⊕ + | + ⊕ ⊕ + | +
� �
� ��
where 1( 1 1)i
ik kY
− + | +� is the subspace generated by the
subspace of measurements of Yi(k+1) and the projection
of it on the subspace generated by:
1 2 1{ ( ) ( 1) ( 1) ( 1)}.
iY k Y k Y k Y k
−
⊕ + ⊕ + ⊕ ⊕ +�
This leads to the following Theorem.
Theorem 2: The optimal estimate ˆ( 1 1)x k k+ | + is
given by the projection of x(k+1) on the space generated
by all the measurements up to the instant k, {Y(k)}, and
the projection of x(k+1) on the subspace generated by: 1 1
1 2{ ( 1 ) ( 1 1) ( 1 1)}.N
Nk k k k k kY Y Y
−
+ | ⊕ + | + ⊕ ⊕ + | +� � ��
The proof of Theorem 2 is given in [7].
4. STATEMENT OF THE ESTIMATION
PROBLEM
Consider the system described by the discrete time
model given by (1)-(2). The objective of the paper is to
obtain the best state estimator which minimizes the
expected value of the admissible cost function given by:
]
1
0
min min ( 1 1)
( 1 1) ( 1) ,
fk
T
k
J k kx
x k k Y k
−
=
= + | +
× + | + | +
∑ E �
�
(6)
such that,
( 1) ( 1 ) ( ) ( 1 ) ( ),x k k k x k k k w k+ = Φ + , + Γ + , (7)
( 1) ( 1) ( 1) ( 1),y k H k x k v k+ = + + + + (8)
( 1) ,x x k x≤ + ≤ (9)
where
( 1) ( 1) ( ) ( 1) ( 1 )
( 1 ) and ( 1) are as defined earlier.
x k y k w k v k k k
k k H k
+ , + , , + , Φ + , ,
Γ + , +
The error ( 1 1)x k k+ | +� is such that ( 1 1)x k k+ | + =�
ˆ( 1) ( 1 1)x k x k k+ − + | + where ˆ( 1 1)x k k+ | + is the
estimate of x(k +1). The vectors n
x x, ∈ℜ are the
minimum and maximum values of ˆ( 1 1)x k k+ | +
element by element.
The random processes w(k) and v( j ) appearing in the
model (7)-(8) are white gaussian with the following
properties:
[ ( )] 0 0 1 ,w k k= ∀ = , ,E � (10)
[ ( ) ( )] 0 1 ,Tjkw j w k Q j kδ= ∀ , = , ,E � (11)
where δjk is the Kronecker-delta function defined such
that δjk =1 if j=k and δjk =0 if j ≠ k.
[ ( )] 0 1 2 ,v k k= ∀ = , ,E � (12)
[ ( ) ( )] 1 2 .Tjkv j v k R j kδ= ∀ , = , ,E � (13)
The two random processes w(k) and v(k) are
independent, i.e.,
[ ( ) ( )] 0 1 2 0 1 .Tv j w k j k= ∀ = , , ; = , ,E � � (14)
Also, it is assumed that:
[ (0)] 0,x =E (15)
[ (0) (0)] (0),Tx x P=E (16)
where P(0) is a positive definite matrix, and x(0) is
independent of {w(k), k=0,1, …} and of {v(k+1), k=0, 1,
…} such that,
[ (0) ( )] 0 0 1 ,Tx w k k= ∀ = , ,E � (17)
[ (0) ( 1)] 0 0 1 .Tx v k k+ = ∀ = , ,E � (18)
Moreover, the model described by (7)-(8) has the
following properties.
P1: The stochastic processes {x(k), k=0,1, …} and
{y(j), j=0,1, …} are gaussian with zero means.
P2:
[ ( ) ( )] 0 0 1 .Tx j w k k j j k= ∀ ≥ ; , = , ,E � (19)
P3:
[ ( ) ( )] 0 1 2 0 1 .Ty j w k k j j k= ∀ ≥ ; = , , ; = , ,E � � (20)
P4:
[ ( ) ( )] 0 0 1 1 2 .Tx j v k k j j k= ∀ , ; = , , ; = , ,E � � (21)
P5:
[ ( ) ( )] 0 1 2 .Ty j v k k j j k= ∀ > ; , = , ,E � (22)
5. DEVELOPMENT OF THE OPTIMAL
RECURSIVE ESTIMATOR
To incorporate the inequality constraints into the
Kalman filter, we have to distinguish between two
different cases. In the first case, the constraints are
strictly satisfied, whilst in the second case some of the
constraints are violated.
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
240
5.1. Optimal state estimator for strictly satisfied
constraints
Let us assume that we are at the (k +1) discrete instant of
time and that ˆ( )x k k| and ( )xxP k k|� �
are given.
The well known Kalman filter estimator when the
constraints are strictly satisfied is given by:
1
ˆ( 1 1)
ˆ ˆ( 1 ) K ( 1)[ ( 1) ( 1 )],
x k k
x k k k y k y k k
+ | +
= + | + + + − + | (23)
where
ˆ( 1 1) [ ( 1) ( 1)],x k k x k Y k+ | + = + | +E (24)
and
ˆ( 1 ) [ ( 1) ( )]
ˆ( 1 ) ( ),
x k k x k Y k
k k x k k
+ | = + |
= Φ + , |
E (25)
ˆ( 1 ) [ ( 1) ( )]
ˆ( 1) ( 1 )
y k k y k Y k
H k x k k
+ | = + |
= + + | .
E (26)
Define ( 1 )x k k+ |� and ( 1 )y k k+ |� such that:
ˆ( 1 ) ( 1) ( 1 ),x k k x k x k k+ | = + − + |� (27)
ˆ( 1 ) ( 1) ( 1 )y k k y k y k k+ | = + − + | .� (28)
The gain K1(k+1) in (23) is such that:
1
1
K ( 1) [ ( 1) ( 1 )]
( [ ( 1 ) ( 1 )])
T
T
k x k k ky
y k k k ky−
+ = + + |
× + | + |
E
E
�
� �
or
1
1
1
K ( 1) [ ( 1 ) ( 1 )]
( [ ( 1 ) ( 1 )])
( 1 ) ( 1) ( 1 ),
T
T
Txx yy
k x k k k ky
y k k k ky
P k k H k P k k
−
−
+ = + | + |
× + | + |
= + | + + |
E
E
� � � �
� �
� � (29)
where
( 1 ) ( 1 ) ( ) ( 1 )
( 1 ) ( 1 ),
T
xx xx
T
P k k k k P k k k k
k k Q k k
+ | = Φ + , | Φ + ,
+ Γ + , Γ + ,
� � � � (30)
( 1 ) ( 1) ( 1 ) ( 1)Tyy xxP k k H k P k k H k R+ | = + + | + + .� � � �
(31)
Hence, the covariance matrix of the filtered estimate
ˆ( 1 1)x k k+ | + is given by:
1
( 1 1)
[ ( 1 1) ( 1 1)]
[ K ( 1) ( 1)] ( 1 ),
xx
T
xx
P k k
x k k k kx
I k H k P k k
+ | +
= + | + + | +
= − + + + |
E
� �
� �
� � (32)
where
ˆ( 1 1) ( 1) ( 1 1)x k k x k x k k+ | + = + − + | + .� (33)
The recursive estimator will then proceed to the next
discrete instant of time.
5.2. Optimal state estimator for saturated constraints
If a subset of the state vector violates the constraints
imposed on the system, a set of equality constraints have
to be included into the model. Accordingly, the problem
(6)-(9) reduces to the following:
]
1
0
min min ( 1 1)
( 1 1) ( 1) ,
fk
T
k
J k kx
x k k Y k
−
=
= + | +
× + | + | +
∑ E �
�
(34)
such that,
( 1) ( 1 ) ( ) ( 1 ) ( ),x k k k x k k k w k+ = Φ + , + Γ + , (35)
( 1) ( 1) ( 1) ( 1),y k H k x k v k+ = + + + + (36)
( 1) ( 1) ( 1),d k D k x k+ = + + (37)
where ( 1)( 1) q kd k
++ ∈ℜ ; ( 1)q k n+ ≤ is the number of
violated constraints at the instant (k+1). Note that d(k+1)
includes the elements of x and of x which have to be
imposed on the subset of states which violated these
constraints. Also, ( 1)( 1) q k nD k
+ ×+ ∈ℜ is a matrix which
contains ones and zeros, where the ones are located at the
position of the state variable which has to be saturated at
the value corresponding to the associated element in the
d(k +1) vector.
In order to handle this situation, the measurement
vector given by (36) will be augmented by (37) as
measurements with zero variance. As a result, the new
augmented measurement equation will take the form:
( 1) ( 1) ( 1) ( 1),a a ay k H k x k v k+ = + + + + (38)
where
( 1) ( 1)( 1) , ( 1) ,
( 1) ( 1)
( 1) 0( 1) and ( 1)
0 0 0
a a
a a
y k H ky k H k
d k D k
v k Rv k R k
+ + + = + = + +
+ + = + = .
Accordingly, the state estimator which satisfies the
improved system constraints and its corresponding
covariance matrix are given by the following lemma.
Lemma 1: The optimal state estimator which
minimizes the cost function (34) subject to the system
model described by (35) and (38) is given by:
1 2ˆ( 1 1) ( 1 1) K ( 1)[ ( 1)ˆ
ˆ( 1 1)],
x k k k k k d kx
d k k
+ | + = + | + + + +
− + | + (39)
1 12
( 1 1)
[ K ( 1) ( 1)] ( 1 1),
xx
x x
P k k
I k D k P k k
+ | +
= − + + + | +
� �
� �
(40)
where 1( 1 1)ˆ k kx + | + is obtained from (23) when
replacing ˆ( 1 1)x k k+ | + by 1( 1 1);ˆ k kx + | + the covari-
ance 1 1x x
P� �
is obtained from (32) when replacing x� by
1,x� and,
1ˆ ˆ( 1 1) ( 1) ( 1 1),d k k D k x k k+ | + = + + | + (41)
ˆ( 1 1) ( 1) ( 1 1),d k k d k d k k+ | + = + − + | +� (42)
A Recursive State Estimator in the Presence of State Inequality Constraints
241
1 1( 1 1) ( 1 1) ( 1),T
x xxdP k k P k k D k+ | + = + | + +� � �
(43)
1 1( 1 1) ( 1) ( 1 1) ( 1),T
x xddP k k D k P k k D k+ | + = + + | + +� � � �
(44) 1
2K ( 1) ( 1 1) ( 1 1)
xd ddk P k k P k k
−+ = + | + + | + .� � � (45)
The proof of this lemma is given in Appendix A.
5.3. Properties of the constrained estimator
The proposed recursive estimator has several attractive
properties.
Property 1: Using equation (40), it can be shown that
1 1( 1 1) ( 1 1).
xx x xP k k P k k+ | + ≤ + | +� � � �
Property 1 means that the constrained estimator has a
smaller covariance than the corresponding unconstrained
estimator.
Property 2: The proposed estimator is an unbiased
estimator.
To show this property, we use equations (39), (37),
(41) and (42) to obtain:
1 2
1 2
1 2
( 1 1)
ˆ( 1) ( 1 1)
( 1) ( 1 1) K ( 1) ( 1 1)ˆ
( 1 1) K ( 1) ( 1 1)
( 1 1) K ( 1) ( 1 1).
x k k
x k x k k
x k k k k d k kx
x k k k d k k
x k k k d k k
+ | +
= + − + | +
= + − + | + − + + | +
= + | + − + + | +
= + | + − + + | +
�
�
��
��
(46)
Taking the expected value of the above equation, we get:
1 12 1
[ ( 1 1)]
[ ( 1 1)]1
K ( 1) ( 1) [ ( )].k k
x k k
k kx
k D k x + | +
+ | +
= + | +
− + +
E
E
E
�
�
�
(47)
Since the unconstrained Kalman filter estimator is an
unbiased one, then,
1[ ( 1 1)] 0k kx + | + = .E � (48)
Therefore, equation (47) implies that:
[ ( 1 1)] 0x k k+ | + = .E � (49)
Property 3: Using the proposed estimator, the value
of the cost function is less than the cost obtained if the
covariance matrix of the unconstrained estimator is
always used to estimate the constrained one.
This property is clear from the fact that at the next
discrete time instant, ( 1 1)xxP k k+ | +� �
resulting from
(40) is used to calculate the new gain and hence the new
covariance matrix ( 2 2).xxP k k+ | +� �
Please note that
this property has also been verified through simulations.
Property 4: The proposed algorithm is based on the
multiple projection approach. It has been shown in [7]
and [20] that such an approach improves the numerical
stability of the estimator. Moreover, in most of the
techniques found in the literature, if a subset of the
constraints is violated, the correction procedure is carried
out only on the states corresponding to the violated
constraints while neglecting their effects on the other
states. In the developed procedure, the impact of this
action on the other states is also taken into consideration.
As a result, such a procedure increases the numerical
stability of the algorithm. This feature is more apparent
when dealing with nonlinear systems.
5.4. The Estimation algorithm
The algorithm which can be used to implement the
proposed recursive estimator is detailed below.
Step 1: Initialization: assign values to P(0), Q and R.
We assume that at the (k+1) discrete instant of time
ˆ( )x k k| and ( )xxP k k|� �
are given.
Step 2: Calculate the predictor estimator ˆ( 1 )x k k+ |
and ˆ( 1 )y k k+ | using (25) and (26) respectively. Then,
calculate the covariance matrices ( 1 )xxP k k+ |� �
and
( 1 )yy
P k k+ |� �
using (30) and (31). Finally, compute
1K ( 1)k + using (29).
Step 3: Calculate the unconstrained filter estimator
ˆ( 1 1)x k k+ | + using (23) and then compute the
corresponding covariance matrix ( 1 1)xxP k k+ | +� �
using
(32).
Step 4: If ˆ( 1 1)x k k+ | + is strictly satisfied, i.e.,
ˆ( 1 1) ,x x k k x≤ + | + ≤ then if k equals kf stop, Else let
k=k +1 and go back to Step 2.
Else Let 1̂( 1 1)x k k+ | + = ˆ( 1 1),x k k+ | + then calcu-
late ˆ( 1 1)d k k+ | + and ( 1 1)d k k+ | +� using (41), (42).
Compute the matrices ( 1 1),xdP k k+ | +� ( 1 1),
ddP k k+ | +� �
2ˆ( 1), ( 1 1)K k x k k+ + | + and ( 1 1)
xxP k k+ | +� �
using (43),
(44), (45), (39) and (40) respectively. If k equals kf stop,
Else let k=k+1 and go back to Step 2.
6. ILLUSTRATIVE EXAMPLES
This section presents the simulation results of two
examples using the developed constrained recursive
estimator. The first example is a numerical one; the
second example is a practical example involving the
control of pollution levels.
6.1. A numerical example
Consider the following estimation problem:
1
0
min min [ ( 1 1)
( 1 1) ( 1)],
fk
T
k
J k kx
x k k Y k
−
=
= + | +
× + | + | +
∑ E �
�
(50)
such that,
0 7326 0 0861( 1) ( )
0 1722 0 9909
0 0609 1 0( ) ( ),
0 0064 0 1
x k x k
u k w k
. − . + = . .
. + + .
(51)
( 1) ( 1) ( 1),y k Hx k v k+ = + + + (52)
( 1) ,x x k x≤ + ≤ (53)
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
242
( ) ,u u k u≤ ≤ (54)
where E[x(0)xT(0)]=P(0)=I, with I being the 2 by 2
identity matrix, E[w(k)wT(j)]=0.01Iδjk; E[v(k)vT(j)]=0.01
Iδjk; y(k+1) is a scalar. The matrix 1 2H
×
∈ℜ will be
specified later on. The vectors x, ,x and the scalars u,
u are the lower and upper bounds of x(k +1), u(k)
respectively element by element. These values will be
specified later on.
The above problem is simulated for four different set
of parameters. To have a realistic situation, the control
strategy which minimizes the quadratic cost function
given by:
2 2 2
1 2
0
min min ( ) ( ) 0 01 ( ),k
J x k x k u k
∞
=
= + + .∑ (55)
while satisfying the model of the system (51) as well as
the system constraints given by (53) and (54) is firstly
designed for the deterministic system using the approach
developed by Hassan et Ali [6]. The obtained trajectories
as well as the output measurements are corrupted by the
noise signals w(k) and v(k +1) for estimation purposes.
In order to compare the recursive algorithm developed
in this paper with the one presented in the paper by
Simon and Chia [24], the following situations will be
handled in each of our simulation cases.
Situation 1: To get the trajectories of x(k +1) and
y(k +1) and hence calculate the unconstrained Kalman
filter estimator, it will be assumed that the system
constraints are not applicable in this phase while they
will be applicable in the estimation phase. It is important
to note that this situation is not a physically realizable
one in real life applications since constraints are usually
applied on the system while it is running and hence the
measurement vector y(k +1) includes the already
constrained states. However, this scenario has to be
carried out to be able to compare our results to those in
[24]. Our technique as well as that developed in [24] will
be applied and comparisons will be made through the
estimation of the cost function.
Situation 2: In this situation, it will be assumed that
the constraints are applied within our system simulations
to get the measurement vector y(k +1). This is the
physically realizable case. Then, the constrained Kalman
filter estimator will be calculated using our technique
and that proposed by [24] in which we consider the
unconstrained estimator is the one resulting from the
Kalman filter before applying the proposed modification
to get the constrained one. Again, the two techniques will
be compared through the estimation of the cost function.
Case 1: Simulations using the first set of parameters In this case, we let x(0)=[1 1]T H=[0 1]T, x1 is
unconstrained, x2= −0.5, no upper bound on the second
state, u = −2, u = 2 and kf = 81.
At first the simulations are carried out for situation 1,
the cost is found to be 4.0666 using the proposed
recursive technique; the cost is found to be 4.1086 when
using the technique proposed by [24].
Then, the simulations are carried out for situation 2.
The actual and estimated states for x1 and x2 are shown in
Figs. 1 and 2 respectively. In this case, the cost is found
to be 4.1085 using the proposed recursive technique, the
cost is found to be 4.2407 when using the technique
proposed by [24].
Case 2: Simulations using the second set of param-
eters
In this case, we let x(0)=[1 1]T, H=[1 0]T, x1 is
unconstrained, x2= −0.5, no upper bound on the second
state, u= −2, u = 2 and kf = 81.
At first the simulations are carried out for situation 1,
the cost is found to be 14.517 using the proposed
recursive technique; the cost is found to be 14.549 when
using the technique proposed by [24].
Then, the simulations are carried out for situation 2.
The actual and estimated states for x1 and x2 are shown in
Figs. 3 and 4 respectively. In this case, the cost is found
to be 14.7646 using the proposed recursive technique,
the cost is found to be14.7721 when using the technique
proposed by [24].
Case 3: Simulations using the third set of param-
eters In this case, we let x(0)= [46.0825 -7.0175]T, H=[0 1],
0 10 20 30 40 50 60 70 80−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
Time instant
The
sta
te x
1
x1x1^
Fig. 1. The plot of x1 and 1̂x versus time (Example 1,
Case 1).
0 10 20 30 40 50 60 70 800
0.2
0.4
0.6
0.8
1
1.2
1.4
Time instant
The
sta
te x
2
x2x2̂
Fig. 2. The plot of x2 and 2x̂ versus time (Example 1,
Case 1).
A Recursive State Estimator in the Presence of State Inequality Constraints
243
x1= −0.5, no upper bound on the first state, no lower
bound on the second state, 2x =1.5, the controller is
unconstrained and kf = 41.
At first the simulations are carried out for situation 1,
the cost is found to be 2.7450 using the proposed
recursive technique; the cost is found to be 2.878 when
using the technique proposed by [24].
Then, the simulations are carried out for situation 2.
The actual and estimated states for x1 and x2 are shown in
Figs. 5 and 6 respectively. In this case, the cost is found
to be 2.8785 using the proposed recursive technique, the
cost is found to be 2.9622 when using the technique
0 10 20 30 40 50 60 70 80−0.6
−0.4
−0.2
0
0.2
0.4
0.6
0.8
1
Time instant
The
sta
te x
1
x1x1̂
Fig. 3. The plot of x1 and 1̂x versus time (Example 1,
Case 2).
0 10 20 30 40 50 60 70 80−0.2
0
0.2
0.4
0.6
0.8
1
1.2
1.4
Time instant
The
sta
te x
2
x2x2̂
Fig. 4. The plot of x2 and 2x̂ versus time (Example 1,
Case 2).
0 5 10 15 20 25 30 35 40−10
0
10
20
30
40
50
Time instant
The
sta
te x
1
x1x2^
Fig. 5. The plot of x1 and 1̂x versus time (Example 1,
Case 3).
0 5 10 15 20 25 30 35 40−8
−7
−6
−5
−4
−3
−2
−1
0
1
2
Time instant
The
sta
te x
2
x2x2̂
Fig. 6. The plot of x2 and 2x̂ versus time (Example 1,
Case 3).
0 5 10 15 20 25 30 35 40−10
0
10
20
30
40
50
Time instant
The
sta
te x
1
x1x1̂
Fig. 7. The plot of x1 and 1̂x versus time (Example 1,
Case 4).
0 5 10 15 20 25 30 35 40−8
−7
−6
−5
−4
−3
−2
−1
0
1
2
Time instant
The
sta
te x
2
x2x2^
Fig. 8. The plot of x2 and 2x̂ versus time (Example 1,
Case 4).
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
244
proposed by [24].
Case 4: Simulations using the fourth set of param-
eters In this case, we let x(0)= [46.0825 -7.0175]T, H=[1 0],
x1= −0.5, no upper bound on the first state, no lower
bound on the second state, 2x =1.5, the controller is
unconstrained and kf = 41.
At first the simulations are carried out for situation 1,
the cost is found to be 6.6464 using the proposed
recursive technique; the cost is found to be 8.911 when
using the technique proposed by [24].
Then, the simulations are carried out for situation 2.
The actual and estimated states for x1 and x2 are shown in
Figs. 7 and 8 respectively. In this case, the cost is found
to be 6.712 using the proposed recursive technique, the
cost is found to be 9.2528 when using the technique
proposed by [24].
6.2. A practical example
In this example, we consider a practical system in
which it is desired to control the pollution levels in the
two reach river system given in [9] and [20]:
102 2
0min min ( ) ( )d Q RJ x t x u t dt
= || − || + || ||∫ (56)
subject to:
1 32 0 0 0
0 32 1 2 0 0( ) ( )
0 9 0 1 32 0
0 0 5 0 32 1 2
0 1 0 5 35
0 0 10 9( ) ( ),
0 0 1 4 19
0 0 1 9
x t x t
u t w t
− . − . − . = . − .
. − . − .
. . . + + + . .
.
�
(57)
0 1 0 0( ) ( ) ( ),
0 0 0 1y t x t v t
= +
(58)
where the state variables x1(t) and x3(t) represent the
concentrations of the BOD in mg/l; the states x2(t) and
x4(t) are the concentrations of the DO in mg/l and the
vector containing the desired values of the state variables
is xd = [4.068 5.946]T. Also, u=[u1 u2]T is the deviation of
the waste water treatment from the nominal values.
The weighting matrices of the cost functions are
chosen such that Q=I4 and R=I4 where I4 is the 4 by 4
identity matrix; E[x(0)xT(0)]=P(0)=I4.The vectors w(t)
and v(t) are zero mean uncorrelated white Gaussian noise
vectors at the input and the output of the system with
covariances E[w(t) wT(t)]=5I4 and E[v(t) vT(t)]=I2.
To maintain the ecological balance of the system
while maintaining the cost of waste water treatment
within reasonable limits, the following constraints are
imposed on the system given by equations (56)-(58):
3( ) 6 5 mg l,x t ≤ . / (59)
( ) 25.u t ≥ − (60)
In order to implement the technique developed in this
paper, the problem given by equations (56)-(58) is
discretized using a first order approximation (Euler’s
method) with a sampling period ∆T=0.1 day. Figs. 9 to
12 depict the actual and estimated states of the system. It
is clear from Fig. 11 that the estimated trajectory 3x̂
satisfies the constraints imposed on the system.
Fig. 9. The plot of x1 and 1̂x vs time (Example 2).
Fig. 10. The plot of x2 and 2x̂ vs time (Example 2).
Fig. 11. The plot of x3 and 3x̂ vs time (Example 2).
A Recursive State Estimator in the Presence of State Inequality Constraints
245
Fig. 12. The plot of x4 and 4x̂ vs time (Example 2).
6.3. Comments on the simulation results
1) It is noticed that in most of our simulation results,
the difference between the two estimation costs is not
very large. This is simply due to the fact that the
constrained estimators did not hit the constraints except
in only few points. However, when the estimators reach
the constraints in a reasonable number of points (as in
case 4 of the first example when the the set of parameters
4 is used), the difference in the cost between the two
techniques is significant. It is natural to expect that the
two techniques will lead to the same value of the cost
function if the estimators did not hit the constraints
during the estimation period.
2) The results obtained from the recursive estimator is
optimal since Kalman filtering gains are based on the
actual covariance matrices resulting from the constrained
Kalman filter rather than the unconstrained Kalman filter
as proposed by [24].
7. CONCLUSION
The paper deals with the design of a recursive
estimator to estimate the states of linear dynamic system
in the presence of state inequality constraints. The
developed algorithm distinguishes between the case
when the constraints are strictly satisfied and the case
when some of the constraints are violated. The usual
Kalman filter is used when the constraints are strictly
satisfied. However, when some of the constraints are
violated, the proposed algorithm uses a series of
successive orthogonalizations on the measurement
subspaces to obtain the optimal estimate.
It is found that the proposed estimator has several
attractive properties. The constrained estimator has a
smaller covariance than the corresponding unconstrained
estimator. Also, the proposed estimator is an unbiased
estimator. In addition, when using the proposed estimator,
the value of the cost function is less than that obtained if
the covariance matrix of the unconstrained estimator is
always used to estimate the constrained one.
The proposed estimator is illustrated through
simulation results of a numerical example and a practical
example. The simulation results indicate that the
proposed estimator works well.
Future work will address the application of the
proposed recursive estimator to some real life problems
such that data transmission over networks.
APPENDIX A: PROOF OF LEMMA 1
The general filtered state estimator when a subset of
the state vector violates the constraints imposed on the
system is given by:
ˆ( 1 1) [ ( 1) ( 1)],a
x k k x k Y k+ | + = + | +E (61)
where
( )
( 1) ( 1)
( 1)
a
Y k
Y k y k
d k
+ = + . +
(62)
Equation (61) can be written in the form:
( 1) ( ) ( 1)ˆ( 1 1) .
( 1)
x k Y k y kx k k
d k
+ | , + , + | + = +
E (63)
Using Theorem 2, we can write,
( 1) ( ) ( 1)ˆ( 1 1) ,
( 1 1)
x k Y k y kx k k
d k k
+ | , + , + | + =
+ | + E
� (64)
where
( 1) ( )( 1 1) ( 1)
( 1)
d k Y kd k k d k
y k
+ | , + | + = + − . +
E� (65)
Now, since ( 1 1)d k k+ | +� is orthogonal to the
subspace generated by the measurement vector Y(k +1),
where YT(k +1)=[YT(k) yT(k +1)], then, it is possible to
write (64) in the form:
ˆ( 1 1) [ ( 1) ( ) ( 1)]
[ ( 1) ( 1 1)].
x k k x k Y k y k
x k d k k
+ | + = + | , +
+ + | + | +
E
E � (66)
Moreover, let
( 1 ) ( 1) [ ( 1) ( )].y k k y k y k Y k+ | = + − + |E� (67)
Again, since ỹ (k+1 | k) is orthogonal to the subspace
generated by the measurement vector Y(k), equation (66)
can take the following form:
ˆ( 1 1) [ ( 1) ( )]
[ ( 1) ( 1 )]
[ ( 1) ( 1 1)].
x k k x k Y k
x k y k k
x k d k k
+ | + = + |
+ + | + |
+ + | + | +
E
E
E
�
�
(68)
The first two terms in the right half of (68) correspond
to the optimal filtered estimate of the unconstrained state
variables. Denoting this estimate by 1( 1 1),ˆ k kx + | +
then using (68) we can write,
1ˆ ˆ( 1 1) ( 1 1)
[ ( 1) ( 1 1)],E
x k k x k k
x k d k k
+ | + = + | +
+ + | + | +� (69)
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
246
where 1̂( 1 1)x k k+ | + and its associated predicted esti-
mator 1̂( 1 ),x k k+ | covariance matrices
1 1( 1 ),
x xP k k+ |� �
1 1( 1 1)
x xP k k+ | +� �
and K1(k +1) are as given by equations
(23)-(33) while replacing x by x1.
Now, we consider the impact of the second term in
(69) which reflects the effects of the saturated constraints
on the optimal filter estimator. Let ( 1 1)d k k+ | +� be
such:
ˆ( 1 1) ( 1) ( 1 1),d k k d k d k k+ | + = + − + | +� (70)
where
ˆ( 1 1) [ ( 1) ( ) ( 1)]
[ ( 1) ( ) ( 1 )]
d k k d k Y k y k
d k Y k y k k
+ | + = + | , +
= + | , + |
E
E �
(71)
1
[ ( 1) ( 1) ( ) ( 1 )]
( 1) ( 1 1)ˆ
D k x k Y k y k k
D k k kx
= + + | , + |
= + + | + .
E �
Let 1 1̂( 1 1) ( 1) ( 1 1).x k k x k x k k+ | + = + − + | +� Using
(70), the fact that ( 1) ( 1) ( 1)d k D k x k+ = + + and (71),
we obtain,
1
1
( 1 1) ( 1) ( 1)
ˆ( 1) ( 1 1)
( 1) ( 1 1)
d k k D k x k
D k x k k
D k x k k
+ | + = + +
− + + | +
= + + | + .
�
�
(72)
Now,
1
[ ( 1) ( 1 1)]
( 1 1) ( 1 1) ( 1 1),xd dd
x k d k k
P k k P k k d k k−
+ | + | +
= + | + + | + + | +
E
� � �
�
� (73)
where
1 1
11
1
( 1 1) [ ( 1) ( 1 1)]
ˆ[( ( 1 1) ( 1))
( ( 1 1) ( 1))]
( 1 1) ( 1)
T
xd
T T
T
x x
P k k x k k kd
x k k kx
x k k D k
P k k D k
+ | + = + + | +
= + | + + +
+ | + +
= + | + + .
E
E
�
� �
�
�
�
(74)
Similarly,
1 1
( 1 1) [ ( 1 1) ( 1 1)]
( 1) ( 1 1) ( 1).
T
dd
T
x x
P k k d k k k kd
D k P k k D k
+ | + = + | + + | +
= + + | + +
E� �
� �
� �
(75)
Using equations (72)-(75), equation (69) leads to,
1
2
ˆ ˆ( 1 1) ( 1 1)
K ( 1) ( 1 1)
x k k x k k
k d k k
+ | + = + | +
+ + + | +� (76)
where
1
2K ( 1) ( 1 1) ( 1 1)
xd ddk P k k P k k
−+ = + | + + | + .� � � (77)
Recall that:
ˆ( 1 1) ( 1) ( 1 1)x k k x k x k k+ | + = + − + | + .� (78)
Therefore, by using equation (76) we can write,
1 2
1 2
( 1 1)
ˆ( 1) ( 1 1)
( 1) ( 1 1) K ( 1) ( 1 1)ˆ
( 1 1) K ( 1) ( 1 1)
x k k
x k x k k
x k k k k d k kx
x k k k d k k
+ | +
= + − + | +
= + − + | + − + + | +
= + | + − + + | + .
�
�
��
(79)
Also,
1 2
1 2
( 1 1)
[ ( 1 1) ( 1 1)]
( ( 1 1) K ( 1) ( 1 1))
.( ( 1 1) K ( 1) ( 1 1))
xx
T
T
P k k
x k k k kx
k k k d k kx
x k k k d k k
+ | +
= + | + + | +
= + | + − + + | +
× + | + − + + | +
E
E
� �
� �
��
��
(80)
After simple mathematical manipulation, this leads to:
1 1
2( 1 1) [ K ( 1) ( 1)]
( 1 1)
xx
x x
P k k I k D k
P k k
+ | + = − + +
× + | + .
� �
� �
(81)
Then, the estimator will proceed to the next discrete
instant of time.
REFERENCES
[1] L. Chia, D. Simon, and H. J. Chizeck, “Kalman
filtering with statistical state constraints,” Control
and Intelligent Systems, vol. 34, no. 1, pp. 73-79,
2006.
[2] T. Chia, P. Chow, and H. Chizek, “Recursive para-
meter identification of constrained systems: an ap-
plication to electrically stimulated muscle,” IEEE
Trans. on Biomedical Engineering, vol. 38, no. 5,
pp. 429-441, 1991.
[3] H. E. Doran, “Constraining Kalman filter and
smoothing estimates to satisfy time-varying restric-
tions,” Rev. Econom. Statist., vol. 74, no. 3, pp.
568-572, 1992.
[4] J. D. Geeter, H. V. Brussel, and J. De Schutter, “A
smoothly constrained Kalman filter,” IEEE Trans.
Pattern Anal. Machine Intell., vol. 19, no. 10, pp.
1171-1177, 1997.
[5] N. Gupta and R. Hauser, “Kalman filtering with
equality and inequality state constraints,” http://
arxiv.org/abs/0709.2791, 2007.
[6] M. F. Hassan and A. K. Ali, “A coordinating ap-
proach for the solution of discrete linear servo-
mechanism problem with constraints,” Asian Jour-
nal of Control, vol. 10, no. 4, pp. 478-494, 2008.
[7] M. F. Hassan, G. Salut, M. G. Singh, and A. Titli,
“A new decentralized filter for large scale intercon-
nected dynamical system,” IEEE Trans. on Auto-
matic Control, vol. 23, no. 2, pp. 262-268, 1978.
[8] N. Haverbeke, B. Pluymers, and B. De Moor,
“Constrained state estimation: a critical evalua-
tion,” Proc. of 25th Benelux Meeting on Systems
and Control, The Netherlands, March 13-15, 2006.
[9] M. F. Hassan, “Water quality simulation and con-
trol in streams,” Encyclopedia of Environmental
A Recursive State Estimator in the Presence of State Inequality Constraints
247
Control Chronology, vol. 13, Waste Water Treat-
ment Technology, Gulf Publicity Company, pp. 77-
138, 1989.
[10] M. F. Hassan and H. T. Attia, “Stream quality con-
trol via a constrained nonlinear time-delay model,”
Journal of Mathematical Control Science and Ap-
plications, vol. 12, no. 1, pp. 23-34, 2008.
[11] M. F. Hassan, A. A, Abouelsoud, and H. M. Soli-
man, “Constrained load-frequency control,” Elec-
tric Power Components and Systems, vol. 36, pp.
266-275, 2008.
[12] S. Hayward, “Constrained Kalman filter for least-
squares estimation of time-varying beam forming
weights,” Mathematics in Signal Processing IV,
Oxford University Press, pp. 113- 125, 1998.
[13] C. V. Hollot, V. Misra, D. Towsley, and W. Gong,
“Analysis and design of controllers for AQM rou-
ters supporting TCP flows,” IEEE Trans. on Auto-
matic Control, vol. 47, no. 6, pp. 545-559, 2002.
[14] S. Julier and J. LaViola, “On Kalman filtering with
nonlinear equality constraints,” IEEE Trans. on
Signal Processing, vol. 55, no. 6, pp. 2774-2784,
2007.
[15] S. Julier and J. Uhlmann, “Unscented filtering and
nonlinear estimation,” Proc. of the IEEE, vol. 92,
no. 3, pp. 401-422, 2004.
[16] S. Ko and R. Bitmead, “State estimation for linear
systems with state equality constraints,” Automati-
ca, vol. 43, no. 8, pp. 1363-1368, 2007.
[17] S. Kolas, B. A. Foss, and T. S. Schei, “Constrained
nonlinear state estimation based on the UKF ap-
proach,” Computers and Chemical Engineering,
vol. 33, pp. 1386-1401, 2009.
[18] D. Luenberger, Optimization by Vector Space Me-
thods, Wiley, New York, 1969.
[19] K. Mahata and T. Soderstrom, “Improved estima-
tion performance using known linear constraints,”
Automatica, vol. 40, no. 8, pp. 1307-1318, 2004.
[20] M. S. Mahmoud, M. F. Hassan, and M. G. Darwish,
Large Scale Control Systems: Theories and Tech-
niques, Marcel Dekker Inc, New York and Basel,
1985.
[21] D. Massicotte, R. Morawski, and A. Barwicz, “In-
corporation of positivity constraint into a Kalman-
filter-based algorithm for correction of spectrome-
tric data,” IEEE Trans. on Instrumentation and
Measurement, vol. 46, no. 1, pp. 2-7, 1995.
[22] J. Porrill, “Optimal combination and constraints for
geometrical sensor data,” International Journal of
Robotics Research, vol. 7, no. 6, pp. 66-77, 1988.
[23] C. Rao, J. Rawlings, and D. Mayne, “Constrained
state estimation for nonlinear discrete time systems:
Stability and moving horizon approximations,”
IEEE Trans. on Automatic Control, vol. 48, no. 2,
pp. 246-258, 2003.
[24] D. Simon and T. Chia, “Kalman filtering with state
equality constraints,” IEEE Trans. on Aerospace
and Electronic Systems, vol. 38, no. 1, pp. 128-136,
2002.
[25] D. Simon and D. L. Simon, “Kalman filtering with
inequality constraints for turbofan engine health es-
timation,” IEE Proceedings - Control Theory and
Applications, vol. 153, no. 3, pp. 371-378, 2006.
[26] B. Teixeira, J. Chandrasekar, H. Palanthandalam-
Madapusi L. Aguirre, L. Torres, L. Aguirre, and D.
Bernstein, “Gain-constrained Kalman filtering for
linear and nonlinear systems,” IEEE Trans. on Sig-
nal Processing, vol. 56, no. 9, pp. 4113-4123, 2008.
[27] P. Vachhani, R. Rengaswamy, V. Gangwal, and S.
Narasimhan, “Recursive estimation in constrained
nonlinear dynamical systems,” AIChE Journal, vol.
51, no. 3, pp. 946-959, 2005.
[28] P. Vachhani, S. Narasimhan, and R. Rengaswamy,
“Robust and reliable estimation via unscented re-
cursive nonlinear dynamic data reconciliation,”
Journal of Process Control, vol. 16, no. 10, pp.
1075-1086, 2006.
[29] L. Wang, Y. Chiang, and F. Chang, “Filtering me-
thod for nonlinear systems with constraints,” IEE
Proceedings - Control Theory and Applications, vol.
149, no. 6, pp. 525-531, 2002.
[30] W. Wen and H. Durrant-Whyte, “Model-based mul-
ti-sensor data fusion,” Proc. of IEEE International
Conference on Robotics and Automation, Nice,
France, pp. 1720-1726, 1992.
[31] C. Yang and E. Blasch, “Kalman filtering with non-
linear state constraints,” Proc. of the 9th Interna-
tional Conference on Information Fusion, Seattle,
WA, pp. 1-8, 2006.
Mohamed Fahim Hassan was born in
Cairo, Egypt on June 21, 1947. He
received his B.Sc. and M.Sc. degrees in
Electrical Engineering from Cairo
University, Faculty of Engineering, Cairo,
Egypt in 1970 and 1973 respectively, and
his D.Sc. (Doctor d’Etat) in Systems
Science and Automatic Control from
Paul Sabatier University, Toulouse,
France in 1978. He has been a faculty member in Electronics
and Communication Department, Faculty of Engineering, Cairo
University since 1978 till now where he held the positions of
Assistant Professor from 1978 to 1983, Associate Professor
from 1983 to 1988 and Professor from 1988 till now. Currently
he is on leave from Cairo University and joined Kuwait
University where he is a Professor of Control Engineering in
College of Engineering and Petroleum. Prof. Hassan was also
the Coordinator and Assistant Director of the Computer
Education Program, Department of Public Service, The
American University in Cairo from 1985 to 1994. He was the
recipient of many outstanding research prizes and medals from
Egypt and USA. His research activities are in the areas of large
scale systems, optimization theory, stochastic control theory,
estimation theory and adaptive control. In addition to that, he
supervised many projects sponsored by Egyptian government
and US- Aid. Prof Hassan is a co-author of one book, author of
many book chapters and encyclopedia chapters. Moreover, he
is an author and co-author of more than 150 technical papers in
most of the international journals and conferences. Prof.
Hassan is a reviewer of many international journals and
conferences.
Mohamed Fahim Hassan, Mohamed Zribi, and Hamed M. K. Alazemi
248
Mohamed Zribi obtained his B.S. de-
gree in Electrical Engineering (Magna
Cum Laude Honors) in 1985 from the
University of Houston, Houston, Texas.
He received his M.S.E.E and Ph.D. de-
grees in Electrical Engineering in 1987
and 1992 from Purdue University, West
Lafayette, Indiana. He held a faculty
position in the School of Electrical Engi-
neering, Nanyang Technological University, Singapore from
1992 till 1998. He is currently a professor in the Electrical En-
gineering Department, College of Engineering & Petroleum,
Kuwait University. His research interests are in nonlinear con-
trol, adaptive control, control applications and robotics.
Hamed M. K. Alazemi received his
B.Sc. and M.S. degrees in Electrical
Engineering from Washington University
(Saint Louis) in 1992 and 1994
respectively, and his Ph.D. degree from
the University of Washington (Seattle) in
2000. He is currently an associate
professor at the Computer Engineering
Department at Kuwait University where
his research interests include analysis/design of Computer
communication network. His recent research emphasis includes
control and communication design, routing in WDM networks
and stochastic performance evaluation and combinatorial
optimization.