On rule acquisition in decision formal contexts
Transcript of On rule acquisition in decision formal contexts
ORIGINAL ARTICLE
On rule acquisition in decision formal contexts
Jinhai Li • Changlin Mei • Cherukuri Aswani Kumar •
Xiao Zhang
Received: 6 August 2012 / Accepted: 16 January 2013 / Published online: 6 February 2013
� Springer-Verlag Berlin Heidelberg 2013
Abstract Rule acquisition is one of the main purposes in
the analysis of decision formal contexts. Up to now, there
have existed several types of rules (e.g., the decision rules
and the granular rules) in decision formal contexts. This
study firstly proposes a new algorithm with less time
complexity for deriving the non-redundant decision rules
from a decision formal context. Then, we invesigate deci-
sion rules and the granular rules in the consistent decision
formal contexts and make a contrast between the decision
rule oriented knowledge reduction and the granular rule
oriented knowledge reduction. Finally, some experiments
are conducted to assess the efficiency of the proposed rule
acquisition algorithm.
Keywords Formal concept analysis � Formal context �Decision formal context � Concept lattice � Rule acquisition
1 Introduction
Formal concept analysis (FCA), proposed by Wille [1], is
oriented towards the discovery of formal concepts and the
construction of concept hierarchies. Nowadays, this theory
has shown a trend of multidisciplinary intersection and
fusion and hence has become an effective tool for con-
ceptual data analysis and knowledge processing.
FCA starts with the notion of a formal context (U, A, I)
which consists of the object set U, the attribute set A and
the binary relation I � U � A indicating that each object of
U has what attributes in A. In FCA, the basic tool used to
analyze databases is the concept lattice which is constituted
by all the formal concepts of a formal context together
with the subconcept–superconcept-relation. According to
Wille’s definition [1], a formal concept is an ordered pair
(X, B) in which X � U contains exactly those objects
shared by all the attributes in B and B � A contains exactly
those attributes that all the objects in X have in common. In
recent years, many studies [2–9] have been devoted to the
issue of reducing the size of the concept lattice of a formal
context in order to improve the understandability of the
resulting concept lattice. In FCA, a useful way of charac-
terizing attribute dependencies in a formal context is via
attribute implication rules or association rules. How to
derive these rules efficiently has drawn much attention in
the literature [10–18].
Decision formal contexts [19], a useful extension of the
formal contexts, were proposed to implement decision
analysis using the concept lattice. Rule acquisition is one of
the main purposes in the analysis of decision formal con-
texts. A few studies [20–25] have recently been devoted to
the rule acquisition in decision formal contexts. To the best
of our knowledge, there have existed several types of rules
(e.g., the decision rules [23–25] and the granular rules [22])
in decision formal contexts. Although a rule acquisition
method for deriving all the non-redundant decision rules
from a decision formal context has been proposed in [24],
this method depends heavily on both the conditional
J. Li (&) � C. Mei � X. Zhang
School of Mathematics and Statistics, Xi’an Jiaotong University,
Xi’an 710049, Shaanxi, People’s Republic of China
e-mail: [email protected]
C. Mei
e-mail: [email protected]
X. Zhang
e-mail: [email protected]
C. A. Kumar
School of Information Technology and Engineering,
VIT University, Vellore, India
e-mail: [email protected]
123
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
DOI 10.1007/s13042-013-0150-z
concept lattice and the decision concept lattice. Since the
construction of the concept lattice for a large database is
very time-consuming, the method proposed in [24] may not
be efficient enough in handling a large database. If some
efficient methods for extracting the decision rules from a
decision formal context are developed, it is of interest to
investigate the relationship between the decision rules and
the granular rules. Furthermore, knowledge reduction is
always one of the important issues in FCA. Therefore, it is
also essential to clarify the relation and the difference
between the decision rule oriented knowledge reduction
[24] and the granular rule oriented knowledge reduction
[22].
In this paper, we first propose an efficient algorithm to
derive the non-redundant decision rules from a decision
formal context. Then we investigate the relationship
between the non-redundant decision rules and the granular
rules in the consistent decision formal contexts and further
make a contrast between the decision rule oriented
knowledge reduction and the granular rule oriented
knowledge reduction. Finally, we conduct some experi-
ments to assess the efficiency of the proposed rule acqui-
sition algorithm.
2 Preliminaries
In this section, we briefly review some basic notions related
to FCA in order to make the paper self-contained.
Definition 1 ([1]) A formal context is a triple (U, A, I)
consisting of the object set U (called the universe of dis-
course), the attribute set A and the binary relation I �U � A in which (x, a) [ I indicates that the object x has the
attribute a and ðx; aÞ 62 I means the opposite.
A formal context (U, A, I) is said to be regular [19] if for
any (x, a) [ U 9 A, the following conditions hold:
(i) there exist a1, a2 [ A such that (x, a1) [ I and
ðx; a2Þ 62 I;(ii) there exist x1, x2 [ U such that (x1, a) [ I and
ðx2; aÞ 62 I:
It should be noted that an irregular formal context
(U, A, I) can be regularized by removing the rows with
their objects having all the attributes or having no attribute
in A and the columns with their attributes being shared by
all the objects in U or not being shared by any object of U.
Such way of the regularization causes no effect on the
analysis results of the formal context. Thus, without loss of
generality, the formal contexts discussed hereinafter are all
assumed to be regular.
Wille [1] introduced a pair of concept forming operators
on a formal context (U, A, I):
X" ¼ fa 2 A j 8x 2 X; ðx; aÞ 2 IgðX � UÞ;B# ¼ fx 2 U j 8a 2 B; ðx; aÞ 2 IgðB � AÞ: ð1Þ
That is, X" is the maximal set of the attributes that all the
objects in X have in common, and B; is the maximal set of
the objects shared by all the attributes in B.
Definition 2 ([1]) Let (U, A, I) be a formal context. The
ordered pair (X, B) with X � U and B � A is called a
formal concept of (U, A, I) if X" ¼ B and B; = X. Here,
the sets X and B are called the extent and the intent of the
formal concept (X, B), respectively.
For two formal concepts (X1, B1) and (X2, B2), if X1 �X2 (or B2 � B1), then (X1, B1) is called a subconcept of
(X2, B2), or (X2, B2) is called a superconcept of (X1, B1).
The subconcept–superconcept-relation between the formal
concepts is denoted by B. Then the set of all the formal
concepts of a formal context (U, A, I) together with the
partial order relation B forms a complete lattice which is
denoted by BðU;A; IÞ and is called the concept lattice of
the formal context (U, A, I). In BðU;A; IÞ; the infimum
and the supremum of {(X1, B1), (X2, B2)} are respectively
defined by
ðX1;B1Þ ^ ðX2;B2Þ ¼ ðX1 \ X2; ðB1 [ B2Þ#"Þ;ðX1;B1Þ _ ðX2;B2Þ ¼ ððX1 [ X2Þ"#;B1 \ B2Þ:
ð2Þ
In [26], the authors discussed the axiomatic charac-
terization of the concept lattice. It should be pointed out
that except Wille’s concept lattice, there have existed
several other kinds of concept lattices in the classical
FCA, e.g., the rough concept lattice [27], the object-
oriented concept lattice [28] and the property-oriented
concept lattice [29]. The relationship among Wille’s,
object-oriented and property-oriented concept lattices was
discussed in [5]. In this paper, we only focus on Wille’s
concept lattice to discuss the rule acquisition in decision
formal contexts.
Definition 3 ([22]) Let (U, A, I) be a formal context and
E � A: The restriction of I on U 9 E, denoted by IE, is
defined as IE(x, a) = I(x, a) for any (x, a) [ U 9 E. The
formal context (U, E, IE) is called a subcontext of
(U, A, I).
Similar to the formal context (U, A, I), a pair of concept
forming operators can also be defined on the subcontext
(U, E, IE) as follows:
X"E ¼ fa 2 E j 8x 2 X; ðx; aÞ 2 IEgðX � UÞ;B#E ¼ fx 2 U j 8a 2 B; ðx; aÞ 2 IEgðB � EÞ: ð3Þ
In fact, the operators "E and ;E are the restrictions of the
concept forming operators " and ; on the subcontext
(U, E, IE). Similar to the discussion in Definition 2, we can
give the notion of a formal concept with its extent and
722 Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
123
intent in (U, E, IE). Also, the set of all the formal concepts
of the subcontext (U, E, IE) together with the subconcept–
superconcept-relation B forms a complete lattice denoted
by BðU;E; IEÞ; in line with the notation of the concept
lattice of (U, A, I). We denote by BUðU;E; IEÞ the set of
the extents of all the formal concepts of (U, E, IE).
Proposition 1 ([1]) Let (U, A, I) be a formal context and
E � A: For X;X1;X2 � U and B;B1;B2 � E; the following
properties hold:
(i) X1 � X2 ) X"E
2 � X"E
1 ;
(ii) B1 � B2 ) B#E
2 � B#E
1 ;
(iii) X � X"E#E ;B � B#E"E ;
(iv) ðX"E#E ;X"EÞ; ðB#E ;B#E"EÞ 2 BðU;E; IEÞ:
It should be noted that ðfxg"E#E ; fxg"EÞðx 2 UÞ and
ðfag#E ; fag#E"EÞða 2 AÞ are referred to as the object con-
cepts and the attribute concepts [10], respectively. For
brevity, in the rest of the paper, we write them as
ðx"E#E ; x"EÞ and ða#E ; a#E"EÞ; respectively.
Proposition 2 ([1]) Let (U, A, I) be a formal context,
E � A and T be an index set. For Xt � U;Bt � E (t [ T),
we have
[
t2T
Xt
!"E
¼\
t2T
Xt"E and
[
t2T
Bt
!#E
¼\
t2T
Bt#E :
3 An efficient rule acquisition algorithm for decision
formal contexts
Definition 4 ([19]) A decision formal context is a quin-
tuple (U, A, I, D, J), where (U, A, I) and (U, D, J) with
A \ D ¼ ; are two formal contexts. Here, A and D are
called the conditional attribute set and the decision attri-
bute set of (U, A, I, D, J), respectively.
Like the formal context, a decision formal context
P ¼ ðU;A; I;D; JÞ is also said to be regular [24] if both
(U, A, I) and (U, D, J) are regular. The decision formal
context PE ¼ ðU;E; IE;D; JÞ is called a subcontext of P if
(U, E, IE) is a subcontext of (U, A, I). Without loss of
generality, the decision formal contexts discussed herein-
after are all assumed to be regular. The concept lattice of
(U, D, J) is denoted by BðU;D; JÞ and the set of the
extents of all the formal concepts of (U, D, J) is denoted by
BUðU;D; JÞ:
Definition 5 ([24]) Let P ¼ ðU;A; I;D; JÞ be a decision
formal context and E � A: For any ðX;BÞ 2 BðU;E; IEÞ
and ðY ;CÞ 2 BðU;D; JÞ; if X, B, Y and C are all nonempty
and X � Y ; then the expression B! C is called a decision
rule generated between the formal concepts (X, B) and
(Y, C). Here, B and C are called the premise and the con-
clusion of the decision rule B! C; respectively. The set of
all the decision rules generated between the formal con-
cepts in BðU;E; IEÞ and those in BðU;D; JÞ is denoted by
RðPEÞ; where PE ¼ ðU;E; IE;D; JÞ:
Thus, for any B! C 2 RðPEÞ with ðX;BÞ 2 B
ðU;E; IEÞ and ðY;CÞ 2 BðU;D; JÞ; we have that each x 2U having all the attributes in B also has all the attributes in
C. So, the decision rule is in fact an ‘‘If–then’’ conjunctive
rule. That is, B! C means ‘‘If ^B, then ^C’’. Moreover, it
is easy to verify that B! C is supported by and only by
the objects in X.
It should be pointed out that the decision rules have
something to do with both the attribute implication rules
and the association rules (see, e.g. [10, 11, 20] for the
detailed discussion of the attribute implication rules and
e.g. [16, 17] for the association rules). Concretely, a
decision rule is a special attribute implication rule. How-
ever, an attribute implication rule may not be a decision
rule since the premise or the conclusion of an attribute
implication rule is not required to be the intent of a formal
concept but an attribute set only. Also, a decision rule is a
special association rule. But an association rule may not be
a decision rule because the antecedent of an association
rule may not be the intent of a formal concept and the
confidence is often less than one.
Definition 6 ([24]) Let P ¼ ðU;A; I;D; JÞ be a decision
formal context and E � A: For B1 ! C1;B2 ! C2 2 R
ðPEÞ; if B1 � B2 and C2 � C1; we say that B2 ! C2 can be
implied by B1 ! C1: We denote this implication relation-
ship by B1 ! C1 ) B2 ! C2: For any B! C 2 RðPEÞ;if there exists B0 ! C0 2 RðPEÞnfB! Cg such that
B0 ! C0 ) B! C; then B! C is said to be redundant in
RðPEÞ; otherwise, B! C is said to be non-redundant in
RðPEÞ: We denote by R�ðPEÞ the set of all the non-
redundant decision rules in RðPEÞ:
It can be known from Definition 6 that for a given
decision formal context, it is more appealing to extract
the non-redundant decision rules since its redundant
decision rules can be implied by the non-redundant
ones.
Let P ¼ ðU;A; I;D; JÞ be a decision formal context. For
any ðX; YÞ 2 BUðU;A; IÞ �BUðU;D; JÞ; define
aðX; YÞ ¼1; if X � Y and there does not exist X0
2 BUðU;A; IÞ such that X � X0 � Y ;0; otherwise;
8<
:
ð4Þ
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731 723
123
bðX; YÞ ¼1; if X � Yand there does not exist Y0
2 BUðU;D; JÞ such that X � Y0 � Y ;0; otherwise.
8<
:
ð5Þ
In [24], the authors put forward a method to derive the
non-redundant decision rules from a decision formal
context. The method can briefly be described as follows:
It is easy to prove that the time complexity of Algorithm
1 is
O ðjUj þ jAjÞjAjjLAj þ jUjjLAj2jLDj þ jUjjLAjjLDj2� �
;
where |LA| and |LD| denote the cardinalities of the concept
lattices BðU;A; IÞ and BðU;D; JÞ; respectively.
In order to enhance the efficiency of the rule acquisition
method in decision formal contexts, we shall propose in the
following a new algorithm of deriving the non-redundant
decision rules which is of less time complexity than
Algorithm 1.
Definition 7 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context and E � A: For any B! C 2 RðPEÞ; if there
exists B0 ! C0 2 RðPEÞ such that B0 � B and C � C0;
we say that B! C is a feedforward redundant decision
rule in RðPEÞ; otherwise, we say that B! C is a feed-
forward non-redundant decision rule in RðPEÞ:
Definition 8 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context and E � A: For any B! C 2 RðPEÞ; if there
exists B0 ! C0 2 RðPEÞ such that B0 � B and C � C0;
we say that B! C is a feedback redundant decision rule in
RðPEÞ; otherwise, we say that B! C is a feedback non-
redundant decision rule in RðPEÞ:
Theorem 1 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context, E � A and B! C 2 RðPEÞ: Then the following
statements hold:
(i) B! C is redundant in RðPEÞ iff B! C is a
feedforward or feedback redundant decision rule in
RðPEÞ:(ii) B! C is non-redundant in RðPEÞ iff B! C is both
a feedforward and a feedback non-redundant deci-
sion rule in RðPEÞ:
Proof It is immediate from Definitions 6, 7 and 8. h
Theorem 2 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context and E � A: For ðX;BÞ 2 BðU;E; IEÞ with X 6¼ ;and B 6¼ ;; if C ¼
Tx2X x"D 6¼ ;; then B! C is a feed-
forward non-redundant decision rule in RðPEÞ; where "D
denotes the operator " on (U, D, J).
Proof Since the ordered pairs ðx"D#D ; x"DÞðx 2 XÞ are
object concepts of (U, D, J) where ;D denotes the operator
; on (U, D, J), the supremum of fðx"D#D ; x"DÞjx 2 Xg;denoted by (Y, C), satisfies
ðY;CÞ ¼W
x2X
ðx"D#D ; x"DÞ ¼S
x2X
x"D#D
� �"D#D
;T
x2X
x"D
!2 BðU;D; JÞ:
Then
X �[
x2X
x"D#D �[
x2X
x"D#D
!"D#D
¼ Y :
Thus, B! C 2 RðPEÞ according to the assumption.
Furthermore, we can prove that B! C is a feedforward
non-redundant decision rule in RðPEÞ: In fact, if B! C is a
feedforward redundant decision rule in RðPEÞ; there exists
B0 ! C0 2 RðPEÞ such that B0 � B and C � C0: Suppose
ðY0;C0Þ 2 BðU;D; JÞ: Then we obtain Y0 � Y: However,
Y ¼[
x2X
x"D#D
!"D#D
�[
x2Y0
x"D#D
!"D#D
¼ Y0;
which is in contradiction with Y0 � Y : h
Theorem 3 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context and E � A: For ðX;BÞ 2 BðU;E; IEÞ with X 6¼;;B 6¼ ; and C ¼
Tx2X x"D 6¼ ;; then B ? C is non-
redundant in RðPEÞ iff there does not exist ðX0;B0Þ 2BðU;E; IEÞ with X0 6¼ ; and B0 6¼ ; such that B0 ! C 2RðPEÞ and B0 , B.
Proof Necessity. If there exists ðX0;B0Þ 2 BðU;E; IEÞwith X0 6¼ ; and B0 6¼ ; such that B0 ! C 2 RðPEÞ and
B0 , B, it follows from Definition 8 that B ? C is a
feedback redundant decision rule in RðPEÞ: According to
Theorem 1, B ? C is redundant in RðPEÞ; which is in
contradiction with the assumption that B ? C is non-
redundant in RðPEÞ:
Sufficiency. If B ? C is redundant in RðPEÞ; by The-
orem 1 we have that B ? C is a feedforward or feedback
redundant decision rule in RðPEÞ:
(i) If B ? C is a feedforward redundant decision rule in
RðPEÞ; then there exists B0 ! C0 2 RðPEÞ such that
B0 � B and C , C0. Suppose ðY0;C0Þ 2 BðU;D; JÞand let Y ¼ C#D : Then we obtain Y0 , Y. However, it
follows from Propositions 1 and 2 that
724 Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
123
Y ¼ C#D ¼\
x2X
x"D
!#D
¼\
x2X
x"D#D"D
!#D
¼[
x2X
x"D#D
!"D#D
�[
x2Y0
x"D#D
!"D#D
¼ Y0;
which is in contradiction with Y0 � Y :(ii) If B! C is a feedback redundant decision rule in
RðPEÞ; there exists B0 ! C0 2 RðPEÞ such that
B0 � B and C � C0: Since C � C0 does not hold, we
obtain C = C0. Thus, B0 ! C 2 RðPEÞ and B0 � B;
which is in contradiction with the assumption. h
Definition 9 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context, E � A and X � RðPEÞ:B! C 2 X is called a
premise-minimal decision rule in X if B0 6� B for any
B0 ! C 2 X:
Definition 10 Let P ¼ ðU;A; I;D; JÞ be a decision for-
mal context and E � A: Define MðPEÞ ¼ fB! C jðX;BÞ 2 BðU;E; IEÞ;X 6¼ ;;B 6¼ ;;C ¼
Tx2X x"D 6¼ ;g and
denote by M�ðPEÞ the set of all the premise-minimal
decision rules in MðPEÞ:
Theorem 4 Let P ¼ ðU;A; I;D; JÞ be a decision formal
context and E � A: Then R�ðPEÞ ¼ M�ðPEÞ:
Proof On one hand, for any B! C 2 M�ðPEÞ; we have
by Definitions 9 and 10 that B! C 2 RðPEÞ and B0 6� B
for any B0 ! C 2 MðPEÞ: It can be known from Theorem
2 that B ? C is a feedforward non-redundant decision rule
in RðPEÞ: If B ? C is a feedback redundant decision rule
in RðPEÞ; there exists B0 ! C0 2 RðPEÞ such that B0 ,
B and C � C0: Since C , C0 is not true, we obtain C = C0.
Thus, B0 ! C 2 MðPEÞ and B0 , B, which is in contra-
diction with B0 6� B for any B0 ! C 2 MðPEÞ: As a result,
B ? C is a feedback non-redundant decision rule in
RðPEÞ: By Theorem 1, B! C 2 R�ðPEÞ is at hand.
On the other hand, for any B! C 2 R�ðPEÞ; there
exist X 2 BUðU;E; IEÞ and Y 2 BUðU;D; JÞ such that
ðX;BÞ 2 BðU;E; IEÞ and ðY;CÞ 2 BðU;D; JÞ: Noting that
[
x2X
x"D#D
!"D#D
;\
x2X
x"D
0@
1A 2 BðU;D; JÞ
and
X �[
x2X
x"D#D
!"D#D
�[
x2Y
x"D#D
!"D#D
¼ Y;
we obtain B!T
x2X x"D 2 RðPEÞ and C �T
x2X x"D :
Then, we can conclude C ¼T
x2X x"D since B! C is a
feedforward non-redundant decision rule in RðPEÞ: By
Definition 10, B! C 2 MðPEÞ follows. Furthermore, we
can prove B! C 2 M�ðPEÞ: In fact, if there exists B0 !C 2 MðPEÞ such that B0 � B; then by Definition 8 B! C
is a feedback redundant decision rule in RðPEÞ; which is in
contradiction with B! C 2 R�ðPEÞ: Thus, based on
Definition 9, we obtain that B! C is a premise-minimal
decision rule in MðPEÞ; i.e. B! C 2 M�ðPEÞ:By Theorem 4, we can obtain all the non-redundant
decision rules from a decision formal context P ¼ðU;A; I;D; JÞ via M�ðPÞ: By Definitions 9 and 10, it is
natural to first compute MðPÞ and then obtain M�ðPÞ:However, here we directly compute M�ðPÞ with-
out generating MðPÞ in advance in order to reduce
the computational complexity, which is described as
follows:
It is easy to prove that the time complexity of Algorithm 2 is
O ðjUj þ jAjÞjAjjLAj þ jDjjLAj2� �
;
where |LA| denotes the cardinality of BðU;A; IÞ: Note that
|U||LD| � |D| generally holds for a given decision formal
context. So, Algorithm 2 is of less time complexity than
Algorithm 1. We have the following example to illustrate
Algorithm 2. h
Example 1 Table 1 shows a decision formal context P ¼ðU;A; I;D; JÞ; where U = {1, 2, 3, 4, 5}, A = {a, b, c,
d, e, f} and D = {d1, d2, d3}. In the table, the number 1 in
the ith row and jth column represents that the object in the
ith row has the attribute in the jth column, and the number
0 in the ith row and jth column means the opposite. Fig-
ure 1 depicts the Hasse diagram of the concept lattice of
the formal context (U, A, I). By Theorem 2, all the feed-
forward non-redundant decision rules generated by the
formal concepts of (U, A, I) are as follows:
r1: a! d1; which is generated by ({1, 3, 5}, {a}) due to
1"D \ 3"D \ 5"D ¼ fd1g and is supported by objects 1,
3, 5;
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731 725
123
r2: ac! d1d2; which is generated by ({3, 5}, {a, c})
due to 3"D \ 5"D ¼ fd1; d2g and is supported by
objects 3, 5;
r3: acf ! d1d2; which is generated by ({3}, {a, c, f})
due to 3"D ¼ fd1; d2g and is supported by object 3;
r4: b! d2; which is generated by ({2, 4, 5}, {b}) due to
2"D \ 4"D \ 5"D ¼ fd2g and is supported by objects 2,
4, 5;
r5: be! d1d2; which is generated by ({4, 5}, {b, e})
due to 4"D \ 5"D ¼ fd1; d2g and is supported by
objects 4, 5;
r6: abce! d1d2; which is generated by ({5}, {a, b,
c, e}) due to 5"D ¼ fd1; d2g and is supported by
object 5;
r7: bd ! d2d3; which is generated by ({2}, {b, d}) due
to 2"D ¼ fd2; d3g and is supported by object 2.
Thus, by applying Algorithm 2 to the decision formal
context P; the rules r1, r2, r4, r5 and r7 are added into M
one by one. That is, P has five non-redundant decision
rules: r1, r2, r4, r5 and r7.
4 Decision rules and granular rules in the consistent
decision formal contexts
In Sect. 3, we have proposed an efficient algorithm to
extract all the non-redundant decision rules from a decision
formal context. Since the decision rules and the granular
rules are two useful ways of discovering knowledge from a
decision formal context, it is of interest to investigate the
relationship between the non-redundant decision rules and
the granular rules. Furthermore, considering that knowl-
edge reduction is one of the key issues in FCA, it is also
essential to clarify the relation and the difference between
the decision rule oriented knowledge reduction [24] and the
granular rule oriented knowledge reduction [22].
4.1 The relationship between the non-redundant
decision rules and the granular rules
Definition 11 ([22]) Let P ¼ ðU;A; I;D; JÞ be a decision
formal context. If x"# � x"D#D for any x 2 U; then P is said
to be consistent; otherwise, P is said to be inconsistent.
In FCA, there are several other kinds of consistent
decision formal contexts (e.g., those in [25, 30–32]) except
the one introduced above. However, for our purpose, we
here only focus on the kind of consistent decision formal
contexts in [22]. That is to say, the consistent decision
formal contexts discussed in the following represents the
ones whose consistency is defined by Definition 11.
Proposition 3 Let P ¼ ðU;A; I;D; JÞ be a decision for-
mal context. Then P is consistent iff x" ! x"D 2 RðPÞ for
any x 2 U:
Proof Necessity. Since P is consistent, it follows from
Definition 11 that x"# � x"D#D for any x 2 U: Noting that
ðx"#; x"Þ 2 BðU;A; IÞ; ðx"D#D ; x"DÞ 2 BðU;D; JÞ and P is
regular, we know that x"#; x"; x"D#D and x"D are all non-
empty, which leads to x" ! x"D 2 RðPÞ:
Sufficiency. It is immediate from Definitions 5 and 11. h
Definition 12 ([22]) Let P ¼ ðU;A; I;D; JÞ be a consis-
tent decision formal context. For any x 2 U; x" ! x"D is
called a granular rule of P:
It can be known from Definition 12 that a granular rule
is a special decision rule. However, a decision rule may not
be a granular rule because the premise or the conclusion of
a decision rule is not required to be the intent of an object
concept but that of a formal concept only.
Let P ¼ ðU;A; I;D; JÞ be a consistent decision formal
context. For any nonempty set X 2 BUðU;A; IÞ withTx2X x" 6¼ ; and
Tx2X x"D 6¼ ;; the mergence of the gran-
ular rules x" ! x"Dðx 2 XÞ is defined as
(U,∅)
({1,3,5},{a})
({3,5},{a,c})
({3},{a,c,f})
({2,4,5},{b})
({2},{b,d})
({4,5},{b,e})
({5},{a,b,c,e})
(∅,A)
Fig. 1 Hasse diagram of the concept lattice of (U, A, I)
Table 1 A decision formal context P ¼ ðU;A; I;D; JÞ
U a b c d e f d1 d2 d3
1 1 0 0 0 0 0 1 0 0
2 0 1 0 1 0 0 0 1 1
3 1 0 1 0 0 1 1 1 0
4 0 1 0 0 1 0 1 1 0
5 1 1 1 0 1 0 1 1 0
726 Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
123
^
x2X
x" ! x"D� �
¼\
x2X
x" !\
x2X
x"D : ð6Þ
It is easy to verify that the mergence of x" ! x"D (x 2 X) is
also a decision rule.
Theorem 5 Let P ¼ ðU;A; I;D; JÞ be a consistent
decision formal context and B! C 2 RðPÞ: Then the
decision rule B! C is non-redundant in RðPÞ iff B!C ¼
Vx2B# x" ! x"D
� �and ðx0" \ BÞ# 6� C#D for any
x0 2 C#DnB#:
Proof Since B! C 2 RðPÞ; there exist X 2 BUðU;A; I)
and Y 2 BUðU;D; JÞ such that ðX;BÞ 2 BðU;A; IÞ and
ðY;CÞ 2 BðU;D; JÞ:
If B ? C is non-redundant in RðPÞ; it follows from
Theorem 1 that B ? C is both a feedforward and a feed-
back non-redundant decision rule in RðPÞ: So, B!Tx2X x"D 2 RðPÞ; which leads to C ¼
Tx2X x"D because
B!T
x2X x"D can imply B ? C. Furthermore, noting that
ðX;BÞ ¼_
x2X
ðx"#; x"Þ ¼[
x2X
x"#
!"#;\
x2X
x"
0
@
1
A;
we have B!C¼V
x2B# x"!x"D
� �: To prove ðx0"\BÞ# 6�
C#D for any x0 2 C#DnB#; it is sufficient to show ðx0"\BÞ# 6� Y for any x0 2 YnX: If there exists x0 2 YnX such
that ðx0" \ BÞ# � Y ; then ðx0
" \ BÞ# ¼ ðx0" \ X"Þ# ¼
ðfx0g [ XÞ"# � Y yielding ðfx0g [ XÞ" 6¼ ;: Since ððfx0g[XÞ"#; ðfx0g [ XÞ"Þ 2 BðU;A; IÞ; we obtain ðfx0g[XÞ"!C 2 RðPÞ; i.e. x0
" \ B! C 2 RðPÞ: Since B! C is a
feedback non-redundant decision rule in RðPÞ; we con-
clude x0: \ B = B, which is in contradiction with
x0 2 YnX:If B! C ¼
Vx2B# x" ! x"D
� �and ðx0" \ BÞ# 6� C#D for
any x0 2 C#DnB#; then by Theorem 2, B! C is a feed-
forward non-redundant decision rule in RðPÞ: Thus, to
prove that B! C is non-redundant in RðPÞ; it is sufficient
to show that B! C is a feedback non-redundant decision
rule in RðPÞ: In fact, if B! C is a feedback redundant
decision rule in RðPÞ; there exists B0 ! C0 2 RðPÞ such
that B0 � B and C � C0: Suppose ðX0;B0Þ 2 BðU;A; IÞand ðY0;C0Þ 2 BðU;D; JÞ: Then X � X0 � Y0 � Y:
Therefore, there exists x 2 X0nX such that ðx" \ BÞ# ¼ðfxg [ XÞ"# � X
"#0 ¼ X0 � Y ¼ C#D ; which is in contra-
diction with ðx0" \ BÞ# 6� C#D for any x0 2 C#DnB#:Theorem 5 clarifies the relationship between the non-
redundant decision rules and the granular rules in a con-
sistent decision formal context. h
4.2 A comparison of the decision rule oriented
knowledge reduction and the granular rule oriented
knowledge reduction
In general, both the decision rules and the granular rules
derived directly from a consistent decision formal context
are not concise or compact. In order to derive more com-
pact decision rules and/or granular rules, the issue of rule
acquisition oriented knowledge reduction was discussed in
[22, 24]. Since knowledge reduction is one of the important
issues in FCA, it is of interest to clarify the relation and the
difference between the decision rule oriented knowledge
reduction and the granular rule oriented knowledge
reduction. This issue will be discussed in the following.
Definition 13 ([24]) Let P ¼ ðU;A; I;D; JÞ be a decision
formal context and E � A: For X � RðPÞ and
X0 � RðPEÞ; if each decision rule of X can be implied by a
decision rule of X0; we say that X can be implied by X0: We
denote this implication relationship by X0 ) X:
Definition 14 ([24]) Let P ¼ ðU;A; I;D; JÞ be a decision
formal context. E � A is called a consistent set of P if
RðPEÞ ) RðPÞ: Furthermore, if E is a consistent set of Pand any F � E is not a consistent set of P; then E is called
a reduct of P:
It can easily be observed from Definitions 13 and 14 that
this kind of knowledge reduction can preserve the decision
rule information of a decision formal context and allows us
to obtain more compact decision rules from a decision
formal context.
Proposition 4 Let P ¼ ðU;A; I;D; JÞ be a decision
formal context. Then E � A is a consistent set of P iff
R�ðPEÞ ) R�ðPÞ:
Proof Necessity. Since E � A is a consistent set of P; it
follows from Definition 14 that RðPEÞ ) RðPÞ:According to Definition 13, it is easy to prove
R�ðPEÞ ) RðPEÞ and RðPÞ ) R�ðPÞ: As a result,
R�ðPEÞ ) RðPEÞ ) RðPÞ ) R�ðPÞ:
Sufficiency. Based on Definition 13, it is also easy to
prove RðPEÞ ) R�ðPEÞ and R�ðPÞ ) RðPÞ: Thus,
according to the assumption R�ðPEÞ ) R�ðPÞ; we can
obtain RðPEÞ ) R�ðPEÞ ) R�ðPÞ ) RðPÞ: By Defi-
nition 14, E is a consistent set of P: h
Definition 15 ([22]) Let P ¼ ðU;A; I;D; JÞ be a consis-
tent decision formal context. E � A is called a granular
consistent set of P if x"E#E � x"D#D for any x 2 U: Fur-
thermore, if E is a granular consistent set of P and any
F � E is not a granular consistent set of P; then E is called
a granular reduct of P:
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731 727
123
Proposition 5 Let P ¼ ðU;A; I;D; JÞ be a consistent
decision formal context. Then E � A is a granular con-
sistent set of P iff x"E ! x"D 2 RðPEÞ for any x 2 U:
Proof Necessity. If E � A is a granular consistent set of
P; then by Definition 15, x"E#E � x"D#D holds for any x 2U: Since P is regular, we have x"D 6¼ ;: Furthermore, we
can prove x"E 6¼ ;: In fact, if x"E ¼ ;; then x"E#E ¼ U:
Thus, x"D#D ¼ U yielding x"D ¼ ;; which is in contradiction
with x"D 6¼ ;: Consequently, x"E ! x"D 2 RðPEÞ:
Sufficiency. It is immediate from Definitions 5 and 15.
Let P ¼ ðU;A; I;D; JÞ be a consistent decision formal
context and E � A be a granular consistent set of P: We
denote by R#ðPEÞ the set of all the granular rules of the
subcontext PE ¼ ðU;E; IE;D; JÞ: h
Theorem 6 Let P ¼ ðU;A; I;D; JÞ be a consistent
decision formal context. If E � A is a granular consistent
set of P; then R#ðPEÞ ) R#ðPÞ:
Proof It is immediate from Definition 13 and Proposi-
tions 3 and 5.
It can easily be seen from Definition 15 and Theorem 6
that the granular rule oriented knowledge reduction can
preserve the granular rule information of a consistent
decision formal context and allows us to derive more
compact granular rules from a consistent decision formal
context.
The following theorem illustrates the relation between
the decision rule oriented knowledge reduction and the
granular rule oriented knowledge reduction. h
Theorem 7 Let P ¼ ðU;A; I;D; JÞ be a consistent
decision formal context. If E � A is a consistent set of P;then E is a granular consistent set of P:
Proof Since P is consistent, it follows from Definition 11
that x"# � x"D#D for any x 2 U: Noting that ðx"#; x"Þ 2BðU;A; IÞ; ðx"D#D ; x"DÞ 2 BðU;D; JÞ and P is regular, we
know that x"#; x"; x"D#D and x"D are all nonempty, which leads
to x" ! x"D 2 RðPÞ: If E � A is a consistent set of P; then
there exists B! C 2 RðPEÞ such that B � x" and x"D � C:
Since there exist X 2 BUðU;E; IEÞ and Y 2 BUðU;D; JÞsuch that ðX;BÞ 2 BðU;E; IEÞ and ðY ;CÞ 2 BðU;D; JÞ;we
have by Proposition 1 that
B � x" ) x 2 B#E
) x"# � X
) X"E � x"#"E
) B � x"E
) x"E#E � B#E ¼ X
and x"D�C)C#D�x"D#D)Y�x"D#D : Therefore, x"E#E�X�Y�x"D#D : By Definition 15, we conclude that E is a
granular consistent set of P:
It can be known from Theorem 7 that the decision rule
oriented knowledge reduction of a consistent decision
formal context can preserve the granular rule information.
However, the granular rule oriented knowledge reduction
may not preserve the decision rule information. That is to
say, it may happen that a granular consistent set is not a
consistent set. In what follows, we use a counterexample to
confirm this assertion. h
Example 2 Let P ¼ ðU;A; I;D; JÞ be the decision formal
context in Example 1. Then the following statements hold:
1"# ¼ f1; 3; 5g � f1; 3; 4; 5g ¼ 1"D#D ;
2"# ¼ f2g ¼ 2"D#D ;
3"# ¼ f3g � f3; 4; 5g ¼ 3"D#D ;
4"# ¼ f4; 5g � f3; 4; 5g ¼ 4"D#D ;
5"# ¼ f5g � f3; 4; 5g ¼ 5"D#D :
Thus, it follows from Definition 11 that the decision formal
context P is consistent. According to the results in
Example 1 and the discussion in Sect. 4.1, we obtain the
following seven feedforward non-redundant decision rules
via the mergence of granular rules:
r1: a! d1; which is generated by the extent {1, 3, 5}
due to 1: \ 3: \ 5: = {a} and 1"D \ 3"D \ 5"D ¼fd1g; is supported by objects 1, 3, 5;
r2: ac! d1d2; which is generated by the extent {3,5}
due to 3: \ 5: = {a,c} and 3"D \ 5"D ¼ fd1; d2g; is
supported by objects 3, 5;
r3: acf ! d1d2; which is generated by the extent {3} due
to 3" ¼ fa; c; fg and 3"D ¼ fd1; d2g; is supported by
object 3;
r4: b! d2; which is generated by the extent {2, 4, 5}
due to 2" \ 4" \ 5" ¼ fbg and 2"D \ 4"D \ 5"D ¼fd2g; is supported by objects 2, 4, 5;
r5: be! d1d2; which is generated by the extent {4,5}
due to 4" \ 5" ¼ fb; eg and 4"D \ 5"D ¼ fd1; d2g; is
supported by objects 4, 5;
r6: abce! d1d2; which is generated by the extent {5}
due to 5: = {a, b, c, e} and 5"D ¼ fd1; d2g; is
supported by object 5;
r7: bd ! d2d3; which is generated by the extent {2} due
to 2: = {b,d} and 2"D ¼ fd2; d3g; is supported by
object 2.
For r3 : acf ! d1d2; there is 5 2 fd1; d2g#Dnfa; c; fg#such that
728 Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
123
ð5" \ fa; c; fgÞ# ¼ f3; 5g � f3; 4; 5g ¼ fd1; d2g#D ;
for r6 : abce! d1d2; there is 4 2 fd1; d2g#Dnfa; b; c; eg#
such that ð4"\fa;b;c;egÞ#¼f4;5g�f3;4;5g¼fd1;d2g#D :
Thus, by Theorem 5, we know that the rules r3 and r6 are
redundant in RðPÞ: Similarly, it can be verified that
r1, r2, r4, r5 and r7 are all non-redundant in RðPÞ:Let E = {a, d, e, f}. Then we can obtain a subcontext
PE ¼ ðU;E; IE;D; JÞ which satisfies
1"E#E ¼ f1; 3; 5g � f1; 3; 4; 5g ¼ 1"D#D ;
2"E#E ¼ f2g ¼ 2"D#D ;
3"E#E ¼ f3g � f3; 4; 5g ¼ 3"D#D ;
4"E#E ¼ f4; 5g � f3; 4; 5g ¼ 4"D#D ; and
5"E#E ¼ f5g � f3; 4; 5g ¼ 5"D#D :
Thus, E is a granular consistent set of P: Figure 2 depicts
the Hasse diagram of the concept lattice of the formal
context (U, E, IE). According to Theorem 5, the non-
redundant decision rules derived from PE are as follows:
r01 : a! d1;
r02 : af ! d1d2;
r03 : e! d1d2;
r04 : d ! d2d3:
It is easy to check that the rules r2 and r4 derived from Pcannot be implied by the non-redundant decision rules
derived from the subcontext PE: By Proposition 4, E is not
a consistent set of P although it is a granular consistent set
of P: That is to say, to remove the attributes b and c from
the decision formal context P will lose the decision rule
information although it can preserve the granular rule
information.
Example 2 illustrates the difference between the deci-
sion rule oriented knowledge reduction and the granular
rule oriented knowledge reduction. Furthermore, by com-
bining the difference with the relation between these two
kinds of knowledge reduction, we understand that the
decision rule oriented knowledge reduction can preserve
more decision rule information than the granular rule ori-
ented knowledge reduction.
5 Experiments
In this section, we conduct some experiments to compare the
proposed algorithm with the existing one in [24] in terms of
the efficiency of extracting the non-redundant decision rules
from a decision formal context. In the experiments, five real-
life databases including Bacteria [33], Zoo [34], Balance
Scale [34], Wine [34], and Car Evaluation [34] are analyzed
to achieve the task of comparing the efficiency. The detailed
information on the five real-life databases is shown in
Table 2. For each of the chosen databases, we took the
classification attribute as the decision attribute and the other
attributes (variables) as the conditional attributes. Then,
using the scaling approach [10] to convert the discrete (but
not Boolean) attributes of Bacteria, Zoo and Balance Scale
into Boolean ones, we obtained three decision formal con-
texts which are denoted by Date sets 1, 2 and 3, respectively.
In the Wine database, there are 178 instances (each of them
denotes a wine) characterized by 13 variables (each of them
denotes a constituent found in each of the wines) whose
values are all continuous. Here, we classified, from small to
large, the values of each variable into three pairwise disjoint
intervals with their length being the same. For example, for
the seventh variable (Flavanoids in the Wine database),
since its minimum value is 0.34 and its maximum value is
5.08, we obtained three pairwise disjoint intervals: [0.34,
1.92), [1.92, 3.50), [3.50, 5.08] according to the above
classification approach. Then, by using the scaling approach,
a decision formal context was obtained and is denoted by
Data set 4. In the Car Evaluation database, its 1728 instances
Table 2 The main characters of the five chosen real-life databases
Database Instances Classes Input attributes excluding the
classification attribute
Boolean Discrete
but not
Boolean
Continuous
Bacteria 17 6 16 0 0
Zoo 101 7 15 1 0
Balance
Scale
625 3 0 4 0
Wine 178 3 0 0 13
Car
Evaluation
1,728 4 0 6 0
(U,∅)
({1,3,5},{a})
({3},{a,f})
({4,5},{e})
({5},{a,e})
({2},{d})
(∅,E)
Fig. 2 Hasse diagram of the concept lattice of (U, E, IE)
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731 729
123
are characterized by six attributes which are Buying price,
Price of the maintenance, Number of doors, Capacity in
terms of persons to carry, The size of luggage boot, Estimated
safety of the car. For our purpose, the values of the third
attribute are divided into two hierarchies: I (2 or 3) and II (4
or 5). Similarly, using the scaling approach, we obtained
another decision formal context denoted by Data set 5.
Then Algorithms 1 and 2 were applied to Data sets 1, 2,
3, 4 and 5. The corresponding running time is reported in
Table 3, in which |U|, |A| and |D| denote the cardinalities of
the object set, the conditional attribute set and the decision
attribute set of the concerned decision formal context,
respectively, and NR is the abbreviation of the term ‘non-
redundant’. It can be seen from Table 3 that by the running
time of extracting the non-redundant decision rules,
Algorithm 2 is much more efficient than Algorithm 1 for
each of the chosen data sets.
6 Conclusion
Rule acquisition is one of the main purposes in the analysis
of decision formal contexts. In this paper, we have pro-
posed a new algorithm of deriving the non-redundant
decision rules from a decision formal context, proved that
the proposed rule acquisition algorithm is of less time
complexity than the existing one in [24], and conducted
some experiments to compare their efficiency. Further-
more, the relationship between the non-redundant decision
rules and the granular rules has been investigated in the
consistent decision formal contexts. Also, the relation and
the difference between the decision rule oriented knowl-
edge reduction and the granular rule oriented knowledge
reduction have been clarified.
From the point of view of applications, the results
obtained in this paper need to be further extended to the
case of fuzzy decision formal contexts [35], incomplete
decision formal contexts [36] or even real decision formal
contexts [37–39] since in the real world the relationship
between some objects and attributes of a decision formal
context may be fuzzy-valued, interval-valued or even real-
valued. This issue will be discussed in our future work.
Acknowledgments The authors would like to thank the anonymous
reviewers for their valuable comments and helpful suggestions which
lead to a significant improvement on the manuscript. This work was
supported by the National Natural Science Foundation of China (Nos.
10971161, 61005042, 11071281 and 61202018).
References
1. Wille R (1982) Restructuring lattice theory: an approach based on
hierarchies of concepts. In: Rival I (ed) Ordered sets. Reidel,
Dordrecht, pp 445–470
2. Zhang WX, Wei L, Qi JJ (2005) Attribute reduction theory and
approach to concept lattice. Sci China Ser F 48(6):713–726
3. Liu M, Shao MW, Zhang WX, Wu C (2007) Reduction method
for concept lattices based on rough set theory and its applications.
Comput Math Appl 53(9):1390–1410
4. Wang X, Zhang WX (2008) Relations of attribute reduction
between object and property oriented concept lattices. Knowl
Based Syst 21:398–403
5. Medina J (2012) Relating attribute reduction in formal, object-
oriented and property-oriented concept lattices. Comput Math
Appl 64(6):1992–2002
6. Li TJ, Wu WZ (2011) Attribute reduction in formal contexts: a
covering rough set approach. Fund Inform 111:15–32
7. Mi JS, Leung Y, Wu WZ (2010) Approaches to attribute reduc-
tion in concept lattices induced by axialities. Knowl Based Syst
23(6):504–511
8. Wei L, Qi JJ (2010) Relation between concept lattice reduction
and rough set reduction. Knowl Based Syst 23(8):934–938
9. Cherukuri AK, Srinivas S (2010) Concept lattice reduction using
fuzzy K-means clustering. Expert Syst Appl 37(3):2696–2704
10. Ganter B, Wille R (1999) Formal concept analysis: mathematical
foundations. Springer, New York
11. Guigues JL, Duquenne V (1986) Famille minimales d’implica-
tions informatives resultant d’un tableau de donnees binaries.
Math Sci Hum 95:5–18
12. Luxenburger M (1991) Implications partielles dans un contexte.
Math Sci Hum 113:35–55
13. Dodin R, Missaoui R (1994) An incremental concept formation
approach for learning from databases. Theor Comput Sci 133:
387–419
14. Valtchev P, Missaoui R, Godin R (2004) Formal concept analysis
for knowledge discovery and data mining: the new challenge. In:
Proceedings of the 2004 international conference on formal
concept analysis, Sydney, Australia, pp 352–371
15. Qu KS, Zhai YH (2008) Generating complete set of implications
for formal contexts. Knowl Based Syst 21:429–433
16. Pasquier N, Bastide Y, Taouil R et al (1999) Efficient mining of
association rules using closed itemset lattices. Inform Sci 24(1):
25–46
17. Zaki MJ (2004) Mining non-redundant association rules. Data
Min Knowl Disc 9:223–248
18. Cherukuri AK (2012) Fuzzy clustering based formal concept
analysis for association rules mining. Appl Artif Intell 26(3):
274–301
19. Zhang WX, Qiu GF (2005) Uncertain decision making based on
rough sets. Tsinghua University Press, Beijing
Table 3 A contrast between Algorithm 1 and Algorithm 2 in terms of
the running time
Data
set
|U| |A| |D| Number of
NR-rules
Running time (s)
Algorithm 1 Algorithm 2
Data
set 1
17 16 6 6 0.036 0.018
Data
set 2
101 21 7 9 0.799 0.428
Data
set 3
625 20 3 303 109.347 78.011
Data
set 4
178 39 3 256 2,826.048 680.908
Data
set 5
1,728 19 4 141 4,121.354 2,810.434
730 Int. J. Mach. Learn. & Cyber. (2013) 4:721–731
123
20. Qu KS, Zhai YH, Liang JY et al (2007) Study of decision
implications based on formal concept analysis. Int J Gen Syst
36(2):147–156
21. Shao MW (2007) Knowledge acquisition in decision formal
contexts. In: Proceedings of the sixth international conference on
machine learning and cybernetics, Hong Kong, pp 4050–4054
22. Wu WZ, Leung Y, Mi JS (2009) Granular computing and
knowledge reduction in formal contexts. IEEE Trans Knowl Data
Eng 21(10):1461–1474
23. Li J, Mei C, Lv Y (2011) A heuristic knowledge-reduction
method for decision formal contexts. Comput Math Appl
61(4):1096–1106
24. Li J, Mei C, Lv Y (2011) Knowledge reduction in decision formal
contexts. Knowl Based Syst 24(5):709–715
25. Li J, Mei C, Lv Y (2012) Knowledge reduction in formal decision
contexts based on an order-preserving mapping. Int J Gen Syst
41(2):143–161
26. Song XX, Wang X, Zhang WX (2012) Independence of axiom
sets characterizing formal concepts. Int J Mach Learn Cybern.
doi:10.1007/s13042-012-0110-z
27. Kent RE (1994) Rough concept analysis. In: Ziarko WP (ed)
Rough sets, Fuzzy sets and knowledge discovery. Springer,
London, pp 248–255
28. Yao YY (2004) Concept lattices in rough set theory. In: Pro-
ceedings of 2004 annual meeting of the north American fuzzy
information processing society, Banff, Canada, pp 796–801
29. Duntsch I, Gediga G (2003) Approximation operators in quali-
tative data analysis. In: Swart H et al (eds) Theory and applications
of relational structures as knowledge instruments, Lecture Notes in
Computer Science, vol 2929. Springer, Berlin, pp 214–230
30. Wei L, Qi JJ, Zhang WX (2008) Attribute reduction theory of
concept lattice based on decision formal contexts. Sci China Ser F
51(7):910–923
31. Pei D, Mi JS (2011) Attribute reduction in decision formal con-
text based on homomorphism. Int J Mach Learn Cyber
2(4):289–293
32. Wang H, Zhang WX (2008) Approaches to knowledge reduction
in generalized consistent decision formal contexts. Math Comput
Model 48:1677–1684
33. Fielding AH (2007) Clustering and classification techniques for
the biosciences. Cambridge University Press, London
34. Frank A, Asuncion A (2010) UCI machine learning repository
[http://archive.ics.uci.edu/ml]. Irvine, CA: University of California,
School of Information and Computer Science
35. Pei D, Li MZ, Mi JS (2011) Attribute reduction in fuzzy decision
formal contexts. In: International conference on machine learning
and cybernetics. IEEE Press, New York, pp 204–208
36. Li J, Mei C, Lv Y (2013) Incomplete decision contexts:
approximate concept construction, rule acquisition and knowl-
edge reduction. Int J Approx Reason 54(1):149–165
37. Li J, Mei C, Lv Y (2012) Knowledge reduction in real decision
formal contexts. Inform Sci 189:191–207
38. Li J, Mei C, Lv Y, Zhang X (2012c) A heuristic knowledge
reduction algorithm for real decision formal contexts. In: Yao JT
et al (eds) Proceedings of RSCTC, Lecture Notes in Artificial
Intelligence, vol 7413. Springer, Berlin, pp 303–312
39. Yang HZ, Leung Y, Shao MW (2011) Rule acquisition and
attribute reduction in real decision formal contexts. Soft Comput
15(6):1115–1128
Int. J. Mach. Learn. & Cyber. (2013) 4:721–731 731
123