Acessibilidade / Reportar erro

Generalized Exponential Bidirectional Fuzzy Associative Memory with Fuzzy Cardinality-Based Similarity Measures Applied to Face Recognition

ABSTRACT

Associative memories are biologically inspired models designed for the storage and recall by association. Such models aim to store a finite set of associations, called the fundamental memory set. The generalized exponential bidirectional fuzzy associative memory (GEB-FAM) is a heteroassociative memory model designed for the storage and recall of fuzzy sets. A similarity measure, that is, a function that indicates how much two fuzzy sets are equal, is at the core of a GEB-FAM model. In this paper, we present a detailed study on the use of cardinality-based similarity measures in the definition of a GEB-FAM. Moreover, we evaluate the performance of the GEB-FAMs defined using such measures in a face recognition problem.

Keywords:
Associative memory; fuzzy set theory; similarity measure; face recognition

RESUMO

Memórias associativas são modelos biologicamente inspirados projetados para o armazenamento e recordação por associação. Tais modelos visam o armazenamento de um conjunto finito de associações, chamado conjunto das memórias fundamentais. A memória associativa bidirecional exponencial fuzzy generalizada (GEB-FAM) é um modelo de memória heteroassociativa para armazenamento e recordação de conjuntos fuzzy. Uma medida de similaridade, isto é, uma função que indica o grau de igualdade entre dois conjuntos fuzzy, está no centro de um modelo GEB-FAM. Neste trabalho, apresentamos um estudo detalhado sobre o uso de medidades de similaridade definidas com base na cardinalidade na definição de uma GEB-FAM. Sobretudo, avaliamos o desempenho das GEB-FAMs usando tais medidas de similaridade em um problema de reconhecimento de faces.

Palavras-chave:
Memória associativa; teoria dos conjuntos fuzzy; medida de similaridade; reconhecimento de face

1 INTRODUCTION

Associative memories are biologically inspired models aimed at storing and recalling information by association 1818. T. Kohonen. “Self-organization and associative memory”. Springer-Verlag New York, Inc., New York, NY, USA, 2rd edition edition (1987).), (1111. M.H. Hassoun & P.B. Watta. Associative Memory Networks. In E. Fiesler & R. Beale (editors), “Handbook of Neural Computation”. Oxford University Press (1997), pp. C1.3:1-C1.3:14.), (1313. R. Hecht-Nielsen. “Neurocomputing”. Addison-Wesley, Reading, MA (1989). ls are designed for the storage of a finite set of association pairs {(a 1; b 1); : : : ; (a p ; b p )}, called the fundamental memory set. Each association pair (a ξ , b ξ ) is a fundamental memory. Given an input pattern a ξ , the memory is expected to produce b ξ , or a sufficiently close pattern, as output. Also, the memory should be tolerant to noise and be able to retrieve an stored item b ξ even from a corrupted version ã ξ of an original item a ξ . We speak of an autoassociative memory if a ξ = b ξ , for all ξ = 1, …, p. In this case, the fundamental memory set can be written as {a 1, ..., a p }. If there is one ξ ∈ {1, …, p} such that a ξb ξ , the memory is said heteroassociative.

The Hopfield neural network, proposed by J. Hopfield in 1982, is a widely known neural network model able to implement an autoassociative memory for the storage of binary or bipolar vectors 1111. M.H. Hassoun & P.B. Watta. Associative Memory Networks. In E. Fiesler & R. Beale (editors), “Handbook of Neural Computation”. Oxford University Press (1997), pp. C1.3:1-C1.3:14.), (1313. R. Hecht-Nielsen. “Neurocomputing”. Addison-Wesley, Reading, MA (1989).), (1515. J.J. Hopfield. Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy of Sciences, 79 (1982), 2554-2558.. Despite its various applications 1414. J. Hopfield & D. Tank. Neural computation of decisions in optimization problems. Biological Cybernetics, 52 (1985), 141-152.), (2626. K. Smith, M. Palaniswami & M. Krishnamoorthy. Neural Techniques for Combinatorial Optimization with Applications. IEEE Transactions on Neural Networks, 9(6) (1998), 1301-1318.), (2525. G. Serpen. Hopfield Network as Static Optimizer: Learning the Weights and Eliminating the Guesswork. Neural Processing Letters, 27(1) (2008), 1-15. doi: 10.1007/s11063-007-9055-8.
https://doi.org/10.1007/s11063-007-9055-...
, the Hopfield neural network suffers from a low absolute storage capacity 2323. R.J. McEliece, E.C. Posner, E.R. Rodemich & S. Venkatesh. The capacity of the Hopfield associative memory. IEEE Transactions on Information Theory, 1 (1987), 33-45.. Such limitation motivated many researchers to develop improved versions of the Hopfield neural network 1212. M.H. Hassoun & A.M. Youssef. A New Recording Algorithm for Hopfield Model Associative Memories. In “Neural Network Models for Optical Computing”, volume 882 of Proceedings of SPIE (1988), pp. 62-70.), (1010. V. Giminez-Martinez. A Modified Hopfield Auto-Associative Memory with Improved Capacity. IEEE Transactions on Neural Networks, 11(4) (2000), 867-878.), (99. C. García & J.A. Moreno. The Hopfield Associative Memory Network: Improving Performance with the Kernel “Trick”. In “Lecture Notes in Artificial Inteligence - Proceedings of IBERAMIA 2004”, volume 3315 of Advances in Artificial Intelligence - IBERAMIA 2004. Springer-Verlag (2004), pp. 871-880.. In particular, Chiueh and Goodman introduced the exponential correlation associative memory (ECAM), a high-capacity autoassociative model designed for the storage of bipolar patterns 33. T.D. Chiueh & R.M. Goodman. Recurrent Correlation Associative Memories. IEEE Transactions on Neural Networks, 2(2) (1991), 275-284. doi: 10.1109/72.80338.
https://doi.org/10.1109/72.80338...
or the heteroassociative case, Jeng et al. proposed the exponential bidirectional associative memory (EBAM) model that can be used to store pairs of bipolar vectors 1616. Y.J. Jeng, C.C. Yeh & T.D. Chiueh. Exponential bidirectional associative memories. Eletronics Letters, 26(11) (1990), 717-718. doi: 10.1049/el:19900468.
https://doi.org/10.1049/el:19900468...
.

Many applications of associative memories, however, require storage of vectors with real components or fuzzy sets 11. M. Aldape-Pérez, C. Yáñez Márquez, O. Camacho-Nieto & A.J. Argüelles-Cruz. An Associative Memory Approach to Medical Decision Support Systems. Computer Methods and Programs in Biomedicine, 106(3) (2012), 287-307. doi: 10.1016/j.cmpb.2011.05.002.
https://doi.org/10.1016/j.cmpb.2011.05.0...
), (22. P. Binh & N. Hoa. Compare Effective Fuzzy Associative Memories for Grey-Scale Image Recognition. In P. Vinh, N. Hung, N. Tung & J. Suzuki (editors), “Context-Aware Systems and Applications”, volume 109 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. Springer Berlin Heidelberg (2013), pp. 258-267. doi: 10.1007/978-3-642-36642-0 26.
https://doi.org/10.1007/978-3-642-36642-...
), (77. E.L. Esmi, P. Sussner, M.E. Valle, F. Sakuray & L. Barros. Fuzzy Associative Memories Based on Subsethood and Similarity Measures with Applications to Speaker Identification. In “Lecture Notes in Computer Science: International Conference on Hybrid Artificial Intelligence Systems (HAIS 2012)”. Springer-Verlag Berlin Heidelberg, Berlin, Germany (2012), pp. 479-490.), (66. E. Esmi, P. Sussner, H. Bustince Sola & J. Fernandez. Q-Fuzzy Associative Memories (Q-FAMs). IEEE Transactions on Fuzzy Systems, 23(2) (2015), 313 - 326.), (1919. S.G. Kong & B. Kosko. Adaptive Fuzzy Systems for Backing up a Truck-and-Trailer. IEEE Transactions on Neural Networks, 3(2) (1992), 211-223.), (2929. M.E. Valle & A.C. de Souza. “Pattern Classification using Generalized Recurrent Exponential Fuzzy Associative Memories”, volume 6. Science Gate Publishing (2016), chapter 4, pp. 79-102. doi: 10.15579/gcsr.vol6.ch4.
https://doi.org/10.15579/gcsr.vol6.ch4...
), (3232. B.L. Zhang, H. Zhang & S.S. Ge. Face Recognition by Applying Wavelet Subband Representation and Kernel Associative Memory. IEEE Transactions on Neural Networks, 15(1) (2004), 166-177. rent exponential fuzzy associative memories 2828. A.C. Souza, M.E. Valle & P. Sussner. Generalized Recurrent Exponential Fuzzy Associative Memories Based on Similarity Measures. In “Proceedings of the 16th World Congress of the International Fuzzy Systems Association (IFSA) and the 9th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT)”, volume 1. Atlantis Press (2015), pp. 455-462. doi: 10.2991/ifsa-eusflat-15.2015.66.
https://doi.org/10.2991/ifsa-eusflat-15....
), (2929. M.E. Valle & A.C. de Souza. “Pattern Classification using Generalized Recurrent Exponential Fuzzy Associative Memories”, volume 6. Science Gate Publishing (2016), chapter 4, pp. 79-102. doi: 10.15579/gcsr.vol6.ch4.
https://doi.org/10.15579/gcsr.vol6.ch4...
(GRE-FAMs) are designed for the storage and recall of a finite family of fuzzy sets. Furthermore, the GRE-FAMs corresponds to a fuzzy version of the ECAM model of Chiueh and Goodman. Inspired by the EBAM, we recently introduced the generalized exponential bidirectional fuzzy associative memories (GEB-FAMs), an extension of GRE-FAMs for the heteroassociative case 2727. A.C. Souza & M.E. Valle. Memória Associativa Bidirecional Exponencial Fuzzy Generalizada Aplicada ao Reconhecimento de Faces. In M.E.R. do Valle Mesquita; Graçaliz Pereira Dimuro; Regivan Hugo Nunes Santiago; Estevão Esmi Laureano (editor), “Recentes Avanços em Sistemas Fuzzy”, volume 1. Sociedade Brasileira de Matemática Aplicada e Computacional (SBMAC), São Carlos - SP (2016), pp. 503-514. ISBN: 978-85-8215-079-5..

Like the GRE-FAMs, GEB-FAMs use a similarity measure in their definition. In general terms, a similarity measure is a function that indicates how much two fuzzy sets are equal. In previous works, we considered a normalized version of the similarity measure proposed by Xuecheng 3030. L. Xuecheng. Entropy, distance measure and similarity measure of fuzzy sets and their relations. Fuzzy Sets and Systems, 52(3) (1992), 305-318. doi: 10.1016/0165-0114(92)90239-Z.
https://doi.org/10.1016/0165-0114(92)902...
. In this work, however, we adopt a more general definition proposed by De Baets and De Meyer 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
and focus on cardinality-based similarity measures 55. B. De Baets, H. De Meyer & H. Naessens. A class of rational cardinality-based similarity measures. Journal of Computational and Applied Mathematics, 132(1) (2001), 51-69.), (44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
. Furthermore, we performed extensive computational experiments in order to evaluate the performance of GEB-FAMs based on these similarity measures in a face recognition problem.

This work is organized as follows. In the next section, we review the definition of fuzzy similarity measures proposed by De Baets and De Meyer and list some cardinality-based similarity measures 55. B. De Baets, H. De Meyer & H. Naessens. A class of rational cardinality-based similarity measures. Journal of Computational and Applied Mathematics, 132(1) (2001), 51-69.), (44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
The GEB-FAMs are presented in Section 3. Computational experiments, performed to evaluate the performance of GEB-FAMs in a face recognition problem, are described and analyzed in Section 4. We finish the paper with the concluding remarks in Section 5.

2 FUZZY SETS AND SIMILARITY MEASURES

We begin this section by recalling the definition of fuzzy sets 3131. L.A. Zadeh. Fuzzy Sets. Information and Control, 8(3) (1965), 338-353. doi: 10.1016/S0019-9958(65)90241-X.
https://doi.org/10.1016/S0019-9958(65)90...
. Subsequently, we present some cardinality-based fuzzy similarity measures proposed by De Baets and De Meyer in 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
.

A fuzzy set A on an universe of discourse U is characterized by its membership function A: U → [0, 1]. This function indicates the membership degree of each element uU to the fuzzy subset A. Thus, A (u) = 0 means that u does not belong to A and A (u) = 1 means total membership of u to A. We denote by ℱ (U) the family of all fuzzy sets of U.

Throughout this paper, we only consider fuzzy sets on a finite universe of discourse U = {u 1, ..., u n }. In this case, we can identify a fuzzy set A with a vector A= (A(u 1), ..., A(u n )) ∈ [0, 1]n (2020. B. Kosko. “Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence”. Prentice Hall, Englewood Cliffs, NJ (1992).. The cardinality and the complement of a fuzzy set A on a finite universe of discourse U = {u 1, ..., u n } are defined respectively by

# A = i = 1 n A ( u i ) and A c ( u i ) = 1 A ( u i ) , i = 1,..., n .

A triangular norm, t-norm for short, is an increasing, commutative, and associative mapping T: [0, 1] × [0, 1] [0, 1] with neutral element 1, that is, T(1, x) = T(x, 1) = x for all x ∈ [0, 1] 1717. E.P. Klement, R. Mesiar & E. Pap. Triangular norms. (2000).. The intersection AB and the union AB of two fuzzy sets A, B ∈ ℱ(U) can be computed as follows using a t-norm:

( A B ) ( u i ) = T ( A ( u i ) , B ( u i ) ) , i = 1,..., n , (2.1)

and

( A B ) ( u i ) = A ( u i ) + B ( u i ) T ( A ( u i ) , B ( u i ) ) , i = 1,..., n . (2.2)

Furthermore, the difference A\B and the symmetric difference A∆B of fuzzy sets A and B are respectively defined by

( A \ B ) ( u i ) = A ( u i ) T ( A ( u i ) , B ( u i ) ) , i = 1,..., n , (2.3)

and

( A Δ B ) ( u i ) = A ( u i ) + B ( u i ) 2 T ( A ( u i ) , B ( u i ) ) , i = 1,..., n . (2.4)

We would like to point out that the identity #(AB) + #(AB) = (#A) + (#B) holds true if the intersection is modeled using a Frank t-norm 88. M.J. Frank. On the simultaneous associativity of F(x, y) and x+y-F(x, y). Aequationes Mathematicae, 19(1) (1979), 194-226. doi: 10.1007/BF02189866.
https://doi.org/10.1007/BF02189866...
), (2424. H.T. Nguyen & E.A. Walker. “A First Course in Fuzzy Logic”. Chapman & Hall/CRC, Boca Raton, 2 edition (2000).. A Frank t-norm, denoted by T s , s ∈ [0, ∞], is defined by

T s ( x , y ) = log s [ 1 + ( s x 1 ) ( s y 1 ) s 1 ] , s > 0, s 1,

with limiting values:

  1. T 0 ( x , y ) = lim s 0 T S ( x , y ) = M ( x , y ) = min { x , y } ,

  2. T 1 ( x , y ) = lim s 1 T S ( x , y ) = P ( x , y ) = x y ,

  3. T ( x , y ) = lim s T S ( x , y ) = W ( x , y ) = max { x + y 1,0 } .

Besides Frank’s t-norms, in this paper we also consider the drastic product t-norm Z: [0, 1] × [0, 1] [0, 1] defined by

Z ( x , y ) = { 1, x = 1 or y = 1, 0, otherwise .

A fuzzy similarity measure is a function that associates to a given pair of fuzzy sets a real number on the interval [0, 1] that indicates the degree of equality of these fuzzy sets. The definition of a fuzzy similarity measure may vary according to the context. In our previous works 2828. A.C. Souza, M.E. Valle & P. Sussner. Generalized Recurrent Exponential Fuzzy Associative Memories Based on Similarity Measures. In “Proceedings of the 16th World Congress of the International Fuzzy Systems Association (IFSA) and the 9th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT)”, volume 1. Atlantis Press (2015), pp. 455-462. doi: 10.2991/ifsa-eusflat-15.2015.66.
https://doi.org/10.2991/ifsa-eusflat-15....
), (2929. M.E. Valle & A.C. de Souza. “Pattern Classification using Generalized Recurrent Exponential Fuzzy Associative Memories”, volume 6. Science Gate Publishing (2016), chapter 4, pp. 79-102. doi: 10.15579/gcsr.vol6.ch4.
https://doi.org/10.15579/gcsr.vol6.ch4...
, we adopted a normalized version of the axiomatic definition proposed by Xuecheng 3030. L. Xuecheng. Entropy, distance measure and similarity measure of fuzzy sets and their relations. Fuzzy Sets and Systems, 52(3) (1992), 305-318. doi: 10.1016/0165-0114(92)90239-Z.
https://doi.org/10.1016/0165-0114(92)902...
. In this work, we consider a more general definition proposed by De Baets and De Meyer in 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
According to this definition, a fuzzy similarity measure is a symmetric binary fuzzy relation on ℱ(U), i.e., a symmetric function 𝒮: ℱ(U) × ℱ(U) [0, 1].

We speak of a reflexive similarity measure S: ℱ(U) × ℱ(U) [0, 1] if the identity S(A, A) = 1 holds for any fuzzy set A ∈ ℱ(U) 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
. Analogously, a similarity measure is said to be locally reflexive if S(A, A) ≥ S(A, B) for all A, B ∈ ℱ(U). Finally, given a t-norm T, we say that S is T-transitive if the inequality

T ( S ( A , B ) , S ( B , C ) ) S ( A , C ) ,

holds true for all fuzzy sets A, B, C ∈ ℱ(U).

In 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
, De Beats and De Meyer introduced the following class of rational similarity measures based on the cardinality of fuzzy sets on a finite universe of discourse:

S ( A , B ) = a α A , B + b ω A , B + c δ A , B + d ν A , B a ' α A , B + b ' ω A , B + c ' δ A , B + d ' ν A , B . (2.5)

where a, a', b, b', c, c', d, d' ∈ {0, 1} are parameters and

  1. αA,B = min{#(A\B), #(B\A)},

  2. ωA,B = max{#(A\B), #(B\A)},

  3. δA,B = #(AB),

  4. νA,B = #(AB)c .

Table 1 shows some similarity measures derived from (2.5). Here, the fuzzification schemes described by (2.1), (2.2), (2.3), and (2.4) are all based on a Frank t-norm. In this paper, we focus on the similarity measures given by Table 1 with the minimum T 0(x, u) = M(x, y) = min(x, y), the algebraic product T 1(x, y) = P(x, y) = xy, and the Łukasiewicz t-norm T (x, y) = W(x, y) = max{x + y - 1, 0}.

Table 1
Expressions of rational cardinality-based similarity measures.

We would like to conclude this section by pointing out that some similarity measures given by Table 1 satisfy the following properties 44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
:

  1. Ri , for i = 1, …, 15, are all reflexive,

  2. S17, S18, and S19 are locally reflexive,

  3. R1, R5, R6, R13, R15, and S18 areW-transitive,

  4. R11 and R 14 are P-transitive,

  5. S19 is M-transitive,

  6. R2 is Z-transitive,

3 GENERALIZED EXPONENTIAL BIDIRECTIONAL FUZZY ASSOCIATIVE MEMORIES

In this section, we present the generalized exponential bidirectional fuzzy associative memories (GEB-FAMs), which have been recently proposed by us in the conference paper 2727. A.C. Souza & M.E. Valle. Memória Associativa Bidirecional Exponencial Fuzzy Generalizada Aplicada ao Reconhecimento de Faces. In M.E.R. do Valle Mesquita; Graçaliz Pereira Dimuro; Regivan Hugo Nunes Santiago; Estevão Esmi Laureano (editor), “Recentes Avanços em Sistemas Fuzzy”, volume 1. Sociedade Brasileira de Matemática Aplicada e Computacional (SBMAC), São Carlos - SP (2016), pp. 503-514. ISBN: 978-85-8215-079-5..

A GEB-FAM can be used for the storage and recall of a finite set of pairs of fuzzy sets. Formally, let {(A ξ , B ξ ), ξ = 1, ..., p} ⊂ ℱ(U) × ℱ(V) be the fundamental memory set, α > 0 a real number, 𝒮U: ℱ(U) × ℱ(U) [0, 1] and 𝒮V: ℱ(V) × ℱ(V) [0, 1] similarity measures, G and H real-valued p × p matrices. Given an input fuzzy set X 0 ∈ ℱ(U), a GEB-FAM produces recursively sequences of fuzzy sets {X t }t > 0 and {Y t }t ≥ 0 defined, for all t ≥ 0, uU, and vV, as follows:

Y t ( ν ) = φ ( ξ = 1 p μ = 1 p g ξ μ e α S U ( A μ , X t ) B ξ ( ν ) η = 1 p μ = 1 p g η μ e α S U ( A μ , X t ) ) (3.1)

and

X t + 1 ( u ) = φ ( ξ = 1 p μ = 1 p h ξ μ e α S V ( B μ , Y t ) A ξ ( u ) η = 1 p μ = 1 p h η μ e α S V ( B μ , Y t ) ) , (3.2)

where the function φ, given by

φ ( x ) = max ( 0, min ( 1, x ) ) ,

ensures that Y t (v), X t+1 (u) ∈ [0, 1] for all vV, uU, and t > 0. In this work, we consider G = C -1, where C = (c ij )p × p is the matrix defined by cij=eαSU(Ai,Aj). Analogously, we can define H = D -1, where D = (d ij )p × p is given by dij=eαSV(Bi,Bj) for all i, j = 1, …, p.

4 COMPUTATIONAL EXPERIMENTS

In this section, we evaluate the performance of GEB-FAMs in a face recognition problem using the AR database 2222. A.M. Martinez. The AR face database. CVC Technical Report, 24 (1998). URL http://ci.nii.ac.jp/naid/10012519345/en/.
http://ci.nii.ac.jp/naid/10012519345/en/...
. Furthermore, we confront the GEB-FAM with the state-of-the-art approaches by performing the same experiment described by Luo et al. In fact, Table 2, extracted from 2121. L. Luo, J. Yang, J. Qian & Y. Tai. Nuclear-L1 norm joint regression for face reconstruction and recognition with mixed noise. Pattern Recognition, 48(12) (2015), 3811 - 3824. doi: 10.1016/j.patcog.2015.06.012.
https://doi.org/10.1016/j.patcog.2015.06...
, gives the accuracy obtained by several state-of-the-art approaches to the face recognition problem using the AR database as explained below.

Table 2
Accuracy obtained by several models applied to the face recognition problem using the AR database.

In the face recognition problem, we must identify a person from a face image using a set of labeled images, called the training set. Such as Luo et al., the gray-scale images from the AR database have been cropped and reshaped to dimension 50 × 40. We considered 8 gray-scale images of each individual from a group of 120 people as the training set. Figure 1 shows the 8 gray-scale images from a certain individual of the training set. Two experiments were conducted to evaluate the performance of an approach to the face recognition problem:

  1. A test set composed by 4 images from each individual with sunglasses and different illumination conditions.

  2. A test set consisting of 4 images from each individual with scarf and different illumination conditions.

Figure 1
Images of an individual from the training set.

Figure 2 shows the test images of the individual of Figure 1 in the experiments: a) sunglasses + illumination and b) scarf + illumination, respectively.

Figure 2
Images in the test set of a certain individual in the experiments.

Let us now describe how a GEB-FAM can be applied for face recognition. First, we identified each face image with a fuzzy subset A ξ , for ξ = 1, …, 960, on an universe of discourse U = {(1, 1), (1, 2), …, (50, 39), (50, 40)}. Moreover, for each ξ ∈ {1, …, 960}, we defined B ξ: {1, 2, ..., 120} → {0, 1} as follows:

B ξ ( i ) = { 1, A ξ belongs to the i -th person , 0, otherwise .

Note that B ξ indicates which person the face image A ξ belongs to. Also, by taking V = {1, …, 120}, we have B ξ(V). Therefore, we can design GEB-FAMs for the storage of the fundamental memory set {(A ξ , B ξ ), ξ = 1, ..., 960} ⊂ ℱ(U) × ℱ(V). Then, given a test image X 0, we determine the fuzzy set produced by a GEB-FAM in a single step, i.e. we calculate Y 0 using (3.1) (with t = 0). We associate the test image X 0 to the i-th person, where i is the first index such that Y 0(i) ≥ Y 0(j), for all j = 1, …, 120.

It turns out that a GEB-FAM depends on the similarity measure 𝒮U and the parameter α > 0. In our computational experiments, we considered all the similarity measures listed in Table 1. Precisely, for each fuzzy similarity measure on Table 1, we used the fuzzification schemes described in Section 2 with the minimum, the product, and the Łukasiewicz t-norm. As a consequence, we have 50 fuzzy similarity measures, namely, the three fuzzy versions of each of the similarity measures R 1, R 2 , ..., R 10, R 12, ..., R 15, S 17, S 18, and the similarity measures R 11 and S 19, which do not depend on the t-norm but only on the cardinality of the involved fuzzy sets. In addition, for each one of these 50 similarity measures, we considered five values for the parameter α, namely, α ∈ {0.5, 1, 5, 10, 30}. Summarizing, the 50 similarity measures combined with the 5 values of the parameter α yielded a total of 250 different GEB-FAMs.

The accuracy rates obtained by all the 250 GEB-FAMs in both experiments are summarized in the histograms shown in Figure 3. Note that a large number of GEB-FAMs yielded an accuracy rate less than or equal to 10%. By looking over at the poor recognition rates, most have been produced by a GEB-FAM based on a non T-transitive, with respect to the minimum, product, łukasiewicz, or drastic product, fuzzy similarity measure. Precisely, except the memory based on S 17, the GEB-FAMs based on non T-transitive similarity measures yielded recognition rates below 10%. The GEB-FAM based on the locally-reflexive non T-transitive similarity measure S 17 with the minimum and the product t-norms yielded accuracy rates of 94.58% (for α = 30) and 53.54% (for α = 5) in experiments a) and b), respectively. In the light of these remarks, let us focus on T-transitive similarity measures.

Figure 3
Histogram of the accuracy rates obtained by considering all 250 GEB-FAMs.

For each T-transitive similarity measure listed in Table 1, we selected the parameter α ∈ {0.5, 1, 5, 10, 30} that produced the largest recognition rate. Figure 4 shows the boxplot of the accuracy values of the 24 fine-tuned GEB-FAM models by the fuzzification schemes.

Figure 4
Boxplot of the accuracy rates produced by fine-tuned GEB-FAMs based on T-transitive similarity measures by the fuzzification scheme.

Precisely, the first boxplot refers to the best GEB-FAMs based on T-transitive similarity measures with the minimum in (2.1), (2.2), (2.3), and (2.4). Similarly, the second and the third boxplots correspond to the GEB-FAMs obtained by using respectively the product and łucasievicz t-norm. According to the Figure 4, the GEB-FAMs obtained by considering the łukasiewicz t-norm also yielded poor recognition rates. Excluding the GEB-FAM based on the similarity measure R 13, which correspond to the two outliers shown in the boxplots on Figure 4, the GEB-FAM models derived from the minimum and the product achieved performance competitive to other models from the literature.

5 CONCLUDING REMARKS

In this paper, we investigated the role of a fuzzy similarity measure in a generalized exponential bidirectional fuzzy associative memory (GEB-FAM). Precisely, we first revised the cardinality-based similarity measures and the fuzzification schemes proposed by De Baets and De Meyer 55. B. De Baets, H. De Meyer & H. Naessens. A class of rational cardinality-based similarity measures. Journal of Computational and Applied Mathematics, 132(1) (2001), 51-69.), (44. B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
https://doi.org/10.1016/j.ejor.2003.06.0...
. Then, we used these fuzzy similarity measures to design single-step GEB-FAM models for a face recognition task.

Using the AR database and 250 different GEB-FAM models, we concluded that the memories based on non T-transitive similarity measures usually produce poor performance, i.e., a recognition rates below 10%. The only exception we found is the GEB-FAM based on the locally reflexive non T-transitive measure S 17 with minimum t-norm, which achieved an accuracy rates of 94.58% and 53.54% in experiments a) sunglasses+illumination and b) scarf+illumination, respectively. GEB-FAMs based on T-transitive similarity measures with the łucasievicz t-norm also exhibit poor recognition rates. In contrast, GEB-FAMs defined using T-transitive measures with either minimum or product t-norms achieved competitive results in comparison with others models from literature. In particular, the best results in this face recognition problem were obtained by considering T-transitive fuzzy similarity measures based on the minimum t-norm.

ACKNOWLEDGEMENTS

This work was supported in part by FAPESP under grant no. 2015/00745-1 and by CNPq under grant no. 305486/2014-4.

REFERENCES

  • 1
    M. Aldape-Pérez, C. Yáñez Márquez, O. Camacho-Nieto & A.J. Argüelles-Cruz. An Associative Memory Approach to Medical Decision Support Systems. Computer Methods and Programs in Biomedicine, 106(3) (2012), 287-307. doi: 10.1016/j.cmpb.2011.05.002.
    » https://doi.org/10.1016/j.cmpb.2011.05.002
  • 2
    P. Binh & N. Hoa. Compare Effective Fuzzy Associative Memories for Grey-Scale Image Recognition. In P. Vinh, N. Hung, N. Tung & J. Suzuki (editors), “Context-Aware Systems and Applications”, volume 109 of Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering. Springer Berlin Heidelberg (2013), pp. 258-267. doi: 10.1007/978-3-642-36642-0 26.
    » https://doi.org/10.1007/978-3-642-36642-0 26
  • 3
    T.D. Chiueh & R.M. Goodman. Recurrent Correlation Associative Memories. IEEE Transactions on Neural Networks, 2(2) (1991), 275-284. doi: 10.1109/72.80338.
    » https://doi.org/10.1109/72.80338
  • 4
    B. De Baets & H. De Meyer. Transitivity-preserving fuzzification schemes for cardinality-based similarity measures. European Journal of Operational Research, 160(3) (2005), 726 - 740. doi: 10.1016/j.ejor.2003.06.036.
    » https://doi.org/10.1016/j.ejor.2003.06.036
  • 5
    B. De Baets, H. De Meyer & H. Naessens. A class of rational cardinality-based similarity measures. Journal of Computational and Applied Mathematics, 132(1) (2001), 51-69.
  • 6
    E. Esmi, P. Sussner, H. Bustince Sola & J. Fernandez. Q-Fuzzy Associative Memories (Q-FAMs). IEEE Transactions on Fuzzy Systems, 23(2) (2015), 313 - 326.
  • 7
    E.L. Esmi, P. Sussner, M.E. Valle, F. Sakuray & L. Barros. Fuzzy Associative Memories Based on Subsethood and Similarity Measures with Applications to Speaker Identification. In “Lecture Notes in Computer Science: International Conference on Hybrid Artificial Intelligence Systems (HAIS 2012)”. Springer-Verlag Berlin Heidelberg, Berlin, Germany (2012), pp. 479-490.
  • 8
    M.J. Frank. On the simultaneous associativity of F(x, y) and x+y-F(x, y). Aequationes Mathematicae, 19(1) (1979), 194-226. doi: 10.1007/BF02189866.
    » https://doi.org/10.1007/BF02189866
  • 9
    C. García & J.A. Moreno. The Hopfield Associative Memory Network: Improving Performance with the Kernel “Trick”. In “Lecture Notes in Artificial Inteligence - Proceedings of IBERAMIA 2004”, volume 3315 of Advances in Artificial Intelligence - IBERAMIA 2004. Springer-Verlag (2004), pp. 871-880.
  • 10
    V. Giminez-Martinez. A Modified Hopfield Auto-Associative Memory with Improved Capacity. IEEE Transactions on Neural Networks, 11(4) (2000), 867-878.
  • 11
    M.H. Hassoun & P.B. Watta. Associative Memory Networks. In E. Fiesler & R. Beale (editors), “Handbook of Neural Computation”. Oxford University Press (1997), pp. C1.3:1-C1.3:14.
  • 12
    M.H. Hassoun & A.M. Youssef. A New Recording Algorithm for Hopfield Model Associative Memories. In “Neural Network Models for Optical Computing”, volume 882 of Proceedings of SPIE (1988), pp. 62-70.
  • 13
    R. Hecht-Nielsen. “Neurocomputing”. Addison-Wesley, Reading, MA (1989).
  • 14
    J. Hopfield & D. Tank. Neural computation of decisions in optimization problems. Biological Cybernetics, 52 (1985), 141-152.
  • 15
    J.J. Hopfield. Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy of Sciences, 79 (1982), 2554-2558.
  • 16
    Y.J. Jeng, C.C. Yeh & T.D. Chiueh. Exponential bidirectional associative memories. Eletronics Letters, 26(11) (1990), 717-718. doi: 10.1049/el:19900468.
    » https://doi.org/10.1049/el:19900468
  • 17
    E.P. Klement, R. Mesiar & E. Pap. Triangular norms. (2000).
  • 18
    T. Kohonen. “Self-organization and associative memory”. Springer-Verlag New York, Inc., New York, NY, USA, 2rd edition edition (1987).
  • 19
    S.G. Kong & B. Kosko. Adaptive Fuzzy Systems for Backing up a Truck-and-Trailer. IEEE Transactions on Neural Networks, 3(2) (1992), 211-223.
  • 20
    B. Kosko. “Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence”. Prentice Hall, Englewood Cliffs, NJ (1992).
  • 21
    L. Luo, J. Yang, J. Qian & Y. Tai. Nuclear-L1 norm joint regression for face reconstruction and recognition with mixed noise. Pattern Recognition, 48(12) (2015), 3811 - 3824. doi: 10.1016/j.patcog.2015.06.012.
    » https://doi.org/10.1016/j.patcog.2015.06.012
  • 22
    A.M. Martinez. The AR face database. CVC Technical Report, 24 (1998). URL http://ci.nii.ac.jp/naid/10012519345/en/
    » http://ci.nii.ac.jp/naid/10012519345/en/
  • 23
    R.J. McEliece, E.C. Posner, E.R. Rodemich & S. Venkatesh. The capacity of the Hopfield associative memory. IEEE Transactions on Information Theory, 1 (1987), 33-45.
  • 24
    H.T. Nguyen & E.A. Walker. “A First Course in Fuzzy Logic”. Chapman & Hall/CRC, Boca Raton, 2 edition (2000).
  • 25
    G. Serpen. Hopfield Network as Static Optimizer: Learning the Weights and Eliminating the Guesswork. Neural Processing Letters, 27(1) (2008), 1-15. doi: 10.1007/s11063-007-9055-8.
    » https://doi.org/10.1007/s11063-007-9055-8
  • 26
    K. Smith, M. Palaniswami & M. Krishnamoorthy. Neural Techniques for Combinatorial Optimization with Applications. IEEE Transactions on Neural Networks, 9(6) (1998), 1301-1318.
  • 27
    A.C. Souza & M.E. Valle. Memória Associativa Bidirecional Exponencial Fuzzy Generalizada Aplicada ao Reconhecimento de Faces. In M.E.R. do Valle Mesquita; Graçaliz Pereira Dimuro; Regivan Hugo Nunes Santiago; Estevão Esmi Laureano (editor), “Recentes Avanços em Sistemas Fuzzy”, volume 1. Sociedade Brasileira de Matemática Aplicada e Computacional (SBMAC), São Carlos - SP (2016), pp. 503-514. ISBN: 978-85-8215-079-5.
  • 28
    A.C. Souza, M.E. Valle & P. Sussner. Generalized Recurrent Exponential Fuzzy Associative Memories Based on Similarity Measures. In “Proceedings of the 16th World Congress of the International Fuzzy Systems Association (IFSA) and the 9th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT)”, volume 1. Atlantis Press (2015), pp. 455-462. doi: 10.2991/ifsa-eusflat-15.2015.66.
    » https://doi.org/10.2991/ifsa-eusflat-15.2015.66
  • 29
    M.E. Valle & A.C. de Souza. “Pattern Classification using Generalized Recurrent Exponential Fuzzy Associative Memories”, volume 6. Science Gate Publishing (2016), chapter 4, pp. 79-102. doi: 10.15579/gcsr.vol6.ch4.
    » https://doi.org/10.15579/gcsr.vol6.ch4
  • 30
    L. Xuecheng. Entropy, distance measure and similarity measure of fuzzy sets and their relations. Fuzzy Sets and Systems, 52(3) (1992), 305-318. doi: 10.1016/0165-0114(92)90239-Z.
    » https://doi.org/10.1016/0165-0114(92)90239-Z
  • 31
    L.A. Zadeh. Fuzzy Sets. Information and Control, 8(3) (1965), 338-353. doi: 10.1016/S0019-9958(65)90241-X.
    » https://doi.org/10.1016/S0019-9958(65)90241-X
  • 32
    B.L. Zhang, H. Zhang & S.S. Ge. Face Recognition by Applying Wavelet Subband Representation and Kernel Associative Memory. IEEE Transactions on Neural Networks, 15(1) (2004), 166-177.

Publication Dates

  • Publication in this collection
    May-Aug 2018

History

  • Received
    12 Apr 2017
  • Accepted
    27 Nov 2017
Sociedade Brasileira de Matemática Aplicada e Computacional Rua Maestro João Seppe, nº. 900, 16º. andar - Sala 163 , 13561-120 São Carlos - SP, Tel. / Fax: (55 16) 3412-9752 - São Carlos - SP - Brazil
E-mail: sbmac@sbmac.org.br