Mean field models for large data-clustering problems
Michael Herty, Lorenzo Pareschi, Giuseppe Visconti
TL;DR
This paper develops mean-field models for data clustering, extending opinion dynamics models to include particle features, enabling efficient clustering algorithms with applications in shape detection and image segmentation.
Contribution
It introduces a novel mean-field approach for clustering that incorporates particle features and derives an efficient algorithm for practical applications.
Findings
Mean-field models effectively capture clustering behavior.
The approach enables efficient computation of clusters.
Applications demonstrate improved shape detection and segmentation.
Abstract
We consider mean-field models for data--clustering problems starting from a generalization of the bounded confidence model for opinion dynamics. The microscopic model includes information on the position as well as on additional features of the particles in order to develop specific clustering effects. The corresponding mean--field limit is derived and properties of the model are investigated analytically. In particular, the mean--field formulation allows the use of a random subsets algorithm for efficient computations of the clusters. Applications to shape detection and image segmentation on standard test images are presented and discussed.
| 0.03 | 1.25e-02 | 30 | 0.03 | 3.47e-02 | 51 | 0.06 | 2.64e-02 | 11 |
| 0.04 | 4.10e-03 | 16 | 0.05 | 1.21e-02 | 14 | 0.07 | 1.48e-02 | 8 |
| 0.05 | 4.00e-03 | 12 | 0.07 | 7.70e-03 | 8 | 0.08 | 1.12e-02 | 8 |
| 0.06 | 4.60e-03 | 9 | 0.09 | 7.90e-03 | 8 | 0.09 | 1.63e-02 | 5 |
| 0.07 | 5.40e-03 | 8 | 0.11 | 1.66e-02 | 3 | 0.10 | 1.63e-02 | 5 |
| 0.05 | 4.44e-02 | 23 | 0.05 | 4.73e-02 | 24 | 0.05 | 6.37e-02 | 30 |
| 0.06 | 1.36e-02 | 11 | 0.06 | 2.62e-02 | 13 | 0.06 | 4.16e-02 | 16 |
| 0.065 | 6.40e-03 | 9 | 0.065 | 1.63e-02 | 11 | 0.07 | 2.12e-02 | 9 |
| 0.07 | 6.70e-03 | 7 | 0.0675 | 7.40e-03 | 10 | 0.075 | 9.70e-03 | 7 |
| 0.08 | 8.50e-03 | 7 | 0.07 | 8.00e-03 | 9 | 0.08 | 9.20e-03 | 7 |
| 0.09 | 1.00e-02 | 6 | 0.08 | 9.80e-03 | 7 | 0.085 | 1.10e-02 | 5 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsBayesian Methods and Mixture Models · Advanced Clustering Algorithms Research · Face and Expression Recognition
Mean field models for large data–clustering problems
M. Herty
Institut für Geometrie und Praktische Mathematik - RWTH Aachen University – Templergraben 55, 52062 Aachen, Germany – [email protected]
L. Pareschi
Mathematics and Computer Science Department - University of Ferrara – Via Machiavelli 35, 44121 Ferrara, Italy – [email protected]
G. Visconti
Institut für Geometrie und Praktische Mathematik - RWTH Aachen University – Templergraben 55, 52062 Aachen, Germany – [email protected]
Abstract
We consider mean-field models for data–clustering problems starting from a generalization of the bounded confidence model for opinion dynamics. The microscopic model includes information on the position as well as on additional features of the particles in order to develop specific clustering effects. The corresponding mean–field limit is derived and properties of the model are investigated analytically. In particular, the mean–field formulation allows the use of a random subsets algorithm for efficient computations of the clusters. Applications to shape detection and image segmentation on standard test images are presented and discussed.
Keywords. Data clustering, opinion dynamic, mean field equations, image segmentation, shape detection
MSC2010. 82C40, 94A08, 68U10
1 Introduction
Particle and kinetic models for consensus and cluster formation appeared in recent literature for self–organized socio–economic dynamical systems as opinion formation, flocking of birds or fish, elections and referendums under influence of mass media, etc. See e.g. [5, 11, 18, 19, 20, 23, 25, 34, 16], the review articles [35, 4, 1] and the book[40]. A related research direction is based on using the consensus features of these models in an artificial way to solve problems of optimization or segmentation of data in large dimensions [28, 41, 15, 29].
In this paper, we aim at formulating suitable models on the microscopic (or particle) level as well as on the mean–field (or kinetic) level to describe the partition of a large set of data in clusters. This problem is also known as data clustering problem and it is widely studied in many applications like pattern recognition, shape detection and image segmentation problems. The proposed methods do not need to have fixed a–priori number of clusters and clusters are characterized by small in–group and large out–group distances.
Since we are interested in modes characterizing distance and qualitative features without additional physical or socio–economical modeling background the proposed model will generalize the Hegselmann–Krause (HK) opinion dynamics model [25]. Originally, the HK model was proposed in a microscopic setting, in one–dimensional spatial and time discrete framework. Several extensions exist, in the sequel we will briefly review the basic model before discussing its extension towards the image clustering problems.
To this aim, let us consider a group of particles with a (scalar) initial state , , and the state of each particle varies depending on the state of the others. The key idea of the Hegselmann–Krause (HK) model [25] is that particles with completely different opinions do not influence each other, and a sort of mediation occurs among agents whose opinions are within a bounded confidence interval described by a parameter Let be the state of the system at time . Then the dynamic of the –th particle is given by
[TABLE]
where is the time–varying adjacency matrix whose entries are in the form
[TABLE]
with
[TABLE]
defining the neighborhood of the –th particle at time , and
[TABLE]
the type of interactions. Precisely, when the interactions are symmetric since , , but is not a stochastic matrix. Instead, when , then is a right stochastic matrix but interactions are no longer symmetric.
Several works have been proposed in the literature which analyze the properties of the HK model. For instance, for the analysis in the time discrete setting we refer to [27]. In [7] it is proven that, during the evolution of the system (1.1), the order of the states is preserved. Thanks to the definition of the interaction kernel (1.2)–(1.4), if , at some time , it remains true for larger times. Therefore, the HK model tends to group the initial states in a finite number of clusters as proved in [35]. Following [35], we define a cluster at time a subset of particles separated from all the other particles
[TABLE]
In [7, 22, 30] the stability of the dynamical model is investigated. In particular, the fact that the system converges to a steady profile in finite time is proved in [7]. For further results on the one–dimensional local and symmetric model we refer also to [8]. We point out that also behavior of cluster formation in the transient is of interest in the mathematical literature [21].
In [36, 10], the one-dimensional Hegselmann–Krause is generalized to the case of a multi–dimensional data–set. Subsequently, the multi–dimensional HK model has been used as a technique to cluster a big amount of data into a small number of subsets with some common features [38] and to compare its performance with the –means algorithm [31]. Recently, in [29, 37] new approaches to clustering problems and image segmentation have been proposed based on the Kuramoto model.
Here, we introduce a generalization of the multi–dimensional formulation of the HK model to solve data clustering problems. This amounts to take into account clustering with respect to different features. We deal with data having both time dependent and static features. The latter describe intrinsic properties of a datum, such as the measure of a trustworthy information or the color intensity of pixels in images. We derive the corresponding mean–field limit and investigate analytically the properties of the model. In particular, following[2] the mean–field formulation allows the use of a random subset algorithm for efficient computations of the clusters.
The rest of the manuscript is organized as follows. The microscopic model is introduced at the beginning of Section 2 and briefly discussed in Section 2.1. The proposed model is still a microscopic model and we describe the case of large data using a mean–field equation in Section 3. Analytical properties of the kinetic equation, such as a–priori estimation on the evolution of the moments and characterization of the limit distribution, are discussed in Section 3.1. Numerical evidence of the theoretical results is provided in Section 4.1. Further, we propose applications on detection and compression of data, such as shape detection, in Section 4.2, and image segmentation, in Section 4.3. We finally conclude with some remarks and future research directions in Section 5.
2 Microscopic models for data–clustering
Each particle is endowed with a time–dependent state vector as well as features representing static characteristics of the system, i.e., is independent of time. As a motivation example consider an image segmentation problem where are the center point of a pixel or voxels of the image and the color coding at the center point.
As in the HK model we define the neighborhood of the particles by
[TABLE]
and are entries of the time–varying matrix defined as
[TABLE]
with defined analogously to (1.4).
Here, and are two bounded confidence levels. The two metrics and need to be properly defined according to the specific context of the problem. Then, the mathematical model for any is given by
[TABLE]
and initial condition and Notice that is a sufficient condition to reduce model (2.4) to the multi–dimensional version of the HK model (1.1).
2.1 Properties of the microscopic model
Existence and convergence of solutions to system (2.4) can be established by using same techniques as in [8] where the original HK in the one–dimensional case was analyzed. In fact, system (2.3)- (2.4) belongs to the same class of state-switched systems.
In the case of symmetric interactions we can recover from the previous model similar results on the moment behavior as presented for the HK model in [8, 26]. We only record the results here since the proofs are slight variations of existing results (see for example [8]).
Define the moments and with respect to the time dependent feature as
[TABLE]
then the following result holds true.
Lemma 2.1**.**
Let be the solution of the dynamical system (2.4) with symmetric interactions, i.e. in (2.2). Then, we obtain
[TABLE]
Corollary 2.2**.**
Let be the solution of the dynamical system (2.4). Assume that and are sufficiently large so that interactions are global. Then the first moment is conserved and the following decay estimate holds:
[TABLE]
Later, we will show that similar results hold for the continuous model. Some remarks on further properties concerning the particle model (2.4) are in order.
Remark 2.3**.**
- •
Formation of clusters in the large time behavior is extensively investigated in the review article **[35]** for general systems of the form (2.4). However, number of clusters cannot be a–priori predicted starting from a given initial configuration.
- •
*In the *non–symmetric case, conservation of the first moment does not hold true. Also, in general, it is not possible to show the decay of the second moment although clustering still appears, see [35].
- •
Extensions of the model to take into account non static features are obtained by including an interaction term on the right hand side of (2.3). The determination of such interaction term, however, would be rather problem dependent and in this paper we will not explore further this direction.
3 Mean–field description
In the case of many particles we derive the formal mean–field equation. Let , be compact domains and . For we denote by the empirical distribution on given by
[TABLE]
Let us consider a test function , i.e. the space of continuous and compactly supported functions on with continuous derivative. Denote by the integration of against the test function on . We have
[TABLE]
where we defined
[TABLE]
and we used the fact that equation (2.4) can be re-written as
[TABLE]
with and
[TABLE]
We can easily compute
[TABLE]
and similarly
[TABLE]
Collecting these formal computations, after integration by part in , we obtain the weak form of the mean–field equation
[TABLE]
If we now define a kernel as continuous extension of the adjacency matrix (2.2)
[TABLE]
and given by
[TABLE]
in the limit , assuming that the empirical measure converge to , we formally obtain the strong form of the kinetic equation as
[TABLE]
Rigorous analytical results on convergence in the case of very large and symmetric interactions have been already discussed, for instance in [13, 14]. These results guarantee convergence of the distribution in (3.3) to a probability limit distribution , provided the initial distribution at time has finite second moment and is a non–negative, bounded, measurable and symmetric kernel. Observe that these assumptions are verified also in our framework. For a more detailed discussion on analytical results on convergence in mean–field models, we refer e.g. to [12, 16]
We briefly discuss the relation to similar kinetic models.
In [9] the analysis of a homogeneous kinetic model for opinion dynamics under bounded confidence is studied. Therein, the model is derived by using a Boltzmann–like approach with instantaneous binary interactions describing compromise. An analogous derivation of the kinetic equation (3.3) is also possible using a binary interaction model based on an explicit Euler discretization of the underlying particle dynamics (2.4) with and performing a grazing collision limit. We omit this computation.
In [9] the authors prove the weak convergence of the solution to a convex combination of Dirac delta functions. In [13] a similar asymptotic distribution is found for the mean–field limit of the classical Hegselmann–Krause model.
A further symmetric clustering model with weighted interactions with respect a fixed number of closest neighbors and corresponding mean–field limit has been introduced in [3]. Moments and long–time behavior could also be studied therein. Finally, models for other applications are also able to cluster information e.g. in traffic flow modeling [42] where the physical acceleration has the role of the bounded confidence.
3.1 Properties of the mean–field model
As preliminary remark we observe that the marginal distribution is preserved in time by the kinetic equation (3.3). Instead, it is easy to check that the marginal distribution is not stationary and its behavior in time is still influenced by a dependent kernel. These considerations are direct consequence of the microscopic model (2.4) and (2.3). For this reason, in the following results and if not otherwise stated, we mainly focus on the analysis of moments with respect to the variable .
As in the discrete case we define the –th moment of the kinetic distribution with respect to as
[TABLE]
Here, we used the following multi–index notation and . In particular, for each we will denote
[TABLE]
the first moment and the second moment, respectively. Then, for a symmetric kernel we obtain by the integration of the kinetic equation
Lemma 3.1**.**
Let be the solution of the model (3.3) with symmetric kernel , i.e., . Then, the following a–priori estimates hold true:
[TABLE]
for each .
Proof.
For each fixed we have
[TABLE]
The last term vanishes due to anti–symmetry of the integrand by the interchange of variables . The second statement follows by observing that for each we have
[TABLE]
Hence, we obtain
[TABLE]
Instead, in the case of global interactions and for a general kernel and we have
Corollary 3.2**.**
Assume that and are sufficiently large so that , for all , and . Then, for all , the following relations hold true:
[TABLE]
Proof.
Multiplying (3.3) by with , and integrating over , we compute
[TABLE]
where with being the –th element of the standard basis vector of and . Then, for we still have have conservation of the first moment since we obtain
[TABLE]
For we have
[TABLE]
and therefore
[TABLE]
Observe that, compared to the local interaction case analyzed in Theorem 3.1 where in general the energy decay property of all second order moments is not guaranteed, in global interactions also the mixed second order moments decay in time. In other words, while in the local interaction model only variances go to zero, in the global interaction model both variances and covariances go to zero in the large time behavior.
Lemma 3.1 and Corollary 3.2 suggest that for any initial distribution will tend to a stationary distribution that is concentrated on a finite number of points in and represents therefore clusters. Hence, in the following we investigate the asymptotic distribution of the model (3.3).
Lemma 3.3**.**
Let and be arbitrary positive bounded confidence levels. Then, the distribution
[TABLE]
with and is a weak stationary solution of the model (3.3) if and only if either for all or for all , for all , or both hold true .
Proof.
Let us assume that at least one of for all and for all , for all , is verified and prove that is the asymptotic distribution of the equation (3.3), i.e. given a test function
[TABLE]
We obtain
[TABLE]
Conversely, assume that as in (3.4) is the steady state of (3.3). Assume by contradiction that there exist such that and , such that . Then, using similar computations as before we obtain
[TABLE]
which contradicts the hypothesis. ∎
Lemma 3.4**.**
Assume that and are sufficiently large so that , for all , and . Then, the distribution
[TABLE]
with is a weak stationary solution of the model (3.3) if and only if .
Proof.
Substituting the expression of in the weak form of the kinetic equation, integrating by parts and using the fact that for and large enough so that
[TABLE]
we obtain
[TABLE]
which is zero if . ∎
Remark 3.5**.**
As direct consequence of Theorem 3.3 and Theorem 3.4 we have that taking sufficiently large or an initial distribution being atomic with respect the second variable, the same quantized steady–state of the kinetic formulation of the microscopic model (1.1) are preserved, cf. [13].
Remark 3.6**.**
In Theorem 3.3 the number of clusters , as well the values and the positions of the clusters, are functions of the initial distribution and of the bounded confidence levels and . As pointed–out also in [14], in general it is not possible to predict the number of Dirac deltas in the asymptotic configuration from a given initial distribution. However, for sufficiently large and assuming , the number of clusters is . This consideration is also observed at the Boltzmann level, see [9].
4 Numerical experiments and applications
The theoretical results on the asymptotic behavior of the mean–field equation (3.3) introduced in the previous section are here also numerically investigated. Moreover, we show the efficiency of the model as technique to solve realistic data–clustering problems and to this end we focus on applications to the field of shape detection and image segmentation.
In order to efficiently solve the kinetic model (3.3) we employ the Mean Field Interaction Algorithm introduced in [2] which is based on random subset evaluation of the kernel term given in (3.1). The algorithm used in the numerical experiments is summarized by the steps in Algorithm 1 for a time interval discretized in subintervals of size . The computational cost of the algorithm is , where is the size of the subset of interacting particles, and for we obtain the explicit Euler scheme for the original particle system (2.4) whose cost is . For further details on the Mean Field Interaction Algorithm we refer to [2].
4.1 Numerical steady–states and moment evolution
We use the Mean Field Interaction Algorithm to numerically investigate the properties of the kinetic model proved in the previous section. We analyze two typical situations which lead to the two applications we show later in this section.
4.1.1 Constant static feature.
First, we consider an initial distribution being the uniform distribution with respect to and a constant distribution along the static feature variable , i.e. . This choice is obviously also consistent with considering the bounded confidence level very large. We show that, as discussed in Remark 3.5, equation (3.3) provides the same steady–states of the Hegselmann–Krause model.
One–dimension.
The numerical steady–states of the mean–field equation (3.3) are first computed for the one–dimensional case and compared to the steady–states of the microscopic model (2.4). Observe that, under the assumption of an initial constant distribution along , the asymptotic behavior of (2.4) is the classical one prescribed by the one–dimensional Hegselmann–Krause model (1.1). The evolution in time of the first and second moment is also provided.
In Figure 4.1 we show the steady–state provided by the mean–field kinetic model (3.3) for the one–dimensional initial uniform distribution on . The final time is and the time step is . We consider particles in the Monte Carlo method so that we reduce error due to the sampling. The number of interacting particles is taken as . We show the results for two values of the confidence bound, in the left panel and in the right panel. The evolution of the distributions up to final time is showed by normalizing with respect to the maximum value at each fixed time. For we observe the formation of a consensus state in large time behavior. In fact, the final distribution is a Dirac delta centered in the initial value of the first moment. For , instead, three clusters arise at equilibrium, similarly the classical Hegselmann–Krause model for the same confidence bounds and equally distributed initial data.
As observed in Figure 4.2, for both values of the bounded confidence level, we have conservation of the first moment and energy dissipation in time. Although we are using a non–symmetric model, the first moment is preserved during the time evolution, with deviation of order from the initial value, since the initial distribution is symmetric. The fluctuations in the first moment are due to the stochastic method.
In Figure 4.3 we show some results of a simple analysis of Algorithm 1 with respect to the values of , i.e. the size of the random subset of interacting particles. Left panel shows the trend to the steady–state of the kinetic model computed with Algorithm 1 and same parameters as in the right plot of Figure 4.1. However, here we consider and . The same equilibrium state is reached but with a faster transient. The dependence of the velocity to the formation of cluster on the size of the random subset is showed in the right panel of Figure 4.3. The velocity to equilibrium decreases as increases. In particular, the case, where each particle is enforced to align to the velocity of the other particle instead of their “mean”, exhibits the fastest convergence. This analysis suggests that, although model (3.3) has a convolution structure and in principle can be efficiently solved with a Fast Fourier Transform at a cost, Algorithm 1 may be preferable since it has a comparable (or even lower) computational cost and it can be applied to more general kernels where the convolution structure is lost.
Two–dimensions.
We also show one example of the numerical steady–states of the mean–field equation (3.3) in the two–dimensional case. Again we employ Algorithm 1. Figure 4.4 shows the steady–state for the particle density and the kinetic density at time and final time . We use particles and the time step is . Using the Mean Field Interaction Algorithm 1, the number of interacting particles is taken as . We show the results for one value of the confidence bound, which leads to the formation of clusters at equilibrium. The evolution in time of the two–dimensional moments is also provided in Figure 4.5. We still observe conservation of the first moment, due to the initial symmetric distribution, and decay in time for the two non–mixed second moments.
4.1.2 Non–constant static feature.
Next, we consider a non–constant initial distribution along the variable . We consider a one–dimensional setting both along and since the goal of this experiment is to provide evidence of the influence of the static feature on the clustering process. The initial kinetic distribution it given as a tensor product between a uniform and Gaussian distribution so that
[TABLE]
with mean , and variance . See the top left plot in Figure 4.6. All the simulations are performed by using samples up to equilibrium.
In this experiment, we expect that the behavior at equilibrium is influenced also by the interactions with respect to the static feature variable due to the corresponding characteristic function in the kernel (3.1). In Figure 4.6 we show the results provided by using and . The top left plot shows particles and kinetic density at equilibrium. Observe that, compared to the case with constant distribution along the static feature, the low value of allows for the formation of more clusters, precisely . Clusters arise because either their distance in direction is larger than the confidence level or the minimum distance in direction is larger than . This consideration is analyzed in the bottom left plot of Figure 4.6 where the blue line with circle markers shows the distance in between two adjacent clusters and the red line with triangle markers the minimum distance between the static features of particles being in two adjacent clusters. Observe that when the distance in is lower than the value , the corresponding distance between the static features is larger than , and therefore cluster is no longer possible. Moreover, we notice that time to reach equilibrium is larger due to two levels of clustering. Finally, the bottom right plot of Figure 4.6 shows the two marginal distributions.
In Figure 4.7 we show the behavior at equilibrium by considering two different pairs of confidence levels. In the left plot, and . Here is large enough to not influence the clustering process and in fact we recover clusters, exactly the same provided in Figure 4.1 when the initial kinetic distribution was constant in . In the right plot, and . In this case, is very large and we show the formation of clusters at equilibrium when only clustering due to the static feature is allowed.
4.2 Clustering and shape detection
The property of the equation (3.3), analytically studied in Section 3.1 and numerically investigated in Section 4.1, of having quantized steady–states makes the model suitable for solving data clustering problems. In particular, in this section we use the kinetic model as technique for shape detection.
Shape detection can be considered as a branch of pattern recognition problems that focuses on the discovering of previously unknown patterns in a big set of data. Machine learning and many clustering algorithms have already been applied to this class of problems, such as the –means algorithm which however suffers from the necessity of defining a–priori the number of clusters. Instead, as already pointed out, opinion dynamics based models automatically find the number of clusters as functions of the confidence value.
More specifically, in this section we apply the models introduced in Section 2 to the example of a character recognition. We consider a letter “A” which is composed by two-dimensional points defining three segments in . To each of these points we apply an additive noise distributed according to a uniform or a Gaussian distribution. We obtain a new set of points
[TABLE]
which define the noisy pattern. Here, the value represents the percentage of noise and it is also chosen in such a way that , . The points are used as initial condition of the model. They are seen as samples from a distribution defining the noisy pattern and the Mean Field Interaction Algorithm 1 is employed in order to solve the kinetic model.
The goal of this example is to cluster the noisy data into a set of points which give information on the shape of the exact pattern to be detected. This can be considered also as a dimensionality reduction problem which could help other algorithms to recognize the unknown pattern efficiently by using information on the position of the clusters. Here the efficiency of the results is studied by means of the following measure:
[TABLE]
where is the position of clusters in , the number of clusters at equilibrium. The quantity measures for each cluster the minimum –norm distance to the exact pattern and then computes the normalized –norm of these quantities. The definition of the measure is inspired by the idea of computing an average of the minimum distances between the clusters and the shape , when formation of multiple clusters distributed close the shape arises, as in the cases showed here. Certainly, cannot provide a general way to measure the quality of the results, since e.g. in case of one steady-state cluster positioned exactly on a point of , we would have providing absurdly the optimal choice.
In the following, all the results are given for an initial set of particles and a large enough final time to reach a steady–state . Moreover, we use the Euclidean norm and all particles are initialized with a constant static feature. For an extension of this application to clustering also with respect to the static feature see Remark 4.1 below.
In Table 1 and Table 2 we show a sensitivity study of the error as function of the percentage of noise and of the bounded confidence value , for initial noisy data uniformly and normally distributed, respectively. The number of clusters at equilibrium is also provided. Results with minimal error value are highlighted with bold font. In particular, we point out as the increasing percentage of noise highly affects the results.
In Figure 4.8 and Figure 4.9 some of this cases are shown. Precisely, for the uniformly distributed initial noisy data, Figure 4.8, we consider the largest value of the percentage of noise and three values of the bounded confidence level : the smallest in Table 1, the optimal (giving the smallest value of the error ) and the largest one . We observe that the result is highly influenced by the choice of the confidence bound which determines the number of final clusters. Smaller and larger values of result in larger values of the error measure . In fact, in one case the model provides too many clusters which are very spread out, with several outliers. In the other case too few clusters so that all the information on the exact shape is lost. For the optimal value of the model provides a good agreement with the exact pattern.
Similar considerations hold for Figure 4.9 where we show the noisy initial data obtained with percentage of noise and three values of the bounded confidence level , (giving the smallest value of the error ) and .
We point out that the goal of this application is to provide a preliminary step for shape feature extraction. This technique should be coupled with a further algorithm which is able to select the correct letter from a given alphabet. The dimensionality reduction provided by the data clustering approach allows to efficiently employ the subsequent recognition analysis.
Remark 4.1** (Shape detection with non–constant static feature).**
In the previous examples the static features is taken constant for all the data. In the non–constant case, one could think of this feature as an additional initial given input which measures the quality of the information of each single point and that can be modeled by the distance to its exact value in .
4.3 Color image segmentation
We now turn to the second application of the data clustering model 3.3 which is the segmentation of gray scale images. Image segmentation is widely used in medical and astronomical image processing, face recognition, etc. In fact, this technique allows to partition an image in sets of significant regions of pixels sharing same characteristics such as closeness and similar intensity of color. As in shape detection, the aim of such approach is to modify the description of an image into a structure which easier to be analyzed for subsequent computer vision algorithms.
Several mathematical techniques have been applied to image segmentation. For instance we mention level set methods [39, 43] methods based on the Kuramoto model [29, 37] and supervised convolution neural networks [17, 46]. A more complicated procedure to segmentation of images is the clustering approach and we refer e.g. to the –means method [44, 47], –means method [33] and hierarchical clustering method [45].
Here, we study the efficiency of the kinetic model (3.3) to solve image segmentation problems and therefore we still relies on the clustering technique. Thanks to the model introduced in this paper, segmentation can be performed by using two levels of clustering in order to determine regions of pixels with similar characteristics. More precisely, we cluster based on the Euclidean distance and the distance of the gray intensity between pixels. Taking into account spatial coordinates is needed in order to avoid the problem of selecting homogeneous regions of pixels which are however distinct in the original image. The clustering with respect the intensity of the gray colors is performed by using the static feature variable .
The application of (3.3) works as described in the following. Number of pixels is the number of particles which are assumed to be equally spaced samples. The intensity of the gray color of each pixel is computed at initial time and defines the one–dimensional static feature of each particle. The Mean Field Interaction Algorithm 1 is then applied to find clusters representing local regions of the original image with homogeneous intensity of color. At equilibrium, we compute the mean of the color intensity of pixels belonging to the same cluster and then they are mapped back to the original positions in the initial image to get the segmentation. Another possible approach, which is more suitable for images with very sharp color intensities, such as in astronomical images, is to apply thresholding technique. This method is based on replacing the color intensity of each cluster by black if the mean is below a certain threshold or by white otherwise. This technique results therefore in binary images.
In Figure 4.10 we first apply the segmentation to a benchmark test in order to show how the model works on a simple test. We initialize an gray scale image with pixels with four regions of different intensity colors. The top and the bottom left corners have intensity and , respectively. The top and the bottom right corners have intensity [math] and , respectively. See the left panel of Figure 4.10. The positions of the pixels are rescaled on . The clustering algorithm is applied with the two bounded confidence values and . At equilibrium the two red clusters showed in the middle panel of Figure 4.10 are computed by the kinetic model. The mean of the intensity colors of the pixels in each cluster is computed and mapped back to the initial position obtaining the segmentation in the right panel of Figure 4.10. The two values of the gray intensity are and .
We now apply the segmentation process to real images taken from different data–sets. In Figure 4.11 we consider an image of pixels showing a night sky, trees and the moon. On this example, the method is able to provide good results with a wide range of confidence values since the variation of the gray scale is sharp between the objects which are also characterized by regions having homogeneous colors. In Figure 4.11 we report the result obtained with and which results in the formation of clusters.
The second image in Figure 4.12 is also characterized by two backgrounds: the sky which is very homogeneous and the field which is less homogeneous. The goal of the segmentation process would be to identify the two cows, separating them from the background. We report the results obtained with and , resulting in clusters. Observe that is taken small in order to avoid the formation of many clusters due to the low homogeneity of the field. The two cows are well identified by the method.
In the case of Figure 4.13 the confidence level is taken larger in order to force clustering of regions with snow but different shadows. The clustering method identifies clusters and the skier is well separated by the background.
In Figure 4.14 we employ the kinetic model for clustering to segmentation of a real image taken by [32]. The true image is pixels and several values of the bounded confidence levels and are applied in order to cluster with respect positions and intensity color of pixels. The best result is obtained with and which results in the formation of clusters. Lower values of allows to obtain more clusters and thus more gray intensity colors at equilibrium. Increasing requires to not take also large, otherwise many information are lost at equilibrium.
Finally, in Figure 4.15 we present an additional experiment aimed to provide a comparison between our segmentation process and the one published in [29] based on the Kuramoto model. The image is selected from the data–set [32]. Right panel of Figure 4.15 has to be compared with Figure (7c) in [29] and, in particular, we observe that our result is able to detect better some structures of the image that are lost by using the Kuramoto model.
5 Conclusions
In this paper we have proposed a new method for clustering of large data which is based on a suitable generalization of the Hegselmann-Krause opinion dynamics model. The extension accounts for clustering with respect to two different sets of features of each single datum: one set describes time dependent characteristics, the other one represents static characteristics.
The mean–field limit of the particle model has been formally derived and the resulting kinetic equation allows for the study of mathematical properties. Time evolution of moments and asymptotic behavior of kinetic equation have been analytically characterized. Moreover, the derivation of the mean–field model allows for reduction of computational complexity thanks to a suitable random subset Monte Carlo algorithm.
Several applications to digital imaging have been proposed. In particular, we have focused on application to shape detection and image segmentation, showing the efficiency of the model to provide satisfying results. Finally, we emphasize that the present model has to be intended as a starting point towards more realistic applications, for example based on the use of non static features combined with suitable machine learning approaches.
Acknowledgments
The authors would like to thank the German Research Foundation (DFG) for the kind support within the Cluster of Excellence “Internet of Production” (IoP ID390621612). Lorenzo Pareschi and Giuseppe Visconti acknowledge the support of the “National Group for Scientific Computation (GNCS-INDAM)”, project ”Numerical approximation of hyperbolic problems and applications”.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] G. Albi, N. Bellomo, L. Fermo, S.-Y. Ha, J. Kim, L. Pareschi, D. Poyato, and J. Soler. Vehicular traffic, crowds, and swarms. from kinetic theory and multiscale methods to applications and research perspectives. Math. Models Meth. Appl. Scie. , to appear, 2019.
- 2[2] G. Albi and L. Pareschi. Binary interaction algorithms for the simulation of flocking and swarming dynamics. Multiscale Model. Simul. , 11(1):1–29, 2013.
- 3[3] G. Albi and L. Pareschi. Modeling of self-organized systems interacting with a few individuals: From microscopic to macroscopic dynamics. Appl. Math. Lett. , 26(4):397–401, 2013.
- 4[4] G. Albi, L. Pareschi, G. Toscani, and M. Zanella. Recent advances in opinion modeling: control and social influence. In N. Bellomo, P. Degond, and E. Tadmor, editors, Active Particles, Volume 1 , pages 49–98. Birkhäuser, Cham, 2017.
- 5[5] G. Albi, L. Pareschi, and M. Zanella. Opinion dynamics over complex networks: kinetic modeling and numerical methods. Kinet. Relat. Models , 10(1):1–32, 2017.
- 6[6] P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik. Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. , 33(5):898–916, May 2011.
- 7[7] V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis. On Krauses’s multi-agent consensus model with state-dependent connectivity. IEEE T Automat Contr , 54(11):2586–2597, 2009.
- 8[8] V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis. Continuous time average-preserving opinion dynamics with opinion-dependent communications. SIAM J. Control Optim. , 48(8):5214–5240, 2010.