Distributed Adaptive Learning of Graph Signals

IEEE Transactions on Signal Processing

The goal of this paper is to propose novel strategies for adaptive learning of signals defined over graphs, which are observed over a (randomly time-varying) subset of vertices. We recast two classical adaptive algorithms in the graph signal processing framework, namely, the least mean squares (LMS) and the recursive least squares (RLS) adaptive estimation strategies. For both methods, a detailed mean-square analysis illustrates the effect of random sampling on the adaptive reconstruction capability and the steady-state performance. Then, several probabilistic sampling strategies are proposed to design the sampling probability at each node in the graph, with the aim of optimizing the tradeoff between steady-state performance, graph sampling rate, and convergence rate of the adaptive algorithms. Finally, a distributed RLS strategy is derived and is shown to be convergent to its centralized counterpart. Numerical simulations carried out over both synthetic and real data illustrate the good performance of the proposed sampling and reconstruction strategies for (possibly distributed) adaptive learning of signals defined over graphs.

2017

This work proposes distributed recursive least squares (RLS) strategies for adaptive reconstruction and learning of signals defined over graphs. First, we introduce a centralized RLS estimation strategy with probabilistic sampling, and we propose a sparse sensing method that selects the sampling probability at each node in the graph in order to guarantee adaptive signal reconstruction and a target steady-state performance. Then, a distributed RLS strategy is derived and is shown to be convergent to its centralized counterpart. The performed numerical tests show the performance of the proposed adaptive method for distributed learning of graph signals.

2017 25th European Signal Processing Conference (EUSIPCO)

The aim of this paper is to propose optimal sampling strategies for adaptive learning of signals defined over graphs. Introducing a novel least mean square (LMS) estimation strategy with probabilistic sampling, we propose two different methods to select the sampling probability at each node, with the aim of optimizing the sampling rate, or the mean-square performance, while at the same time guaranteeing a prescribed learning rate. The resulting solutions naturally lead to sparse sampling probability vectors that optimize the tradeoff between graph sampling rate, steady-state performance, and learning rate of the LMS algorithm. Numerical simulations validate the proposed approach, and assess the performance of the proposed sampling strategies for adaptive learning of graph signals.

IEEE Transactions on Signal Processing, 2020

We propose two new least mean squares (LMS)-based algorithms for adaptive estimation of graph signals that improve the convergence speed of the LMS algorithm while preserving its low computational complexity. The first algorithm, named extended least mean squares (ELMS), extends the LMS algorithm by virtue of reusing the signal vectors of previous iterations alongside the signal available at the current iteration. Utilizing the previous signal vectors accelerates the convergence of the ELMS algorithm at the expense of higher steady-state error compared to the LMS algorithm. To further improve the performance, we propose the fast ELMS (FELMS) algorithm in which the influence of the signal vectors of previous iterations is controlled by optimizing the gradient of the mean-square deviation (GMSD). The FELMS algorithm converges faster than the ELMS algorithm and has steady-state errors comparable to that of the LMS algorithm. We analyze the mean-square performance of ELMS and FELMS algorithms theoretically and derive the respective convergence conditions as well as the predicted MSD values. In addition, we present an adaptive sampling strategy in which the sampling probability of each node is changed according to the GMSD of the node. Computer simulations using both synthetic and real data validate the theoretical results and demonstrate the merits of the proposed algorithms.

2016 24th European Signal Processing Conference (EUSIPCO), 2016

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations sampled over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the advantages achieved by the proposed strategy for online estimation of band-limited graph signals.

ArXiv, 2016

In many applications spanning from sensor to social networks, transportation systems, gene regulatory networks or big data, the signals of interest are defined over the vertices of a graph. The aim of this paper is to propose a least mean square (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the performance of the proposed method. Furthermore, to cope with the case where the bandwidth is not known beforehand, we propose a method that performs a sparse online estimation of the signal supp...

IEEE Transactions on Signal and Information Processing over Networks, 2016

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the performance of the proposed method. Furthermore, to cope with the case where the bandwidth is not known beforehand, we propose a method that performs a sparse online estimation of the signal support in the (graph) frequency domain, which enables online adaptation of the graph sampling strategy. Finally, we apply the proposed method to build the power spatial density cartography of a given operational region in a cognitive network environment.

2018

This paper proposes strategies for distributed Wiener-based reconstruction of graph signals from subsampled measurements. Given a stationary signal on a graph, we fit a distributed autoregressive moving average graph filter to a Wiener graph frequency response and propose two reconstruction strategies: i) reconstruction from a single temporal snapshot; ii) recursive signal reconstruction from a stream of noisy measurements. For both strategies, a mean square error analysis is performed to highlight the role played by the filter response and the sampled nodes, and to propose a graph sampling strategy. Our findings are validated with numerical results, which illustrate the potential of the proposed algorithms for distributed reconstruction of graph signals.

2019

Recovering a graph signal from samples is a central problem in graph signal processing. Least mean squares (LMS) method for graph signal estimation is computationally efficient adaptive method. In this paper, we introduce a technique to robustify LMS with respect to mismatches in the presumed graph topology. It builds on the fact that graph LMS converges faster when the graph topology is specified correctly. We consider two measures of convergence speed, based on which we develop randomized greedy algorithms for robust interpolation of graph signals. In simulation studies, we show that the randomized greedy robust least mean squares (RGRLMS) outperforms the regular LMS and has even more potential given a robust sampling design.

arXiv (Cornell University), 2022

This paper generalizes the proportionate-type adaptive algorithm to the graph signal processing and proposes two proportionate-type adaptive graph signal recovery algorithms. The gain matrix of the proportionate algorithm leads to faster convergence than least mean squares (LMS) algorithm. In this paper, the gain matrix is obtained in a closed-form by minimizing the gradient of the mean-square deviation (GMSD). The first algorithm is the Proportionate-type Graph LMS (Pt-GLMS) algorithm which simply uses a gain matrix in the recursion process of the LMS algorithm and accelerates the convergence of the Pt-GLMS algorithm compared to the LMS algorithm. The second algorithm is the Proportionate-type Graph Extended LMS (Pt-GELMS) algorithm, which uses the previous signal vectors alongside the signal of the current iteration. The Pt-GELMS algorithm utilizes two gain matrices to control the effect of the signal of the previous iterations. The stability analyses of the algorithms are also provided. Simulation results demonstrate the efficacy of the two proposed proportionate-type LMS algorithms.