Robust Least Mean Squares Estimation of Graph Signals

IEEE Transactions on Signal Processing, 2020

We propose two new least mean squares (LMS)-based algorithms for adaptive estimation of graph signals that improve the convergence speed of the LMS algorithm while preserving its low computational complexity. The first algorithm, named extended least mean squares (ELMS), extends the LMS algorithm by virtue of reusing the signal vectors of previous iterations alongside the signal available at the current iteration. Utilizing the previous signal vectors accelerates the convergence of the ELMS algorithm at the expense of higher steady-state error compared to the LMS algorithm. To further improve the performance, we propose the fast ELMS (FELMS) algorithm in which the influence of the signal vectors of previous iterations is controlled by optimizing the gradient of the mean-square deviation (GMSD). The FELMS algorithm converges faster than the ELMS algorithm and has steady-state errors comparable to that of the LMS algorithm. We analyze the mean-square performance of ELMS and FELMS algorithms theoretically and derive the respective convergence conditions as well as the predicted MSD values. In addition, we present an adaptive sampling strategy in which the sampling probability of each node is changed according to the GMSD of the node. Computer simulations using both synthetic and real data validate the theoretical results and demonstrate the merits of the proposed algorithms.

ArXiv, 2016

In many applications spanning from sensor to social networks, transportation systems, gene regulatory networks or big data, the signals of interest are defined over the vertices of a graph. The aim of this paper is to propose a least mean square (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the performance of the proposed method. Furthermore, to cope with the case where the bandwidth is not known beforehand, we propose a method that performs a sparse online estimation of the signal supp...

IEEE Transactions on Signal and Information Processing over Networks, 2016

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the performance of the proposed method. Furthermore, to cope with the case where the bandwidth is not known beforehand, we propose a method that performs a sparse online estimation of the signal support in the (graph) frequency domain, which enables online adaptation of the graph sampling strategy. Finally, we apply the proposed method to build the power spatial density cartography of a given operational region in a cognitive network environment.

IEEE Transactions on Signal Processing

The goal of this paper is to propose novel strategies for adaptive learning of signals defined over graphs, which are observed over a (randomly time-varying) subset of vertices. We recast two classical adaptive algorithms in the graph signal processing framework, namely, the least mean squares (LMS) and the recursive least squares (RLS) adaptive estimation strategies. For both methods, a detailed mean-square analysis illustrates the effect of random sampling on the adaptive reconstruction capability and the steady-state performance. Then, several probabilistic sampling strategies are proposed to design the sampling probability at each node in the graph, with the aim of optimizing the tradeoff between steady-state performance, graph sampling rate, and convergence rate of the adaptive algorithms. Finally, a distributed RLS strategy is derived and is shown to be convergent to its centralized counterpart. Numerical simulations carried out over both synthetic and real data illustrate the good performance of the proposed sampling and reconstruction strategies for (possibly distributed) adaptive learning of signals defined over graphs.

2016 24th European Signal Processing Conference (EUSIPCO), 2016

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with guaranteed performance in terms of mean-square error, and tracking from a limited number of observations sampled over a subset of vertices. A detailed mean square analysis provides the performance of the proposed method, and leads to several insights for designing useful sampling strategies for graph signals. Numerical results validate our theoretical findings, and illustrate the advantages achieved by the proposed strategy for online estimation of band-limited graph signals.

Signal Processing

This work proposes a normalized least-mean-squares (NLMS) algorithm for online estimation of bandlimited graph signals (GS) using a reduced number of noisy measurements. As in the classical adaptive filtering framework, the resulting GS estimation technique converges faster than the least-mean-squares (LMS) algorithm while being less complex than the recursive least-squares (RLS) algorithm, both recently recast as adaptive estimation strategies for the GS framework. Detailed steady-state mean-squared error and deviation analyses are provided for the proposed NLMS algorithm, and are also employed to complement previous analyses on the LMS and RLS algorithms. Additionally, two different time-domain data-selective (DS) strategies are proposed to reduce the overall computational complexity by only performing updates when the input signal brings enough innovation. The parameter setting of the algorithms is performed based on the analysis of these DS strategies, and closed formulas are derived for an accurate evaluation of the update probability when using different adaptive algorithms. The theoretical results predicted in this work are corroborated with high accuracy by numerical simulations.

2017

This work proposes distributed recursive least squares (RLS) strategies for adaptive reconstruction and learning of signals defined over graphs. First, we introduce a centralized RLS estimation strategy with probabilistic sampling, and we propose a sparse sensing method that selects the sampling probability at each node in the graph in order to guarantee adaptive signal reconstruction and a target steady-state performance. Then, a distributed RLS strategy is derived and is shown to be convergent to its centralized counterpart. The performed numerical tests show the performance of the proposed adaptive method for distributed learning of graph signals.

2017 25th European Signal Processing Conference (EUSIPCO)

The aim of this paper is to propose optimal sampling strategies for adaptive learning of signals defined over graphs. Introducing a novel least mean square (LMS) estimation strategy with probabilistic sampling, we propose two different methods to select the sampling probability at each node, with the aim of optimizing the sampling rate, or the mean-square performance, while at the same time guaranteeing a prescribed learning rate. The resulting solutions naturally lead to sparse sampling probability vectors that optimize the tradeoff between graph sampling rate, steady-state performance, and learning rate of the LMS algorithm. Numerical simulations validate the proposed approach, and assess the performance of the proposed sampling strategies for adaptive learning of graph signals.

arXiv (Cornell University), 2022

This paper generalizes the proportionate-type adaptive algorithm to the graph signal processing and proposes two proportionate-type adaptive graph signal recovery algorithms. The gain matrix of the proportionate algorithm leads to faster convergence than least mean squares (LMS) algorithm. In this paper, the gain matrix is obtained in a closed-form by minimizing the gradient of the mean-square deviation (GMSD). The first algorithm is the Proportionate-type Graph LMS (Pt-GLMS) algorithm which simply uses a gain matrix in the recursion process of the LMS algorithm and accelerates the convergence of the Pt-GLMS algorithm compared to the LMS algorithm. The second algorithm is the Proportionate-type Graph Extended LMS (Pt-GELMS) algorithm, which uses the previous signal vectors alongside the signal of the current iteration. The Pt-GELMS algorithm utilizes two gain matrices to control the effect of the signal of the previous iterations. The stability analyses of the algorithms are also provided. Simulation results demonstrate the efficacy of the two proposed proportionate-type LMS algorithms.

Cooperative and Graph Signal Processing, 2018

The aim of this chapter is to give an overview of the recent advances related to sampling and recovery of signals defined over graphs. First, we illustrate the conditions for perfect recovery of bandlimited graph signals from samples collected over a selected set of vertexes. Then, we describe some sampling design criteria proposed in the literature to mitigate the effect of noise and model mismatching when performing graph signal recovery. Finally, we illustrate algorithms and optimal sampling strategies for adaptive recovery and tracking of dynamic graph signals, where both sampling set and signal values are allowed to vary with time. Numerical simulations carried out over both synthetic and real data illustrate the potential advantages of graph signal processing methods for sampling, interpolation, and tracking of signals observed over irregular domains such as, e.g., technological or biological networks.