Blue-Noise Sampling on Graphs
Gonzalo Arce2018, arXiv (Cornell University)
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Related papers
The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains
IEEE Signal Processing Magazine, 2000
In applications such as social, energy, transportation, sensor, and neuronal networks, high-dimensional data naturally reside on the vertices of weighted graphs. The emerging field of signal processing on graphs merges algebraic and spectral graph theoretic concepts with computational harmonic analysis to process such signals on graphs. In this tutorial overview, we outline the main challenges of the area, discuss different ways to define graph spectral domains, which are the analogues to the classical frequency domain, and highlight the importance of incorporating the irregular structures of graph data domains when processing signals on graphs. We then review methods to generalize fundamental operations such as filtering, translation, modulation, dilation, and downsampling to the graph setting, and survey the localized, multiscale transforms that have been proposed to efficiently extract information from high-dimensional data on graphs. We conclude with a brief discussion of open issues and possible extensions.
Graph Signal Processing -- Part I: Graphs, Graph Spectra, and Spectral Clustering
arXiv (Cornell University), 2019
The area of Data Analytics on graphs promises a paradigm shift as we approach information processing of classes of data, which are typically acquired on irregular but structured domains (social networks, various ad-hoc sensor networks). Yet, despite its long history, current approaches mostly focus on the optimization of graphs themselves, rather than on directly inferring learning strategies, such as detection, estimation, statistical and probabilistic inference, clustering and separation from signals and data acquired on graphs. To fill this void, we first revisit graph topologies from a Data Analytics point of view, and establish a taxonomy of graph networks through a linear algebraic formalism of graph topology (vertices, connections, directivity). This serves as a basis for spectral analysis of graphs, whereby the eigenvalues and eigenvectors of graph Laplacian and adjacency matrices are shown to convey physical meaning related to both graph topology and higher-order graph properties, such as cuts, walks, paths, and neighborhoods. Through a number of carefully chosen examples, we demonstrate that the isomorphic nature of graphs enables the basic properties and descriptors to be preserved throughout the data analytics process, even in the case of reordering of graph vertices, where classical approaches fail. Next, to illustrate estimation strategies performed on graph signals, spectral analysis of graphs is introduced through eigenanalysis of mathematical descriptors of graphs and in a generic way. Finally, a framework for vertex clustering and graph segmentation is established based on graph spectral representation (eigenanalysis) which illustrates the power of graphs in various data association tasks. The supporting examples demonstrate the promise of Graph Data Analytics in modeling structural and functional/semantic inferences. At the same time, Part I serves as a basis for Part II and Part III which deal with theory, methods and applications of processing Data on Graphs and Graph Topology Learning from data. Contents 1 Introduction 2 2 Graph Definitions and Properties 3 2.1 Basic Definitions. .. .. .. .. .. .. .. 3 2.2 Some Frequently Used Graph Topologies. . 5 2.3 Properties of Graphs and Associated Matrices 7 3 Spectral Decomposition of Graph Matrices 10 3.
From graphs to signals and back: Identification of graph structures using spectral analysis
2015
Many systems comprising entities in interactions can be represented as graphs, whose structure gives significant insights about how these systems work. Network theory has undergone further developments, in particular in relation to detection of communities in graphs, to catch this structure. Recently, an approach has been proposed to transform a graph into a collection of signals: Using a multidimensional scaling technique on a distance matrix representing relations between vertices of the graph, points in a Euclidean space are obtained and interpreted as signals, indexed by the vertices. In this article, we propose several extensions to this approach, developing a framework to study graph structures using signal processing tools. We first extend the current methodology, enabling us to highlight connections between properties of signals and graph structures, such as communities, regularity or randomness, as well as combinations of those. A robust inverse transformation method is next described, taking into account possible changes in the signals compared to original ones. This technique uses, in addition to the relationships between the points in the Euclidean space, the energy of each signal, coding the different scales of the graph structure. These contributions open up new perspectives in the study of graphs, by enabling processing of graphs through the processing of the corresponding collection of signals, using reliable tools from signal processing. A technique of denoising of a graph by filtering of the corresponding signals is then described, suggesting considerable potential of the approach.
Graph Signal Processing: Foundations and Emerging Directions [From the Guest Editors]
IEEE Signal Processing Magazine
Graph Signal Processing - Part II: Processing and Analyzing Signals on Graphs
2019
The focus of Part I of this monograph has been on both the fundamental properties, graph topologies, and spectral representations of graphs. Part II embarks on these concepts to address the algorithmic and practical issues centered round data/signal processing on graphs, that is, the focus is on the analysis and estimation of both deterministic and random data on graphs. The fundamental ideas related to graph signals are introduced through a simple and intuitive, yet illustrative and general enough case study of multisensor temperature field estimation. The concept of systems on graph is defined using graph signal shift operators, which generalize the corresponding principles from traditional learning systems. At the core of the spectral domain representation of graph signals and systems is the Graph Discrete Fourier Transform (GDFT). The spectral domain representations are then used as the basis to introduce graph signal filtering concepts and address their design, including Chebys...
Complex Basis For Spectral Analysis of Graph Signals
International Journal of Mathematics Trends and Technology, 2020
The Signal Processing on Graph (SPG) is an emerging field of research aiming to develop accurate methods for big data analysis by combining graph theory and classical signal processing methods. One key method in signal processing on graph is the so-called Graph Fourier Transform (GFT) which is a generalization of the Classical Fourier Transform (defined for data lying on regular domains :1D for times series or 2D for images) to data lying on networks. Those network data are viewed like a set of interrelated data points lying on a graph whose graph vertices map the data points and graph links encode the relationship between data. In the classical framework, the Fourier transform is a linear operator that performs the mapping of a vector from its initial representation domain to the frequency domain through the Fourier matrix which is an orthonormal basis formed by complex exponential vectors constructed from powers of the complex number. Those vectors are of a key importance in the properties of the transform and its applications. However, for each graph Fourier transform proposed in the literature, although its graph Fourier matrix is orthonormal, its vectors are not complex as in the classical framework, limiting the extension and the use of some useful properties of the classical Fourier transform to the graph signals framework. In this work, we present a method to define a complex orthonormal basis for the graph Fourier transform that allows to perform spectral analysis for graph signals in the frequency domain. The graph Fourier basis we defined is identical to the Fourier basis when applied to graph signals defined on a regular domain. We applied the proposed method successfully to signal detection on an irregularly sampled sensor network.
Fourier could be a data scientist: From graph Fourier transform to signal processing on graphs
Comptes Rendus Physique
The legacy of Joseph Fourier in science is vast, especially thanks to the essential tool that is the Fourier Transform. The flexibility of this analysis, its computational efficiency and the physical interpretation it offers makes it a cornerstone in many scientific domains. With the explosion of digital data, both in quantity and diversity, the generalization of the tools based on Fourier Transform is mandatory. In data science, new problems arose for the processing of irregular data such as social networks, biological networks or other data on networks. Graph Signal Processing is a promising approach to deal with those. The present text is an overview of the state-of-the-art in Graph Signal Processing, focusing on how to define a Fourier Transform for data on graphs, how to interpret it and how to use it to process such data. It closes showing some examples of use. Along the way, the review reveals how Fourier's work remains modern and universal, and how his concepts, coming from physics and blended with mathematics, computer science and signal processing, play a key role to answer the modern challenges in data science.
A SYSTEMATIC REVIEW OF GRAPH SIGNAL PROCESSING
Graph signal processing(GSP) is a representation of data in graphical format with directed or undirected vertices. In many applications such as big data networks, economic and social networks analysis signals with graph is relevant. Harmonic analysis for processing the signals with spectral and algebric graphical thereotical concepts are merged and analyzed with respect to signal processing schemes on graphs. In this work, main challenges of GSP are discussed with Graph Spectral Domains (GSD) and when processing the signals on graph. The information is extracted efficiently from the highdimensional data by using operators of signals on graph and transformation of graph on signal are highlighted in this work. Finally, a brief discussion of open issues of GSP are reviewed.
Vertex-Frequency Graph Signal Processing
ArXiv, 2019
Graph signal processing deals with signals which are observed on an irregular graph domain. While many approaches have been developed in classical graph theory to cluster vertices and segment large graphs in a signal independent way, signal localization based approaches to the analysis of data on graph represent a new research direction which is also a key to big data analytics on graphs. To this end, after an overview of the basic definitions in graphs and graph signals, we present and discuss a localized form of the graph Fourier transform. To establish an analogy with classical signal processing, spectral- and vertex-domain definitions of the localization window are given next. The spectral and vertex localization kernels are then related to the wavelet transform, followed by a study of filtering and inversion of the localized graph Fourier transform. For rigour, the analysis of energy representation and frames in the localized graph Fourier transform is extended to the energy fo...
Vertex-Frequency Analysis: A Way to Localize Graph Spectral Components [Lecture Notes]
IEEE Signal Processing Magazine, 2017
Vertex-frequency graph signal processing: A comprehensive review
Digital Signal Processing, 2020
Graph signal processing deals with signals which are observed on an irregular graph domain. While many approaches have been developed in classical graph theory to cluster vertices and segment large graphs in a signal independent way, signal localization based approaches to the analysis of data on graph represent a new research direction which is also a key to big data analytics on graphs. To this end, after an overview of the basic definitions of graphs and graph signals, we present and discuss a localized form of the graph Fourier transform. To establish analogy with classical signal processing, spectral domain and vertex domain definitions of the localization window are given next. The spectral and vertex localization kernels are then related to the wavelet transform, followed by their polynomial approximations and a study of filtering and inversion operations. For rigor, the analysis of energy representation and frames in the localized graph Fourier transform is extended to the energy forms of vertex-frequency distributions, which operate even without the requirement to apply localization windows. Another link with classical signal processing is established through the concept of local smoothness, which is subsequently related to the paradigm of signal smoothness on graphs, a lynchpin which connects the properties of the signals on graphs and graph topology. This all represents a comprehensive account of the relation of general vertex-frequency analysis with classical time-frequency analysis, an important but missing link for more advanced applications of graph signal processing. The theory is supported by illustrative and practically relevant examples.
Data Analytics on Graphs Part II: Signals on Graphs
Foundations and Trends® in Machine Learning, 2020
Vertex-Frequency Graph Signal Processing: A review
2019
Graph signal processing deals with signals which are observed on an irregular graph domain. While many approaches have been developed in classical graph theory to cluster vertices and segment large graphs in a signal independent way, signal localization based approaches to the analysis of data on graph represent a new research direction which is also a key to big data analytics on graphs. To this end, after an overview of the basic definitions in graphs and graph signals, we present and discuss a localized form of the graph Fourier transform. To establish an analogy with classical signal processing, spectral- and vertex-domain definitions of the localization window are given next. The spectral and vertex localization kernels are then related to the wavelet transform, followed by a study of filtering and inversion of the localized graph Fourier transform. For rigour, the analysis of energy representation and frames in the localized graph Fourier transform is extended to the energy fo...
From graphs to signals and back: Identification of network structures using spectral analysis
arXiv (Cornell University), 2015
The structure of networks describing interactions between entities gives significant insights about how these systems work. Recently, an approach has been proposed to transform a graph into a collection of signals, using a multidimensional scaling technique on a distance matrix representing relations between vertices of the graph as points in a Euclidean space: coordinates are interpreted as components, or signals, indexed by the vertices. In this article, we propose several extensions to this approach: We first extend the current methodology, enabling us to highlight connections between properties of the collection of signals and graph structures, such as communities, regularity or randomness, as well as combinations of those. A robust inverse transformation method is next described, taking into account possible changes in the signals compared to original ones. This technique uses, in addition to the relationships between the points in the Euclidean space, the energy of each signal, coding the different scales of the graph structure. These contributions open up new perspectives by enabling processing of graphs through the processing of the corresponding collection of signals. A technique of denoising of a graph by filtering of the corresponding signals is then described, suggesting considerable potential of the approach.
Sampling and Recovery of Graph Signals
Cooperative and Graph Signal Processing, 2018
The aim of this chapter is to give an overview of the recent advances related to sampling and recovery of signals defined over graphs. First, we illustrate the conditions for perfect recovery of bandlimited graph signals from samples collected over a selected set of vertexes. Then, we describe some sampling design criteria proposed in the literature to mitigate the effect of noise and model mismatching when performing graph signal recovery. Finally, we illustrate algorithms and optimal sampling strategies for adaptive recovery and tracking of dynamic graph signals, where both sampling set and signal values are allowed to vary with time. Numerical simulations carried out over both synthetic and real data illustrate the potential advantages of graph signal processing methods for sampling, interpolation, and tracking of signals observed over irregular domains such as, e.g., technological or biological networks.
Spectral Graph Analysis: A Unified Explanation and Modern Perspectives
arXiv: Statistics Theory, 2019
Complex networks or graphs are ubiquitous in sciences and engineering: biological networks, brain networks, transportation networks, social networks, and the World Wide Web, to name a few. Spectral graph theory provides a set of useful techniques and models for understanding `patterns of interconnectedness' in a graph. Our prime focus in this paper is on the following question: Is there a unified explanation and description of the fundamental spectral graph methods? There are at least two reasons to be interested in this question. Firstly, to gain a much deeper and refined understanding of the basic foundational principles, and secondly, to derive rich consequences with practical significance for algorithm design. However, despite half a century of research, this question remains one of the most formidable open issues, if not the core problem in modern network science. The achievement of this paper is to take a step towards answering this question by discovering a simple, yet un...
Exploiting Structure In Data: Sampling and Signal Processing on Graphs
2020
With the explosive growth of information and communication, data is being generated at an unprecedented rate from various sources, including multimedia, sensor networks, biological systems, social networks, and physical infrastructure. Research in graph signal processing aims to develop tools for processing such data by providing a framework for the analysis of high-dimensional datadefined on irregular graph domains. Graph signal processing extends fundamental signal processingconcepts to data supported on graphs that we refer to as graph signals. In this work, we study two fraternal problems: (1) sampling and (2) reconstruction of signals on graphs. Both of these problems are eminent topics in the field of signal processing over the past decades and have meaningful implications for many real-world problems including semi-supervised learning and activelearning on graphs. Sampling is the task of choosing or measuring some representative subset of the signal such that we can interpola...
GRAPH SPECTRAL TECHNIQUES IN COMPUTER SCIENCES
We give a survey of graph spectral techniques used in computer sciences. The survey consists of a description of particular topics from the theory of graph spectra independently of the areas of Computer science in which they are used. We have described the applications of some important graph eigenvalues (spectral radius, algebraic connectivity, the least eigenvalue etc.), eigenvectors (principal eigenvector, Fiedler eigenvector and other), spectral reconstruction problems, spectra of random graphs, Hoffman polynomial, integral graphs etc. However, for each described spectral technique we indicate the fields in which it is used (e.g. in modelling and searching Internet, in computer vision, pattern recognition, data mining, multiprocessor systems, statistical databases, and in several other areas). We present some novel mathematical results (related to clustering and the Hoffman polynomial) as well.
On Local Distributions in Graph Signal Processing
ArXiv, 2022
Graph filtering is the cornerstone operation in graph signal processing (GSP). Thus, understanding it is key in developing potent GSP methods. Graph filters are local and distributed linear operations, whose output depends only on the local neighborhood of each node. Moreover, a graph filter’s output can be computed separately at each node by carrying out repeated exchanges with immediate neighbors. Graph filters can be compactly written as polynomials of a graph shift operator (typically, a sparse matrix description of the graph). This has led to relating the properties of the filters with the spectral properties of the corresponding matrix – which encodes global structure of the graph. In this work, we propose a framework that relies solely on the local distribution of the neighborhoods of a graph. The crux of this approach is to describe graphs and graph signals in terms of a measurable space of rooted balls. Leveraging this, we are able to seamlessly compare graphs of different ...
A Hilbert Space Theory of Generalized Graph Signal Processing
IEEE Transactions on Signal Processing, 2019
Graph signal processing (GSP) has become an important tool in many areas such as image processing, networking learning and analysis of social network data. In this paper, we propose a broader framework that not only encompasses traditional GSP as a special case, but also includes a hybrid framework of graph and classical signal processing over a continuous domain. Our framework relies extensively on concepts and tools from functional analysis to generalize traditional GSP to graph signals in a separable Hilbert space with infinite dimensions. We develop a concept analogous to Fourier transform for generalized GSP and the theory of filtering and sampling such signals.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.