Modern challenges in graph coarsening

Submitted by Nicolas KERIVEN on
Team
Date of the beginning of the PhD (if already known)
01/01/2024
Place
Rennes
Laboratory
IRISA - UMR 6074
Description of the subject

Graph coarsening [1], or graph reduction, is a complex and difficult problem that consists
in, given a large graph, producing a smaller graph that “summarizes” the initial one. The
objective can be to save computing time and memory, but also to extract some interesting
properties of the original graph through its reduction. An ubiquitous tool in many areas
of scientific computing, it has been postulated that graph coarsening could bear many
interesting links with the recent domain of graph Machine Learning, which has known an
exponential growth in terms of scope, applications and literature in the last few years.
In particular, just as multi-scale Convolutional Neural Networks involve “pooling” steps,
researchers have tried to integrate graph coarsening methods in Graph Neural Networks
(GNN), but the results were generally not conclusive, mainly due to the complexity and
unstability of the current approaches. Hence the need for better, more stable approaches.
In this thesis, we will study more data-driven approaches to perform graph coarsening
through the definition of well-behaved cost functions, both supervised or unsupervised,
which could be more stable that approaches involving randomness. We will examine their
integration in GNNs such as Graph UNets [2].
There are many methods to perform graph coarsening, but most seek to preserve some
properties of the original graph, such as the spectrum of its Laplacian [4, 3]. Depending
on the candidate, we will examine such guarantees, and particularly their limitations. We
will study, both empirically and theoretically, the difference between random-based and
learning-based approaches for graph coarsening.

Bibliography

[1] Jie Chen, Yousef Saad, and Zechen Zhang. Graph coarsening: from scientific computing to
machine learning, volume 79. Springer International Publishing, 2022.


[2] Hongyang Gao and Shuiwang Ji. Graph U-Nets. IEEE Transactions on Pattern Analysis and
Machine Intelligence, 44(9):4948–4960, 2022.


[3] Andreas Loukas. Graph reduction with spectral and cut guarantees. Journal of Machine Learn-
ing Research, 20:1–42, 2019.


[4] Andreas Loukas and Pierre Vandergheynst. Spectrally approximating large graphs with smaller
graphs. 35th International Conference on Machine Learning, ICML 2018, 7:5102–5118, 2018.

Researchers

Lastname, Firstname
Roumy, Aline
Type of supervision
Director
Laboratory
Inria
Team

Lastname, Firstname
Keriven, Nicolas
Type of supervision
Supervisor (optional)
Laboratory
UMR 6074
Team
Contact·s
Nom
Keriven, Nicolas
Email
nicolas.keriven@cnrs.fr
Téléphone
+33 2 99 88 73 60
Keywords
Graph coarsening, graph neural network, random graph