Energy-based Epistemic Uncertainty for Graph Neural Networks

by Dominik Fuchsgruber*, Tom Wollschläger,  and Stephan Günnemann.

Published at the 38th Annual Conference on Neural Information Processing Systems (NeurIPS), 2024.

 

Abstract

In domains with interdependent data, such as graphs, quantifying the epistemic uncertainty of a Graph Neural Network (GNN) is challenging as uncertainty can arise at different structural scales. Existing techniques neglect this issue or only distinguish between structure-aware and structure-agnostic uncertainty without combining them into a single measure. We propose GEBM, an energy-based model (EBM) that provides high-quality uncertainty estimates by aggregating energy at different structural levels that naturally arise from graph diffusion. In contrast to logit-based EBMs, we provably induce an integrable density in the data space by regularizing the energy function. We introduce an evidential interpretation of our EBM that significantly improves the predictive robustness of the GNN. Our framework is a simple and effective post hoc method applicable to any pre-trained GNN that is sensitive to various distribution shifts. It consistently achieves the best separation of in-distribution and out-of-distribution data on 6 out of 7 anomaly types while having the best average rank over shifts on all datasets.

 

Cite

Please cite our paper if you use the model, experimental results, or our code in your own work:

@inproceedings{fuchsgruberenergy,
  title={Energy-based Epistemic Uncertainty for Graph Neural Networks},
  author={Fuchsgruber, Dominik and Wollschl{\"a}ger, Tom and G{\"u}nnemann, Stephan},
  booktitle={The Thirty-eighth Annual Conference on Neural Information Processing Systems}
}

Links

[Paper  | GitHub]