Text this: Graph-theoretical approach to the eigenvalue spectrum of perturbed higher-order exceptional points