Text this: Effect of spectral statistics on the nuclear dissipation