Text this: An Information Geometric Perspective on the Complexity of Macroscopic Predictions Arising from Incomplete Information