Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise
We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured nois...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
American Physical Society
2025-01-01
|
| Series: | Physical Review Research |
| Online Access: | http://doi.org/10.1103/PhysRevResearch.7.013081 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832591247678636032 |
|---|---|
| author | Jean Barbier Francesco Camilli Yizhou Xu Marco Mondelli |
| author_facet | Jean Barbier Francesco Camilli Yizhou Xu Marco Mondelli |
| author_sort | Jean Barbier |
| collection | DOAJ |
| description | We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still remains challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide suboptimal algorithms or are limited to a special class of noise ensembles. In this paper, using tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals) we establish the characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. Remarkably, our analysis unveils the asymptotic equivalence between the rotationally invariant model and a surrogate Gaussian one. Finally, we show how to saturate the predicted statistical limits using an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations. |
| format | Article |
| id | doaj-art-9afcfa56208743788cc45778c99182de |
| institution | Kabale University |
| issn | 2643-1564 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | American Physical Society |
| record_format | Article |
| series | Physical Review Research |
| spelling | doaj-art-9afcfa56208743788cc45778c99182de2025-01-22T15:55:44ZengAmerican Physical SocietyPhysical Review Research2643-15642025-01-017101308110.1103/PhysRevResearch.7.013081Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noiseJean BarbierFrancesco CamilliYizhou XuMarco MondelliWe consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still remains challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide suboptimal algorithms or are limited to a special class of noise ensembles. In this paper, using tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals) we establish the characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. Remarkably, our analysis unveils the asymptotic equivalence between the rotationally invariant model and a surrogate Gaussian one. Finally, we show how to saturate the predicted statistical limits using an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations.http://doi.org/10.1103/PhysRevResearch.7.013081 |
| spellingShingle | Jean Barbier Francesco Camilli Yizhou Xu Marco Mondelli Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise Physical Review Research |
| title | Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise |
| title_full | Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise |
| title_fullStr | Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise |
| title_full_unstemmed | Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise |
| title_short | Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise |
| title_sort | information limits and thouless anderson palmer equations for spiked matrix models with structured noise |
| url | http://doi.org/10.1103/PhysRevResearch.7.013081 |
| work_keys_str_mv | AT jeanbarbier informationlimitsandthoulessandersonpalmerequationsforspikedmatrixmodelswithstructurednoise AT francescocamilli informationlimitsandthoulessandersonpalmerequationsforspikedmatrixmodelswithstructurednoise AT yizhouxu informationlimitsandthoulessandersonpalmerequationsforspikedmatrixmodelswithstructurednoise AT marcomondelli informationlimitsandthoulessandersonpalmerequationsforspikedmatrixmodelswithstructurednoise |