Text this: Causality-driven feature selection and domain adaptation for enhancing chemical foundation models in downstream tasks