Text this: Matrix Generation by First-Order Taylor Expansion in a Localized Manner