Text this: Polarization Properties of the Electromagnetic Response to High-frequency Gravitational Wave