Text this: A Wide and Deep Exploration of Radio Galaxies with Subaru HSC (WERGS). X. The Massive and Passive Nature of Radio Galaxies at z ∼ 4