Text this: The Goldilocks principle of learning unitaries by interlacing fixed operators with programmable phase shifters on a photonic chip