Text this: Enhancing Evolution of Neural Network Assisted Compact Model Through Continual Learning