yes, that happens, and can be mitigated somewhat by having weak units shielded by strong ones.But a race to the final banner total is the essence of the game Victory Conditions.
Thematically it reflects pushing the army to the breaking point, when the army routs
and historically after the battle, the victors chase the losers as they race to safety
What do you hope for?
"I will either find a way, or make one."
attrib to Hannibal Barca