Multiple unit combat pursuit question

What happens when Multiple units pursue the same fleeing unit, ignoring a second unit that rolls lower than these pursuers pursuit roll ?

Example: My Yeomen and 2 Knights are in combat with a unit of Goblins, before being flank charged by a unit of Orcs.
Sadly they lose the combat and both units fail their leadership checks, meaning they must flee
BRB P60 says "units on winning side are each only permitted to pursue a single enemy unit"
My opponent says he will pursue the Knights with both the Goblin and the Orc unit.
The Goblins roll an 11 the Orcs a 5, the Knights a 7 and the Yeomen an 8
Clearly the Knights have been destroyed, but what we were not clear on is what happens to the Yeomen?
Bizarrely it seems that the Goblins have gone past the Yeomen, but not destroyed them (as they were busy pursuing the Knights?).

Is this correct?



GGGGG
GGGGGOOO
YYYYKKOOO
           OOO
           OOO
           OOO

G = Goblin
O = Orc
Y = Yeoman
K = Knight