Hi Mark, I'm going to take a crack at this. Mind you, I'm no expert but I have a theory. The reason for the ball in question (again, my theory) is to prevent only one selector shaft at a time. In other words, once one selector shaft is moved, the others are locked out of movement. One doesn't want more than one gear selected-expensive noises are sure to occur! Like you, when removing the rear cover, I pulled off 5th gear synchro and gear. I feared the worst but I lucked out. I saw that the ball was still perched in its bore. This is why the manual instructs selecting 4th to prevent 5th gear selector shaft from moving. If you think about it, one could theoretically position the gear selector to grab two adjacent selector shaft notches coincidentally, absolutely to be avoided at all costs. I hope this helps.
To repeat myself, just my theory. Anyone thinks I'm misguided, please do enlighten.
Gerry