Don’t fear the worst.....as far as I know, the worst would be dropping something down in that hole! I don’t think you can ruin it just working topside for this job. If your shifting worked before the ball failed, I think you should be able to get it sorted out.