If you post a snapshot we can take a look at your particular case – the optimizer gives a totally custom solution for each combination of character and settings, so it’s hard to comment without seeing it. Instructions on how to do that in this post:
Without seeing the specifics: none of the secondary stats are that much stronger than the others from a pure survival point of view for Brewmasters. Shifting most of your crit to another secondary isn’t all of a sudden going to make you way tougher. You probably won’t notice much of a difference. The play might feel a little different if you e.g. move it all to haste, but you won’t feel much weaker from a toughness perspective.
That said, crit/vers are generally better offensive stats. So there’s not much downside to favoring those two stats in all situations.