I've had no issue shooting the SX3 with a spandoflage facemask because it is form-fitting and isn't bulky. Same with the tube-type neck gaiters that can be pulled up to serve as an ear covering/face mask. I got one of that style from a local farm-home store in black to wear inside my popup blind for turkey hunting this spring and ended up buying a couple more in multicam off ebay to keep in my bow case during hunting season. Indeed, either leave your top couple buttons undone or zipped down or tuck in your collar and you won't have an issue.
As for Stan sizing, I wear an Lg/XL glove and shoot the large SX3. I always wear a glove on my bow hand, but during hunting I cut the finger stalls off my release hand glove so the bulk of the surface is covered but I have bare fingers for release operation. Sure, your release will get cold in cold weather, but a handwarmer in your pocket will keep you fully functional and when a deer steps out you don't even feel your release. Rather like the recoil of a rifle is totally a moot point when shooting at a nice buck.