Also, the brushes could be irritating you. A soft, dense one should help. I've heard of this nice kabuki brush from CVS that only costs $10.
I must say that if you're using drugstore mineral makeup brands, they are most likely the problem. This is because they use cheaper, filler material [hence the lower price tag].
I hope you find a solution! Don't give up on MMU!!