I also have a hard time with dresses and some structured pieces because even though most of my measurements are a 00 or smaller, my naturalwaist is often closer to a 2.
The area just under the bust is a woman's smallest torso measurement, so emphasizing it with a structured waistband that hits higher than your naturalwaist will make you look a size smaller.