It may seem weird, but just leaving your nipples exposed after a feeding can really help ease the pain of cracked or bleeding nipples. (verywellfamily.com)
Notice if liquid pools at the lip / rim of the bottle and doesn't easily leave the nipple. (bluesmartmia.com)
In these instances, leaving the nipples alone for a while may help the condition to improve. (webmd.com)