"To feel the difference" means to be aware of or notice a change or contrast between two things. It implies that there is a previous experience or comparison that allows you to perceive a distinction in how things are or how they affect you.
Full definition