In spite of every other ranking factor, Google's webspam team will still occasionally take manual action against certain sites which can take half a year to a year to recover from after you've cleaned up the problems.
The webspam algorithm later became known (officially) as the Penguin algorithm update via a tweet from Matt Cutts, who was then head of the Google webspam team.