The "distraction factor" refers to something that takes your attention away from what you should be focusing on or doing. It's something that distracts you and makes it harder to concentrate or stay focused. Full definition
Others are worried about the distraction factor. (inc.com)
In all, it's a good move, if not only for the distraction factor but also for the fact that the calcio mercato seems to drag on endlessly. (serpentsofmadonnina.com)
This pumps up the distraction factor immeasurably. (babygaga.com)