The phrase "harder opponents" means that the people or teams you are competing against are more challenging or difficult to defeat.