The phrase "rough diamond" refers to a person who has good qualities or potential, but may appear unpolished or rough around the edges.