The phrase "person on the other end of the phone" refers to someone who is at the receiving end of a telephone call. It means that there is another individual, not visible or physically present, but communicating with you through a phone conversation.