You're able to tame horses fairly early in the game - as you first leave the Great Plateau and head towards Kakariko Village as part of the Seek out
Impa quest - but it's worth learning how to effectively break them in and
eventually gain more valuable ones.