Horse problems in Sport of Kings/Horse Race?

Okay, so I’m trying to win the horse race in Sport of Kings, but once I reach Uzhitz the horse starts fighting me and pulls up every time I try to gallop, so I completely fall behind the other riders. Am I doing something wrong? My horsemanship is at 12 and I have spurs for another +3.