Horse camera view keeps flipping up

When I ride the horse and am angled down a bit (looking more towards the ground than forward), the game forces me back up again every 5 or so seconds. This is very irritating. Is this intentional or a bug?