Bad frame rates ...ie stuttering on xbox one

it seems the longer i play the worse the stuttering gets, even riding my horse is a pain I have tried the refreshing the cache thing, am contemplating buying a xbox one s…anyone have any ideas ?

Its the game not the console. Don’t drop items. Played well,up until dancing with the devil quest. Loaded older,save and avoided that quest so far so good