Steam overlay and controller use

I recently purchased a Steam controller to use with this game. Unfortunately I quickly found out that Steam overlay is not working and cannot seem to get the Steam controller to work. Whenever I use the steam controller I can hear it changing stuff on Steam in the background (when the game is full screen).

I’m a complete noob to Steam controller. Am I doing something wrong? Is anyone else currently able to use the steam controller?