Nope not at all, I chose the Bandit right off the bat. It's a good melee class if thats what you're looking for. I did invest a bit into his attunement and intelligence so he can use some magic further down the line. But I am pretty much happy with my choice, I have a lvl 24 Bandit right now and plan to soon start playing with the Pyromancer just to get both melee and magic players under my belt.
What class did you end up staying with?