Thoughts on Dahlias

I've been thinking about adding dahlias to my little garden, though I hear they are hard to grow - mostly because you have to remember to take the tubers out of the ground and then put them back in, and it has to happen at a certain time. It does not sound too complicated by itself, but the way my garden works (so far) is that as soon as I take something out, I put something else in. So there might be no place for them by the time I should stick them back in - some other lovely plant might be happily growing in their spot. And it feels a little unfair. Dahlias are also maddening for me to draw - but I love trying :) Perhaps I will get a plant too and see if it can survive without leaving the soil for the winter?