The place the first comes to mind for me, although maybe not a royal palace per se, is the Castle of Mey. Something about it just draws me there.
If that castle doesn't count, I'll go with Balmoral. The countryside of Scotland is someplace that has always appealed to me.