I have a feeling Dalaran is so slow because it's so small. Too much crap going on in such a little area it forces everything to be loaded/cached since its considered close by to your character.