Evenings are peak times for WoW but also for ISP's.

If you use cable or ADSL chances are you're sharing your line with many others. Are other things slowing down at the same time? Like log out of WoW and try downloading something...

I've yet to encounter a wow server that's so incredibly busy it lags due to the userbase.

I'd be looking into your own connection towards their servers.