I noticed the same lag recently when doing the mid summer bonfire quests. I just put it down to server lag (as I live half way accross the world from the servers :-( ). I don't think I have added an additional logic that would slow that part down, but I can double check.