Yes, but I also have auto loot turned on. The window stays up indefinitely. Typically what I will do is Shift Click (to not auto loot), click the piece of loot I want, then hit yes. I've not had any issues of the window disappearing but you're right, there's no way for you to see which piece of loot you're binding to yourself.