The fact of the matter is that increasing the file size of sigs will slow the site down. Watch out for the poor folks who have slow DSL...

I think 20kb is more than fine.