select the file in windows explorer, then hit shift+delete.

this will delete the file without putting it in the recycle bin