You can close all at once by either using the Command Menu `CloseAuxWins' button or by typing meta-l meta-w.