Deuteronomy 20:12

Besiege it. The Rabbins assert, that when the city of Madian was attacked in the days of Moses, one side was left unmolested, that the inhabitants might escape, and that this practice was afterwards observed as a law. But we see nothing of the kind in Scripture.