Joshua 8:9, 17

So Joshua sent them out. And they went to the place of ambush and lay between Bethel and Ai, to the west of Ai, but Joshua spent that night among the people.

Not a man was left in Ai or Bethel who did not go out after Israel. They left the city open and pursued Israel.