Leviticus 16:10, 21-22

The other goat, which was chosen by lot to remove the sin, must be brought alive before the LORD. The priest will use it to perform the acts that remove Israel’s sin so they will belong to the LORD. Then this goat will be sent out into the desert as a goat that removes sin.

He will put both his hands on the head of the living goat, and he will confess over it all the sins and crimes of Israel. In this way Aaron will put the people’s sins on the goat’s head. Then he will send the goat away into the desert, and a man who has been appointed will lead the goat away. So the goat will carry on itself all the people’s sins to a lonely place in the desert. The man who leads the goat will let it loose there.