Leviticus 16:23

And Aaron shall come in to the Tabernacle of the Congregation, and shall put off the linen garments which he put on when he went in to the Holy Place, and shall leave them there, since they were used only in the rite of atonement on this one day in the year;