Genesis 43:5

but if thou wilt not send him, we will not go down; for the man said unto us, Ye shall not see my face except your brother be with you. That was the alternative and the condition, and Judah was not in a position to change it.