Joseph had a choice when he discovered Mary was pregnant. He could publicly divorce Mary, which would have led to Mary being stoned. Or, he could try to divorce Mary quietly.