You were absolutely correct with everything that you said, and it seems you said it with the right attitude. If you haven't already, call your pastor and notify him of this conversation, before ol' boy calls and gives his twisted version of things. As much as he complains about wanting someone to be patient and work with him, dude doesn't want to learn. If he did, he wouldn't have walked out.
If he wants to walk, let him kick rocks. In the meantime, keep praying for him.