My friend feels ashamed to go to church with me....?

My friend feels ashamed to go to church with me, because he hasn't gone to church for so long. He affraid that people will judge him, and look at him as an outcast. I told him it's nothing like that. They will welcome him. I don't know why he thinks this way. What should I say to him to convince him other whys?