Are atheists and agnostics really support a freer world without religion? like 6 billion of all of them?

I think that all the recruitment has been done by religious groups. I've never had an athiest or agnostic try to convince me of anything.