But that's almost the point I'm making. Most atheists don't bother constantly asserting that there isn't a God. The only reason people view atheism as being a hard position of belief is that the most vocal atheists are the most firm in their belief.

You are, right, people who don't have a firm belief in an absence of a God don't tend to go on about it. But they are still atheists.