Atheists...don't have no songs

Check out this youtube video (click here)!  Steve Martin performed with the Steep Canyon Rangers at a jazzfest in the States.  You know how we have a number of hymnals and never run out of songs to sing?  Well, this is a humourous take on what it would be like to be an atheist - do they have hymnals?