OK, OK. I'm kidding. Audacity is what I use as well--though there are better programs out there, if you're looking for professional-level editing. They just cost more--a WHOLE lot more. For occasional, home/church use, Audacity is probably the best choice.
I'm not real familiar with GarageBand. I do know that in Audacity you can record, save as an Audacity Project(aup) or export as WAV(uncompressed), MP3(in Windows, at least, I haven't figured out how in Linux) and OGG(which is free and open source, though not as widely supported as MP3). There are also many effects plugins such as noise removal, amplification, etc., and it supports editing the files as well.