FreeSound.Org is a good website for downloading copyright-free sounds that are often suitable for use in your own musique concrète project.

The Arts Media Center has some sound effects CDs in its collection, too.