The Library of Congress has just launched The National Jukebox on the Internet. They have more than 10,000 historical recordings and are calling it "the largest collection of historical recordings ever made publicly available online."
It includes music but also contains poetry, speeches and other spoken word recordings. They don't have everything but they have a lot and there's more to come.
Please note they have disclaimers all over the place that historical recordings may contain offensive language.