From Jason Burby at ClickZ:

Some of the best site optimization lessons come from failed tests. Don't be afraid of trying something in a test. Do be afraid if you aren't using A/B or multivariate testing to improve your site. Unless you measure, test, and tune, you have no idea if changes you make improve or harm the site.