Nick
Yes, I believe that in order to accept the bible as inerrent as a whole, we must not "throw out" a part cause we are uncomfortable with it. God did it, it will be understood at some point (maybe not till He reveals it), but to say "awe forget it, lets move on" is nieve, since this is a HUGE stumbling block to evangelizing to the secular world, not to mention, it would call into question the rest of the content for believers as well.
If we analyze liturature, we must not concude something is allegorical, if it does not clearly use allegorical style. Genesis is not an allegorical piece of liturature by any standard, and hence, should not be interpreted as such. Good exegesis is required, and that means 'free of bias from preconceived notions, or agendas'. If we do that, and use the proper context and field of reference, it all should fit with known and future science, since God is the author of both.
God Bless