|
Reader's Favorites
Media Casualties Mount Administration Split On Europe Invasion Administration In Crisis Over Burgeoning Quagmire Congress Concerned About Diversion From War On Japan Pot, Kettle On Line Two... Allies Seize Paris The Natural Gore Book Sales Tank, Supporters Claim Unfair Tactics Satan Files Lack Of Defamation Suit Why This Blog Bores People With Space Stuff A New Beginning My Hit Parade
Instapundit (Glenn Reynolds) Tim Blair James Lileks Bleats Virginia Postrel Kausfiles Winds Of Change (Joe Katzman) Little Green Footballs (Charles Johnson) Samizdata Eject Eject Eject (Bill Whittle) Space Alan Boyle (MSNBC) Space Politics (Jeff Foust) Space Transport News (Clark Lindsey) NASA Watch NASA Space Flight Hobby Space A Voyage To Arcturus (Jay Manifold) Dispatches From The Final Frontier (Michael Belfiore) Personal Spaceflight (Jeff Foust) Mars Blog The Flame Trench (Florida Today) Space Cynic Rocket Forge (Michael Mealing) COTS Watch (Michael Mealing) Curmudgeon's Corner (Mark Whittington) Selenian Boondocks Tales of the Heliosphere Out Of The Cradle Space For Commerce (Brian Dunbar) True Anomaly Kevin Parkin The Speculist (Phil Bowermaster) Spacecraft (Chris Hall) Space Pragmatism (Dan Schrimpsher) Eternal Golden Braid (Fred Kiesche) Carried Away (Dan Schmelzer) Laughing Wolf (C. Blake Powers) Chair Force Engineer (Air Force Procurement) Spacearium Saturn Follies JesusPhreaks (Scott Bell) Science
Nanobot (Howard Lovy) Lagniappe (Derek Lowe) Geek Press (Paul Hsieh) Gene Expression Carl Zimmer Redwood Dragon (Dave Trowbridge) Charles Murtaugh Turned Up To Eleven (Paul Orwin) Cowlix (Wes Cowley) Quark Soup (Dave Appell) Economics/Finance
Assymetrical Information (Jane Galt and Mindles H. Dreck) Marginal Revolution (Tyler Cowen et al) Man Without Qualities (Robert Musil) Knowledge Problem (Lynne Kiesling) Journoblogs The Ombudsgod Cut On The Bias (Susanna Cornett) Joanne Jacobs The Funny Pages
Cox & Forkum Day By Day Iowahawk Happy Fun Pundit Jim Treacher IMAO The Onion Amish Tech Support (Lawrence Simon) Scrapple Face (Scott Ott) Regular Reading
Quasipundit (Adragna & Vehrs) England's Sword (Iain Murray) Daily Pundit (Bill Quick) Pejman Pundit Daimnation! (Damian Penny) Aspara Girl Flit Z+ Blog (Andrew Zolli) Matt Welch Ken Layne The Kolkata Libertarian Midwest Conservative Journal Protein Wisdom (Jeff Goldstein et al) Dean's World (Dean Esmay) Yippee-Ki-Yay (Kevin McGehee) Vodka Pundit Richard Bennett Spleenville (Andrea Harris) Random Jottings (John Weidner) Natalie Solent On the Third Hand (Kathy Kinsley, Bellicose Woman) Patrick Ruffini Inappropriate Response (Moira Breen) Jerry Pournelle Other Worthy Weblogs
Ain't No Bad Dude (Brian Linse) Airstrip One A libertarian reads the papers Andrew Olmsted Anna Franco Review Ben Kepple's Daily Rant Bjorn Staerk Bitter Girl Catallaxy Files Dawson.com Dodgeblog Dropscan (Shiloh Bucher) End the War on Freedom Fevered Rants Fredrik Norman Heretical Ideas Ideas etc Insolvent Republic of Blogistan James Reuben Haney Libertarian Rant Matthew Edgar Mind over what matters Muslimpundit Page Fault Interrupt Photodude Privacy Digest Quare Rantburg Recovering Liberal Sand In The Gears(Anthony Woodlief) Sgt. Stryker The Blogs of War The Fly Bottle The Illuminated Donkey Unqualified Offerings What she really thinks Where HipHop & Libertarianism Meet Zem : blog Space Policy Links
Space Future The Space Review The Space Show Space Frontier Foundation Space Policy Digest BBS AWOL
USS Clueless (Steven Den Beste) Media Minder Unremitting Verse (Will Warren) World View (Brink Lindsay) The Last Page More Than Zero (Andrew Hofer) Pathetic Earthlings (Andrew Lloyd) Spaceship Summer (Derek Lyons) The New Space Age (Rob Wilson) Rocketman (Mark Oakley) Mazoo Site designed by Powered by Movable Type |
Living Down To Expectations When we last left Rocketman, he was accusing Gregg Maryniak of comparing launch vehicles to submersibles, an accusation that, knowing Gregg, I found quite unlikely. He has since had an email discussion with Gregg, and clarified the issue. I found this little bit of Gregg's response interesting, because it wasn't something to which I'd previously (or at least recently) given much explicit thought. Bottom line is that space stuff costs perhaps 500 times as much to develop historically as (very challenging) undersea stuff. Why? It may be largely because of the expectation that it should (based on the history of governments racing each other without regard to normal engineering cost contraints.) When I speak to big audiences of traditional government space program engineers and program managers I usually pray that one of them will ask me: "You mean to say that mere expectations can be cost drivers--ridiculous"...to which I say, I have two words for them...."stock market." Is Gregg right? Is space hardware and operations expensive because we expect it to be? There's actually quite a bit of evidence that it is. Most space contracts, particularly government contracts are cost plus fixed fee. This means that the contractors are reimbursed for the actual costs of executing the contract, as reported by them, plus some amount for profit (typically a few percent of the contract value). This is because high-technology research and development is recognized to be high risk--that the schedule might slip, or the costs be greater than originally estimated, and few if any private companies The problem with this, of course, is that it skews incentives in a way that are bad for the taxpayer (though not necessarily for the true constituencies of the space program--the contractors themselves, and the congresspeople in whose districts the contractors employ people). Perversely, the more they spend, the more they earn. There are occasionally attempts to mitigate this by putting in bonuses for hitting cost targets, and penalties for missing schedules or overrunning the budget, but they're largely ineffective, at least judging by the space station program. But there's a more pernicious result of this, that's less often considered. In order for NASA to project the cost of the contract, they have to have a way of estimating the costs, even if it's something that may have never been done before. The way they (and the contractors) typically do this is called parametric cost analysis. They have cost models that are built up by examining many past programs, and incorporating the cost and schedule data from those programs. The models might use factors such as complexity (which is hard to measure), weight, technology level, and so on. The hope is that a good cost estimator can come up with a valid estimate for the program cost and schedule, based on similar efforts that have been performed in the past. One problem with this is that it's more art than science, and heavily dependent on the assumptions that the modeler uses. Another problem, of course, is that reinforces notions of how expensive things will be, because by definition, it's based on how expensive things were in the past. It doesn't provide any way to model true innovation. In addition, because almost all of the experience comes from government programs, the data base for private space activities is very sparse, so they don't have any way of modeling that with any degree of credibility. And it turns even government programs, given the right team and incentives, can beat the estimates. As an example, consider the DC-X program: Prior to letting the DC-X contract our program office conducted a cost estimating study. We used three models, one developed internally, one used by the US Air Force and one from NASA. The results were that our cost estimate based on the rapid program assumptions I described earlier and projected a cost between $60 and $70 million, the Air Force model using standard aerospace procurement practices produced an estimate of $365 million, the NASA model based on highly technology development based shuttle program experience projected the program would cost over $600 million. The actual DC-X program cost through the first test series came in around $65 million. In other words, they beat the conventional Air Force costing model by a factor of more than five, and its NASA equivalent by almost an order of magnitude, or factor of ten. Sadly, here's the process (slightly oversimplified). NASA comes up with a program idea. They come up with a cost estimate for it. They request a budget. If Congress authorizes it, they put out a procurement for that budget target. The contractors write their proposals, and then come up with their own cost estimates that magically, and almost invariably turn out to be close to what NASA has money for. And thus the expensive game is perpetuated. But as one more example of how such estimates and quotes can be voodoo, let me relate a story (possibly apocryphal, but it's certainly believable to anyone with experience in the business) that was told to me by a program manager from the seventies. In the process of submitting a proposal, a small, almost insignificant typo found its way into the final version as delivered to the customer. It was a decimal point, misplaced one place to the right, resulting in a bid for that part of the program ten times too high, relative to the contractor's internal estimate. The contractor was downselected for a Best And Final Offer, which is an opportunity to negotiate a little bit. The contractor fully expected to be raked over the coals for their outrageously high bid (I think that it was something like ten million dollars, when it should have been one), and they weren't disappointed. The NASA contracting officer excoriated them, calling them crooks and cheats, and other names not mentionable in a family web site, and finally finished up his lecture with the words, "...and we're not going to give you a dime over nine million!" And of course, the outraged response from the contractors' representatives (as they sighed with relief) was, "But we can't do it for that!" Posted by Rand Simberg at September 24, 2003 11:09 AMTrackBack URL for this entry:
http://www.transterrestrial.com/mt-diagnostics.cgi/1772 Listed below are links to weblogs that reference this post from Transterrestrial Musings.
There Is, However, One Big Difference
Excerpt: Rand Simberg of Transterrestrial Musings has an intriguing post about why space hardware costs so much more than hardware intended... Weblog: blogoSFERICS Tracked: September 25, 2003 05:49 AM
http://www.rocketmanblog.com/2003/09/rand_simberg_fr.html
Excerpt: Rand Simberg from Transterrestrial Musings has an interesting post discussing the cost structure of government space contracts titled Living Down To Expectations. Rand builds on an argument Gregg Maryniak, executive director of the X Prize, makes that ... Weblog: Rocket Man Blog Tracked: September 28, 2003 01:06 AM
The Cost Of Space Programs
Excerpt: Rand Simberg from Transterrestrial Musings has an interesting post discussing the cost structure of government space contracts titled Living Down To Expectations. Rand builds on an argument Gregg Maryniak, executive director of the X Prize, makes that ... Weblog: Rocket Man Blog Tracked: September 28, 2003 01:10 AM
Comments
As someone who personally witnessed a Lockmart rep give the details on their X-33 proposal, where "Subcontractors in 38 states and 120-something congressional districts" was a bulleted item under the heading of "Technical Specifications," this story is completely believable to me. (This was at the Space Access conference, shortly before the contract was awarded. I still remember how the room groaned when they saw that line.) Posted by Nathan Koren at September 25, 2003 10:31 AMPost a comment |