Contamination found in shuttle engines to be used by SLS
Now we know why the first launch is likely delayed: It appears that contamination has been found in the used and refurbished shuttle engines that the Space Launch System is using.
A “routine quality assurance inspection” of the core stage, he said, discovered contamination in tubing in the engine section of the core stage, which hosts the vehicle’s four RS-25 main engines and associated systems. That contamination turned out to be paraffin wax, which is used to keep the tubes from crimping while being manufactured but is supposed to be cleaned out before shipment.
“The prime contractor determined the vendor was not fully cleaning the tubes and it was leaving residue in the tubes,” McErlean said. “This was retained as a requirement in the prime contractor’s spec, but it was not properly carried out.” Boeing is the prime contractor for the SLS core stage, but he did not disclose the vendor who provided the contaminated tubing.
The contamination was initially found in a single tube, he said, but later checks found similar residue in other tubes. All the tubing in the core stage is now being inspected and cleaned, a process he said is not straightforward because of the “mass of tubing” in the engine section and also because cleaning is a “non-trivial process.”
Some obvious questions immediately arise:
1. These engines were previously flown on the space shuttles, numerous times. How did the paraffin wax, used “to keep the tubes from crimping while being manufactured,” remain in the tubes during all those shuttle flights?
2. Assuming the tubes were a new addition or replacement during the refurbishing process, it still seems astonishing that a subcontractor could be so lax. Did they really believe the wax did not need to be thoroughly cleaned?
3. While they have admitted that they will likely have to delay the launch because of issues with the core stage, why do they deny this contamination problem is the cause? More important, how much is it costing to fix? And how much time are they actually losing to fix it?
4. Finally, this is only one of many similar problems that we have seen with this entire project. Boeing and NASA have gotten so far about $40 billion to build this rocket, and have been working on it since 2006, more than a dozen years ago. Furthermore, they supposedly are building it using shuttle equipment in a Saturn rocket-type design in order to save money and time. Instead, they have wasted billions and taken more than three times longer than it took us to win World War II to get to a point where the program still has not flown.
Does anyone really believe this project is anything but a huge boondoggle? And if so, can they please tell me how it will be possible for the United States to really explore the heavens with a project run this incompetently?
Readers!
Please consider supporting my work here at Behind the Black. Your support allows me the freedom and ability to analyze objectively the ongoing renaissance in space, as well as the cultural changes -- for good or ill -- that are happening across America. Fourteen years ago I wrote that SLS and Orion were a bad ideas, a waste of money, would be years behind schedule, and better replaced by commercial private enterprise. Only now does it appear that Washington might finally recognize this reality.
In 2020 when the world panicked over COVID I wrote that the panic was unnecessary, that the virus was apparently simply a variation of the flu, that masks were not simply pointless but if worn incorrectly were a health threat, that the lockdowns were a disaster and did nothing to stop the spread of COVID. Only in the past year have some of our so-called experts in the health field have begun to recognize these facts.
Your help allows me to do this kind of intelligent analysis. I take no advertising or sponsors, so my reporting isn't influenced by donations by established space or drug companies. Instead, I rely entirely on donations and subscriptions from my readers, which gives me the freedom to write what I think, unencumbered by outside influences.
You can support me either by giving a one-time contribution or a regular subscription. There are four ways of doing so:
1. Zelle: This is the only internet method that charges no fees. All you have to do is use the Zelle link at your internet bank and give my name and email address (zimmerman at nasw dot org). What you donate is what I get.
2. Patreon: Go to my website there and pick one of five monthly subscription amounts, or by making a one-time donation.
3. A Paypal Donation or subscription:
4. Donate by check, payable to Robert Zimmerman and mailed to
Behind The Black
c/o Robert Zimmerman
P.O.Box 1262
Cortaro, AZ 85652
You can also support me by buying one of my books, as noted in the boxes interspersed throughout the webpage or shown in the menu above.
Now we know why the first launch is likely delayed: It appears that contamination has been found in the used and refurbished shuttle engines that the Space Launch System is using.
A “routine quality assurance inspection” of the core stage, he said, discovered contamination in tubing in the engine section of the core stage, which hosts the vehicle’s four RS-25 main engines and associated systems. That contamination turned out to be paraffin wax, which is used to keep the tubes from crimping while being manufactured but is supposed to be cleaned out before shipment.
“The prime contractor determined the vendor was not fully cleaning the tubes and it was leaving residue in the tubes,” McErlean said. “This was retained as a requirement in the prime contractor’s spec, but it was not properly carried out.” Boeing is the prime contractor for the SLS core stage, but he did not disclose the vendor who provided the contaminated tubing.
The contamination was initially found in a single tube, he said, but later checks found similar residue in other tubes. All the tubing in the core stage is now being inspected and cleaned, a process he said is not straightforward because of the “mass of tubing” in the engine section and also because cleaning is a “non-trivial process.”
Some obvious questions immediately arise:
1. These engines were previously flown on the space shuttles, numerous times. How did the paraffin wax, used “to keep the tubes from crimping while being manufactured,” remain in the tubes during all those shuttle flights?
2. Assuming the tubes were a new addition or replacement during the refurbishing process, it still seems astonishing that a subcontractor could be so lax. Did they really believe the wax did not need to be thoroughly cleaned?
3. While they have admitted that they will likely have to delay the launch because of issues with the core stage, why do they deny this contamination problem is the cause? More important, how much is it costing to fix? And how much time are they actually losing to fix it?
4. Finally, this is only one of many similar problems that we have seen with this entire project. Boeing and NASA have gotten so far about $40 billion to build this rocket, and have been working on it since 2006, more than a dozen years ago. Furthermore, they supposedly are building it using shuttle equipment in a Saturn rocket-type design in order to save money and time. Instead, they have wasted billions and taken more than three times longer than it took us to win World War II to get to a point where the program still has not flown.
Does anyone really believe this project is anything but a huge boondoggle? And if so, can they please tell me how it will be possible for the United States to really explore the heavens with a project run this incompetently?
Readers!
Please consider supporting my work here at Behind the Black. Your support allows me the freedom and ability to analyze objectively the ongoing renaissance in space, as well as the cultural changes -- for good or ill -- that are happening across America. Fourteen years ago I wrote that SLS and Orion were a bad ideas, a waste of money, would be years behind schedule, and better replaced by commercial private enterprise. Only now does it appear that Washington might finally recognize this reality.
In 2020 when the world panicked over COVID I wrote that the panic was unnecessary, that the virus was apparently simply a variation of the flu, that masks were not simply pointless but if worn incorrectly were a health threat, that the lockdowns were a disaster and did nothing to stop the spread of COVID. Only in the past year have some of our so-called experts in the health field have begun to recognize these facts.
Your help allows me to do this kind of intelligent analysis. I take no advertising or sponsors, so my reporting isn't influenced by donations by established space or drug companies. Instead, I rely entirely on donations and subscriptions from my readers, which gives me the freedom to write what I think, unencumbered by outside influences.
You can support me either by giving a one-time contribution or a regular subscription. There are four ways of doing so:
1. Zelle: This is the only internet method that charges no fees. All you have to do is use the Zelle link at your internet bank and give my name and email address (zimmerman at nasw dot org). What you donate is what I get.
2. Patreon: Go to my website there and pick one of five monthly subscription amounts, or by making a one-time donation.
3. A Paypal Donation or subscription:
4. Donate by check, payable to Robert Zimmerman and mailed to
Behind The Black
c/o Robert Zimmerman
P.O.Box 1262
Cortaro, AZ 85652
You can also support me by buying one of my books, as noted in the boxes interspersed throughout the webpage or shown in the menu above.
When rocket engines stand on the shelf for decades and decades, old age maybe makes them earwax?
Sci fi people like to talk about generational space travel. Well, we have it right here and now! Soyuz from 1965 as the only crewed launcher outside of China, and NASA looking longingly back at that concept. Using some ancient engines they found in the storage (like the first version of Antares used Soviet engines for the N-1 Moon failure). Never making up anything new, that might be or become politically sensitive. Just looking back. That’s governmental rocket science, in human spaceflight anyway, robotics has such a great track record as contrast to show what would’ve been possible.
It sounds to me as though the paraffin contamination is in the tubing that carries LOX and/or LH2 from the SLS core stage’s tankage to the engines. These would be newly manufactured parts and would not have flown previously.
Perhaps Boeing used a subcontractor whose experience is mostly in providing tubing for aircraft applications, not rocket plumbing. Paraffin in a line carrying jet fuel would quickly dissolve and present no problem. Paraffin in a line carrying LH2 would freeze so hard that pieces spalled off the tubing walls by launch vibration could potentially damage high-speed turbomachinery inside the engines. Paraffin in a line carrying LOX could cause an explosion.
Such explosions have been known to occur when LOX tank trucks have been involved in traffic accidents, sprung leaks and LOX has spilled onto asphalt paved surfaces. Asphalt has a higher molecular weight than paraffin wax and is correspondingly more difficult to ignite. Paraffin is easier to ignite and, inside a piece of rocket plumbing, would be subjected to rapidly moving LOX flow at very high pressure, neither of which apply in traffic accident-caused LOX spills. An SLS core stage with paraffin in its LOX delivery plumbing could cause a launch-time explosion that would make SpaceX’s Amos-6 misadventure look like a damp squib by comparison.
The “old reliable” legacy contractors are definitely old, but “reliable” seems increasingly to be equal parts nostalgia and vainglory.
It all brings to mind Allen Shepherd’s remark about everything being made by the lowest bidder. And of course, no one will be held accountable and demoted or fired – despite what I learned as a Freshman ROTC cadet, “The commander is responsible for all the unit does or fails to do.”
Robert,
On your fourth question, all projects run into trouble, and even when I was working on space instruments we would have multiple schedule-slipping problems rear their ugly heads. This really is to be expected, and managers should be setting their schedules to allow for problem solving, especially on development projects. One difference between those instruments and SLS is the order of magnitude of cost when a delay happens. Another difference is the amount of delay.
I know that I have just sounded like I am defending SLS’s problems, and maybe I am, but to counter what I just said, the article states: “We have a lot of mitigation activities in work across the board.”
That sounds like there is more trouble on SLS than should be expected. Coming from a space agency that designed, built, tested and successfully used a huge rocket, spacecraft, and lunar lander in under a decade, we have great expectations from that agency. Are these expectations unjustified?
Maybe, but I don’t think so. NASA should have learned how to manage a large project, even one that is unique in history.
Among the differences between then and now is that on Project Apollo there was a sense of urgency, which produced a requirement for high quality control on first production items. Planning had to be right the first time, design had to be first rate, manufacturing had to be accurate, and test had to only rarely find problems. The budget may have been larger for Project Apollo, but they had to build everything from scratch. Most of those things had never been done before, and no one knew how to do them.
Today, there is not nearly as much national pride in SLS as there was in Apollo (or as much as in Falcon rockets, for that matter), and there likely is not as much pride felt by the subcontractors or their workers, either. Back in the 1960s space was virtually everywhere in American culture; today it is an afterthought — mostly the thought is that it is merely an everyday tool, such as GPS.
Apollo had its difficulties, but it still succeeded within schedule. The Space Shuttle also had some delays, but it ultimately worked, although not as well as intended. The ISS took 15 years to start getting hardware into space, but there was a lot of politics involved, creating that lag. A part of SLS’s problem was also political, since it replaces the politically cancelled Constellation project. The James Webb Space Telescope is also suffering from problems, costing almost an order of magnitude more than originally expected.
This brings up another difference between the 1960s and now: the politicians holding the purse strings today just are not in a hurry to get anything done, and don’t seem bothered when things don’t get done right. Meanwhile, commercial companies are working hard to get things going sooner rather than later and are trying hard to get it done right at lower cost.
Civil space went from a “can do” attitude in the 1960s to a “no can do” attitude. It seems to me that the NewSpace companies are bringing back “can do.” Even when at first they don’t succeed, as with Armadillo Aerospace, the people of New Space try, try again, as with Exos Aerospace. https://en.wikipedia.org/wiki/Exos_Aerospace (Also compare Rotary Rocket, XCOR, and Agile Aero.)
Theoretically, we should have learned a lot of lessons between the 1960s and today, but it seems as though those lessons were lost on NASA, its contractors, and its subcontractors — and I’m not sure that Congress ever learns anything. It seems as though those who are involved in SLS do not have any sense of urgency or of that 1960s sense of pride in their workmanship.
Edward: In writing my post, I provided in question #4 links to a variety of equally embarrassing problems that the SLS program has experienced. In writing it, I was tempted to describe those problems, but got lazy and didn’t. I should have. They were:
Each of these is unacceptable. All of them is disgusting, and exposes this project for the disaster that it is. If I was an astronaut I certainly would be afraid to fly on it.
In fact, much of this reminds me of the terrible engineering foolishness that led up to the Apollo 1 fire. As astronaut Frank Borman noted after being a major participant in the post-fire investigation, “Quite frankly, we did not think.”
I don’t think there has been much thought involved with the entire SLS/Orion project. It has been driven entirely by Congress, and they certainly are not the ones to design a rocket or space capsule. But in this case, they have.
But it sounded like such a great idea for a quick cheap stop-gap after the shuttle was canceled. Just launch the shuttle without the shuttle! Can you do that next time? -Sure, that only makes everything much easier! No development work needed, no new infrastructure. Just more of the same but cheaper. Oh well, and here we are decades later.
SLS is a disaster and I don’t Believe it will ever fly. The government motto of a jobs program and no care of what the result is very destructive. The government cannot compete with the private sector such as SpaceX. We can only hope that the Trump administration makes our government space agency like the private sector. I doubt that will ever happen. In the meantime it is a total embarrassment.
It would have been cheap but all those NASA engineers wanted to use all new techniques and materials.
They wanted lighter fuel tanks so they needed new materials and they wanted to use new welding tech. So a billion in cash wasted.
Their excuse was they didn’t have any of the old equipment left over to build the old stuff so they needed all new stuff. but in the end it would have been cheaper to rebuild the old stuff.
Heat shielding? Can’t use the stuff from the shuttle or even the Apollo so they needed new stuff.
@pzatchok Yeah, it is ridiculous” SLS should’ve been a simplification of the STS. Planetary Society’s blog has through the years celebrated every new item they have had do build or rebuild. The assembly building, the crawler, the barge, the launch pad. But even they seem to have lost enthusiasm for the waste more recently.
I also notice a sharp attitude change in the popular online spaceflight community concerning the JWST. Not that anyone wants to scrap it, but former enthusiasts have grown tired of it all. Astronomers at The Space Telescope Science Institute, that manages the science of Hubble and will do so also for JWST, have for years been stressed about the JWST soon is to be launched. Urging priority to preparing JWST research. It’s been a while since I’ve seen anything of that. The delays must mess up the career plans for alot of the researcher. If you’re a PhD student you can’t wait with your project for several extra years, you have to drop it and do something else instead. But it’s frustrating that the launch is constantly announced to be about a year into the future.
Here are external costs to be added to what the government accounts for as in cash payments for the SLS or JWST.
One of the bad things is the subcontractor survival.
Just how many of these companies who made parts for the shuttle system are still around after 20 years?
And remember Prime subcontractors like Lockheed and Boeing have thousands of sub sub contractors making parts for them.(I work for one of them)
They change quite a bit over the years and unless they get continuing orders for something they tend to toss out the old machines and upgrade tech to better compete in the changing market.
Parts sometimes do not last 10 or 15 years, adhesives stop working, parts delaminate,and rubber dries out, Plastics are, well plastic, and a part screwed down and tight today might very well be loose in 10 years.
Robert Zimmerman,
You wrote: “I was tempted to describe those problems, but got lazy and didn’t.”
I had reviewed those links and almost included a paragraph referencing the dropped and damaged tank dome. However, my comment was getting long, and I deleted that paragraph.
SLS seems to be having more — or worse — problems than we should expect, but even commercial companies have problems. The dropped tank dome reminds me of two dropped satellites. Any crane operation has hazards, not only to people (if someone is wrong about the center of mass, a lifted object can swing quite a bit, and this has happened in commercial operations) but is hazardous to the flight hardware (I heard of one satellite that swung, then swung back and bumped into the stand it had just come off).
That a subcontractor did not completely clean its tubing — and did not find the problem during internal inspections — is troubling. The problems that SLS is having is reminiscent of the quality problems that the Russian space program is having. Government space programs do not seem to care much about cost or schedule, and quality seems to be suffering, too.
Today’s commercial space programs do seem to care about cost, schedule, and quality. This reminds me of Red Adair, who is (also) famous for having said something like, “I can do it fast, I can do it well, and I can do it cheap. Pick two.” However, his and every other industry gets better at each of those options as time passes. The Space Shuttle, ISS, James Web Space Telescope, and SLS make it look like government does just the opposite. We are seeing government space projects cost more, take longer, and not do the intended job very well. But then, government can afford such poor results, because they just squeeze more money from the rest of us in order to do the next poor job.
You wrote: “I don’t think there has been much thought involved with the entire SLS/Orion project.”
The planning certainly has been poor. I’m still having difficulty believing that they traded ESA ISS support for one and a half Orion service modules (SM). This leaves NASA with the necessity of paying for another SM design and development program. As far as I know, there still is no effort to replace the ESA SM.
“It sounds to me as though the paraffin contamination is in the tubing that carries LOX and/or LH2 from the SLS core stage’s tankage to the engines. These would be newly manufactured parts and would not have flown previously.”
Dick is correct. These lines are in the main propulsion system of the SLS core stage, not in the engines. They would be newly built tubes, not ones left over from the Shuttle program.
“I’m still having difficulty believing that they traded ESA ISS support for one and a half Orion service modules (SM).”
That’s because the purpose of signing the Europeans on to this project was to make it harder for Congress or the Administration to cancel. During the dark years of ISS delays, it was the specter of a major international embarrassment that kept that program from being cancelled. Had it been an American-only program, ISS would have been cancelled. NASA bought the same insurance policy for Orion.
Your explanation of the Orion SM procurement is correct. Problem is, NASA didn’t keep up its “premiums” on that “insurance.” The Euros only built two SM’s and have delivered both. That particular potential international “firewall” against project cancellation is now null and void. NASA, as Edward notes, seems not to have arranged any second source for Orion SM’s. That makes “plans” for any Orion missions beyond EM-2 very much matters of science fiction.