Cluster satellites study the effects of solar wind
Enabling & Support

'Dirty hack' restores Cluster mission from near loss

30/06/2011 2918 views 10 likes
ESA / Enabling & Support / Operations

Using ingenuity and an unorthodox 'dirty hack', ESA has recovered the four-satellite Cluster mission from near loss. The drama began in March, when a crucial science package stopped responding to commands – one of a mission controller's worst fears.

Since a pair of spectacular dual launches in 2000, the four Cluster satellites have been orbiting Earth in tightly controlled formation. Each of the 550 kg satellites carries an identical payload to investigate Earth's space environment and its interaction with the solar wind – the stream of charged particles pouring out from the Sun.

Among each satellite's 11 instruments, five comprise the Wave Experiment Consortium (WEC), which makes important measurements of electrical and magnetic fields. All four sensors must work together to make carefully orchestrated observations – the loss of any one could seriously affect the unique 'four-satellite science' delivered by the mission.

On 5 March, the WEC package on Cluster's number 3 satellite, Samba, failed to switch on. Ground controllers at ESA's European Space Operations Centre, in Darmstadt, Germany, immediately triggered a series of standard recovery procedures, none of which succeeded.

Even worse, no status information could be coaxed out of the instruments.

Dangerous scenario for orbiting satellite

Engineers working in Cluster control room
Engineers working in Cluster control room

"With no status data and no response from the instrument, we suspected either that the device's five power switches were locked closed or a failure caused by an electrical short circuit, one of the most dangerous faults on any satellite," said ESA's Jürgen Volpp, Cluster operations manager.

Over the next several weeks, working closely with the satellites' builder, the WEC scientists and manufacturer, and other ESA teams, the Cluster control team diagnosed the problem, eventually making use of some onboard software that had been dormant since just after launch over 10 years ago.

The result ruled out a short circuit and pointed an accusing finger at the five power switches being locked in the 'closed' position.

Five instruments in the WEC package on each Cluster satellite
Five instruments in the WEC package on each Cluster satellite

Tests in 1995 had simulated what might happen if three of the five switches locked close, but no one ever considered how to recover from all five being locked – such a situation had not been deemed possible.

Armed with this information and a great deal of ingenuity, the team painstakingly designed a recovery procedure and tested it on one of Samba's functioning sister satellites.

Solution based on a 'dirty hack'

"The solution was based on a 'dirty hack' – jargon referring to any non-standard procedure – but we really had no other option," said Jürgen.

Finally, on 1 June, in a very tense mission control room, a series of commands was radioed up. To immense relief, these flipped the power switches to 'on' and the recalcitrant WEC came back to life.

When unexpected trouble occurs, you really want to have an experienced and talented team on hand to solve the problem.

Cluster has since returned to normal operation and measures are being taken to prevent this failure from happening again.

"When everything goes as planned, flying a mission can be routine," said ESA's Manfred Warhaut, Head of Mission Operations. "But when unexpected trouble occurs, and there's nothing in the manuals, you really want to have an experienced and talented team on hand to solve the problem."

Related Links

Science & Exploration

Cluster overview

01/01/1970 11092 views
Open item
4-satellite Cluster mission
Enabling & Support

Cluster II operations

10629 views 44 likes
Open item
Cluster path through aurora region
Science & Exploration

Cluster encounters a natural particle accelerator

01/02/2011 1786 views 3 likes
Open item
Ceremony for the International Academy of Astronautics Laurels 2010
Science & Exploration

Laurels for Cluster-Double Star teams

28/09/2010 1241 views 2 likes
Open item
The Cluster quartet
Science & Exploration

Cluster turns the invisible into the visible

01/09/2010 1250 views 3 likes
Open item
The four Cluster spacecraft
Agency

Cluster's decade of discovery

16/07/2010 1578 views 2 likes
Open item
Science & Exploration

Shocking recipe for making killer electrons

11/03/2010 1341 views 1 likes
Open item
Effect of extreme solar activity on Earth's magnetosphere
Science & Exploration

Watching solar activity muddle Earth’s magnetic field

29/04/2009 3541 views 1 likes
Open item
Mars Express
Science & Exploration

ESA extends missions studying Mars, Venus and Earth’s magne…

10/02/2009 1634 views 0 likes
Open item
Earth's oxygen escaping from Earth's polar regions
Science & Exploration

Cluster watches Earth’s leaky atmosphere

28/08/2008 2725 views 3 likes
Open item
Cluster II
Science & Exploration

Cluster listens to the sounds of Earth

27/06/2008 1645 views 1 likes
Open item
The Cluster quartet
Science & Exploration

Solitary waves in translation

07/03/2008 693 views 0 likes
Open item
Cluster observing the electron diffusion region
Science & Exploration

New discovery on magnetic reconnection to impact future spa…

23/01/2008 1447 views 1 likes
Open item
Schematic of Earth’s night-side magnetosphere
Science & Exploration

High-speed beams of charged particles accelerate towards Ea…

06/12/2007 2674 views 5 likes
Open item
CME observed by SOHO
Science & Exploration

Solar outburst pulls a magnetic slingshot

21/11/2007 906 views 1 likes
Open item