• → European Space Agency

      • Space for Europe
      • Space News
      • Space in Images
      • Space in Videos
    • About Us

      • Welcome to ESA
      • DG’s blog
      • For Member State Delegations
      • Business with ESA
      • Law at ESA
      • ESA Exhibitions
      • ESA Publications
      • Careers at ESA
      • ESAshop
    • Our Activities

      • Space News
      • Observing the Earth
      • Human and Robotic Exploration
      • Space Transportation
      • Navigation
      • Space Science
      • Space Engineering & Technology
      • Operations
      • Telecommunications & Integrated Applications
      • Preparing for the Future
    • Careers at ESA

    • For Media

      • Media
      • ESA TV
      • Videos for professionals
      • Photos
    • For Educators

    • For Kids

    • ESA

    • Space Engineering & Technology

    • Preparing for the Future

    • Shaping the Future

    • What we do
    • Directorate of Technology, Engineering and Quality (TEC)
    • Engineering

      • Engineering for space
      • Support to projects
      • Ensuring quality
    • Cross-cutting initiatives

      • About Cross-cutting initiatives
      • Clean Space
      • Design 2 Produce
      • Advanced Manufacturing
      • Technology Breakthroughs for Science (TEBS)
      • Technologies for Exploration
      • Space and Energy
    • Electrical

      • Electrical engineering
      • Control Systems
      • Data Systems
      • RF Systems, Payloads and Technology
      • Electromagnetics and Space Environment
      • Power Systems
    • Mechanical

      • Mechanical engineering
      • Thermal Control
      • Structures and Mechanisms
      • Mechatronics and Optics, incl. robotics and life support
      • Propulsion and Aerothermodynamics
    • Systems

      • Systems and software engineering
      • Software Systems
      • Systems Engineering, incl. cost engineering
    • Product Assurance

      • Product Assurance
      • Flight Safety
      • Dependability
      • Quality Management and Assurance
      • Materials and Processes
      • Electronic Components
      • Software Product Assurance
    • Standards

      • Requirements and standards
      • European Cooperation for Space Standardization (ECSS)
      • European Space Components Coordination (ESCC)
    • Technology

      • A solid investment
      • Going up
      • Giant leaps
    • Technology Harmonisation
    • Directorate Technology programmes

      • About Directorate Technology Programmes
      • Technology Development Element Programme (TDE)
      • General Support Technology Programme (GSTP)
      • Technology Transfer Programme (TTP)
      • European Components Initiative (ECI)
    • Technology in domain programmes
    • Technology in domain programmes
    • Services
    • ESA Conferences

    ESA > Our Activities > Space Engineering & Technology

    Augmented reality promises astronauts instant medical knowhow

    CAMDASS
    6 February 2012

    A new augmented reality unit developed by ESA can provide just-in-time medical expertise to astronauts. All they need to do is put on a head-mounted display for 3D guidance in diagnosing problems or even performing surgery.

    The Computer Assisted Medical Diagnosis and Surgery System, CAMDASS, is a wearable augmented reality prototype.

    Augmented reality merges actual and virtual reality by precisely combining computer-generated graphics with the wearer’s view.

    CAMDASS is focused for now on ultrasound examinations but in principle could guide other procedures.

    Augmented reality headset
    Headset

    Ultrasound is leading the way because it is a versatile and effective medical diagnostic tool, and already available on the International Space Station.

    Future astronauts venturing further into space must be able to look after themselves. Depending on their distance from Earth, discussions with experts on the ground will involve many minutes of delay or even be blocked entirely.

    “Although medical expertise will be available among the crew to some extent, astronauts cannot be trained and expected to maintain skills on all the medical procedures that might be needed,” said Arnaud Runge, a biomedical engineer overseeing the project for ESA.


    Augmented reality
    Augmented reality view

    CAMDASS uses a stereo head-mounted display and an ultrasound tool tracked via an infrared camera. The patient is tracked using markers placed at the site of interest.

    An ultrasound device is linked with CAMDASS and the system allows the patient’s body to be ‘registered’ to the camera and the display calibrated to each wearer’s vision.

    3D augmented reality cue cards are then displayed in the headset to guide the wearer. These are provided by matching points on a ‘virtual human’ and the registered patient.

    CAMDASS layout
    System layout

    This guides the wearer to position and move the ultrasound probe.

    Reference ultrasound images give users an indication of what they should be seeing, and speech recognition allows hands-free control.

    The prototype has been tested for usability at Saint-Pierre University Hospital in Brussels, Belgium, with medical and nursing students, Belgian Red Cross and paramedic staff.

    Augmented reality testing
    CAMDASS testing in Brussels

    Untrained users found they could perform a reasonably difficult procedure without other help, with effective probe positioning.

    “Based on that experience, we are looking at refining the system – for instance, reducing the weight of the head-mounted display as well as the overall bulkiness of the prototype,” explained Arnaud.

    “Once it reaches maturity, the system might also be used as part of a telemedicine system to provide remote medical assistance via satellite.

    “It could be deployed as a self-sufficient tool for emergency responders as well.

    “It would be interesting to perform more testing in remote locations, in the developing world and potentially in the Concordia Antarctic base. Eventually, it could be used in space.”

    Funded by ESA’s Basic Technology Research Programme, the prototype was developed for the Agency by a consortium led by Space Applications Services NV in Belgium with support from the Technical University of Munich and the DKFZ German Cancer Research Centre.

    Rate this

    Views

    Share

    • Currently 5 out of 5 Stars.
    • 1
    • 2
    • 3
    • 4
    • 5
    Rating: 5/5 (4 votes cast)

    Thank you for rating!

    You have already rated this page, you can only rate it once!

    Your rating has been changed, thanks for rating!

    3616
    Tweet
    • Space for health
      • Mechatronics and Optics, incl. robotics and life support
        • About the Basic Technology Research Programme (TRP) OLD
        • Related articles
          • Spinning blood device set to safeguard astronaut health
            • Long-distance ultrasound exams controlled by joystick
            • Related links
            • Space Applications Services NV
            • Technical University of Munich
            • DKFZ German Cancer Research Centre
            • Saint-Pierre University Hospital, Brussels
    • App Store
    • Subscribe
    • mobile version
    • FAQ

    • Site Map

    • Contacts

    • Terms and conditions