• → European Space Agency

      • Space for Europe
      • Space News
      • Space in Images
      • Space in Videos
    • About Us

      • Welcome to ESA
      • DG's news and views
      • For Member State Delegations
      • Business with ESA
      • Law at ESA
      • ESA Exhibitions
      • ESA Publications
      • Careers at ESA
      • ESAshop
    • Our Activities

      • Space News
      • Observing the Earth
      • Human Spaceflight
      • Space Transportation
      • Navigation
      • Space Science
      • Space Engineering & Technology
      • Operations
      • Telecommunications & Integrated Applications
      • Preparing for the Future
    • Careers at ESA

    • For Media

      • Media
      • ESA TV
      • Videos for professionals
      • Photos
    • For Educators

    • For Kids

    • ESA

    • Space Engineering & Technology

    • Preparing for the Future

    • Shaping the Future

    • What we do
    • Directorate of Technology, Engineering and Quality (TEC)
    • Engineering

      • Engineering for space
      • Support to projects
      • Ensuring quality
    • Cross-cutting initiatives

      • About Cross-cutting initiatives
      • Clean Space
      • Design 2 Produce
      • Advanced Manufacturing
      • Technology Breakthroughs for Science (TEBS)
      • Technologies for Exploration
      • Space and Energy
    • Electrical

      • Electrical engineering
      • Control Systems
      • Data Systems
      • RF Systems, Payloads and Technology
      • Electromagnetics and Space Environment
      • Power Systems
    • Mechanical

      • Mechanical engineering
      • Thermal Control
      • Structures and Mechanisms
      • Mechatronics and Optics, incl. robotics and life support
      • Propulsion and Aerothermodynamics
    • Systems

      • Systems and software engineering
      • Software Systems
      • Systems Engineering, incl. cost engineering
    • Product Assurance

      • Product Assurance
      • Flight Safety
      • Dependability
      • Quality Management and Assurance
      • Materials and Processes
      • Electronic Components
      • Software Product Assurance
    • Standards

      • Requirements and standards
      • European Cooperation for Space Standardization (ECSS)
      • European Space Components Coordination (ESCC)
    • Technology

      • A solid investment
      • Going up
      • Giant leaps
    • Technology Harmonisation
    • Directorate Technology programmes

      • About Directorate Technology Programmes
      • Basic Technology Research Programme (TRP)
      • General Support Technology Programme (GSTP)
      • Technology Transfer Programme (TTP)
      • European Components Initiative (ECI)
    • Technology in domain programmes
    • Technology in domain programmes
    • Services
    • ESA Conferences

    ESA > Our Activities > Space Engineering & Technology

    One-eyed robot learns to see in weightlessness

    Stereo camera on ISS drone
    28 September 2016

    A small drone taught itself to judge distances using only one eye during trials aboard the International Space Station, ESA-backed researchers have reported.

    Although humans can effortlessly estimate distances with a single eye, robots still lack this capability.

    “It is a mathematical impossibility to extract distances to objects from one single image, if the object has not been encountered before,” explains Guido de Croon from Delft University of Technology, one of the investigators.

    “But if we recognise something to be a car, then we know its physical characteristics, and we can use that information to estimate its distance from us. A similar logic is what we wanted the drone to learn during our experiment.”

    Spheres drone

    One of the Spheres – Synchronized Position Hold Engage and Reorient Experimental Satellite – drones resident in the Space Station was pressed into service for testing.

    With 12 carbon dioxide gas thrusters enabling rotation and movement in all direction, the bowling ball-sized Spheres are essentially free-floating mini-spacecraft within the Station, used for testing a wide variety of technology.

    For this test, a drone began navigating inside Japan’s module while recording stereo vision information from its two camera ‘eyes’. It then began to learn about the distances to walls and nearby obstacles so that when its stereo camera was switched off, it could then begin autonomous exploration using only a single camera.

    Quadcopter for ground test

    Operating in weightlessness, with no favoured up or down direction, added to the challenge. However, the experiment demonstrated that machine learning would indeed allow the normally stereo-viewing drone to recover from the loss of one camera.

    The self-supervised learning software had previously been tested thoroughly at the TU Delft CyberZoo – a research lab for flying and walking robots – using quadcopters.

    The experiment, presented on 27 September at the International Astronautical Congress in Guadalajara, Mexico, marked an important step in an ongoing research effort based on advanced artificial intelligence concepts, in collaboration between ESA, the Massachusetts Institute of Technology and the Micro Air Vehicles Lab of the Delft University of Technology.

    Spheres drone with ISS crewman

    “It was very exciting to see a drone in space learning using cutting-edge artificial intelligence methods for the very first time,” explains Dario Izzo, coordinating the research contribution from ESA’s Advanced Concepts Team.

    “At ESA, in particular in our team, we’ve been working towards the goal for the last five years. In space applications, machine learning is not considered a reliable approach to autonomy: a ‘bad’ learning approach may result in a catastrophic failure of the entire mission.

    SPHERES models
    Spheres on Station

    “Our approach, based on self-supervised learning, has a high degree of reliability and helps drone autonomy. A similar learning approach was successfully applied to self-driving cars, a task where reliability is also of paramount importance.”

    Leopold Summerer, heading the  Advanced Concepts Team, adds: “This is a further step in our quest for truly autonomous space systems, which are increasingly in demand for deep-space exploration, complex operations, for reducing costs, and increasing capabilities and science opportunities.”

    Rate this

    Views

    Share

    • Currently 5 out of 5 Stars.
    • 1
    • 2
    • 3
    • 4
    • 5
    Rating: 4.8/5 (74 votes cast)

    Thank you for rating!

    You have already rated this page, you can only rate it once!

    Your rating has been changed, thanks for rating!

    4707
    Tweet
    • 67th International Astronautical Congress
    • IAC paper: "Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments"
    • TU Delft CyberZoo
    • SPHERES in the Destiny lab on the ISS
      SPHERES in the Destiny lab on the ISS
      Spheres
    • Logo
      Logo
      Advanced Concepts Team
    • App Store
    • Subscribe
    • mobile version
    • LATEST ARTICLES
    • · Sentinel-3B on launch pad
    • · Walking on the Moon – underwater
    • · Storm hunter in position
    • · Mars impact crater or supervolcano?
    • · Top tomatoes thanks to Mars missio…
    • FAQ

    • Site Map

    • Contacts

    • Terms and conditions