Margarita Chli, vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich, is seen standing in front of a room giving a talk.
Margarita Chli, an Amazon Research Award recipient, is vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich, where she heads up the Vision for Robotics Lab.
Lukas Bigler/wavelighthouse

How Margarita Chli is using drones to go where people can’t

When it comes to assisting search-and-rescue missions, dogs are second to none, but an Amazon Research Award recipient says they might have some competition from drones.

Today, using drones in responding to natural or man-made disasters is limited by the fact that they need to be both individually piloted and have their observations interpreted by a human. But what if drones could “see” on their own? What if they could not only make decisions about navigation, but also where to look more closely — or even collaborate with other drones and robots to observe a specific location?

That suite of skills is exactly what Margarita Chli, an Amazon Research Award recipient and vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich (the Swiss Federal Institute of Technology), is exploring. Chli heads up the Vision for Robotics Lab there (V4RL), and she’s been using her 2019 Amazon Research Award (she was awarded one in 2020 as well) to advance robotic vision for small aircraft, including drones.

Chli grew up in Greece and Cyprus with math teachers as parents, so while she was “heavily trained” in the language of mathematics, she didn’t always know robotics would be her professional focus.

Chli says it was really a series of lucky events that led to her introduction to “influential and brilliant scientists who planted the seed of intellectual curiosity in this area.”

After studying computer science and engineering at the University of Cambridge, where she earned her bachelor’s and master’s degrees, she considered her options.

“The coolest thing at the time seemed to be this PhD position at Imperial College in London, where my advisor, Andrew Davison, brought me into the area of robotic vision. That’s how it all started,” says Chli.

Related content
Measuring the displacement between location estimates derived from different camera views can help enforce the local consistency vital to navigation.

Davison’s expertise was pioneering monocular SLAM (simultaneous localization and mapping), which is about “understanding how a camera moves in space,” says Chli. In pursuing her PhD, Chli did a lot of coding on her laptop, connecting that computer to a single camera and testing algorithms.

During her postdoc at ETH Zurich, which began in 2010, she applied her computer-vision algorithms to small drones. Chli says it was exciting to translate what she was doing on her laptop to a robot that was actually moving. That’s when she envisioned the potential impact for this technology.

“It's one thing to write some code and look at beautiful images, and another thing to get a robot moving – you get a feeling that you're creating something. And even going beyond that, to create something that can help people,” says Chli.

Drones in disaster zones

Her time at ETH Zurich also marked an era where drones, which had once been prohibitively expensive, were becoming more popular and accessible. “The technological hardware side of things was blooming, which meant we could run then-expensive image-processing algorithms onboard smaller and smaller platforms.” Those drones were more expensive, bulkier, less flexible, and lacked the processing power compared to today’s drones, “but nevertheless, the applications and imagination were there already,” she says.

As she wrote her research proposals, Chli expanded her thinking about the power of this technology. “What can we do with this? How we can use drones and robots and robotic vision to have robots in our everyday lives, that that can help us with tasks that we don't want to do?”

Those questions have propelled her research ever since.

Margarita Chli is seen speaking behind a lectern that says ETH Zürich on it, there are two large flower vases just behind her
One of the first projects for Margarita Chli at ETH Zurich: using drones for search-and-rescue missions.
Oliver Bartenschlager

One of the first projects Chli got to work on at ETH Zurich — where she was appointed as a deputy director of the lab she was working as a postdoc — was using drones for search-and-rescue missions. That work involved drones accessing areas that would be too dangerous or time-consuming for rescuers on foot, allowing rescuers to search for missing people with less risk.

Working backwards from the end-user, Chli spoke with rescuers at Club Alpino Italiano and learned that they didn’t want anything in the field that wasn’t directly useful — drones that worked independently made more sense than dedicating human resources to flying and monitoring drones.

These rescuers had lost colleagues to this very risky work, which takes place in harsh weather conditions, and so they were understandably demanding — and skeptical. “They had no time for delays or mistakes from fussy hardware or software,” she says.

The requirement for simplicity and a just-works solution has “been a great drive for my research ever since, to be honest: to develop plug-and-play, no-fuss systems, such that mission experts do not need to also be robotics experts or pilots.”

Related content
Radhika Nagpal has created robots that can build towers without anyone in charge. Now she’s turned her focus to fulfillment center robots.

While supporting the work of search-and-rescue teams is still an important component of her work, Chli and team have expanded the scope of their research.

Chli also envisions drones being used for inspecting hard-to-reach areas like wind-turbine blades, or power plants. “In 2012, there was a big explosion in the power plant on the island where I come from in Cyprus. We needed drones to be able to inspect the boilers for cracks to figure out how safe it was for humans to go closer,” she says.

Truly useful robots

This incident inspired Chli to focus on designing robots with real utility.

“I found it quite astonishing that we would see in the news robots that could do all sorts of gimmicky things, but we didn’t have reliable enough robots that could really help humans in a time of dire need.” She wanted to change that, and with her background in robotic vision and interest in drones, creating an unmanned aerial vehicle (UAV) that could “see” was the next challenge. In 2013, she was part of the team that ran the first vision-based autonomous flights of a small helicopter.

Margarita Chli is seen standing on a garden terrace, a drone is hovering over her shoulder in the background.
Margarita Chli is tackling drone challenges such as how a drone can maintain estimating its motion as accurately as possible.
Daniel Winkler

That same year, Chli took a post as a professor at the University of Edinburgh as a Chancellor's fellow. There, she started Vision for Robotics Lab (V4RL), which focuses on vision for robots, especially UAVs. In 2015, she returned to ETH Zurich, where she’s now professor and continues to lead V4RL.

Her research has been accelerated thanks to the resources made available to her as an Amazon Research Award recipient; resources that include access to AWS EC2 and S3.

“I think that what Amazon is doing is a great thing, because it's helping us actually see what researchers can do with its tools and it is democratizing where research is going,” she says.

She’s using those tools to tackle some of the most important problems in her work at ETH Zurich, like “how to figure out where a good spot to land is for our drones, and how we can keep a drone estimating its motion as accurately as possible, without being affected by water, trees, pedestrians, cars, and other dynamic, moving parts of the scene.” While flight-critical tasks must be processed on the drones themselves, transferring other processing tasks to the cloud, like semantic segmentation and high-level path planning, makes sense, says Chli.

Drones helping humanity

Chli thinks drones that can see and make decisions on their own will serve humanity outside search-and-rescue operations.

Researchers tracking wildlife migrations or large, dispersed herds could use drones to keep tabs on individual animals in ways humans on foot can’t, while at the same time understanding group movements.

Robots are going to help us in many ways that today we cannot really imagine, in ways we never thought possible.
Margarita Chli

“Archaeologists have come to us and said, ‘We have about 250 archaeological sites in Greece, we have a few tools around like a tripod, and I can put it in different places and take laser scans, but it's heavy, it's bulky. I don't want to find holes in my model, because I don't have time to go back to every one of these sites to capture new data.’ That’s where drones could be ideal, because they can map an area,” says Chli.

Chli says she’s become a bit of a drone evangelist because often when people hear her speak about autonomous drones, they think of military applications — whereas her focus is on what robots can do to improve the human condition.

Chli said she understands how that distrust emerged. “This technology has been growing very quickly, particularly comparing the progress today to a few years back,” she said. “And the less we know about how this technology works, the more scared we are of it.”

That’s why, she says, it’s important to raise questions and have open dialogues to address concerns because, as she sees it, robots are going to be part of our everyday lives.

“Robots are going to help us in many ways that today we cannot really imagine,” Chli says, “in ways we never thought possible.”

Research areas

Related content

US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
LU, Luxembourg
Are you a talented and inventive scientist with a strong passion about modern data technologies and interested to improve business processes, extracting value from the data? Would you like to be a part of an organization that is aiming to use self-learning technology to process data in order to support the management of the procurement function? The Global Procurement Technology, as a part of Global Procurement Operations, is seeking a skilled Data Scientist to help build its future data intelligence in business ecosystem, working with large distributed systems of data and providing Machine Learning (ML) and Predictive Modeling expertise. You will be a member of the Data Engineering and ML Team, joining a fast-growing global organization, with a great vision to transform the Procurement field, and become the role model in the market. This team plays a strategic role supporting the core Procurement business domains as well as it is the cornerstone of any transformation and innovation initiative. Our mission is to provide a high-quality data environment to facilitate process optimization and business digitalization, on a global scale. We are supporting business initiatives, including but not limited to, strategic supplier sourcing (e.g. contracting, negotiation, spend analysis, market research, etc.), order management, supplier performance, etc. We are seeking an individual who can thrive in a fast-paced work environment, be collaborative and share knowledge and experience with his colleagues. You are expected to deliver results, but at the same time have fun with your teammates and enjoy working in the company. In Amazon, you will find all the resources required to learn new skills, grow your career, and become a better professional. You will connect with world leaders in your field and you will be tackling Data Science challenges to ensure business continuity, by taking the right decisions for your customers. As a Data Scientist in the team, you will: -be the subject matter expert to support team strategies that will take Global Procurement Operations towards world-class predictive maintenance practices and processes, driving more effective procurement functions, e.g. supplier segmentation, negotiations, shipping supplies volume forecast, spend management, etc. -have strong analytical skills and excel in the design, creation, management, and enterprise use of large data sets, combining raw data from different sources -provide technical expertise to support the development of ML models to facilitate intelligent digital services, such as Contract Lifecycle Management (CLM) and Negotiations platform -cooperate closely with different groups of stakeholders, e.g. data/software engineers, product/program managers, analysts, senior leadership, etc. to evaluate business needs and objectives to set up the best data management environment -create and share with audiences of varying levels technical papers and presentations -deal with ambiguity, prioritizing needs, and delivering results in a dynamic environment Basic qualifications -Master’s Degree in Computer Science/Engineering, Informatics, Mathematics, or a related technical discipline -3+ years of industry experience in data engineering/science, business intelligence or related field -3+ years experience in algorithm design, engineering and implementation for very-large scale applications to solve real problems -Very good knowledge of data modeling and evaluation -Very good understanding of regression modeling, forecasting techniques, time series analysis, machine-learning concepts such as supervised and unsupervised learning, classification, random forest, etc. -SQL and query performance tuning skills Preferred qualifications -2+ years of proficiency in using R, Python, Scala, Java or any modern language for data processing and statistical analysis -Experience with various RDBMS, such as PostgreSQL, MS SQL Server, MySQL, etc. -Experience architecting Big Data and ML solutions with AWS products (Redshift, DynamoDB, Lambda, S3, EMR, SageMaker, Lex, Kendra, Forecast etc.) -Experience articulating business questions and using quantitative techniques to arrive at a solution using available data -Experience with agile/scrum methodologies and its benefits of managing projects efficiently and delivering results iteratively -Excellent written and verbal communication skills including data visualization, especially in regards to quantitative topics discussed with non-technical colleagues
US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
US, CA, San Francisco
About Twitch Launched in 2011, Twitch is a global community that comes together each day to create multiplayer entertainment: unique, live, unpredictable experiences created by the interactions of millions. We bring the joy of co-op to everything, from casual gaming to world-class esports to anime marathons, music, and art streams. Twitch also hosts TwitchCon, where we bring everyone together to celebrate, learn, and grow their personal interests and passions. We’re always live at Twitch. Stay up to date on all things Twitch on Linkedin, Twitter and on our Blog. About the role: Twitch builds data-driven machine learning solutions across several rich problem spaces: Natural Language Processing (NLP), Recommendations, Semantic Search, Classification/Categorization, Anomaly Detection, Forecasting, Safety, and HCI/Social Computing/Computational Social Science. As an Intern, you will work with a dedicated Mentor and Manager on a project in one of these problem areas. You will also be supported by an Advisor and participate in cohort activities such as research teach backs and leadership talks. This position can also be located in San Francisco, CA or virtual. You Will: Solve large-scale data problems. Design solutions for Twitch's problem spaces Explore ML and data research
US, WA, Seattle
We are a team of doers working passionately to apply cutting-edge advances in deep learning in the life sciences to solve real-world problems. As a Senior Applied Science Manager you will participate in developing exciting products for customers. Our team rewards curiosity while maintaining a laser-focus in bringing products to market. Competitive candidates are responsive, flexible, and able to succeed within an open, collaborative, entrepreneurial, startup-like environment. At the leading edge of both academic and applied research in this product area, you have the opportunity to work together with a diverse and talented team of scientists, engineers, and product managers and collaborate with others teams. Location is in Seattle, US Embrace Diversity Here at Amazon, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust Balance Work and Life Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives Mentor & Grow Careers Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future. Key job responsibilities • Manage high performing engineering and science teams • Hire and develop top-performing engineers, scientists, and other managers • Develop and execute on project plans and delivery commitments • Work with business, data science, software engineer, biological, and product leaders to help define product requirements and with managers, scientists, and engineers to execute on them • Build and maintain world-class customer experience and operational excellence for your deliverables
US, Virtual
The Amazon Economics Team is hiring Interns in Economics. We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Some knowledge of econometrics, as well as basic familiarity with Stata, R, or Python is necessary. Experience with SQL, UNIX, Sawtooth, and Spark would be a plus. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. You will learn how to build data sets and perform applied econometric analysis at Internet speed collaborating with economists, data scientists and MBAʼs. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. Roughly 85% of interns from previous cohorts have converted to full time economics employment at Amazon. If you are interested, please send your CV to our mailing list at econ-internship@amazon.com.
US, WA, Seattle
Amazon internships are full-time (40 hours/week) for 12 consecutive weeks with start dates in May - July 2023. Our internship program provides hands-on learning and building experiences for students who are interested in a career in hardware engineering. This role will be based in Seattle, and candidates must be willing to work in-person. Corporate Projects (CPT) is a team that sits within the broader Corporate Development organization at Amazon. We seek to bring net-new, strategic projects to life by working together with customers and evolving projects from ZERO-to-ONE. To do so, we deploy our resources towards proofs-of-concept (POCs) and pilot programs and develop them from high-level ideas (the ZERO) to tangible short-term results that provide validating signal and a path to scale (the ONE). We work with our customers to develop and create net-new opportunities by relentlessly scouring all of Amazon and finding new and innovative ways to strengthen and/or accelerate the Amazon Flywheel. CPT seeks an Applied Science intern to work with a diverse, cross-functional team to build new, innovative customer experiences. Within CPT, you will apply both traditional and novel scientific approaches to solve and scale problems and solutions. We are a team where science meets application. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems.