Margarita Chli, vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich, is seen standing in front of a room giving a talk.
Margarita Chli, an Amazon Research Award recipient, is vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich, where she heads up the Vision for Robotics Lab.
Lukas Bigler/wavelighthouse

How Margarita Chli is using drones to go where people can’t

When it comes to assisting search-and-rescue missions, dogs are second to none, but an Amazon Research Award recipient says they might have some competition from drones.

Today, using drones in responding to natural or man-made disasters is limited by the fact that they need to be both individually piloted and have their observations interpreted by a human. But what if drones could “see” on their own? What if they could not only make decisions about navigation, but also where to look more closely — or even collaborate with other drones and robots to observe a specific location?

That suite of skills is exactly what Margarita Chli, an Amazon Research Award recipient and vice director at the Institute of Robotics and Intelligent Systems at ETH Zurich (the Swiss Federal Institute of Technology), is exploring. Chli heads up the Vision for Robotics Lab there (V4RL), and she’s been using her 2019 Amazon Research Award (she was awarded one in 2020 as well) to advance robotic vision for small aircraft, including drones.

Chli grew up in Greece and Cyprus with math teachers as parents, so while she was “heavily trained” in the language of mathematics, she didn’t always know robotics would be her professional focus.

Chli says it was really a series of lucky events that led to her introduction to “influential and brilliant scientists who planted the seed of intellectual curiosity in this area.”

After studying computer science and engineering at the University of Cambridge, where she earned her bachelor’s and master’s degrees, she considered her options.

“The coolest thing at the time seemed to be this PhD position at Imperial College in London, where my advisor, Andrew Davison, brought me into the area of robotic vision. That’s how it all started,” says Chli.

Related content
Measuring the displacement between location estimates derived from different camera views can help enforce the local consistency vital to navigation.

Davison’s expertise was pioneering monocular SLAM (simultaneous localization and mapping), which is about “understanding how a camera moves in space,” says Chli. In pursuing her PhD, Chli did a lot of coding on her laptop, connecting that computer to a single camera and testing algorithms.

During her postdoc at ETH Zurich, which began in 2010, she applied her computer-vision algorithms to small drones. Chli says it was exciting to translate what she was doing on her laptop to a robot that was actually moving. That’s when she envisioned the potential impact for this technology.

“It's one thing to write some code and look at beautiful images, and another thing to get a robot moving – you get a feeling that you're creating something. And even going beyond that, to create something that can help people,” says Chli.

Drones in disaster zones

Her time at ETH Zurich also marked an era where drones, which had once been prohibitively expensive, were becoming more popular and accessible. “The technological hardware side of things was blooming, which meant we could run then-expensive image-processing algorithms onboard smaller and smaller platforms.” Those drones were more expensive, bulkier, less flexible, and lacked the processing power compared to today’s drones, “but nevertheless, the applications and imagination were there already,” she says.

As she wrote her research proposals, Chli expanded her thinking about the power of this technology. “What can we do with this? How we can use drones and robots and robotic vision to have robots in our everyday lives, that that can help us with tasks that we don't want to do?”

Those questions have propelled her research ever since.

Margarita Chli is seen speaking behind a lectern that says ETH Zürich on it, there are two large flower vases just behind her
One of the first projects for Margarita Chli at ETH Zurich: using drones for search-and-rescue missions.
Oliver Bartenschlager

One of the first projects Chli got to work on at ETH Zurich — where she was appointed as a deputy director of the lab she was working as a postdoc — was using drones for search-and-rescue missions. That work involved drones accessing areas that would be too dangerous or time-consuming for rescuers on foot, allowing rescuers to search for missing people with less risk.

Working backwards from the end-user, Chli spoke with rescuers at Club Alpino Italiano and learned that they didn’t want anything in the field that wasn’t directly useful — drones that worked independently made more sense than dedicating human resources to flying and monitoring drones.

These rescuers had lost colleagues to this very risky work, which takes place in harsh weather conditions, and so they were understandably demanding — and skeptical. “They had no time for delays or mistakes from fussy hardware or software,” she says.

The requirement for simplicity and a just-works solution has “been a great drive for my research ever since, to be honest: to develop plug-and-play, no-fuss systems, such that mission experts do not need to also be robotics experts or pilots.”

Related content
Radhika Nagpal has created robots that can build towers without anyone in charge. Now she’s turned her focus to fulfillment center robots.

While supporting the work of search-and-rescue teams is still an important component of her work, Chli and team have expanded the scope of their research.

Chli also envisions drones being used for inspecting hard-to-reach areas like wind-turbine blades, or power plants. “In 2012, there was a big explosion in the power plant on the island where I come from in Cyprus. We needed drones to be able to inspect the boilers for cracks to figure out how safe it was for humans to go closer,” she says.

Truly useful robots

This incident inspired Chli to focus on designing robots with real utility.

“I found it quite astonishing that we would see in the news robots that could do all sorts of gimmicky things, but we didn’t have reliable enough robots that could really help humans in a time of dire need.” She wanted to change that, and with her background in robotic vision and interest in drones, creating an unmanned aerial vehicle (UAV) that could “see” was the next challenge. In 2013, she was part of the team that ran the first vision-based autonomous flights of a small helicopter.

Margarita Chli is seen standing on a garden terrace, a drone is hovering over her shoulder in the background.
Margarita Chli is tackling drone challenges such as how a drone can maintain estimating its motion as accurately as possible.
Daniel Winkler

That same year, Chli took a post as a professor at the University of Edinburgh as a Chancellor's fellow. There, she started Vision for Robotics Lab (V4RL), which focuses on vision for robots, especially UAVs. In 2015, she returned to ETH Zurich, where she’s now professor and continues to lead V4RL.

Her research has been accelerated thanks to the resources made available to her as an Amazon Research Award recipient; resources that include access to AWS EC2 and S3.

“I think that what Amazon is doing is a great thing, because it's helping us actually see what researchers can do with its tools and it is democratizing where research is going,” she says.

She’s using those tools to tackle some of the most important problems in her work at ETH Zurich, like “how to figure out where a good spot to land is for our drones, and how we can keep a drone estimating its motion as accurately as possible, without being affected by water, trees, pedestrians, cars, and other dynamic, moving parts of the scene.” While flight-critical tasks must be processed on the drones themselves, transferring other processing tasks to the cloud, like semantic segmentation and high-level path planning, makes sense, says Chli.

Drones helping humanity

Chli thinks drones that can see and make decisions on their own will serve humanity outside search-and-rescue operations.

Researchers tracking wildlife migrations or large, dispersed herds could use drones to keep tabs on individual animals in ways humans on foot can’t, while at the same time understanding group movements.

Robots are going to help us in many ways that today we cannot really imagine, in ways we never thought possible.
Margarita Chli

“Archaeologists have come to us and said, ‘We have about 250 archaeological sites in Greece, we have a few tools around like a tripod, and I can put it in different places and take laser scans, but it's heavy, it's bulky. I don't want to find holes in my model, because I don't have time to go back to every one of these sites to capture new data.’ That’s where drones could be ideal, because they can map an area,” says Chli.

Chli says she’s become a bit of a drone evangelist because often when people hear her speak about autonomous drones, they think of military applications — whereas her focus is on what robots can do to improve the human condition.

Chli said she understands how that distrust emerged. “This technology has been growing very quickly, particularly comparing the progress today to a few years back,” she said. “And the less we know about how this technology works, the more scared we are of it.”

That’s why, she says, it’s important to raise questions and have open dialogues to address concerns because, as she sees it, robots are going to be part of our everyday lives.

“Robots are going to help us in many ways that today we cannot really imagine,” Chli says, “in ways we never thought possible.”

Research areas

Related content

US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As an Applied Scientist in the Content Understanding Team, you will lead the end-to-end research and deployment of video and multi-modal models applied to a variety of downstream applications. More specifically, you will: - Work backwards from customer problems to research and design scientific approaches for solving them - Work closely with other scientists, engineers and product managers to expand the depth of our product insights with data, create a variety of experiments to determine the high impact projects to include in planning roadmaps - Stay up-to-date with advancements and the latest modeling techniques in the field - Publish your research findings in top conferences and journals About the team Our Prime Video Content Understanding team builds holistic media representations (e.g. descriptions of scenes, semantic embeddings) and apply them to new customer experiences supply chain problems. Our technology spans the entire Prime Video catalogue globally, and we enable instant recaps, skip intro timing, ad placement, search, and content moderation.
US, WA, Seattle
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video team member, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As an Applied Scientist in the Content Understanding Team, you will lead the end-to-end research and deployment of video and multi-modal models applied to a variety of downstream applications. More specifically, you will: - Work backwards from customer problems to research and design scientific approaches for solving them - Work closely with other scientists, engineers and product managers to expand the depth of our product insights with data, create a variety of experiments to determine the high impact projects to include in planning roadmaps - Stay up-to-date with advancements and the latest modeling techniques in the field - Publish your research findings in top conferences and journals About the team Our Prime Video Content Understanding team builds holistic media representations (e.g. descriptions of scenes, semantic embeddings) and apply them to new customer experiences supply chain problems. Our technology spans the entire Prime Video catalogue globally, and we enable instant recaps, skip intro timing, ad placement, search, and content moderation.
IN, HR, Gurugram
Our customers have immense faith in our ability to deliver packages timely and as expected. A well planned network seamlessly scales to handle millions of package movements a day. It has monitoring mechanisms that detect failures before they even happen (such as predicting network congestion, operations breakdown), and perform proactive corrective actions. When failures do happen, it has inbuilt redundancies to mitigate impact (such as determine other routes or service providers that can handle the extra load), and avoids relying on single points of failure (service provider, node, or arc). Finally, it is cost optimal, so that customers can be passed the benefit from an efficiently set up network. Amazon Shipping is hiring Applied Scientists to help improve our ability to plan and execute package movements. As an Applied Scientist in Amazon Shipping, you will work on multiple challenging machine learning problems spread across a wide spectrum of business problems. You will build ML models to help our transportation cost auditing platforms effectively audit off-manifest (discrepancies between planned and actual shipping cost). You will build models to improve the quality of financial and planning data by accurately predicting ship cost at a package level. Your models will help forecast the packages required to be pick from shipper warehouses to reduce First Mile shipping cost. Using signals from within the transportation network (such as network load, and velocity of movements derived from package scan events) and outside (such as weather signals), you will build models that predict delivery delay for every package. These models will help improve buyer experience by triggering early corrective actions, and generating proactive customer notifications. Your role will require you to demonstrate Think Big and Invent and Simplify, by refining and translating Transportation domain-related business problems into one or more Machine Learning problems. You will use techniques from a wide array of machine learning paradigms, such as supervised, unsupervised, semi-supervised and reinforcement learning. Your model choices will include, but not be limited to, linear/logistic models, tree based models, deep learning models, ensemble models, and Q-learning models. You will use techniques such as LIME and SHAP to make your models interpretable for your customers. You will employ a family of reusable modelling solutions to ensure that your ML solution scales across multiple regions (such as North America, Europe, Asia) and package movement types (such as small parcel movements and truck movements). You will partner with Applied Scientists and Research Scientists from other teams in US and India working on related business domains. Your models are expected to be of production quality, and will be directly used in production services. You will work as part of a diverse data science and engineering team comprising of other Applied Scientists, Software Development Engineers and Business Intelligence Engineers. You will participate in the Amazon ML community by authoring scientific papers and submitting them to Machine Learning conferences. You will mentor Applied Scientists and Software Development Engineers having a strong interest in ML. You will also be called upon to provide ML consultation outside your team for other problem statements. If you are excited by this charter, come join us!
IN, HR, Gurugram
We're on a journey to build something new a green field project! Come join our team and build new discovery and shopping products that connect customers with their vehicle of choice. We're looking for a talented Senior Applied Scientist to join our team of product managers, designers, and engineers to design, and build innovative automotive-shopping experiences for our customers. This is a great opportunity for an experienced engineer to design and implement the technology for a new Amazon business. We are looking for a Applied Scientist to design, implement and deliver end-to-end solutions. We are seeking passionate, hands-on, experienced and seasoned Senior Applied Scientist who will be deep in code and algorithms; who are technically strong in building scalable computer vision machine learning systems across item understanding, pose estimation, class imbalanced classifiers, identification and segmentation.. You will drive ideas to products using paradigms such as deep learning, semi supervised learning and dynamic learning. As a Senior Applied Scientist, you will also help lead and mentor our team of applied scientists and engineers. You will take on complex customer problems, distill customer requirements, and then deliver solutions that either leverage existing academic and industrial research or utilize your own out-of-the-box but pragmatic thinking. In addition to coming up with novel solutions and prototypes, you will directly contribute to implementation while you lead. A successful candidate has excellent technical depth, scientific vision, project management skills, great communication skills, and a drive to achieve results in a unified team environment. You should enjoy the process of solving real-world problems that, quite frankly, haven’t been solved at scale anywhere before. Along the way, we guarantee you’ll get opportunities to be a bold disruptor, prolific innovator, and a reputed problem solver—someone who truly enables AI and robotics to significantly impact the lives of millions of consumers. Key job responsibilities Architect, design, and implement Machine Learning models for vision systems on robotic platforms Optimize, deploy, and support at scale ML models on the edge. Influence the team's strategy and contribute to long-term vision and roadmap. Work with stakeholders across , science, and operations teams to iterate on design and implementation. Maintain high standards by participating in reviews, designing for fault tolerance and operational excellence, and creating mechanisms for continuous improvement. Prototype and test concepts or features, both through simulation and emulators and with live robotic equipment Work directly with customers and partners to test prototypes and incorporate feedback Mentor other engineer team members. A day in the life - 6+ years of building machine learning models for retail application experience - PhD, or Master's degree and 6+ years of applied research experience - Experience programming in Java, C++, Python or related language - Experience with neural deep learning methods and machine learning - Demonstrated expertise in computer vision and machine learning techniques.
US, WA, Seattle
Do you want to re-invent how millions of people consume video content on their TVs, Tablets and Alexa? We are building a free to watch streaming service called Fire TV Channels (https://techcrunch.com/2023/08/21/amazon-launches-fire-tv-channels-app-400-fast-channels/). Our goal is to provide customers with a delightful and personalized experience for consuming content across News, Sports, Cooking, Gaming, Entertainment, Lifestyle and more. You will work closely with engineering and product stakeholders to realize our ambitious product vision. You will get to work with Generative AI and other state of the art technologies to help build personalization and recommendation solutions from the ground up. You will be in the driver's seat to present customers with content they will love. Using Amazon’s large-scale computing resources, you will ask research questions about customer behavior, build state-of-the-art models to generate recommendations and run these models to enhance the customer experience. You will participate in the Amazon ML community and mentor Applied Scientists and Software Engineers with a strong interest in and knowledge of ML. Your work will directly benefit customers and you will measure the impact using scientific tools.
US, MA, Boston
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Applied Scientist with a strong deep learning background, to build industry-leading technology with Large Language Models (LLMs) and multi-modal systems. You will support projects that work on technologies including multi-modal model alignment, moderation systems and evaluation. Key job responsibilities As an Applied Scientist with the AGI team, you will support the development of novel algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in generative artificial intelligence (GenAI). You are also expected to publish in top tier conferences. About the team The AGI team has a mission to push the envelope in LLMs and multimodal systems. Specifically, we focus on model alignment with an aim to maintain safety while not denting utility, in order to provide the best-possible experience for our customers.
US, MA, Boston
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Senior Applied Scientist with a strong deep learning background, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Senior Applied Scientist with the AGI team, you will work with talented peers to lead the development of novel algorithms and modeling techniques, to advance the state of the art with LLMs. Your work will directly impact our customers in the form of products and services that make use of speech and language technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in generative artificial intelligence (GenAI). About the team The AGI team has a mission to push the envelope in LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
IN, KA, Bangalore
Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime members can customize their viewing experience and find their favorite movies, series, documentaries, and live sports – including Amazon MGM Studios-produced series and movies; licensed fan favorites; and programming from Prime Video add-on subscriptions such as Apple TV+, Max, Crunchyroll and MGM+. All customers, regardless of whether they have a Prime membership or not, can rent or buy titles via the Prime Video Store, and can enjoy even more content for free with ads. Are you interested in shaping the future of entertainment? Prime Video's technology teams are creating best-in-class digital video experience. As a Prime Video technologist, you’ll have end-to-end ownership of the product, user experience, design, and technology required to deliver state-of-the-art experiences for our customers. You’ll get to work on projects that are fast-paced, challenging, and varied. You’ll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. We’ll look for you to bring your diverse perspectives, ideas, and skill-sets to make Prime Video even better for our customers. With global opportunities for talented technologists, you can decide where a career Prime Video Tech takes you! Key job responsibilities As a highly experienced and seasoned science leader, you will apply state of the art natural language processing and computer vision research to video centric digital media, while also responsible for creating and maintaining the best environment for applied science in order to recruit, retain and develop top talent. You will lead the research direction for a team of deeply talented applied scientists, creating the roadmaps for forward-looking research and communicate them effectively to senior leadership. You will also hire and develop applied scientists - growing the team to meet the evolving needs of our customers.
IN, KA, Bengaluru
The Amazon Alexa AI team in India is seeking a talented, self-driven Applied Scientist to work on prototyping, optimizing, and deploying ML algorithms within the realm of Generative AI. Key responsibilities include: - Research, experiment and build Proof Of Concepts advancing the state of the art in AI & ML for GenAI. - Collaborate with cross-functional teams to architect and execute technically rigorous AI projects. - Thrive in dynamic environments, adapting quickly to evolving technical requirements and deadlines. - Engage in effective technical communication (written & spoken) with coordination across teams. - Conduct thorough documentation of algorithms, methodologies, and findings for transparency and reproducibility. - Publish research papers in internal and external venues of repute - Support on-call activities for critical issues Basic Qualifications: - Master’s or PhD in computer science, statistics or a related field or relevant science experience (publications/scientific prototypes) in lieu of Masters - Experience in deep learning, machine learning, and data science. - Proficiency in coding and software development, with a strong focus on machine learning frameworks. - Experience in Python, or another language; command line usage; familiarity with Linux and AWS ecosystems. - Understanding of relevant statistical measures such as confidence intervals, significance of error measurements, development and evaluation data sets, etc. - Excellent communication skills (written & spoken) and ability to collaborate effectively in a distributed, cross-functional team setting. Preferred Qualifications: - Track record of diving into data to discover hidden patterns and conducting error/deviation analysis - Ability to develop experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations - The motivation to achieve results in a fast-paced environment. - Exceptional level of organization and strong attention to detail - Comfortable working in a fast paced, highly collaborative, dynamic work environment - Papers published in AI/ML venues of repute
IN, KA, Bengaluru
The Amazon Alexa AI team in India is seeking a talented, self-driven Applied Scientist to work on prototyping, optimizing, and deploying ML algorithms within the realm of Generative AI. Key responsibilities include: - Research, experiment and build Proof Of Concepts advancing the state of the art in AI & ML for GenAI. - Collaborate with cross-functional teams to architect and execute technically rigorous AI projects. - Thrive in dynamic environments, adapting quickly to evolving technical requirements and deadlines. - Engage in effective technical communication (written & spoken) with coordination across teams. - Conduct thorough documentation of algorithms, methodologies, and findings for transparency and reproducibility. - Publish research papers in internal and external venues of repute - Support on-call activities for critical issues Basic Qualifications: - Master’s or PhD in computer science, statistics or a related field - 2-7 years experience in deep learning, machine learning, and data science. - Proficiency in coding and software development, with a strong focus on machine learning frameworks. - Experience in Python, or another language; command line usage; familiarity with Linux and AWS ecosystems. - Understanding of relevant statistical measures such as confidence intervals, significance of error measurements, development and evaluation data sets, etc. - Excellent communication skills (written & spoken) and ability to collaborate effectively in a distributed, cross-functional team setting. - Papers published in AI/ML venues of repute Preferred Qualifications: - Track record of diving into data to discover hidden patterns and conducting error/deviation analysis - Ability to develop experimental and analytic plans for data modeling processes, use of strong baselines, ability to accurately determine cause and effect relations - The motivation to achieve results in a fast-paced environment. - Exceptional level of organization and strong attention to detail - Comfortable working in a fast paced, highly collaborative, dynamic work environment