Carlos Huertas, manager of machine learning on the Buyer Risk Prevention Team, is seen sitting at a table wearing sunglasses and a leather jacket
Carlos Huertas, manager of machine learning on the Buyer Risk Prevention Team, is a “discussion grandmaster” on Kaggle, where his avatar includes his signature sunglasses.

Scarce computing resources transformed Carlos Huertas into an optimization master

At Amazon, he develops machine learning models to help keeping Amazon stores safe and trustworthy for customers and selling partners.

Watching Iron Man as a college student in his hometown of Tijuana, Mexico, Carlos Huertas was struck by one character in particular: J.A.R.V.I.S., the butler-like artificial assistant embedded in Tony Stark’s armor.

Even though it was only a movie, Huertas knew it foreshadowed real-life potential.

“I was fascinated by that level of technology,” he says.

At the time, he was pursuing a bachelor’s degree in computer engineering at the Universidad Autónoma de Baja California. Inspired by J.A.R.V.I.S.’s impressive communication skills, Huertas decided to pursue a master’s in natural language processing (NLP) at the same university.

That early shift to artificial intelligence ultimately brought him to Amazon, where he is a manager of machine learning on the Buyer Risk Prevention Team in Seattle, which is responsible for protecting customers from fraud and abuse.

Doing more with less

The master’s program was challenging, as NLP requires a lot of hardware horsepower that wasn’t available to Huertas at the time.

Back then, you needed huge machines ... We were a very humble facility and had regular consumer computers, so it was hard for me to try to match what people were doing with more resources.
Carlos Huertas

“Back then, you needed huge machines to achieve interesting things, which I didn’t have,” he says. “We were a very humble facility and had regular consumer computers, so it was hard for me to try to match what people were doing with more resources.”

The limited computing resources forced him to think outside of the box and develop creative solutions to do more with less. The challenge energized him, and for his PhD, he turned to the field of machine learning optimization, specifically feature selection for high-dimensional spaces.

That area of machine learning involves designing algorithms that help a machine to focus solely on features that are relevant to a specific task. One example where feature selection may be used is the “cat vs dog” image classification task, a classic machine learning project for beginners that involves classifying photos as containing either a dog or a cat.

Those animals have numerous features, such as color, height, weight, tail, nose shape, and eye color. Humans use their knowledge of the world to understand what helps differentiate them. For example, size might be important as most dogs tend to be bigger, but tail might not be very useful, since both animals have it.

“How do we make sure a machine learns this on its own? Feature selection is the process to help the computer understand that some of the characteristics are more important than others, so it can focus on what matters most and achieve similar or even better level of performance without so much computing power,” Huertas says.

Solving customer problems with machine learning

Huertas routinely applies feature selection in his work at Amazon.

The Buyer Risk Prevention team, Huertas explains, is responsible for keeping Amazon stores safe and trustworthy for customers and selling partners.

“In the spirit of one of our main leadership principles, Customer Obsession, we are constantly innovating and never stop trying to get the best possible experience for all our customers,” he notes. “To this end, we identify pain points and tackle them with technology.”

In order to get it right for customers, in 2019 Amazon created a team to focus on mitigating issues customers might face when reaching out for support with their accounts; that’s the team Huertas currently leads. The team develops machine learning solutions that assist customers in resolving issues with their accounts.

“The algorithm will try to review the case on its own using artificial intelligence and determine the right action for the customer,” he says. “With this, we can provide much faster support.”

As Amazon grows, so too do the amount of data and the complexity of the systems. In that context, it is important to understand which features are relevant to determine whether an issue is legitimate or not.

“This is a perfect match for feature selection, where we ask: ‘Can we be smarter and have a selection of what we should focus on so that our models perform the best without scalability issues?’” he says.

Huertas’ team focuses on providing faster and more accurate responses to customers’ concerns about their account status.

Now, customers who may have encountered issues can reclaim access without having to navigate a complex process. Huertas thinks of his own parents, who are Amazon customers but may have a hard time using third-party systems, such as email, to communicate with Amazon.

Huertas says his background as an assistant professor at Universidad Autónoma de Baja California, where he taught object-oriented programming and web development, helped shape him into a team player and a leader.

“In academia, we have this common phrase that the student doesn't fail, it is the professor who fails,” Huertas says. “When I was a professor, I felt this need to push my students forward. And that's something that I still carry with me on my team. I feel a lot of satisfaction seeing my team members develop.”

Discussion grandmaster on Kaggle

Back when Huertas was a PhD student, he joined Kaggle, an online data science and machine learning community. His goal: use the platform to test some of his PhD ideas and see how they fared against real-life problems. Because of his frequent interactions on the platform, where he still serves as a mentor to many of his peers, he holds the title of “discussion grandmaster” and was once one of the five most active users in the forum — among almost 5 million users.

Carlos Huertas (NxGTR) | Kaggle Grandmaster Interview | Kaggle Days

“The community has always been very friendly, and newcomers ask a lot of questions on how to get started,” he says.

At Kaggle, companies promote competitions to solve real-life machine-learning problems.

“It's especially useful when you're a student, because in academia you won't have access to the type of problems that Amazon might have. Getting exposure to those problems without the need to have a job there really helps you to develop your skills,” Huertas says.

In one of those competitions, when Huertas was still a PhD student, he ended up in the top 9 contestants among thousands of scientists around the world. He was competing with a laptop that, he recalls, “could barely run more than a browser.” The experience taught him a lot about how constraints can be empowering.

“It forced me to develop my own packages. And in the process, I learned how things work behind the scenes,” he says. When people have a lot of computing power, he notes, they might forget about the importance of optimization and rely on a lot of pre-built packages that might operate like a black-box.

“When you don't understand what is the magic happening behind the scenes, it is very hard to progress beyond that,” he says.

His prominence on Kaggle drew interest from ZestFinance, a Los Angeles-based company that offers underwriting analysis for lenders. After a stint building machine learning models for them, he joined Instacart where he helped launch the company’s first customer retention platform by building machine learning models to analyze which customers were more prone to abandon the platform.

Shortly after that Amazon recruiters reached out and he accepted a position on the Buyer Risk Prevention team.

“I like that Amazon puts a huge emphasis on matching your skills with the role,” Huerta says. “While other companies might have generic roles, like data scientist, Amazon has very specialized roles, such as applied scientist, research scientist, data engineer, machine learning engineer. That ensures that you're going to focus exactly on what you like.”

Amazon is looking for data scientists, economists, research scientists, and other positions to help advance the state of the art in customer-obsessed science.

The advice he provides younger scientists is to always practice what you learn in academia in a real-life setting. He compares it with a sport: You can read several books about soccer, but if you’ve never kicked a ball, it will be very tough to play it.

“It is very important that you materialize that theory into practice,” he says. “If you are still doing your PhD, there are platforms like Kaggle that will provide you with data so that you can practice your skills. By the time you complete your studies, you will have two or three years of technical experience in the field, working with real problems. That will take you very far.”

Related content

US, WA, Seattle
The Global Media Entertainment Science team uses state of the art economics and machine learning models to provide Amazon’s entertainment businesses guidance on strategically important questions. We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Some knowledge of econometrics, as well as basic familiarity with Python is necessary, and experience with SQL and UNIX would be a plus. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. You will learn how to build data sets and perform applied econometric analysis at Internet speed collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. Roughly 85% of previous cohorts have converted to full time scientist employment at Amazon. If you are interested, please send your CV to our mailing list at econ-internship@amazon.com. Key job responsibilities
US, CA, Palo Alto
The Amazon Search team creates powerful, customer-focused search solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, Amazon Product Search services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day. Our Search Relevance team works to maximize the quality and effectiveness of the search experience for visitors to Amazon websites worldwide. The Search Relevance team focuses on several technical areas for improving search quality. In this role, you will invent universally applicable signals and algorithms for training machine-learned ranking models. The relevance improvements you make will help millions of customers discover the products they want from a catalog containing millions of products. You will work on problems such as predicting the popularity of new products, developing new ranking features and algorithms that capture unique characteristics, and analyzing the differences in behavior of different categories of customers. The work will span the whole development pipeline, including data analysis, prototyping, A/B testing, and creating production-level components. Joining this team, you’ll experience the benefits of working in a dynamic, entrepreneurial environment, while leveraging the resources of Amazon.com (AMZN), one of the world’s leading Internet companies. We provide a highly customer-centric, team-oriented environment in our offices located in Palo Alto, California. Please visit https://www.amazon.science for more information
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. Do you have a strong machine learning background and want to help build new speech and language technology? Amazon is looking for PhD students who are ready to tackle some of the most interesting research problems on the leading edge of natural language processing. We are hiring in all areas of spoken language understanding: NLP, NLU, ASR, text-to-speech (TTS), and more! A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Science Intern, you will develop and implement novel scalable algorithms and modeling techniques to advance the state-of-the-art in technology areas at the intersection of ML, NLP, search, and deep learning. You will work side-by-side with global experts in speech and language to solve challenging groundbreaking research problems on production scale data. The ideal candidate must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Amazon has positions available for Natural Language Processing & Speech Intern positions in multiple locations across the United States. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. Please visit our website to stay updated with the research our teams are working on: https://www.amazon.science/research-areas/conversational-ai-natural-language-processing
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. The Research team at Amazon works passionately to apply cutting-edge advances in technology to solve real-world problems. Do you have a strong machine learning background and want to help build new speech and language technology? Do you welcome the challenge to apply optimization theory into practice through experimentation and invention? Would you love to help us develop the algorithms and models that power computer vision services at Amazon, such as Amazon Rekognition, Amazon Go, Visual Search, etc? At Amazon we hire research science interns to work in a number of domains including Operations Research, Optimization, Speech Technologies, Computer Vision, Robotics, and more! As an intern, you will be challenged to apply theory into practice through experimentation and invention, develop new algorithms using mathematical programming techniques for complex problems, implement prototypes and work with massive datasets. Amazon has a culture of data-driven decision-making, and the expectation is that analytics are timely, accurate, innovative and actionable. Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Amazon Scientist use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. The Research team at Amazon works passionately to apply cutting-edge advances in technology to solve real-world problems. Do you have a strong machine learning background and want to help build new speech and language technology? Do you welcome the challenge to apply optimization theory into practice through experimentation and invention? Would you love to help us develop the algorithms and models that power computer vision services at Amazon, such as Amazon Rekognition, Amazon Go, Visual Search, etc? At Amazon we hire research science interns to work in a number of domains including Operations Research, Optimization, Speech Technologies, Computer Vision, Robotics, and more! As an intern, you will be challenged to apply theory into practice through experimentation and invention, develop new algorithms using mathematical programming techniques for complex problems, implement prototypes and work with massive datasets. Amazon has a culture of data-driven decision-making, and the expectation is that analytics are timely, accurate, innovative and actionable. Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Amazon Scientist use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
CA, ON, Toronto
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. Are you a Masters student interested in machine learning, natural language processing, computer vision, automated reasoning, or robotics? We are looking for skilled scientists capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Our scientists use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
CA, ON, Toronto
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. Are you a PhD student interested in machine learning, natural language processing, computer vision, automated reasoning, or robotics? We are looking for skilled scientists capable of putting theory into practice through experimentation and invention, leveraging science techniques and implementing systems to work on massive datasets in an effort to tackle never-before-solved problems. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Our scientists use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science.
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. We are looking for Masters or PhD students excited about working on Automated Reasoning or Storage System problems at the intersection of theory and practice to drive innovation and provide value for our customers. AWS Automated Reasoning teams deliver tools that are called billions of times daily. Amazon development teams are integrating automated-reasoning tools such as Dafny, P, and SAW into their development processes, raising the bar on the security, durability, availability, and quality of our products. AWS Automated Reasoning teams are changing how computer systems built on top of the cloud are developed and operated. AWS Automated Reasoning teams work in areas including: Distributed proof search, SAT and SMT solvers, Reasoning about distributed systems, Automating regulatory compliance, Program analysis and synthesis, Security and privacy, Cryptography, Static analysis, Property-based testing, Model-checking, Deductive verification, compilation into mainstream programming languages, Automatic test generation, and Static and dynamic methods for concurrent systems. AWS Storage Systems teams manage trillions of objects in storage, retrieving them with predictable low latency, building software that deploys to thousands of hosts, achieving 99.999999999% (you didn’t read that wrong, that’s 11 nines!) durability. AWS storage services grapple with exciting problems at enormous scale. Amazon S3 powers businesses across the globe that make the lives of customers better every day, and forms the backbone for applications at all scales and in all industries ranging from multimedia to genomics. This scale and data diversity requires constant innovation in algorithms, systems and modeling. AWS Storage Systems teams work in areas including: Error-correcting coding and durability modeling, system and distributed system performance optimization and modeling, designing and implementing distributed, multi-tenant systems, formal verification and strong, practical assurances of correctness, bits-IOPS-Watts: the interplay between computation, performance, and energy, data compression - both general-purpose and domain specific, research challenges with storage media, both existing and emerging, and exploring the intersection between storage and quantum technologies. As an Applied Science Intern, you will work closely with Amazon scientists and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A successful candidate will be a self-starter with strong attention to detail and the ability to thrive in a fast-paced, ever-changing environment who is comfortable with ambiguity. Amazon believes that scientific innovation is essential to being the world’s most customer-centric company. Our ability to have impact at scale allows us to attract some of the brightest minds in Automated Reasoning and related fields. Our scientists work backwards to produce innovative solutions that delight our customers. Please visit https://www.amazon.science (https://www.amazon.science/) for more information.
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. We are looking for PhD students excited about working on Automated Reasoning or Storage System problems at the intersection of theory and practice to drive innovation and provide value for our customers. AWS Automated Reasoning teams deliver tools that are called billions of times daily. Amazon development teams are integrating automated-reasoning tools such as Dafny, P, and SAW into their development processes, raising the bar on the security, durability, availability, and quality of our products. AWS Automated Reasoning teams are changing how computer systems built on top of the cloud are developed and operated. AWS Automated Reasoning teams work in areas including: Distributed proof search, SAT and SMT solvers, Reasoning about distributed systems, Automating regulatory compliance, Program analysis and synthesis, Security and privacy, Cryptography, Static analysis, Property-based testing, Model-checking, Deductive verification, compilation into mainstream programming languages, Automatic test generation, and Static and dynamic methods for concurrent systems. AWS Storage Systems teams manage trillions of objects in storage, retrieving them with predictable low latency, building software that deploys to thousands of hosts, achieving 99.999999999% (you didn’t read that wrong, that’s 11 nines!) durability. AWS storage services grapple with exciting problems at enormous scale. Amazon S3 powers businesses across the globe that make the lives of customers better every day, and forms the backbone for applications at all scales and in all industries ranging from multimedia to genomics. This scale and data diversity requires constant innovation in algorithms, systems and modeling. AWS Storage Systems teams work in areas including: Error-correcting coding and durability modeling, system and distributed system performance optimization and modeling, designing and implementing distributed, multi-tenant systems, formal verification and strong, practical assurances of correctness, bits-IOPS-Watts: the interplay between computation, performance, and energy, data compression - both general-purpose and domain specific, research challenges with storage media, both existing and emerging, and exploring the intersection between storage and quantum technologies. As an Applied Science Intern, you will work closely with Amazon scientists and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A successful candidate will be a self-starter with strong attention to detail and the ability to thrive in a fast-paced, ever-changing environment who is comfortable with ambiguity. Amazon believes that scientific innovation is essential to being the world’s most customer-centric company. Our ability to have impact at scale allows us to attract some of the brightest minds in Automated Reasoning and related fields. Our scientists work backwards to produce innovative solutions that delight our customers. Please visit https://www.amazon.science (https://www.amazon.science/) for more information.
US, WA, Seattle
To ensure a great internship experience, please keep these things in mind. This is a full time internship and requires an individual to work 40 hours a week for the duration of the internship. Amazon requires an intern to be located where their assigned team is. Amazon is happy to provide relocation and housing assistance if you are located 50 miles or further from the office location. Help us develop the algorithms and models that power computer vision services at Amazon, such as Amazon Rekognition, Amazon Go, Visual Search, and more! We are combining computer vision, mobile robots, advanced end-of-arm tooling and high-degree of freedom movement to solve real-world problems at huge scale. As an intern, you will help build solutions where visual input helps the customers shop, anticipate technological advances, work with leading edge technology, focus on highly targeted customer use-cases, and launch products that solve problems for Amazon customers. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. You will own the design and development of end-to-end systems and have the opportunity to write technical white papers, create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. Amazon Science gives insight into the company’s approach to customer-obsessed scientific innovation. Amazon fundamentally believes that scientific innovation is essential to being the most customer-centric company in the world. It’s the company’s ability to have an impact at scale that allows us to attract some of the brightest minds in artificial intelligence and related fields. Amazon Scientist use our working backwards method to enrich the way we live and work. For more information on the Amazon Science community please visit https://www.amazon.science