On the left is the cover of the book Ethical Machines, on the right is its author Reid Blackman
Reid Blackman’s new book — Ethical Machines: Your Concise Guide to Totally Unbiased, Transparent, and Respectful AI — is a guide for avoiding bias in artificial intelligence and machine learning.

Reid Blackman: The ethics of AI

The author of Ethical Machines explains why companies pursuing ethical AI must ultimately place the responsibility with their senior leadership.

When Diya Wynn, a senior practice manager in Amazon’s Emerging Technologies and Intelligent Platforms group, created Amazon Web Services’ (AWS) responsible AI team in late 2020, she began looking for thought leaders with whom she could collaborate.

AI and machine learning technologies were game changers and had demonstrable upside, but there were potential downsides as well. A raft of potential issues for AWS’s customers — from legal concerns to ethical dilemmas — accompanied the deployment of these potent technologies.

Senior business leaders were slowly realizing that their organizations didn’t have the people or institutional knowledge and practices to address those risks. AWS customers were looking for guidance on how to use AI-based tools responsibly.

As Amazon made a strong commitment to responsible AI, Wynn found her first partner. Reid Blackman was a former philosophy professor turned entrepreneur who had leaped into the fray in 2018 by starting Virtue, a consulting firm aimed at helping companies institute responsible AI and ML practices within their organizations.

Blackman’s new book — Ethical Machines: Your Concise Guide to Totally Unbiased, Transparent, and Respectful AI (Harvard Business Review Press) is a how-to guide for navigating some daunting and potentially perilous waters.

Potent tech, unintended consequences

For Blackman, AI ethics in business is actually about intelligent systems designed to handle specific, narrow tasks far more efficiently than humans could. Machine learning, fueled by a seemingly bottomless trove of data, has enabled automated decision-making that produces faster, more accurate outcomes than ever before possible.

Related content
Thirteen new projects focus on ensuring fairness in AI algorithms and the systems that incorporate them.

Unfortunately, such systems have also proven to be capable of flawed or unintended results that can do significant harm to a company’s reputation and bottom line. The more AI-based products and services have become integral to the global economy, the clearer it has become that oversight is essential.

Having been introduced by a mutual colleague participating in an AI working group Wynn and Blackman quickly realized they had similar goals, and a partnership emerged. While many executives consider “responsible AI” a bit esoteric, Blackman has embraced the opposite perspective.

“To him, AI ethics are not fuzzy,” Wynn said. “He has a way of getting around that conversation and helping people land on some concrete ideas about what is good and right.”

Together, they are delivering workshops for Amazon customers and providing the book as a primer on how to think about and implement effective internal processes and programs.

Responding to ‘alarm bells’

Blackman’s philosophy background proved to be a useful foundation for considering the implications of AI. Ethically responsible behavior, after all, is at the heart of most conversations about human nature. But after a decade of teaching, he had grown weary of the academic environment.

Blackman had an entrepreneurial bent: In grad school, he had started a successful fireworks wholesaling business. He noticed that the adoption of AI in business, though still in its infancy, had exploded. The decision to leave academia, where he taught philosophy at Colgate University and the University of North Carolina, was based on that entrepreneurial itch and a realization that a new market was materializing.

“It was 2018, and I became aware of engineers ringing alarm bells around the coming impact of AI on society,” Blackman said, citing the fallout from the Cambridge Analytica scandal.

Reid Blackman: Why we need a broader ethical AI perspective in business

By 2020 and 2021, the conversation around AI ethics and responsibility had reached a fever pitch. Blackman wrote articles about the subject for the likes of the Harvard Business Review and TechCrunch. He came at the problem with an unusual take. He distinguishes between two groups: AI for good, and AI for not bad.

“Those in the 'AI for good' group ask themselves the question: 'How can we create a positive social impact with the powerful tool that is AI?'" Blackman explained. “That is usually the province of corporate social responsibility. There’s rarely a business model behind their goals.

“AI for not bad is about risk mitigation. These people have a goal, which may or may not be ethical in character, like making loans to people, interviewing people for jobs, diagnosing people with various diseases and recommending treatments, and they ask themselves: `How can we use AI to help us with those things in a way that doesn’t ethically screw things up?’”

That question is of paramount concern to business leaders. Because as these products and services tread close to ethical boundaries, their implementation has serious implications to business reputations.

The path to AI for good and ‘not bad’

Companies have long struggled to find ways to create and maintain an ethically sound organization, Blackman said, and AI adds a new layer of complexity. Making sure the tools they use are accurate, reliable, and based on sound science is a challenging task.

Added to the problem, he pointed out, is that senior leaders, specifically CEOs and COOs, believe this is a technical problem to be solved by engineers and data scientists. That, Blackman insisted, is wrong.

You will only get the systematic design, development, procurement and deployment of ethically responsible tools on the condition that you have a top-down strategy for doing it right.
Reid Blackman

“Ultimately, this resides with senior leadership,” Blackman said. “Junior engineers and data scientists want to do the right thing, but the truth is that you will only get the systematic design, development, procurement and deployment of ethically responsible tools on the condition that you have a top-down strategy for doing it right. What’s more you can’t math your way out of these problems. Data scientists need support from relevant experts who can help make the qualitative judgments that are a necessary feature of any robust ethical risk assessment."

Blackman insists that ethics is not “squishy” or difficult to understand and mitigate if leaders are willing to learn enough about how AI and ML intersect with ethics.

The reason most organizations are slow in responding to this new challenge, he said, is that they may either not know they have a problem, or “They might know they have a problem, but nobody owns the problem. If nobody owns the problem, there will be no budget allotted to solve it. Corporate codes of conduct are usually too general and vague to effectively address the issue.

“Senior leaders are intellectually intimidated by the topic,” Blackman said. “They say, `This is something for the data scientists to figure out. Not me.’”

In his book, Blackman lays out what he considers the crucial distinction that organizations must understand in order to understand AI ethics: structure versus content. The content side of the equation is focused on the ethical issues to avoid. The structural structure side is aimed at how to mitigate those risks.

Related content
Krishna Gade, the founder of this Alexa Fund portfolio company, answers three questions about ‘responsible AI’.

Blackman believes most leaders get a superficial view of the content side: Bias is bad, fairness is good, black box algorithms are scary. What, they then ask, should our structure look like? “They answer that too quickly,” Blackman said, “and they run into problems. If you go deeper on the content side, then the structure side will reveal itself.”

Going deeper, he suggested, means exploring what bias looks like, understanding the concept of discriminatory impacts, and developing a strong AI ethics statement. With a comprehensive understanding of the content side, businesses can create the appropriate procedures, processes, policies, and infrastructure to identify and mitigate risks.

Developing a partner ecosystem

For Wynn, building a “partner ecosystem” is a key method for scaling AWS’s work. Customers have been starting to ask more and more questions about AI and ML issues.

“Our consistent way to respond comes through our responsible AI framework to instantiate principles in an organization, the strategic guidance we offer in engagement, leveraging services and tools that compliment responsible AI principles,” Wynn explains.

“We’ve opened Pandora’s Box, and there is no closing it,” Wynn said. “What do we do in wielding this tremendous power we have with AI and ensure it isn’t harmful?”

Working with AWS is a potent partnership, Blackman added. “There is great value bringing our collective experience in qualitative assessment, ethical technology, and software engineering together to service customers,” Wynn agreed.

View from space of a connected network around planet Earth representing the Internet of Things.
Sign up for our newsletter

Research areas

Related content

GB, London
Are you excited about applying economic models and methods using large data sets to solve real world business problems? Then join the Economic Decision Science (EDS) team. EDS is an economic science team based in the EU Stores business. The teams goal is to optimize and automate business decision making in the EU business and beyond. An internship at Amazon is an opportunity to work with leading economic researchers on influencing needle-moving business decisions using incomparable datasets and tools. It is an opportunity for PhD students and recent PhD graduates in Economics or related fields. We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Knowledge of econometrics, as well as basic familiarity with Stata, R, or Python is necessary. Experience with SQL would be a plus. As an Economics Intern, you will be working in a fast-paced, cross-disciplinary team of researchers who are pioneers in the field. You will take on complex problems, and work on solutions that either leverage existing academic and industrial research, or utilize your own out-of-the-box pragmatic thinking. In addition to coming up with novel solutions and prototypes, you may even need to deliver these to production in customer facing products. Roughly 85% of previous intern cohorts have converted to full time economics employment at Amazon.
US, CA, Cupertino
We're looking for an Applied Scientist to help us secure Amazon's most critical data. In this role, you'll work closely with internal security teams to design and build AR-powered systems that protect our customers' data. You will build on top of existing formal verification tools developed by AWS and develop new methods to apply those tools at scale. You will need to be innovative, entrepreneurial, and adaptable. We move fast, experiment, iterate and then scale quickly, thoughtfully balancing speed and quality. Inclusive Team Culture Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Work/Life Balance Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future. Key job responsibilities Deeply understand AR techniques for analyzing programs and other systems, and keep up with emerging ideas from the research community. Engage with our customers to develop understanding of their needs. Propose and develop solutions that leverage symbolic reasoning services and concepts from programming languages, theorem proving, formal verification and constraint solving. Implement these solutions as services and work with others to deploy them at scale across Payments and Healthcare. Author papers and present your work internally and externally. Train new teammates, mentor others, participate in recruiting and interviewing, and participate in our tactical and strategic planning. About the team Our small team of applied scientists works within a larger security group, supporting thousands of engineers who are developing Amazon's payments and healthcare services. Security is a rich area for automated reasoning. Most other approaches are quite ad-hoc and take a lot of human effort. AR can help us to reason deliberately and systematically, and the dream of provable security is incredibly compelling. We are working to make this happen at scale. We partner closely with our larger security group and with other automated reasoning teams in AWS that develop core reasoning services.
US, NY, New York
Search Thematic Ad Experience (STAX) team within Sponsored Products is looking for a leader to lead a team of talented applied scientists working on cutting-edge science to innovate on ad experiences for Amazon shoppers!. You will manage a team of scientists, engineers, and PMs to innovate new widgets on Amazon Search page to improve shopper experience using state-of-the-art NLP and computer vision models. You will be leading some industry first experiences that has the potential to revolutionize how shopping looks and feels like on Amazon, and e-commerce marketplaces in general. You will have the opportunity to design the vision on how ad experiences look on Amazon search page, and use the combination of advanced techniques and continuous experimentation to realize this vision. Your work will be core to Amazon’s advertising business. You will be a significant contributor in building the future of sponsored advertising, directly impacting the shopper experience for our hundreds of millions of shoppers worldwide, while delivering significant value for hundreds of thousands of advertisers across the purchase journey with ads on Amazon. Key job responsibilities * Be the technical leader in Machine Learning; lead efforts within the team, and collaborate and influence across the organization. * Be a critic, visionary, and execution leader. Invent and test new product ideas that are powered by science that addresses key product gaps or shopper needs. * Set, plan, and execute on a roadmap that strikes the optimal balance between short term delivery and long term exploration. You will influence what we invest in today and tomorrow. * Evangelize the team’s science innovation within the organization, company, and in key conferences (internal and external). * Be ruthless with prioritization. You will be managing a team which is highly sought after. But not all can be done. Have a deep understanding of the tradeoffs involved and be fierce in prioritizing. * Bring clarity, direction, and guidance to help teams navigate through unsolved problems with the goal to elevate the shopper experience. We work on ambiguous problems and the right approach is often unknown. You will bring your rich experience to help guide the team through these ambiguities, while working with product and engineering in crisply defining the science scope and opportunities. * Have strong product and business acumen to drive both shopper improvements and business outcomes. A day in the life * Lead a multidisciplinary team that embodies “customer obsessed science”: inventing brand new approaches to solve Amazon’s unique problems, and using those inventions in software that affects hundreds of millions of customers * Dive deep into our metrics, ongoing experiments to understand how and why they are benefitting our shoppers (or not) * Design, prototype and validate new widgets, techniques, and ideas. Take end-to-end ownership of moving from prototype to final implementation. * Be an advocate and expert for STAX science to leaders and stakeholders inside and outside advertising. About the team We are the Search thematic ads experience team within Sponsored products - a fast growing team of customer-obsessed engineers, technologists, product leaders, and scientists. We are focused on continuous exploration of contexts and creatives to drive value for both our customers and advertisers, through continuous innovation. We focus on new ads experiences globally to help shoppers make the most informed purchase decision while helping shortcut the time to discovery that shoppers are highly likely to engage with. We also harvest rich contextual and behavioral signals that are used to optimize our backend models to continually improve the shopper experience. We obsess about our customers and are continuously seeking opportunities to delight them.
US, CA, Palo Alto
Amazon is the 4th most popular site in the US. Our product search engine, one of the most heavily used services in the world, indexes billions of products and serves hundreds of millions of customers world-wide. We are working on a new initiative to transform our search engine into a shopping engine that assists customers with their shopping missions. We look at all aspects of search CX, query understanding, Ranking, Indexing and ask how we can make big step improvements by applying advanced Machine Learning (ML) and Deep Learning (DL) techniques. We’re seeking a thought leader to direct science initiatives for the Search Relevance and Ranking at Amazon. This person will also be a deep learning practitioner/thinker and guide the research in these three areas. They’ll also have the ability to drive cutting edge, product oriented research and should have a notable publication record. This intellectual thought leader will help enhance the science in addition to developing the thinking of our team. This leader will direct and shape the science philosophy, planning and strategy for the team, as we explore multi-modal, multi lingual search through the use of deep learning . We’re seeking an individual that can enhance the science thinking of our team: The org is made of 60+ applied scientists, (2 Principal scientists and 5 Senior ASMs). This person will lead and shape the science philosophy, planning and strategy for the team, as we push into Deep Learning to solve problems like cold start, discovery and personalization in the Search domain. Joining this team, you’ll experience the benefits of working in a dynamic, entrepreneurial environment, while leveraging the resources of Amazon [Earth's most customer-centric internet company]. We provide a highly customer-centric, team-oriented environment in our offices located in Palo Alto, California.
JP, 13, Tokyo
Our mission is to help every vendor drive the most significant impact selling on Amazon. Our team invent, test and launch some of the most innovative services, technology, processes for our global vendors. Our new AVS Professional Services (ProServe) team will go deep with our largest and most sophisticated vendor customers, combining elite client-service skills with cutting edge applied science techniques, backed up by Amazon’s 20+ years of experience in Japan. We start from the customer’s problem and work backwards to apply distinctive results that “only Amazon” can deliver. Amazon is looking for a talented and passionate Applied Science Manager to manage our growing team of Applied Scientists and Business Intelligence Engineers to build world class statistical and machine learning models to be delivered directly to our largest vendors, and working closely with the vendors' senior leaders. The Applied Science Manager will set the strategy for the services to invent, collaborating with the AVS business consultants team to determine customer needs and translating them to a science and development roadmap, and finally coordinating its execution through the team. In this position, you will be part of a larger team touching all areas of science-based development in the vendor domain, not limited to Japan-only products, but collaborating with worldwide science and business leaders. Our current projects touch on the areas of causal inference, reinforcement learning, representation learning, anomaly detection, NLP and forecasting. As the AVS ProServe Applied Science Manager, you will be empowered to expand your scope of influence, and use ProServe as an incubator for products that can be expanded to all Amazon vendors, worldwide. We place strong emphasis on talent growth. As the Applied Science Manager, you will be expected in actively growing future Amazon science leaders, and providing mentoring inside and outside of your team. Key job responsibilities The Applied Science Manager is accountable for: (1) Creating a vision, a strategy, and a roadmap tackling the most challenging business questions from our leading vendors, assess quantitatively their feasibility and entitlement, and scale their scope beyond the ProServe team. (2) Coordinate execution of the roadmap, through direct reports, consisting of scientists and business intelligence engineers. (3) Grow and manage a technical team, actively mentoring, developing, and promoting team members. (4) Work closely with other science managers, program/product managers, and business leadership worldwide to scope new areas of growth, creating new partnerships, and proposing new business initiatives. (5) Act as a technical supervisor, able to assess scientific direction, technical design documents, and steer development efforts to maximize project delivery.
US, NY, New York
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. As a core product offering within our advertising portfolio, Sponsored Products (SP) helps merchants, retail vendors, and brand owners succeed via native advertising, which grows incremental sales of their products sold through Amazon. The SP team's primary goals are to help shoppers discover new products they love, be the most efficient way for advertisers to meet their business objectives, and build a sustainable business that continuously innovates on behalf of customers. Our products and solutions are strategically important to enable our Retail and Marketplace businesses to drive long-term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day! The Supply team (within Sponsored Products) is looking for an Applied Scientist to join a fast-growing team with the mandate of creating new ad experiences that elevate the shopping experience for hundreds of millions customers worldwide. The Applied Scientist will take end-to-end ownership of driving new product/feature innovation by applying advanced statistical and machine learning models. The role will handle petabytes of unstructured data (images, text, videos) to extract insights into what metadata can be useful for us to highlight to simplify purchase decisions, and propose new experiences that increase shopper engagement. Why you love this opportunity Amazon is investing heavily in building a world-class advertising business. This team is responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our solutions generate billions in revenue and drive long-term growth for Amazon’s Retail and Marketplace businesses. We deliver billions of ad impressions, millions of clicks daily, and break fresh ground to create world-class products. We are highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit - with a broad mandate to experiment and innovate. Key job responsibilities As an Applied Scientist on this team you will: Build machine learning models and perform data analysis to deliver scalable solutions to business problems. Perform hands-on analysis and modeling with very large data sets to develop insights that increase traffic monetization and merchandise sales without compromising shopper experience. Work closely with software engineers on detailed requirements, technical designs and implementation of end-to-end solutions in production. Design and run A/B experiments that affect hundreds of millions of customers, evaluate the impact of your optimizations and communicate your results to various business stakeholders. Work with scientists and economists to model the interaction between organic sales and sponsored content and to further evolve Amazon's marketplace. Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. Research new predictive learning approaches for the sponsored products business. Write production code to bring models into production. A day in the life You will invent new experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon! Define a long-term science vision for our advertising business, driven fundamentally from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding.
US, CA, Palo Alto
The Amazon Search team creates powerful, customer-focused search solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, Amazon Search services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day. We are seeking a Principal Scientist with deep expertise in Search. Your responsibility will be to advance the state-of-the-art for search science that leads to world-class products that impact Amazon's customers. Key job responsibilities You will be responsible for defining key research directions, adopting or inventing new machine learning techniques, conducting rigorous experiments, publishing results, and ensuring that research is translated into practice. You will develop long-term strategies, persuade teams to adopt those strategies, propose goals and deliver on them. You will also participate in organizational planning, hiring, mentorship and leadership development. You will be technically fearless and with a passion for building scalable science and engineering solutions. You will serve as a key scientific resource in full-cycle development (conception, design, implementation, testing to documentation, delivery, and maintenance). About the team This is a position on Core Ranking and Experimentation team in Palo Alto, CA. The team works on a variety of topics in search ranking and relevance, such as multi-objective optimization, personalization, and fast online experimentation. We work closely with teams in various parts of the stack to ensure that our science is translated to customer facing products.
US, WA, Bellevue
Amazon is looking for a passionate, talented, and inventive Applied Scientists with a strong machine learning background to help build industry-leading Speech and Language technology. Our mission is to provide a delightful experience to Amazon’s customers by pushing the envelope in Automatic Speech Recognition (ASR), Machine Translation (MT), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV). As part of our AI team in Amazon AWS, you will work alongside internationally recognized experts to develop novel algorithms and modeling techniques to advance the state-of-the-art in human language technology. Your work will directly impact millions of our customers in the form of products and services that make use of speech and language technology. You will gain hands on experience with Amazon’s heterogeneous speech, text, and structured data sources, and large-scale computing resources to accelerate advances in spoken language understanding. We are hiring in all areas of human language technology: ASR, MT, NLU, text-to-speech (TTS), and Dialog Management, in addition to Computer Vision.
CA, ON, Toronto
WE ARE OPEN TO HIRING THIS ROLE IN SF BAY AREA, SEATTLE, TORONTO, OR VIRGINIA (HQ2). Amazon Advertising is one of Amazon's fastest growing and most profitable businesses, responsible for defining and delivering a collection of advertising products that drive discovery and sales. Our products and solutions are strategically important to enable our Retail and Marketplace businesses to drive long-term growth. We deliver billions of ad impressions and millions of clicks and break fresh ground in product and technical innovations every day! The Sponsored Products Demand Identification and Campaign Optimization (DEICO) team is responsible for building experiences across all seller and advertiser touchpoints to generate performant Sponsored Products demand and improved campaign performance through guardrail-based controls. We do this through 1) Creating performant demand focusing on Amazon supplier use cases (e.g. launching a new ASIN) through presets for campaign creation. 2) Making existing demand performant through diagnosing gaps and providing proactive and targeted recommendations, and 3) Developing and launching new campaign optimization rules that allow advertisers to provide performance guardrails and automate optimization of their campaigns. Within these domains, we focus on creating holistic recommendations through machine learning for products to advertise and optimal presets across every parameter that go into Sponsored Products ad campaign setup, as well as consolidated recommendations that improve performance of existing Sponsored Product campaigns. As an Applied Scientist on this team, you will: • Drive end-to-end Machine Learning projects that have a high degree of ambiguity, scale, complexity. • Perform hands-on analysis and modeling of enormous data sets to develop insights that increase traffic monetization and merchandise sales, without compromising the shopper experience. • Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with software engineers to assist in productionizing your ML models. • Run A/B experiments, gather data, and perform statistical analysis. • Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving. • Research new and innovative machine learning approaches. • Recruit Applied Scientists to the team and provide mentorship. Why you will love this opportunity: Amazon is investing heavily in building a world-class advertising business. This team defines and delivers a collection of advertising products that drive discovery and sales. Our solutions generate billions in revenue and drive long-term growth for Amazon’s Retail and Marketplace businesses. We deliver billions of ad impressions, millions of clicks daily, and break fresh ground to create world-class products. We are a highly motivated, collaborative, and fun-loving team with an entrepreneurial spirit - with a broad mandate to experiment and innovate. Impact and Career Growth: You will invent new experiences and influence customer-facing shopping experiences to help suppliers grow their retail business and the auction dynamics that leverage native advertising; this is your opportunity to work within the fastest-growing businesses across all of Amazon! Define a long-term science vision for our advertising business, driven from our customers' needs, translating that direction into specific plans for research and applied scientists, as well as engineering and product teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding. Team video https://youtu.be/zD_6Lzw8raE
IN, KA, Bangalore
Amazon is investing heavily in building a world class advertising business and we are responsible for defining and delivering a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. The ATT team, based in Bangalore, is responsible for ensuring that ads are compliant to world-wide advertising policies and are of high quality, leading to higher conversion for the advertisers and providing a great experience for the shoppers. Machine learning, particularly multi-modal data understanding, is fundamental to the way we drive our business, meet our goals and satisfy our customers. ATT team invests in researching and developing state of art models that analyze various type of ad assets – text, audio, images and videos - to ensure compliance to advertising policies. We also help advertisers create more successful ads by creating ML models to assist ad generation as well as to provide data-driven interpretable insights. Key job responsibilities Major responsibilities · Deliver key goals to enhance advertiser experience and protect shopper trust by innovative use of computer vision, NLP and statistical techniques · Drive core business analytics and data science explorations to inform key business decisions and algorithm roadmap · Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation · Hire and develop top talent in machine learning and data science and accelerate the pace of innovation in the group · Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production