Image shows the abstract page from a paper titled "Optimal Auction Design with Deferred Inspection and Reward" on the left; the authors — Saeed Alaei (top left), Alexandre Belloni (top right), Ali Makhdoumi (bottom left), and Azarakhsh Malekian (bottom right) are shown in a two-by-two grid on the right
In their paper, "Optimal Auction Design with Deferred Inspection and Reward", Saeed Alaei (top left), Alexandre Belloni (top right), Ali Makhdoumi (bottom left), and Azarakhsh Malekian (bottom right) developed a mechanism to incentivize buyers within an auction to bid higher by giving a bonus to bids whose value are closer to the true value of the item.

Monitoring and rewarding honest bids to increase revenue in auctions

Amazon Scholar Alexandre Belloni discusses the implications of auction design on digital goods.

Alexandre Belloni has been intrigued by operations research and optimization problems since his days at as an electrical engineering undergrad at the Pontifical Catholic University of Rio de Janeiro, back in his home country of Brazil. Further schooling just cemented that. His master’s in mathematical economics at the Institute for Pure and Applied Mathematics, also in Rio de Janeiro, “happened to have a strong optimization track,” he said. “Once I got there, the economics influence started to kick in,” he says. “And, given my background, I was always looking for the intersection of operations research and economics.”

For his PhD, Belloni worked on optimization and econometrics at the MIT Operations Research Center. His interest in economics continued to influence his academic path and most of his current research is focused on mechanism design problems, which he describes as “a broad class of ways to allocate resources.” “For example, auctions are a classic way that you can allocate an item and it is especially useful in cases where it’s difficult to price the value of the item.”

Belloni says mechanism design is an incredible field to work on. “Not only there are many interesting perspectives to consider — such as information, computational, approximations, robustness, dynamics — but we also see several industry problems requiring to coordinate decentralized systems.”

Since 2007, Belloni has also taught at the Fuqua Business School at Duke University, where he is currently the John D. Forsyth Professor of Decision Sciences. In 2018, he was recruited to become an Amazon Scholar, joining the company in that capacity in January 2019. “I always thought that the best research is the one that is motivated by empirical, real problems. Amazon gives you a great opportunity to see the real problems,” he says.

Related content
How the Amazon Logistics Research Science team guides important decisions related to last-mile delivery.

Since then, he has been studying problems related to mechanism design and machine learning at Fulfillment by Amazon (FBA), the subdivision of Amazon’s Supply Chain Optimization Technologies (SCOT) organization for third-party sellers who use Amazon’s storage and fulfillment capabilities.

One of the challenges Belloni and his FBA colleagues are currently addressing has to do with capacity management. Third-party sellers own and control their own inventories, and Amazon, with limited information, determines how to both balance the demand for space and ensure fulfillment center capacity is used efficiently and is available for products that customers love. “There has been tons of amazing work and we continue to obsess on finding better ways to manage capacity,” Belloni said.

Coordinating and optimizing allocations is also at the core of a recent work by Belloni and colleagues. In the paper “Optimal Auction Design with Deferred Inspection and Reward”, the authors develop a mechanism to incentivize buyers within an auction to bid higher by rewarding with a bonus the ones whose bids are closer to the true value of the item. This strategy can only be used in certain settings, where it is possible to monitor how the buyer is monetizing that good.

In this interview, Belloni discusses how he and his co-authors — Saeed Alaei, Ali Makhdoumi and Azarakhsh Malekian — came up with this new auction design that is especially suitable for digital goods and how it may impact revenues.

  1. Q. 

    What is the mechanism that you and your colleagues developed to optimize auction design? What are the implications for digital goods?

    A. 

    The key thing about this paper is that, in certain settings, after the winner of an auction is revealed, we can actually learn what is the true value of the good for the agent [buyer]. Indeed, there are many settings where the values are (nearly) observed with some delay. In those cases, if the agent said the truth — that is, the bid is close to the true value — we can give them a bonus back from their initial deposits.

    Related content
    The 2001 paper was awarded for “foundational work initiating a long and fruitful line of work in approximately revenue-optimal auction design in prior free settings”.

    It turns out that we were able to fully characterize the optimal mechanism for a single agent. By using rewards after the inspection to help us screen the agent, we found that the optimal allocation is not a thresholding strategy, and instead is an increasing and continuous function of the reported value. Indeed, it is possible to have different payments (via the rewards) for the same allocation, which contrasts with the case without inspection where no such mechanism would be incentive compatible.

    The results are quite relevant in settings where it is possible to monitor the value (or performance) of the good for the bidder. Digital goods are certainly one application that motivated our setting. For example, consider a platform that would like to sell some preferred advertisement position for a digital good to be displayed. Because consumption of the digital good occurs within the platform, its value is observed, whether it is the winner of the specific auction or not.

    Thus, the paper provides insights on how to monetize on this additional monitoring while still allowing agents to fully control the maximum they would be paying to acquire the preferred advertisement position. This is attractive as agents are always concerned with liability and, in practice, they could be reluctant to accept a contract in which they do not know how much they could end up paying. So, we are taking this concern into consideration. We monitor them, but we cannot charge more than whatever the amount they bid. The agents are in full control of how much they will spend. Ultimately, we are rewarding a digital good that has high value to be able to screen further via monitoring.

  2. Q. 

    How were you able to extrapolate your results from a single buyer to multiple buyers?

    A. 

    A priori, it was unclear how the results would generalize for the multiple-agents case given the generality of the first result. The first step was to consider the so-called reduced-form representation where we model the expected allocation and payments of a bidder condition on his or her own type (by averaging out over the types of the other bidders). But to ensure the reduced form is implementable as an auction, it is well known the additional Border constraints needed to be considered, which can get tricky.

    Using duality theory, we then find a sufficient condition under which the Border constraint in the reduced form of the problem can be dealt with nicely. The sufficient technical condition on the hazard rate of the distribution of the maximum value is not needed in the single-agent case. Indeed, the result for a single agent holds quite generally. Surprisingly, the same structural properties in the single-agent case are still preserved in the multiple-agents case.

    Related content
    Amazon Research Award recipient Éva Tardos studies complex theoretical questions that have far-ranging practical consequences.

    Importantly, we provide an implementation of our optimal auction for multiple agents — Border constraints guarantee an implementation exists but do not tell us how. In particular, we show that the implementation of the optimal auction involves allocating to the agent with the maximum bid and then rewarding this agent if they report truthfully. One aspect of this setup with inspection is that we can further distinguish bidders by having more freedom to manipulate the amount of allocation and payments. In typical auctions, without inspection, there is no value to do that and agents either get the good or not. In our case, we can essentially give you the good with only 50% chance if you bid low, for example.

    Indeed, we increase the chance of allocating the good as the bids increase and when we reach 100% change we can further increase the reward for reporting correctly. So, if you think about a second price auction, for example, the agent pays the second-highest price, and that's it. Here, the monitoring allows us further screen bidders after they bid which allows us to refine the final payments through the bonus. Thus bidders have an additional incentive to pay more (even in a single-agent case) just to make sure that they will have a higher chance of getting the good.

  3. Q. 

    What impact does your optimization have on revenue? And how does that differ from auctions in classic settings?

    A. 

    This auction will, by design, generate higher revenues than the standard option (without monitoring). Intuitively, because of the bonus, if the agent tries to take advantage of you by bidding too low, they are not getting any bonus back. Now, if the agent tells you the truth, then they're going to get a decent bonus. So, this creates this incentive that makes them willing to push towards the true value.

    Related content
    Amazon Scholar David Card and Amazon academic research consultant Guido Imbens talk about the past and future of empirical economics.

    In the paper, we present a nice characterization of why the revenue is going to be bigger. The typical idea in an auction is that you need to pay information rent for the agents. And what happens is that this monitoring reduces the information rent by design. More precisely, the information rent gets reduced by a factor related to the best alternative bid the agent could place. That comes out very clearly in the math.

    We cannot say that we are going to do 20% or 30% more because that's very specific of the company. However, note that this will be particularly impactful with a small number of agents. Thin markets where there is a single bidder, for example, who could typically walk away with a lot of surplus. In specific settings (depending on distributions, number of agents, etc.) we provide examples in the paper where gains are significant. Nonetheless, we can clearly say that we always reduce the information rent.

Related content

US, CA, Sunnyvale
The Artificial General Intelligence (AGI) team is looking for a passionate, talented, and inventive Member of Technical Staff with a strong deep learning background, to build industry-leading Generative Artificial Intelligence (GenAI) technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As a Member of Technical Staff with the AGI team, you will lead the development of algorithms and modeling techniques, to advance the state of the art with LLMs. You will lead the foundational model development in an applied research role, including model training, dataset design, and pre- and post-training optimization. Your work will directly impact our customers in the form of products and services that make use of GenAI technology. You will leverage Amazon’s heterogeneous data sources and large-scale computing resources to accelerate advances in LLMs. About the team The AGI team has a mission to push the envelope in GenAI with LLMs and multimodal systems, in order to provide the best-possible experience for our customers.
US, NY, New York
Amazon Advertising is one of Amazon's fastest growing and most profitable businesses. Our products are used daily to surface new selection and provide customers a wider set of product choices along their shopping journeys. The business is focused on generating value for shoppers as well as advertisers. Our team uses a combination of econometrics, machine learning, and data science to build disruptive products for all our Advertising products. We also generate insights to guide Amazon Advertising strategy, providing direct support to senior leadership. We are looking for an experienced Economist with a deep passion for building econometric solutions and the ability to communicate data insights and scientific vision to execute on strategic projects. Key job responsibilities - Leverage econometrics and ML models to optimize advertising strategies on behalf of our customers. - Influence key business and product decisions based on insights from models you develop. - Perform hands-on analysis and modeling with enormous data sets to develop insights that increase traffic monetization and merchandise sales without compromising shopper experience. - Work closely with software engineers on detailed requirements to productionize the models you build. - Run A/B experiments that affect hundreds of millions of customers, evaluate the impact of your optimizations and communicate your results to various business stakeholders. - Work with other scientists, software developers, and product partners to implement your solutions.
GB, London
We are looking for an Economist to work on exciting and challenging business problems related to Amazon Retail’s worldwide product assortment. You will build innovative solutions based on econometrics, machine learning, and experimentation. You will be part of a interdisciplinary team of economists, product managers, engineers, and scientists, and your work will influence finance and business decisions affecting Amazon’s vast product assortment globally. If you have an entrepreneurial spirit, you know how to deliver results fast, and you have a deeply quantitative, highly innovative approach to solving problems, and long for the opportunity to build pioneering solutions to challenging problems, we want to talk to you. Key job responsibilities * Work on a challenging problem that has the potential to significantly impact Amazon’s business position * Develop econometric models and experiments to measure the customer and financial impact of Amazon’s product assortment * Collaborate with other scientists at Amazon to deliver measurable progress and change * Influence business leaders based on empirical findings
US, NY, New York
About Sponsored Products and Brands: The Sponsored Products and Brands (SPB) organization at Amazon Ads is re-imagining the advertising landscape through industry leading generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond. We are at the forefront of re-inventing advertising experiences, bridging human creativity with artificial intelligence to transform every aspect of the advertising lifecycle from ad creation and optimization to performance analysis and customer insights. We are a passionate group of innovators dedicated to developing responsible and intelligent AI technologies that balance the needs of advertisers, enhance the shopping experience, and strengthen the marketplace. If you're energized by solving complex challenges and pushing the boundaries of what's possible with AI, join us in shaping the future of advertising. About Our Team: The Brand Beacon team is responsible for inventing impressions offerings for brands to increase share of voice via premium experiences, helping brands get discovered, acquire new customers and sustainably grow customer lifetime value. We build end-to-end solutions that enable brands to drive discovery, visibility and share of voice. This includes building advertiser controls, shopper experiences, monetization strategies and optimization features. We succeed when (1) shoppers discover, engage and build affinity with brands and (2) brands can grow their business at scale with our advertising products. About This Role: As a Senior Scientist for the team, you will have the opportunity to apply your deep subject matter expertise in the area of ML, LLM and GenAI models. You will invent new product experiences that enable novel advertiser and shopper experiences. This role will liaise with internal Amazon partners and work on bringing state-of-the-art GenAI models to production, and stay abreast of the latest developments in the space of GenAI and identify opportunities to improve the efficiency and productivity of the team. Additionally, you will define a long-term science vision for our advertising business, driven by our customer’s needs, and translate it into actionable plans for our team of applied scientists and engineers. This role will play a critical role in elevating the team’s scientific and technical rigor, identifying and implementing best-in-class algorithms, methodologies, and infrastructure that enable rapid experimentation and scaling. You will communicate learnings to leadership and mentor and grow Applied AI talent across org. * Develop AI solutions for advertiser and shopper experiences. Build monetization and optimization systems that leverage generative models to value and improve campaign performance. * Define a long-term science vision and roadmap for our advertising business, driven from our customers' needs, translating that direction into specific plans for applied scientists and engineering teams. This role combines science leadership, organizational ability, technical strength, product focus, and business understanding. * Design and conduct A/B experiments to evaluate proposed solutions based on in-depth data analyses. * Effectively communicate technical and non-technical ideas with teammates and stakeholders. * Stay up-to-date with advancements and the latest modeling techniques in the field. * Think big about the arc of development of Gen AI over a multi-year horizon and identify new opportunities to apply these technologies to solve real-world problems. #GenAI
US, WA, Seattle
Amazon's Stores-Ads Science team operates at the intersection of Amazon's Stores and advertising businesses. We develop causal measurement systems, optimization algorithms, and machine learning models that inform how advertising affects shopper engagement, driving selling partner growth and marketplace economics. Our science shapes decisions both at the strategic level and in production systems. We are a team of interdisciplinary scientists who combine causal inference, economic modeling, and machine learning to drive measurable business impact. We are looking for an Applied Science Manager to lead our Ads Impact initiative. This team owns the science of understanding and optimizing how advertising creates value for shoppers and selling partners. What makes this role distinctive is its position at the frontier of AI and Economics: as Amazon's shopping experience evolves from traditional search toward LLM-powered, agentic commerce, the fundamental mechanisms through which advertising creates value are changing. This role will partner with leading scientists and academic researchers to measure these effects through large-scale causal experimentation, and develop novel methods to encode causal and economic reasoning into AI systems that optimize the shopping experience. Key job responsibilities In this role, you will lead a team of scientists, setting the technical vision and science roadmap for ads impact measurement and optimization. You will design experiments that identify the causal mechanisms through which advertising drives shopper engagement, advertiser value, and marketplace outcomes. You will develop optimization algorithms that integrate these causal signals into production and business decision-making, in close partnership with engineering and product teams across the organization. You will lead the research and communicate findings and recommendations to senior leadership through written narratives that connect technical science to business strategy. This role requires deep expertise in causal inference and experimental design, combined with strong applied ML skills and the engineering judgment to translate research into production systems. You will hire and develop future science leaders, think strategically, set ambitious roadmaps in highly ambiguous problem spaces, and foster a culture that values both intellectual depth and production impact. You will work cross-functionally, influencing across organizational boundaries to drive alignment on complex, multi-sided tradeoffs.
US, WA, Seattle
Amazon Industrial Robotics is seeking exceptional applied science talent to develop AI and machine learning systems that will enable the next generation of advanced manufacturing capabilities at unprecedented scale. We're building revolutionary software infrastructure that combines cutting-edge AI, large-scale optimization, and advanced manufacturing processes to create adaptive production control systems. As a Senior Applied Scientist, you will develop and improve machine learning systems that enable real-time manufacturing flow decisions. You will leverage state-of-the-art optimization and ML techniques, evaluate them against representative manufacturing scenarios, and adapt them to meet the robustness, reliability, and performance needs of production environments. You will invent new algorithms where gaps exist. You'll collaborate closely with software engineering, manufacturing engineering, robotics simulation, and operations teams, and your outputs will directly power the systems that determine what to build next, where to allocate resources, and how to maximize throughput. The ideal candidate brings deep expertise in optimization and machine learning, with a proven track record of delivering scientifically complex solutions into production. You are hands-on, writing significant portions of critical-path scientific code while driving your team's scientific agenda. If you're passionate about inventing the intelligent manufacturing systems of tomorrow rather than optimizing those of today, this role offers the chance to make a lasting impact on the future of automation. Key job responsibilities - Identify and devise new scientific approaches for constraint identification, dispatch optimization, WIP release control, and predictive flow intelligence when the problem is ill-defined and new methodologies need to be invented - Lead the design, implementation, and successful delivery of scientifically complex solutions for real-time manufacturing flow optimization in production - Design and build ML models and optimization algorithms including constraint prediction, starvation risk forecasting, and dispatch optimization - Write a significant portion of critical-path scientific code with solutions that are inventive, maintainable, scalable, and extensible - Execute rapid, rigorous experimentation with reproducible results, closing the gap between simulation and real manufacturing environments - Build evaluation benchmarks that measure model performance against manufacturing outcomes including constraint utilization and throughput rather than traditional ML metrics alone - Influence your team's science and business strategy through insightful contributions to roadmaps, goals, and priorities - Partner with manufacturing engineering, robotics simulation, and applied intelligence teams to ensure scientific approaches are grounded in operational reality - Drive your team's scientific agenda and role model publishing of research results at peer-reviewed venues when appropriate and not precluded by business considerations - Actively participate in hiring and mentor other scientists, improving their skills and ability to deliver - Write clear narratives and documentation describing scientific solutions and design choices
US, NY, New York
The Ads Measurement Science team in the Measurement, Ad Tech, and Data Science (MADS) team of Amazon Ads serves a centralized role developing solutions for a multitude of performance measurement products. We create solutions which measure the comprehensive impact of advertiser's ad spend, including sales impacts both online and offline and across timescales, and provide actionable insights that enable our advertisers to optimize their media portfolios. We also own the science solutions for AI tools that unlock new insights and automate high-effort customer workflows, such as custom query and report generation based on natural language user requests. We leverage a host of scientific technologies to accomplish this mission, including Generative AI, classical ML, Causal Inference, Natural Language Processing, and Computer Vision. As a Senior Research Scientist on the team, you will be at the forefront of innovation, developing measurement solutions end-to-end from inception to production. You will set the technical vision and innovate on behalf of our customers. You will propose, design, analyze, and productionize models to provide novel measurement insights to our customers. You will partner with engineering to deploy these solutions into production. You will work with key stakeholders from various business teams to enable advertisers to act upon those metrics. Key job responsibilities * Lead the development of ad measurement models and solutions that address the full spectrum of an advertiser's investment, focusing on scalable and efficient methodologies. * Collaborate closely with cross-functional teams including engineering, product management, and business teams to define and implement measurement solutions. * Use state-of-the-art scientific technologies including Generative AI, Classical Machine Learning, Causal Inference, Natural Language Processing, and Computer Vision to develop state of the art models that measure the impact of ad spend across multiple platforms and timescales. * Drive experimentation and the continuous improvement of ML models through iterative development, testing, and optimization. * Translate complex scientific challenges into clear and impactful solutions for business stakeholders. * Mentor and guide junior scientists, fostering a collaborative and high-performing team culture. * Foster collaborations between scientists to move faster, with broader impact. * Regularly engage with the broader scientific community with presentations, publications, and patents. A day in the life You will solve real-world problems by getting and analyzing large amounts of data, generate business insights and opportunities, design simulations and experiments, and develop statistical and ML models. The team is driven by business needs, which requires collaboration with other Scientists, Engineers, and Product Managers across the advertising organization. You will prepare written and verbal presentations to share insights to audiences of varying levels of technical sophistication. Team video https://advertising.amazon.com/help/G4LNN5YWHP6SM9TJ About the team We are a team of scientists across Applied, Research, Data Science and Economist disciplines. You will work with colleagues with deep expertise in ML, NLP, CV, Gen AI, and Causal Inference with a diverse range of backgrounds. We partner closely with top-notch engineers, product managers, sales leaders, and other scientists with expertise in the ads industry and on building scalable modeling and software solutions.
US, WA, Seattle
Do you want a role with deep meaning and the ability to make a major impact? As part of Intelligent Talent Acquisition (ITA), you'll have the opportunity to reinvent the hiring process and deliver unprecedented scale, sophistication, and accuracy for Amazon Talent Acquisition operations. ITA is an industry-leading people science and technology organization made up of scientists, engineers, analysts, product professionals and more, all with the shared goal of connecting the right people to the right jobs in a way that is fair and precise. Last year we delivered over 6 million online candidate assessments, and helped Amazon deliver billions of packages around the world by making it possible to hire hundreds of thousands of workers in the right quantity, at the right location and at exactly the right time. You’ll work on state-of-the-art research, advanced software tools, new AI systems, and machine learning algorithms, leveraging Amazon's in-house tech stack to bring innovative solutions to life. Join ITA in using technologies to transform the hiring landscape and make a meaningful difference in people's lives. Together, we can solve the world's toughest hiring problems. Recruiting Agents and Candidate Voice team is revolutionizing how Amazon finds and connects with talent worldwide! We're looking for an experienced Applied Scientist to design and implement agentic solutions that help millions of candidates find their dream jobs at Amazon. Key job responsibilities • Design and architect AI-powered agentic solutions that help candidates navigate Amazon's hiring process, including scoping requirements, identifying dependencies and constraints, and creating robust scientific and technical designs that balance candidate experience with system scalability. • Implement and deploy conversational AI agents leveraging state-of-the-art LLM and GenAI technologies to enable candidates to explore job opportunities, understand role requirements, and receive personalized guidance throughout their hiring journey. • Develop rigorous evaluation frameworks to measure agent effectiveness, candidate satisfaction, and hiring outcomes—continuously iterating on models to improve accuracy, fairness, and user experience across millions of candidate interactions. • Collaborate cross-functionally with Research Scientists, Software Engineers, and Product teams to integrate agentic solutions into Amazon's candidate-facing platforms, ensuring seamless deployment and alignment with broader Talent Acquisition goals. • Drive innovation in agentic AI research by staying current with advances in NLP, LLMs, and autonomous agent architectures, while contributing to the scientific community through publications, internal tech talks, and knowledge sharing. About the team Our team focuses on understanding and improving the experience of both job seekers and the recruiters who support them. You'll be at the intersection of people, data, and technology—solving fascinating problems that directly impact how we hire the best talent globally.
US, WA, Seattle
Do you want a role with deep meaning and the ability to make a major impact? As part of Intelligent Talent Acquisition (ITA), you'll have the opportunity to reinvent the hiring process and deliver unprecedented scale, sophistication, and accuracy for Amazon Talent Acquisition operations. ITA is an industry-leading people science and technology organization made up of scientists, engineers, analysts, product professionals and more, all with the shared goal of connecting the right people to the right jobs in a way that is fair and precise. Last year we delivered over 6 million online candidate assessments, and helped Amazon deliver billions of packages around the world by making it possible to hire hundreds of thousands of workers in the right quantity, at the right location and at exactly the right time. You’ll work on state-of-the-art research, advanced software tools, new AI systems, and machine learning algorithms, leveraging Amazon's in-house tech stack to bring innovative solutions to life. Join ITA in using technologies to transform the hiring landscape and make a meaningful difference in people's lives. Together, we can solve the world's toughest hiring problems. Recruiting Agents and Candidate Voice team is revolutionizing how Amazon finds and connects with talent worldwide! We're looking for an experienced Applied Scientist to design and implement agentic solutions that help millions of candidates find their dream jobs at Amazon. Key job responsibilities • Design and architect AI-powered agentic solutions that help candidates navigate Amazon's hiring process, including scoping requirements, identifying dependencies and constraints, and creating robust scientific and technical designs that balance candidate experience with system scalability. • Implement and deploy conversational AI agents leveraging state-of-the-art LLM and GenAI technologies to enable candidates to explore job opportunities, understand role requirements, and receive personalized guidance throughout their hiring journey. • Develop rigorous evaluation frameworks to measure agent effectiveness, candidate satisfaction, and hiring outcomes—continuously iterating on models to improve accuracy, fairness, and user experience across millions of candidate interactions. • Collaborate cross-functionally with Research Scientists, Software Engineers, and Product teams to integrate agentic solutions into Amazon's candidate-facing platforms, ensuring seamless deployment and alignment with broader Talent Acquisition goals. • Drive innovation in agentic AI research by staying current with advances in NLP, LLMs, and autonomous agent architectures, while contributing to the scientific community through publications, internal tech talks, and knowledge sharing. About the team Our team focuses on understanding and improving the experience of both job seekers and the recruiters who support them. You'll be at the intersection of people, data, and technology—solving fascinating problems that directly impact how we hire the best talent globally.
GB, London
Sr. Applied Scientists in AWS Automated Reasoning are dedicated to making AWS the best computing service in the world for customers who require advanced and rigorous solutions for automated reasoning, privacy, and sovereignty. Key job responsibilities The successful candidate will: Solve large or significantly complex problems that require deep knowledge and understanding of your domain and scientific innovation. Own strategic problem solving, and take the lead on the design, implementation, and delivery for solutions that have a long-term quantifiable impact. Provide cross-organizational technical influence, increasing productivity and effectiveness by sharing your deep knowledge and experience. Develop strategic plans to identify fundamentally new solutions for business problems. Assist in the career development of others, actively mentoring individuals and the community on advanced technical issues.