Amazon Consumer Science Summit goes virtual

COVID-19-induced trend toward virtual conferences may change how science is conducted.

COVID-19 has caused massive disruption around the globe. That includes the myriad of science conferences held each year. With the pandemic now forcing the cancellation of nearly all in-person events, these conferences have gone virtual.

Amazon is a participant in this trend. In late September, for instance, Amazon’s consumer science organization held its seventh annual Consumer Science Summit, which focused on science applications for economic decision-making, with topics ranging from operations research and econometrics, to statistics and machine learning.  Originally planned as a 200-person conference to be held at a resort in Washington state, event organizers considered how best to proceed. Their final decision: move the summit online.

No one was sure quite what to expect, but the outcome was surprisingly positive. Without the need to limit attendees due to space constraints, and without the need for participants to build travel days into their schedule or worry about acquiring a US visa, attendance was more than four times that of previous in-person events. Moreover, prominent scientists who otherwise might have been unable to attend in person were able to deliver virtual keynote talks.

Ping Xu, forecasting science director, standing outside in front of a rainbow.
Ping Xu, forecasting science director within Amazon's Supply Chain Optimization Technologies (SCOT) organization, was one of the organizers of this year's Consumer Science Summit.

“In this age of isolation and uncertainty, it turns out this event helped us return to the roots of science — the exchange of ideas,” said Ping Xu, forecasting science director within Amazon’s Supply Chain Optimization Technologies organization.

In fact, scientists everywhere are discovering that a well-run virtual event can have benefits that extend beyond an in-person conference.

The Scientist magazine, for instance, reported on an August conference held by the Society for Mathematical Biology and the European Society for Mathematical and Theoretical Biology. Originally set for Heidelberg, Germany, the virtual conference created virtual space so it would provide for socializing, networking, and mentoring, as well as hearing talks, seeing posters, and visiting the meeting’s corporate sponsors.  

Plus, the roughly 1,800 attendees represented more than 90 countries — two to three times as many as at previous in-person meetings. 

The move to virtual scientific conferences poses some intriguing questions. Will it make science more collaborative and multidisciplinary? Or will people lose the chance for serendipitous connections that are the staple of in-person event?

In an effort to make up for the lack of in-person interaction, Consumer Science Summit organizers took advantage of online tools to facilitate collaboration among virtual attendees. The conference had its own Slack channel, for instance, and networking coffee breaks occurred over Chime. The four-day conference included the presentation of 208 papers and abstracts, 5 keynote, 28 lightning, and 12 technical talks, and 2 fireside chats. 

The keynote talks included presentations by Ming Lin, a computer science professor  at the University of Maryland; Anna Nagurney, the John F. Smith Memorial Professor within the Department of Operations and Information Management at the University of Massachusetts Amherst Isenberg School of Management; Susan Athey, an economics of technology professor at Stanford University, and senior fellow of the Stanford Institute for Economic Policy Research; Nassim Taleb, distinguished professor of risk engineering at the NYU Tandon School of Engineering, and author of several books, including “The Black Swan”; and Gerard Cachon, a professor within the Operations, Information and Decisions Department at the University of Pennsylvania Wharton School. The two fireside chats were with Scott Aronson, the David J. Bruton Centennial Professor of Computer Science at the University of Texas at Austin, and Swami Sivasubramanian, vice president, AWS machine learning. Below are three of those keynote talks.

Nassim Taleb: Statistical consequences of fat tails
In this keynote talk, Professor Taleb discusses concepts from the first version of his Technical Incerto: Statistical Consequences of Fat Tails: Real World Preasymptotics, Epistemology, and Applications.
Gerard Cachon: Human vs. robot workers in fulfillment center pick processes
In his keynote talk, Professor Cachon talks about new research he has conducted with Omar Besbes, a professor at Columbia University Business School.
Anna Nagurney: Optimization of food supply chain networks: Why quality, trade instruments, and labor all matter
In her keynote talk, which she dedicated to essential workers, Professor Nagurney discusses her latest research on food supply chain networks.

“It was much better than I expected, given my first exposure to the technology that we would rely upon,” says Robert Stine, senior principal scientist within SCOT. “Some aspects, such as the recorded lightning talks worked very well.  This format was better than the awkward in-person version — and could be combined nicely with online meetings and poster sessions.”

Adds Mauricio Resende, a principal scientist within Amazon’s Transportation Services organization: “I attended the previous four summits, and was pleasantly surprised at how well this virtual conference ran. We had a few glitches where people had to refresh their browsers, but otherwise there were no delays, no problems with the live presentations — or the recorded ones.  And we had a much larger audience.”

Ping Xu, the event’s sponsor, agrees.

“I thought it went really well,” she says. “I was really glad to see that we could draw a wider audience by going virtual. Plus, we learned a lot about how to manage a virtual conference. For instance, one thing I learned is that the virtual format encourages a broader engagement but an in-person format encourages a deeper engagement. For our 2021 conference, we are entertaining a hybrid approach where we can offer online talks for a larger audience but still allow in-person celebrations and discussions.

It was hard at times not to miss the more social aspects of an in-person conference, where scientists can connect with peers they’ve worked with before and perhaps make new connections.

“I still prefer in-person conferences,” says Resende. “They give me a chance to bump into old friends and make new ones. I have begun many a collaboration or paper on the basis of unexpected meetings at conferences.”

In this age of isolation and uncertainty, it turns out this event helped us return to the roots of science – the exchange of ideas
Ping Xu, forecasting science director

Some event organizers are aware of that shortcoming and have developed clever ways to address it.  One conference, for instance, asked participants to write a short description of their work and research interests. That information was then run through an algorithm that matched up attendees with similar interests.   

Prior to the COVID-19 pandemic, there already was a movement within the machine learning science community to allow remote paper and poster presentations at scientific conferences.

Turing Award winner Joshua Bengio is a supporter of the movement allowing more virtual presentations of papers and poster sessions, saying in a blog post that he believes “we should rethink these events with the objective of eliminating the resulting carbon footprint.”

In the post, Bengio suggests the science community could consider decentralized conferences, where instead of having a conference at one location, meeting places could be established — at least one on each continent — so that scientists could attend their “local” meeting.

Some think scientists working remotely more often would have greater impact than having science conferences adopt a completely remote model.

“I think the impact of working virtually reduces carbon footprint more than the impact of going from an in-person conference model to a virtual model,” says Resende. “I have worked remotely two or three days a week since 1988. Virtual conferencing reduces the need to see people face-to-face, but doesn’t eliminate it.”

Other drawbacks include sometimes having too much to choose from, reducing focus. And virtual conference-goers have the same challenge as remote workers everywhere: giving full attention to a conference speaker when emails are coming in and phones are ringing.

Nonetheless, most scientists expect to be attending more virtual conferences in the foreseeable future, if largely because of COVID-19.

On the plus side, a world of virtual conferences will improve as conference organizers grow accustomed to virtual formats, and new conferencing tools become available.  Events are apt to draw more people — as the Amazon summit did — and can take advantage of a wider pool of speakers.

But will that improve science?

“Perhaps,” says Stine. “But there already are lots of ways to exchange ideas virtually, such as ArXiv for sharing manuscripts. And universities now post lectures and seminars on-line. That all might change, of course, with a new generation of scientists who have grown up on virtual campuses.”

No matter if in-person or virtual, the key is the exchange of ideas.  In opening the Consumer Science Summit, Xu, the forecasting science director who helped organize the consumer summit, quoted George Bernard Shaw.

“If you have an apple and I have an apple and we exchange these apples, then you and I will each have an apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas.”

Whether virtual or in-person, the primary purpose of science conferences remains the same: the exchange of ideas as researchers stand on the shoulders of the giants who preceded them, seeking to advance the science.

Related content

US, WA, Bellevue
We are seeking a passionate, talented, and inventive individual to join the Applied AI team and help build industry-leading technologies that customers will love. This team offers a unique opportunity to make a significant impact on the customer experience and contribute to the design, architecture, and implementation of a cutting-edge product. The mission of the Applied AI team is to enable organizations within Worldwide Amazon.com Stores to accelerate the adoption of AI technologies across various parts of our business. We are looking for a Senior Applied Scientist to join our Applied AI team to work on LLM-based solutions. On our team you will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. You will be responsible for developing and maintaining the systems and tools that enable us to accelerate knowledge operations and work in the intersection of Science and Engineering. You will push the boundaries of ML and Generative AI techniques to scale the inputs for hundreds of billions of dollars of annual revenue for our eCommerce business. If you have a passion for AI technologies, a drive to innovate and a desire to make a meaningful impact, we invite you to become a valued member of our team. We are seeking an experienced Scientist who combines superb technical, research, analytical and leadership capabilities with a demonstrated ability to get the right things done quickly and effectively. This person must be comfortable working with a team of top-notch developers and collaborating with our research teams. We’re looking for someone who innovates, and loves solving hard problems. You will be expected to have an established background in building highly scalable systems and system design, excellent project management skills, great communication skills, and a motivation to achieve results in a fast-paced environment. You should be somebody who enjoys working on complex problems, is customer-centric, and feels strongly about building good software as well as making that software achieve its operational goals.
IN, KA, Bengaluru
Do you want to lead the development of advanced machine learning systems that protect millions of customers and power a trusted global eCommerce experience? Are you passionate about modeling terabytes of data, solving highly ambiguous fraud and risk challenges, and driving step-change improvements through scientific innovation? If so, the Amazon Buyer Risk Prevention (BRP) Machine Learning team may be the right place for you. We are seeking a Senior Applied Scientist to define and drive the scientific direction of large-scale risk management systems that safeguard millions of transactions every day. In this role, you will lead the design and deployment of advanced machine learning solutions, influence cross-team technical strategy, and leverage emerging technologies—including Generative AI and LLMs—to build next-generation risk prevention platforms. Key job responsibilities Lead the end-to-end scientific strategy for large-scale fraud and risk modeling initiatives Define problem statements, success metrics, and long-term modeling roadmaps in partnership with business and engineering leaders Design, develop, and deploy highly scalable machine learning systems in real-time production environments Drive innovation using advanced ML, deep learning, and GenAI/LLM technologies to automate and transform risk evaluation Influence system architecture and partner with engineering teams to ensure robust, scalable implementations Establish best practices for experimentation, model validation, monitoring, and lifecycle management Mentor and raise the technical bar for junior scientists through reviews, technical guidance, and thought leadership Communicate complex scientific insights clearly to senior leadership and cross-functional stakeholders Identify emerging scientific trends and translate them into impactful production solutions
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
US, MA, Boston
The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems. Key job responsibilities As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services. A day in the life An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.
GB, London
We are looking for a Senior Economist to work on exciting and challenging business problems related to Amazon Retail’s worldwide product assortment. You will build innovative solutions based on econometrics, machine learning, and experimentation. You will be part of a interdisciplinary team of economists, product managers, engineers, and scientists, and your work will influence finance and business decisions affecting Amazon’s vast product assortment globally. If you have an entrepreneurial spirit, you know how to deliver results fast, and you have a deeply quantitative, highly innovative approach to solving problems, and long for the opportunity to build pioneering solutions to challenging problems, we want to talk to you. Key job responsibilities * Work on a challenging problem that has the potential to significantly impact Amazon’s business position * Develop econometric models and experiments to measure the customer and financial impact of Amazon’s product assortment * Collaborate with other scientists at Amazon to deliver measurable progress and change * Influence business leaders based on empirical findings
IN, KA, Bengaluru
Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you have an entrepreneurial spirit, know how to deliver, love to work with data, are deeply technical, highly innovative and long for the opportunity to build solutions to challenging problems that directly impact the company's bottom-line, we want to talk to you. Major responsibilities - Use machine learning and analytical techniques to create scalable solutions for business problems - Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes - Design, development, evaluate and deploy innovative and highly scalable models for predictive learning - Research and implement novel machine learning and statistical approaches - Work closely with software engineering teams to drive real-time model implementations and new feature creations - Work closely with business owners and operations staff to optimize various business operations - Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation - Mentor other scientists and engineers in the use of ML techniques Key job responsibilities Use machine learning and analytical techniques to create scalable solutions for business problems Analyze and extract relevant information from large amounts of Amazon’s historical business data to help automate and optimize key processes Design, develop, evaluate and deploy, innovative and highly scalable ML models Work closely with software engineering teams to drive real-time model implementations Work closely with business partners to identify problems and propose machine learning solutions Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model maintenance Work proactively with engineering teams and product managers to evangelize new algorithms and drive the implementation of large-scale complex ML models in production Leading projects and mentoring other scientists, engineers in the use of ML techniques About the team International Machine Learning Team is responsible for building novel ML solutions that attack India first (and other Emerging Markets across MENA and LatAm) problems and impact the bottom-line and top-line of India business. Learn more about our team from https://www.amazon.science/working-at-amazon/how-rajeev-rastogis-machine-learning-team-in-india-develops-innovations-for-customers-worldwide
EG, Cairo
Are you a MS or PhD student interested in a 2026 internship in the field of machine learning, deep learning, generative AI, large language models and speech technology, robotics, computer vision, optimization, operations research, quantum computing, automated reasoning, or formal methods? If so, we want to hear from you! We are looking for students interested in using a variety of domain expertise to invent, design and implement state-of-the-art solutions for never-before-solved problems. You can find more information about the Amazon Science community as well as our interview process via the links below; https://www.amazon.science/ https://amazon.jobs/content/en/career-programs/university/science https://amazon.jobs/content/en/how-we-hire/university-roles/applied-science Key job responsibilities As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to write technical white papers, create roadmaps and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists and other science interns to develop solutions and deploy them into production. You will have the opportunity to design new algorithms, models, or other technical solutions whilst experiencing Amazon’s customer focused culture. The ideal intern must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems. A day in the life At Amazon, you will grow into the high impact person you know you’re ready to be. Every day will be filled with developing new skills and achieving personal growth. How often can you say that your work changes the world? At Amazon, you’ll say it often. Join us and define tomorrow. Some more benefits of an Amazon Science internship include; • All of our internships offer a competitive stipend/salary • Interns are paired with an experienced manager and mentor(s) • Interns receive invitations to different events such as intern program initiatives or site events • Interns can build their professional and personal network with other Amazon Scientists • Interns can potentially publish work at top tier conferences each year About the team Applicants will be reviewed on a rolling basis and are assigned to teams aligned with their research interests and experience prior to interviews. Start dates are available throughout the year and durations can vary in length from 3-6 months for full time internships. This role may available across multiple locations in the EMEA region (Austria, Estonia, France, Germany, Ireland, Israel, Italy, Jordan, Luxembourg, Netherlands, Poland, Romania, Spain, South Africa, UAE, and UK). Please note these are not remote internships.
US, CA, San Diego
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to apply their macroeconomics and forecasting skillsets to solve real world problems. The intern will work in the area of forecasting, developing models to improve the success of new product launches in Private Brands. Our PhD Economist Internship Program offers hands-on experience in applied economics, supported by mentorship, structured feedback, and professional development. Interns work on real business and research problems, building skills that prepare them for full-time economist roles at Amazon and beyond. You will learn how to build data sets and perform applied econometric analysis collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis About the team The Amazon Private Brands Intelligence team applies Machine Learning, Statistics and Econometrics/economics to solve high-impact business problems, develop prototypes for Amazon-scale science solutions, and optimize key business functions of Amazon Private Brands and other Amazon orgs. We are an interdisciplinary team, using science and technology and leveraging the strengths of engineers and scientists to build solutions for some of the toughest business problems at Amazon, covering areas such as pricing, discovery, negotiation, forecasting, supply chain and product selection/development.