ICASSP: Michael I. Jordan’s “alternative view on AI”

In a plenary talk, the Berkeley professor and Distinguished Amazon Scholar will argue that AI research should borrow concepts from economics and focus on social collectives.

Intelligence is notoriously hard to define, but when most people (including computer scientists) think about it, they construe it on the model of human intelligence: an information-processing capacity that allows an autonomous agent to act upon the world.

Michael I. Jordan, the Pehong Chen Distinguished Professor in both the computer science and statistics departments at UC Berkeley, and a Distinguished Amazon Scholar.

But Michael I. Jordan, the Pehong Chen Distinguished Professor in both the computer science and statistics departments at the University of California, Berkeley, and a Distinguished Amazon Scholar, thinks that that’s too narrow a concept of intelligence.

“Swarms of ants are intelligent, in the sense that they can build ant hills and share food, even though each individual ant is not thinking about hills or sharing,” Jordan says. “Economists have taken this perspective further, with their focus on the tasks accomplished by markets. Accomplishing those tasks is by some definition a reflection of intelligence. A market that brings food into, say, New York every day is an intelligent entity. It's akin to a brain, and it’s important to remember that a brain is a loosely coupled collection of neurons that are each performing relatively simple functions. Analogously, a bunch of loosely coupled decisions made by producers, suppliers, and consumers constitute a market that is a form of intelligence. A grand challenge is to marry this kind of intelligence with the form of intelligence that arises from learning from data.”

Jordan argues that distributed, social intelligence is better suited to meeting human needs than the type of autonomous general intelligence we associate with the Terminator movies or Marvel’s Ultron. By the same token, he says, AI’s goals should be formulated at the level of the collective, not the level of the individual agent.

Related content
Amazon Science hosts a conversation with Amazon Scholars Michael I. Jordan and Michael Kearns and Amazon distinguished scientist Bernhard Schölkopf.

“A good engineer is supposed to think about the overall goal of the system you’re building,” Jordan says. “If your overall goal is diffuse — create intelligence, and somehow it will solve problems — that's not good enough.

“What machine learning and network data do is bring people together in new ways to share data, to share services with each other, and to create new kinds of markets, new kinds of social collectives. Building systems like that is a perfectly reasonable engineering goal. Real-world examples are easy to find in domains such as transportation, commerce, health care. Those are not best analyzed as some super-intelligence coming in to help you solve problems. Rather, they're best analyzed as, Hey, we're designing a new system that has new kinds of data flows that were never present before and there’s a need to aggregate and integrate those flows in various ways, with the overall goal of serving individuals according to their utilities.”

New signals

At this year’s International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Jordan will elaborate on these ideas in a plenary talk titled “An alternative view on AI: Collaborative learning, incentives, and social welfare”. ICASSP might seem like an odd venue for so expansive a talk, but Jordan argues — again — that that’s only if you rely on an overly restricted definition.

Related content
Alexa scientist Ariya Rastrow on the blurring boundaries between acoustic processing and language understanding.

“You can make signal processing very narrow, and then it's, how do you do compression, how do you get high-fidelity recordings, and so on,” he says. “But those are all the engineering challenges of the past. In emerging domains, the notion of what constitutes a signal is broader. Signals are often coming from humans, and they often have semantic content. Moreover, when people interact with an economic relationship in mind, they signal to each other in various ways: What am I willing to pay for this? And what is someone else willing to pay? Markets are full of signals. Machine learning can create new vocabularies for signaling. 

“So part of the story here is going to be to say, hey, signal-processing folks, it's not just about the data and the algorithms and the statistics. It's about a broader conception of signals. Signal processing isn’t just about the processing and streaming of bits but about what these bits are being used for and what market forces they can set in motion. I definitely would hope to convince signal-processing people to think ambitiously about what the scope of the field can be.”

Statistical contract theory

One of the tools that Jordan and his Berkeley research group are using to make markets more intelligent is what they call statistical contract theory. Classical contract theory investigates markets with information asymmetries: for instance, a seller doesn’t know how potential buyers value a particular good, but the buyers themselves do.

Michael I. Jordan on AI, statistical contract theory, and prediction-powered inference.

The goal is to devise a menu of contracts that balances out the asymmetries. An example is tiered-class seating on airplanes: some customers will contract to pay higher fares for more room and better food; some customers will contract to forego those advantages in exchange for lower fares. The seller doesn’t have to know in advance which population is which; the populations are self-selecting.

In statistical contract theory, Jordan explains, the contracts have statistical analyses embedded within them. The example he likes to use is the drug approval process.

“The job of the regulatory agency is to decide which drugs go to market,” Jordan says. “And it's partially a statistical problem: You have a drug candidate, and it may or may not be effective on humans. You don't know a priori. So you do an A/B test. You bring in people, and you either give them the treatment, or you give them a control, and you see if there has been an improvement.

“The problem is that there are more players in this game. The drug candidates are not coming just from nature or from the agency itself. There are these third-party agents, which are the pharmaceutical companies, that are generating drug candidates. They can generate tens of thousands of them, which would be far too expensive to test.

“The agency has no idea whether a candidate is good or bad before they run their clinical trial. But the pharmaceutical company knows a little more. They know how they develop the candidates, and maybe they did some internal testing. So there you have your asymmetry. The agency can’t just ask the pharmaceutical company, Hey, is that candidate good or not? Because the pharmaceutical company is just hoping that it passes the screening and gets onto the market and they make some money.

Related content
Michael I. Jordan, Amazon Scholar and professor at the University of California, Berkeley, writes about the classical goals in human-imitative AI, and reflects on how in the current hubbub over the AI revolution it is easy to forget that these goals haven’t yet been achieved.

“The solution is something we call statistical contract theory, and hopefully, it will begin to emerge as a new field. The mathematical ingredients are again menus of options, including license fees, durations of licenses, sizes of the trials, and so on. And every drug company gets to look at that same menu for every possible drug. They make a selection, and then nature reveals an outcome via a clinical trial.

“In the selection process, the drug company is revealing something. The drug company says, hey, on this candidate drug, I know it's really good, so I'm going to take ‘business class’. And now you kind of revealed something to the agency. But the agency doesn't use that information directly; they set up a contract a priori, and you made your selection. We have a new mathematical theory that exactly addresses that kind of design problem and, hopefully, a range of other problems.”

Prediction-powered inference

Another tool that Jordan’s group has been developing is called prediction-powered inference.

“How do I use neural nets not just to make good predictions but to make good confidence intervals?” Jordan says. “The problem is that even if these predictions are very accurate, they still make big errors in some instances, and those can conspire to yield biased confidence intervals. We have this new technique called prediction-powered inference that addresses this problem.

“Classical bias correction would be just that I estimate the bias, and I correct the original estimate for the bias to get a more unbiased estimator. What we're doing is different. We're estimating not the bias but a confidence interval on all the possible biases. And then we're using that confidence interval to do all possible adjustments of the original value to get a confidence interval on the true parameter. So we don't just get a better predictive estimate; we get a whole confidence interval that has a high probability of covering the truth. It is able to use all of these biased predictions from the neural net and nonetheless provide an interval that has a guarantee of covering the truth. It's kind of almost magical that it can be done. But it can.”

Research areas

Related content

US, CA, Palo Alto
We’re working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You’ll be working with talented scientists, engineers, and technical program managers (TPM) to innovate on behalf of our customers. If you’re fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey! We are open to hiring candidates to work out of one of the following locations: Palo Alto, CA, USA
US, WA, Redmond
Project Kuiper is an initiative to launch a constellation of Low Earth Orbit satellites that will provide low-latency, high-speed broadband connectivity to unserved and underserved communities around the world. We are searching for talented candidates with experience in spaceflight trajectory modeling and simulation, orbit mechanics, and launch vehicle mission planning. Key job responsibilities This position requires experience in simulation and analysis of astrodynamics models and spaceflight trajectories. This position requires experience in software development for astrodynamics applications and expertise in supporting mission workflow for satellite operations. Strong analysis skills are required to develop engineering studies of complex large-scale dynamical systems. This position requires demonstrated expertise in computational analysis automation and tool development. Working with the Kuiper engineering team, you will: - Develop modeling techniques for analysis and simulation of deployment dynamics of multiple satellites - Support Project Kuiper’s Launch Vehicle Mission Management team with technical expertise in Launch Vehicle trajectory requirements specification - Develop tools to support Mission Management planning for over 80 launches! - Work collaboratively with launch vehicle system technical teams - Provide support of algorithm development and testing for the Kuiper Flight Dynamics System. - Provide software development support of production code. Export Control Requirement: Due to applicable export control laws and regulations, candidates must be a U.S. citizen or national, U.S. permanent resident (i.e., current Green Card holder), or lawfully admitted into the U.S. as a refugee or granted asylum. We are open to hiring candidates to work out of one of the following locations: Redmond, WA, USA
CN, 11, Beijing
Are you interested in applying your strong quantitative analysis and big data skills to world-changing problems? Are you interested in driving the development of methods, models and systems for strategy planning, transportation and fulfillment network? Are you interested to cooperate with Amazonians around the world? If so, then this is the job for you. Our team, ATE(Analytics Technology and Engineering) is looking for an Applied Scientist to join our growing Science Team in Bangalore (India)/ Beijing(China). We are responsible for creating core analytics tech capabilities, quantative models, platforms development, and data engineering. We develop scalable analytics applications and research models to optimize operations processes. We standardize and optimize data sources and visualization efforts across geographies, build up, and maintain the online business intelligence services and data mart. You will work with other scientists, professional data engineers, business intelligence engineers, and product managers using rigorous quantitative approaches to ensure high quality data tech products for our customers around the world, including India, Australia, Brazil, Mexico, Singapore and Middle East. Amazon is growing rapidly and because we are driven by faster delivery to customers, a more efficient supply chain network, and lower cost of operations, our main focus is in the development of strategic models and automation tools fed by our massive amounts of available data. You will be responsible for building these models/tools that improve the economics of Amazon’s worldwide fulfillment networks in different countries as Amazon increases the speed and decreases the cost to deliver products to customers. You will work on large-scale vehicle routing and scheduling problems under complex operational and physical constraints. You will also identify and evaluate opportunities to reduce variable costs by improving fulfillment center processes, transportation operations and scheduling, and the execution of operational plans. Finally, you will help create the metrics to quantify improvements to the fulfillment costs (e.g., transportation and labor costs) resulting from the application of these optimization models and tools. Key job responsibilities - Design and develop complex mathematical, simulation and optimization models and apply them to define strategic and tactical needs and drive the appropriate business and technical solutions in the areas of vehicle routing, inventory management, network flow, supply chain optimization, demand planning. - Apply theories of mathematical optimization, including linear programming, combinatorial optimization, integer programming, dynamic programming, network flows and algorithms to design optimal or near optimal solution methodologies to be used by in-house decision support tools and software. - Translating business questions and concerns into specific analytical questions that can be answered with available data using Statistical and Machine Learning methods. - Prototype models by using modeling and programming languages with efficient data querying and modeling infrastructure. - Communicate proposals and results in a clear manner backed by data and coupled with actionable conclusions to drive business decisions. - Collaborate with colleagues from multidisciplinary science, engineering and business backgrounds. - Manage your own process. Prioritize and execute on high impact projects, triage external requests, and ensure to deliver projects in time. We are open to hiring candidates to work out of one of the following locations: Beijing, 11, CHN
GB, Cambridge
Our team builds generative AI solutions that will produce some of the future’s most influential voices in media and art. We develop cutting-edge technologies with Amazon Studios, the provider of original content for Prime Video, with Amazon Game Studios and Alexa, the ground-breaking service that powers the audio for Echo. Do you want to be part of the team developing the future technology that impacts the customer experience of ground-breaking products? Then come join us and make history. We are looking for a passionate, talented, and inventive Applied Scientist with a background in Machine Learning to help build industry-leading Speech, Language, Audio and Video technology. As an Applied Scientist at Amazon you will work with talented peers to develop novel algorithms and generative AI models to drive the state of the art in audio (and vocal arts) generation. Position Responsibilities: * Participate in the design, development, evaluation, deployment and updating of data-driven models for digital vocal arts applications. * Participate in research activities including the application and evaluation and digital vocal and video arts techniques for novel applications. * Research and implement novel ML and statistical approaches to add value to the business. * Mentor junior engineers and scientists. We are open to hiring candidates to work out of one of the following locations: Cambridge, GBR | London, GBR
GB, Cambridge
Our team undertakes research together with multiple organizations to advance the state-of-the-art in speech technologies. We not only work on giving Alexa, the ground-breaking service that powers Echo, her voice, but we also develop cutting-edge technologies with Amazon Studios, the provider of original content for Prime Video. Do you want to be part of the team developing the latest technology that impacts the customer experience of ground-breaking products? Then come join us and make history. We are looking for a passionate, talented, and inventive Senior Applied Scientist with a background in Machine Learning to help build industry-leading Speech, Language and Video technology. As a Senior Applied Scientist at Amazon you will work with talented peers to develop novel algorithms and modelling techniques to drive the state of the art in speech and vocal arts synthesis. Position Responsibilities: * Participate in the design, development, evaluation, deployment and updating of data-driven models for digital vocal arts applications. * Participate in research activities including the application and evaluation and digital vocal and video arts techniques for novel applications. * Research and implement novel ML and statistical approaches to add value to the business. * Mentor junior engineers and scientists. We are open to hiring candidates to work out of one of the following locations: Cambridge, GBR | London, GBR
US, VA, Arlington
The GenAI Innovation Center helps AWS customers accelerate their use of Generative AI to solve business challenges and promote innovation across their organizations. The Public Sector team focuses on public sector customers and their unique challenges. As a data scientist, you have deep and broad experience as an ML practitioner. You interface directly with customers to understand and identify their challenges that can be addressed by Generative AI. You build secure solutions that can scale to the size of the problem at hand and guide customers through your rigorous evaluation process. You'll design and run experiments, research new algorithms, and find new ways of optimizing risk, profitability, and customer experience. You're part of both a small team dedicated to public sector customers and a global organization enabling customers to accelerate their progress on GenAI. This position requires that the candidate selected be a US Citizen. AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success. AWS Support also partners with a global list of customers that are building mission-critical applications on top of AWS services. Key job responsibilities The primary responsibilities of this role are to: Design, develop, and evaluate innovative ML models to solve diverse challenges and opportunities across industries. Interact with customer directly to understand their business problems, and help them with defining and implementing scalable Generative AI solutions to solve them. Work closely with account teams, research scientist teams, and product engineering teams to drive model implementations and new solution. A day in the life 1. Team with a GenAI strategist to understand a customer problem and provide guidance on how and whether GenAI can help address the issue. 2. Share your latest experiment results or challenges with other scientists on the team. 3. Collaborate on a blog post to share the results and methods used in your most recent customer success. 4. Attend or a deliver a tech talk to highlight a project you or a team mate just completed. 5. Provide feedback to your team during a code review. 6. Meet with customer stakeholders to demonstrate the latest progress on their problem. About the team Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. We are open to hiring candidates to work out of one of the following locations: Arlington, VA, USA | Denver, CO, USA
US, CA, Santa Clara
Amazon is looking for a motivated individual with strong analytical and algorithmic skills and practical experience to join the Modeling and Optimization (MOP) Routing Science team. Your main focus will be on developing and improving our last-mile experience, with emphasis on algorithmic and analytical work. We are looking for candidates with proven ability to design, implement, and evaluate state-of-the-art solutions to large-scale optimization problems, working closely with software development engineers. The position requires strong background in combinatorial optimization, algorithms, algorithm engineering, and data structures, particularly as it applies to vehicle routing and related problems. Familiarity with data science and Machine Learning techniques is a plus. You will also play an integral role in the network planning, modeling, and analysis that will improve the efficiency and cost effectiveness of global fulfillment operations. You will identify and evaluate opportunities to reduce variable costs by improving the transportation network topology, inventory placement, transportation operations and scheduling, fulfillment center processes, and the execution to operational plans. You will also improve the efficiency of capital investment by helping plan the location and deployment of fixed assets. Finally, you will help create the metrics to quantify improvements to the fulfillment costs (e.g., transportation and labor costs) resulting from the application of these optimization models and tools. Key job responsibilities We are looking for candidates with proven ability to design, implement, and evaluate state-of-the-art solutions to large-scale optimization problems, working closely with software development engineers. The position requires strong background in combinatorial optimization, algorithms, algorithm engineering, and data structures, particularly as it applies to vehicle routing problems. We are open to hiring candidates to work out of one of the following locations: Santa Clara, CA, USA
US, WA, Seattle
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Some knowledge of econometrics, as well as basic familiarity with Python is necessary, and experience with SQL and UNIX would be a plus. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. You will learn how to build data sets and perform applied econometric analysis at Internet speed collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. Roughly 85% of previous cohorts have converted to full time economics employment at Amazon. If you are interested, please send your CV to our mailing list at econ-internship@amazon.com. We are open to hiring candidates to work out of one of the following locations: Seattle, WA, USA
US, WA, Seattle
We are looking for detail-oriented, organized, and responsible individuals who are eager to learn how to work with large and complicated data sets. Some knowledge of econometrics, as well as basic familiarity with Python is necessary, and experience with SQL and UNIX would be a plus. These are full-time positions at 40 hours per week, with compensation being awarded on an hourly basis. You will learn how to build data sets and perform applied econometric analysis at Internet speed collaborating with economists, scientists, and product managers. These skills will translate well into writing applied chapters in your dissertation and provide you with work experience that may help you with placement. Roughly 85% of previous cohorts have converted to full time economics employment at Amazon. If you are interested, please send your CV to our mailing list at econ-internship@amazon.com. We are open to hiring candidates to work out of one of the following locations: Seattle, WA, USA
US, MA, North Reading
We are looking for experienced scientists and engineers to explore new ideas, invent new approaches, and develop new solutions in the areas of Controls, Dynamic modeling and System identification. Are you inspired by invention? Is problem solving through teamwork in your DNA? Do you like the idea of seeing how your work impacts the bigger picture? Answer yes to any of these and you’ll fit right in here at Amazon Robotics. We are a smart team of doers that work passionately to apply cutting edge advances in robotics and software to solve real-world challenges that will transform our customers’ experiences in ways we can’t even imagine yet. We invent new improvements every day. We are Amazon Robotics and we will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun. Key job responsibilities Applied Scientists take on big unanswered questions and guide development team to state-of-the-art solutions. We want to hear from you if you have deep industry experience in the Mechatronics domain and : * the ability to think big and conceive of new ideas and novel solutions; * the insight to correctly identify those worth exploring; * the hands-on skills to quickly develop proofs-of-concept; * the rigor to conduct careful experimental evaluations; * the discipline to fast-fail when data refutes theory; * and the fortitude to continue exploring until your solution is found We are open to hiring candidates to work out of one of the following locations: North Reading, MA, USA | Westborough, MA, USA