Garegin Papoian, the Monroe Martin Professor at the University of Maryland, is seen sitting at a desk with an open laptop in front of him. He has turned around in his seat to face the camera.
Garegin Papoian is the Monroe Martin Professor at the University of Maryland. Within his Papoian Lab, a theoretical physical chemistry group located at the university, his team is working toward developing fundamental molecular models of the whole cell, a concept still in its infancy
Courtesy of Garegin Papoian

Garegin Papoian’s quest to model an elusive class of proteins

With the support of an Amazon Research Award, Papoian’s team is deciphering the dynamics of intrinsically disordered proteins.

How do molecules come together and start to behave like a living system? This is the type of question that drives Garegin Papoian’s research. At the University of Maryland, where he is the Monroe Martin Professor, he has been focusing on computational modeling of biological molecules like proteins and DNA. Within his Papoian Lab, a theoretical physical chemistry group also located at the university, his team is also working toward developing fundamental molecular models of the whole cell, a concept still in its infancy.

Papoian’s path into science was determined early on. Growing up in Armenia, then a part of the Soviet Union, he went to a special school of physics and mathematics, where he was introduced to Science Olympiads. While in high school, he won the first place in the Republic of Armenia in separate Olympiads in chemistry, physics, mathematics and biology. “Science Olympiads were a big reason why I got drawn into science, in particular to chemistry and physics”, he says.

Because of his success in the competitions, he was invited to study at an advanced chemistry college in Moscow established specifically for Olympiad winners.

“I was 16,” he says, “but it was assumed that we already knew all university level chemistry. So, they would start immediately with a very high-level training.” The program included an internship in the United States, at the University of Kansas. From there he eventually enrolled as a graduate student at Cornell University, where he pursued his PhD in quantum chemistry, working under the Nobel Laureate, Roald Hoffmann.

During his postdoc, he turned to classical physics with a particular emphasis on biophysics. “I was interested in bringing concepts of physical chemistry to understand biological phenomena from the molecular perspective,” he says. “And my long-term career goal is to develop concepts both for proteins and cells.”

Predicting a protein’s shape

A protein is a large molecule essential to all living things. The sequence of amino acids that form a protein determines its three-dimensional structure. Each protein has a unique shape that dictates its function. Being able to predict what a protein structure looks like from its amino acid sequence has been a long-standing scientific challenge and one of the research interests of Papoian’s group, for which he received an AWS Machine Learning Research Award in 2018.

This animation shows the structure of a protein called linker histone H1
This animation shows the structure of a protein called linker histone H1, including its disordered tails, predicted by Papoian's team. "We discovered that interactions of those disordered tails with DNA help to structurally position H1 with respect to the nucleosome. In terms of the bigger picture, the H1-nucleosome interactions regulate epigenetic processes, determining for example which particular genes should be turned on or off,” says Papoian.

One of the applications of protein structure prediction is drug design. “When you design a drug, you need to know what the target looks like,” says Papoian. If you know that the target protein has a certain pocket, for example, you can develop a molecule that will fit nicely into that pocket. While identifying genes associated with diseases has become easier, the sequence of a gene doesn’t tell you what the protein expressed by it looks like, and experimental methods to determine the protein shape are lengthy and expensive.

IDPs ... are more like this crazy spaghetti. It's very hard to deal with them both experimentally and computationally.
Garegin Papoian

Even in the wake of DeepMind demonstrating that AlphaFold is capable of predicting protein structures with an unprecedented level of accuracy, challenges still remain.

It turns out that a large proportion of human proteins are not completely structured in neat three-dimensional shapes. These are called the intrinsically disordered proteins (IDPs). “They are much more dynamic and mostly never fall into a single structure,” says Papoian. “They are more like this crazy spaghetti. It's very hard to deal with them both experimentally and computationally because they are so elusive.” He notes that about a third of human proteins are like that, including many important disease-causing proteins.

Papoian’s AWS Machine Learning Research Award enabled his team to advance the development of a system that is better suited to simulating these proteins.

Tackling disordered proteins

For the past few years, Papoian Lab has been working with a protein modeling framework called AWSEM-MD (pronounces “awesome”), which stands for associative memory, water-mediated, structure and energy model — molecular dynamics. It has been developed jointly with Peter Wolynes, Papoian’s former postdoctoral advisor who is currently at Rice University and with whom he continued to collaborate over the years.

Using the AWS Machine Learning Research Award, Papoian and his colleagues developed AWSEM-IDP, an AWSEM branch specifically designed to simulate intrinsically disordered proteins.

This system uses a database of protein fragment structures obtained experimentally, for example, through nuclear magnetic resonance (NMR) spectroscopy — a technique that determines the structure and dynamics of proteins. "These fragments serve as structural memories that guide the IDP to undergo structural transformations that are informed by the experiment,” Papoian explains. “This allows simulating more realistic IDP dynamics.”

The fragment database may also contain structures from atomistic simulations — a type of simulation where every atom of a protein is present. “The reason why we prefer not to do those in general is that they’re very expensive, so we cannot do very big simulations. But we can do atomistic simulations of short fragments to give us good fragment memories, again improving the accuracy of IDP’s structural exploration in AWSEM simulations,” he says.

An IDP will prefer multiple structures, not just one.

“That's the key difference from regular proteins: IDPs are multi-faceted in essence. But they still prefer certain structures over others. And the AWSEM-IDP model allows you to correctly describe those preferences,” Papoian explained. This model was described in a 2018 article published at the Journal of Physical Chemistry B.

In another work published earlier this year that was supported by the AWS Machine Learning Award, Papoian and his colleagues applied AWSEM-IDP to study a protein called linker histone H1, which plays an essential role in regulating many important biological processes. This protein has two intrinsically disordered regions, parts of its structure that are not well folded and resemble two tails. Because they are disordered, it’s much harder to understand what they do and how they interact.

Proteins like linker histone H1 regulate histone complexes, which act like a spool around which the DNA wraps to create structures called nucleosomes. “In this paper, we used AWSEM-IDP to model the nucleosome with linker histone H1, in particular with these disordered tails. And that allowed us to understand how the linker histone and the nucleosome come together and interact, and what's the role of these disordered tails,” says Papoian. Understanding proteins’ interactions with nucleosomes may give important insights on epigenetics, which is one of Papoian Lab’s interests.

Future challenges

Because making sense of IDPs is such a difficult process, Papoian says that AWSEM-IDP is an ongoing program with room for improvement. “What we have currently works better in some classes of proteins, and not so much in others. So next we’ll explore what are the challenges for what we currently have in ASWEM-IDP and try to come up with new advances to overcome them.”

In addition to IDPs, Papoian Lab will also continue to pursue the use of deep learning for structure prediction of well-folded proteins. Although there is some conceptual overlap with AlphaFold, Papoian believes that AWSEM-MD is a powerful tool and has advantages to other approaches when it comes to molecular dynamics.

Proteins are not frozen objects. Some of them are well structured, but many are not structured at all, and they are dynamic and move and shape-shift incessantly.
Garegin Papoian

“Proteins are not frozen objects,” he says. “Some of them are well structured, but many are not structured at all, and they are dynamic and move and shape-shift incessantly. So, to understand how these proteins function, you must model their dynamics and that’s what AWSEM-MD can do best.”

Papoian thinks one exciting area to be explored in coming decades will be combining machine learning and physics to work on protein structure prediction, protein dynamics, multiprotein complexes, and epigenetics.

“There are lots of things that still remain to be understood in our models. And I think that probably neither physics nor machine learning by themselves can tackle them. But a program that brings them together in a productive way can be very powerful,” he said.

Modeling an entire cell

Another ambitious project that Papoian and his colleagues are pursuing is to develop a computational model of an entire cell. “We still don’t have a blueprint of a cell the way we have a blueprint of a car or a Boeing airplane.”

To do that, his group develops their own software from scratch.

Garegin Papoian: How do cells move? Chemistry meets mechanics

“We basically do the science, the physics, and biophysics of what is needed to model our cells. We derive the needed algorithms from scratch based on the laws of physics and chemistry and then we program that into a computer and run simulations on a supercomputer,” he explained. This has to be done at a single molecule resolution, he adds, meaning that they have to track every single molecule within a cell.

To achieve that, the Papoian Lab developed a model called MEDYAN.

“We can already model some number of proteins, the membrane, we can model rich chemistry. We have developed some of the fundamental chemistry and physics components of what needs to be done,” he says. The next step is to scale it. “We usually do simulations with several types of proteins. So instead of several, you will need maybe hundreds or thousands of different types of proteins, so it just brings more complexity.”

When that happens, it will be a huge revolution in biomedicine, he says. “Then lots of things that people laboriously spend years doing in the laboratory could just run on AWS servers. And you could do your experiments and search for treatments computationally, which would be much cheaper and faster.”

Research areas

Related content

US, VA, Arlington
We are seeking an exceptional Data Scientist to join our team in PXT Central Science. The ideal candidate will thrive in a dynamic, multifaceted role where you'll translate complex business challenges into rigorous quantitative frameworks, extract actionable insights from structured and unstructured datasets, and architect science-backed, scalable solutions that elevate the experience of our 1 million+ employees worldwide. If you're energized by the opportunity to apply data science to our mission of making Amazon Earth's Best Employer, we want to hear from you. Key job responsibilities • Own the design, development, and maintenance of scalable models and prototypes leveraging statistical, machine learning, or GenAI methodologies to enhance employee experience. • Partner with scientists, engineers, and product leaders to solve for employee experience defects using scientific approaches, building new services and tools that deliverable measurable impact. • Author and maintain detailed technical documentation related to the projects you drive. • Communicate results to diverse audiences of varying technical background with effective writing, visualizations, and presentations • Stay current with emerging methods and technologies, and implement them strategically to amplify the team’s impact. About the team The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, machine learning, and Generative AI to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science, engineering, and UX to develop and deliver solutions that measurably achieve this goal.
US, WA, Bellevue
The Amazon Fulfillment Technologies (AFT) Science team is looking for an exceptional Applied Scientist, with strong optimization and analytical skills, to develop production solutions for one of the most complex systems in the world: Amazon’s Fulfillment Network. At AFT Science, we design, build and deploy optimization, simulation, and machine learning solutions to power the production systems running at world wide Amazon Fulfillment Centers. We solve a wide range of problems that are encountered in the network, including labor planning and staffing, demand prioritization, pick assignment and scheduling, and flow process optimization. We are tasked to develop innovative, scalable, and reliable science-driven solutions that are beyond the published state of art in order to run frequently (ranging from every few minutes to every few hours per use case) and continuously in our large scale network. Key job responsibilities As an Applied Scientist, you will work with other scientists, software engineers, product managers, and operations leaders to develop scientific solutions and analytics using a variety of tools and observe direct impact to process efficiency and associate experience in the fulfillment network. Key responsibilities include: * Develop an understanding and domain knowledge of operational processes, system architecture and functions, and business requirements * Deep dive into data and code to identify opportunities for continuous improvement and/or disruptive new approach * Develop scalable mathematical models for production systems to derive optimal or near-optimal solutions for existing and new challenges * Create prototypes and simulations for agile experimentation of devised solutions * Advocate technical solutions to business stakeholders, engineering teams, and senior leadership * Partner with engineers to integrate prototypes into production systems * Design experiment to test new or incremental solutions launched in production and build metrics to track performance About the team Amazon Fulfillment Technology (AFT) designs, develops and operates the end-to-end fulfillment technology solutions for all Amazon Fulfillment Centers (FC). We harmonize the physical and virtual world so Amazon customers can get what they want, when they want it. The AFT Science team has expertise in operations research, optimization, scheduling, planning, simulation, and machine learning. We also have domain expertise in the operational processes within the FCs and their defects. We prioritize advancements that support AFT tech teams and focus areas rather than specific fields of research or individual business partners. We influence each stage of innovation from inception to deployment which includes both developing novel solutions or improving existing approaches. Resulting production systems rely on a diverse set of technologies, our teams therefore invest in multiple specialties as the needs of each focus area evolves.
US, WA, Seattle
We are seeking an exceptional Data Scientist to join our team in PXT Central Science. The ideal candidate will thrive in a dynamic, multifaceted role where you'll translate complex business challenges into rigorous quantitative frameworks, extract actionable insights from structured and unstructured datasets, and architect science-backed, scalable solutions that elevate the experience of our 1 million+ employees worldwide. If you're energized by the opportunity to apply data science to our mission of making Amazon Earth's Best Employer, we want to hear from you. Key job responsibilities • Own the design, development, and maintenance of scalable models and prototypes leveraging statistical, machine learning, or GenAI methodologies to enhance employee experience. • Partner with scientists, engineers, and product leaders to solve for employee experience defects using scientific approaches, building new services and tools that deliverable measurable impact. • Author and maintain detailed technical documentation related to the projects you drive. • Communicate results to diverse audiences of varying technical background with effective writing, visualizations, and presentations • Stay current with emerging methods and technologies, and implement them strategically to amplify the team’s impact. About the team The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, machine learning, and Generative AI to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science, engineering, and UX to develop and deliver solutions that measurably achieve this goal.
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.
US, WA, Bellevue
Amazon’s Last Mile Team is looking for a passionate individual with strong optimization and analytical skills to join its Last Mile Science team in the endeavor of designing and improving the most complex planning of delivery network in the world. Last Mile builds global solutions that enable Amazon to attract an elastic supply of drivers, companies, and assets needed to deliver Amazon's and other shippers' volumes at the lowest cost and with the best customer delivery experience. Last Mile Science team owns the core decision models in the space of jurisdiction planning, delivery channel and modes network design, capacity planning for on the road and at delivery stations, routing inputs estimation and optimization. Our research has direct impact on customer experience, driver and station associate experience, Delivery Service Partner (DSP)’s success and the sustainable growth of Amazon. Optimizing the last mile delivery requires deep understanding of transportation, supply chain management, pricing strategies and forecasting. Only through innovative and strategic thinking, we will make the right capital investments in technology, assets and infrastructures that allows for long-term success. Our team members have an opportunity to be on the forefront of supply chain thought leadership by working on some of the most difficult problems in the industry with some of the best product managers, scientists, and software engineers in the industry. Key job responsibilities Candidates will be responsible for developing solutions to better manage and optimize delivery capacity in the last mile network. The successful candidate should have solid research experience in one or more technical areas of Operations Research or Machine Learning. These positions will focus on identifying and analyzing opportunities to improve existing algorithms and also on optimizing the system policies across the management of external delivery service providers and internal planning strategies. They require superior logical thinkers who are able to quickly approach large ambiguous problems, turn high-level business requirements into mathematical models, identify the right solution approach, and contribute to the software development for production systems. To support their proposals, candidates should be able to independently mine and analyze data, and be able to use any necessary programming and statistical analysis software to do so. Successful candidates must thrive in fast-paced environments, which encourage collaborative and creative problem solving, be able to measure and estimate risks, constructively critique peer research, and align research focuses with the Amazon's strategic needs.
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.
US, CA, Pasadena
The Amazon Web Services (AWS) Center for Quantum Computing (CQC) is a multi-disciplinary team of theoretical and experimental physicists, materials scientists, and hardware and software engineers on a mission to develop a fault-tolerant quantum computer. Throughout your internship journey, you'll have access to unparalleled resources, including state-of-the-art computing infrastructure, cutting-edge research papers, and mentorship from industry luminaries. This immersive experience will not only sharpen your technical skills but also cultivate your ability to think critically, communicate effectively, and thrive in a fast-paced, innovative environment where bold ideas are celebrated. Join us at the forefront of applied science, where your contributions will shape the future of Quantum Computing and propel humanity forward. Seize this extraordinary opportunity to learn, grow, and leave an indelible mark on the world of technology. Amazon has positions available for Quantum Research Science and Applied Science Internships in Santa Clara, CA and Pasadena, CA. We are particularly interested in candidates with expertise in any of the following areas: superconducting qubits, cavity/circuit QED, quantum optics, open quantum systems, superconductivity, electromagnetic simulations of superconducting circuits, microwave engineering, benchmarking, quantum error correction, fabrication, etc. Key job responsibilities In this role, you will work alongside global experts to develop and implement novel, scalable solutions that advance the state-of-the-art in the areas of quantum computing. You will tackle challenging, groundbreaking research problems, work with leading edge technology, focus on highly targeted customer use-cases, and launch products that solve problems for Amazon customers. The ideal candidate should possess the ability to work collaboratively with diverse groups and cross-functional teams to solve complex business problems. A successful candidate will be a self-starter, comfortable with ambiguity, with strong attention to detail and the ability to thrive in a fast-paced, ever-changing environment. About the team Diverse Experiences AWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Hybrid Work We value innovation and recognize this sometimes requires uninterrupted time to focus on a build. We also value in-person collaboration and time spent face-to-face. Our team affords employees options to work in the office every day or in a flexible, hybrid work model near one of our U.S. Amazon offices.
US, WA, Bellevue
Amazon is seeking a Language Data Scientist to join the Alexa International science team as domain expert. This role focuses on expanding analysis and evaluation of conversational interaction data deliverables. The Language Data Scientist is an expert in conversation assessment processes, working closely with a team of skilled machine learning scientists and engineers, and is a key member in developing new conventions for relevant annotation workflows. The Language Data Scientist will be own unique data analysis and research requests that support the training and evaluation of LLMs and machine learning models, and the overall processing of a data collection. Key job responsibilities To be successful in this role, you must have a passion for data, efficiency, and accuracy. Specifically, you will: - Own data analyses for customer-facing features, including launch go/no-go metrics for new features and accuracy metrics for existing features - Handle unique data analysis requests from a range of stakeholders, including quantitative and qualitative analyses to elevate customer experience with speech interfaces - Lead and evaluate changing dialog evaluation conventions, test tooling developments, and pilot processes to support expansion to new data areas - Continuously evaluate workflow tools and processes and offer solutions to ensure they are efficient, high quality, and scalable - Provide expert support for a large and growing team of data analysts - Provide support for ongoing and new data collection efforts as a subject matter expert on conventions and use of the data - Conduct research studies to understand speech and customer-Alexa interactions - Collaborate with scientists and product managers, and other stakeholders in defining and validating customer experience metrics
US, WA, Bellevue
Alexa International Science team is looking for a passionate, talented, and inventive Senior Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. At this level, you will drive cross-team scientific strategy, influence partner teams, and deliver solutions that have broad impact across Alexa's international products and services. Key job responsibilities As a Senior Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs, particularly delivering industry-leading scientific research and applied AI for multi-lingual applications — a challenging area for the industry globally. Your work will directly impact our global customers in the form of products and services that support Alexa+. You will leverage Amazon's heterogeneous data sources and large-scale computing resources to accelerate advances in text, speech, and vision domains. The ideal candidate possesses a solid understanding of machine learning, speech and/or natural language processing, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environment, like to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and are able to influence and align multiple teams around a shared scientific vision.
US, WA, Bellevue
Alexa International is looking for a passionate, talented, and inventive Applied Scientist to help build industry-leading technology with Large Language Models (LLMs) and multimodal systems, requiring strong deep learning and generative models knowledge. You will contribute to developing novel solutions and deliver high-quality results that impact Alexa's international products and services. Key job responsibilities As an Applied Scientist with the Alexa International team, you will work with talented peers to develop novel algorithms and modeling techniques to advance the state of the art with LLMs. Your work will directly impact our international customers in the form of products and services that make use of digital assistant technology. You will leverage Amazon's heterogeneous data sources, unique and diverse international customer nuances and large-scale computing resources to accelerate advances in text, voice, and vision domains in a multimodal setup. The ideal candidate possesses a solid understanding of machine learning, natural language understanding, modern LLM architectures, LLM evaluation & tooling, and a passion for pushing boundaries in this vast and quickly evolving field. They thrive in fast-paced environments to tackle complex challenges, excel at swiftly delivering impactful solutions while iterating based on user feedback, and collaborate effectively with cross-functional teams. A day in the life * Analyze, understand, and model customer behavior and the customer experience based on large-scale data. * Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants. * Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF. * Set up experimentation frameworks for agile model analysis and A/B testing. * Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies. * Contribute to end-to-end delivery of solutions from research to production, including reusable science components. * Communicate solutions clearly to partners and stakeholders. * Contribute to the scientific community through publications and community engagement.