Gari Clifford is the tenured chair of the Department of Biomedical Informatics at Emory University and a professor of biomedical engineering at Georgia Institute of Technology. Clifford, an Amazon Research Award recipient, is seen here speaking at Emory University.
Gari Clifford is the tenured chair of the Department of Biomedical Informatics at Emory University and a professor of biomedical engineering at Georgia Institute of Technology. He is seen here speaking at Emory University.
Steve Nowland/Emory University

Using machine learning to reduce costs, increase accuracy, and improve access in healthcare

Gari Clifford, the chair of the Department of Biomedical Informatics at Emory University and an Amazon Research Award recipient, wants to transform healthcare.

Gari Clifford is an academic who keeps his eyes fixed on real-world problems. His work in machine learning and signal processing is centered on improving some of the world's most burdensome and overlooked healthcare issues.

Clifford, now the tenured chair of the Department of Biomedical Informatics at Emory University and a professor of Biomedical Engineering at Georgia Institute of Technology, got his start in theoretical physics. But near the end of his master’s degree in the mid 90’s, his interests began to change. Conway’s Game of Life spurred him to think about ways to actually measure complex biological systems. Neural networks seemed like the most reasonable answer.

Finding a group working on neural networks in the ‘90s wasn’t easy. But once he made his way to Oxford in 1998, where he pursued a biomedical engineering PhD, Clifford found himself learning and working at the epicenter of British artificial intelligence. He gained steady experience — not just in building neural networks, but also in processing the data properly.

Oxford is also where Clifford “became profoundly interested in solving real-world problems.” At first, his research focused on using machine learning to predict cardiovascular events and critical care needs in hospitals. “That’s where all the data was,” he explains.

Transforming healthcare

After graduate school, Clifford started to get excited about new areas, particularly neuropsychiatry and maternal-fetal health.

“These were the biggest areas where I could have the biggest effect,” Clifford said. “And they’ll have the biggest effect in low- to middle-income countries, which is where I’m most interested in making a difference.”

Edge machine learning is going to transform healthcare.
Gari Clifford

He’s since held research and faculty positions at MIT, Oxford, and more recently Emory and Georgia Tech, the latter two because he wanted to be more embedded in healthcare systems. He describes his lab as “applying machine learning to whatever problems doctors come up with.” But, he explains, his “secret agenda,” is to see it change healthcare entirely. And for that to happen, edge machine learning — machine learning done in real time and on edge devices — is the key, he said.

“Edge machine learning is going to transform healthcare,” Clifford predicts. Rather than processing data in the cloud, edge machine learning relies on smart devices that use deep machine learning algorithms to process data locally and in real time.

The cloud is still essential to collect the initial data and train the model. Scaling this work requires a large vendor like AWS, Clifford said. Only once the ML model is trained on the cloud can it then be run off the edge sensors in real time. Edge sensors continue to update the model locally, and the data only needs to be pushed to the cloud periodically to prevent model drift and share local updates across all sensors. “The models are much smaller than the data,” Clifford said. “So not only does this reduce the energy and bandwidth needed, but it can preserve the privacy of the patient.”

Monitoring patient environments

Currently, the Clifford Lab — now in its twelfth year and supporting 12 graduate students and six postdoctoral scholars — is using edge machine learning to monitor patient environments. While today’s healthcare system doesn’t ignore a patient’s social support system, such as their interactions with friends, relatives or care providers, it also doesn’t record them, Clifford explained.

A complete picture of an individual’s support system could inform their care, he adds. For instance, decreased interaction with others, changes in their social circle or word choices, and decreased daily travel can all indicate a worsening of the patient’s condition. And they can be easily measured with a smartphone app running edge technology. This strategy is particularly important for the maternal and neuropsychiatry patient populations Clifford is working with, because “traditional healthcare is quite limited for these patient groups,” he said.

In 2018, Clifford received an Amazon Machine Learning Research Award for this work. The funding from Amazon allowed Clifford’s team to develop prototypes and partially funded two PhD students working on the project. They developed audio and Bluetooth algorithms that can run on Raspberry Pis to track who is going in and out of a patient’s hospital care environment. Using the audio and Bluetooth data as a diagnostic tool, the team hopes to understand whether a patient is degenerating quickly and what might be the cause.

“Based on the data, maybe we can come up with interventions — like a sleep intervention — that would reduce deterioration,” Clifford said.

“We started by developing [this technology] for in-hospital use because it allows for rapid development. The hospital is like an experimental environment that's easier to control. It’s much more difficult to do that in someone's home,” he added. But that’s the direction in which his team is moving.

Helping patients stay at home longer

One project Clifford’s group is working on uses the same Raspberry Pis with added sensors to monitor patients with a range of neuropsychiatry issues, including schizophrenia, Alzheimer’s, mild cognitive impairment, Parkinson’s disease, and postpartum depression.

Zifan Jiang, a PhD candidate in machine learning and graduate research assistant at Emory University, is seen here testing a device while wearing sterile gloves and a mask.
Zifan Jiang, a PhD candidate in machine learning and graduate research assistant at Emory University, is seen here testing a device in the Clifford Lab.
Courtesy of Gari Clifford

The strategy is to deploy Raspberry Pi devices in these patients’ home environments to monitor their interactions, movement and who comes and goes. Monitoring and managing the patient environment — such as how often they see a healthcare provider, their sleeping patterns, or how often they communicate with others — could help patients live in their homes longer (as opposed to hospitalization) and improve quality of life, Clifford said.

Most importantly for Clifford, the low cost of the tiny Raspberry Pi devices means this strategy is cost-effective. It can be rapidly scaled and deployed in middle- and low-income countries, places where mental and maternal health create an enormous burden but go largely unmanaged.

“It’s an exciting phase,” Clifford said. But many challenges are ahead, like acceptance of the technology. “As we expand sensors and tech, people are obviously concerned about privacy,” he noted. A 2019 study by Pega found that only 30% of respondents felt comfortable with businesses that use artificial intelligence to interact with them.

The importance of developing with inclusivity

As this technology develops, it’s critical to pull underrepresented groups into the process, Clifford explains. Artificial intelligence as an industry tends to be very homogeneous, he notes, and building trust will require that people from different cultures and backgrounds have a hand in its development.

Comfort levels with this technology are not likely to be any higher in the healthcare realm. “There is systemic distrust of this kind of technology, especially in disparity populations,” Clifford said. “And a history of the medical research community exploiting minority populations.”

Clifford’s lab invests significant time trying to build that trust.

In a collaboration with the Morehouse School of Medicine, the team built an app with Amazon Web Services (AWS), leveraging cloud-based computing and infrastructure resources to measure young African Americans’ exposure to different factors that affect cardiovascular disease, such as exercise, healthy food, and air pollution. Community engagement leaders in Atlanta facilitated the data collection, and several interested community members were trained and brought on to the development team. The aim is “to build the infrastructure for them and with them,” Clifford said. The app has just been made open source and “the hope is we have built a substrate the community could build companies out of.”

[The midwives] have fully taken ownership, and they don’t need us anymore. That was the best end result I’ve had with my research, ever.
Gari Clifford

In Guatemala, a midwife organization Clifford’s group has been collaborating with to predict maternal-fetal health outcomes has completely taken ownership of the technology. The strategy collects inputs like low-cost ultrasound data and pictures of daily blood pressure, and the data, once computed via AWS (Clifford’s team utilized AWS tools like Elastic Cloud Compute, Elastic Load Balancing, Relational Database Service, and GuardDuty, among others) can help predict fetal health.

Next up, Clifford is in search of funding to put that algorithm on the ultrasound device so the computing can be done locally. But in the meantime, the midwives have adopted the technology as the standard of care and reported that they hadn’t lost a single patient in the deployment area over last year.

“They have fully taken ownership, and they don’t need us anymore,” Clifford said. “That was the best end result I’ve had with my research, ever.”

Related content

CA, BC, Vancouver
Machine learning (ML) has been strategic to Amazon from the early years. We are pioneers in areas such as recommendation engines, product search, eCommerce fraud detection, and large-scale optimization of fulfillment center operations. The Amazon ML Solutions Lab team helps AWS customers accelerate the use of machine learning to solve business and operational challenges and promote innovation in their organization. We are looking for a passionate, talented, and inventive Applied Scientist with a strong machine learning background to help develop solutions by pushing the envelope in Time Series, Automatic Speech Recognition (ASR), Natural Language Understanding (NLU), Machine Learning (ML) and Computer Vision (CV).Inclusive Team Culture Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Work/Life Balance Our team puts a high value on work-life balance. It isn’t about how many hours you spend at home or at work; it’s about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives. Mentorship & Career Growth Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we’re building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future. As a ML Solutions Lab Applied Scientist, you are proficient in designing and developing advanced ML models to solve diverse challenges and opportunities. You will be working with terabytes of text, images, and other types of data and develop novel models to solve real-world problems. You'll design and run experiments, research new algorithms, and find new ways of optimizing risk, profitability, and customer experience. You will apply classical ML algorithms and cutting-edge deep learning (DL) approaches to areas such as drug discovery, customer segmentation, fraud prevention, capacity planning, predictive maintenance, pricing optimization, call center analytics, player pose estimation, and event detection among others. The primary responsibilities of this role are to: Design, develop, and evaluate innovative ML/DL models to solve diverse challenges and opportunities across industriesInteract with customer directly to understand their business problems, and help them with defining and implementing scalable ML/DL solutions to solve themWork closely with account teams, research scientist teams, and product engineering teams to drive model implementations and new algorithmsThis position requires travel of up to 20%.
US, WA, Seattle
Are you a Ph.D. interested in the fields of machine learning, deep learning, automated reasoning, speech, robotics, computer vision, optimization, or quantum computing? Do you enjoy diving deep into hard technical problems and coming up with solutions that enable successful products that improve the lives of people in a meaningful way? If this describes you, come join our science teams at Amazon. As an Applied Scientist, you will have access to large datasets with billions of images and video to build large-scale systems. Additionally, you will analyze and model terabytes of text, images, and other types of data to solve real-world problems and translate business and functional requirements into quick prototypes or proofs of concept. We are looking for smart scientists capable of using a variety of domain expertise to invent, design, evangelize, and implement state-of-the-art solutions for never-before-solved problems.
US, WA, Seattle
Amazon internships are full-time (40 hours/week) for 12 consecutive weeks with start dates in May - July 2023. Our internship program provides hands-on learning and building experiences for students who are interested in a career in hardware engineering. This role will be based in Seattle, and candidates must be willing to work in-person.Corporate Projects (CPT) is a team that sits within the broader Corporate Development organization at Amazon. We seek to bring net-new, strategic projects to life by working together with customers and evolving projects from ZERO-to-ONE. To do so, we deploy our resources towards proofs-of-concept (POCs) and pilot programs and develop them from high-level ideas (the ZERO) to tangible short-term results that provide validating signal and a path to scale (the ONE). We work with our customers to develop and create net-new opportunities by relentlessly scouring all of Amazon and finding new and innovative ways to strengthen and/or accelerate the Amazon Flywheel.CPT seeks an Applied Science intern to work with a diverse, cross-functional team to build new, innovative customer experiences. Within CPT, you will apply both traditional and novel scientific approaches to solve and scale problems and solutions. We are a team where science meets application. A successful candidate will be a self-starter comfortable with ambiguity, strong attention to detail, and the ability to work in a fast-paced, ever-changing environment. As an Applied Science Intern, you will own the design and development of end-to-end systems. You’ll have the opportunity to create technical roadmaps, and drive production level projects that will support Amazon Science. You will work closely with Amazon scientists, and other science interns to develop solutions and deploy them into production. The ideal scientist must have the ability to work with diverse groups of people and cross-functional teams to solve complex business problems.
US, IL, Chicago
MULTIPLE POSITIONS AVAILABLECompany: AMAZON.COM SERVICES LLCPosition Title: Data Scientist ILocation: Chicago, IllinoisPosition Responsibilities:Build the core intelligence, insights, and algorithms that support the real estate acquisition strategies for Amazon physical stores. Tackle cutting-edge, complex problems such as predicting the optimal location for new Amazon stores by bringing together numerous data assets, and using best-in-class modeling solutions to extract the most information out of them. Work with business stakeholders, software development engineers, and other data scientists across multiple teams to develop innovative solutions at massive scale.Amazon.com is an Equal Opportunity-Affirmative Action Employer – Minority / Female / Disability / Veteran / Gender Identity / Sexual Orientation #0000
US, WA, Seattle
Note that this posting is for a handful of teams within Amazon Robotics. Teams include: Robotics, Computer Vision, Machine Learning, Optimization, and more.Are you excited about building high-performance robotic systems that can perceive and learn to help deliver for customers? The Amazon Robotics team is creating new science products and technologies that make this possible, at Amazon scale. We work at the intersection of computer vision, machine learning, robotic manipulation, navigation, and human-robot interaction.Amazon Robotics is seeking broad, curious applied scientists and engineering interns to join our diverse, full-stack team. In addition to designing, building, and delivering end-to-end robotic systems, our team is responsible for core infrastructure and tools that serve as the backbone of our robotic applications, enabling roboticists, applied scientists, software and hardware engineers to collaborate and deploy systems in the lab and in the field. We will give you the tools and support you need to invent with us in ways that are rewarding, fulfilling and fun. Come join us!A day in the lifeAs an intern you will develop a new algorithm to solve one of the challenging computer vision and manipulation problems in Amazon's robotic warehouses. Your project will fit your academic research experience and interests. You will code and test out your solutions in increasingly realistic scenarios and iterate on the idea with your mentor to find the best solution to the problem.
US, WA, Seattle
Are you excited about building high-performance robotic systems that can perceive, learn, and act intelligently alongside humans? The Robotics AI team is creating new science products and technologies that make this possible, at Amazon scale. We work at the intersection of computer vision, machine learning, robotic manipulation, navigation, and human-robot interaction.The Amazon Robotics team is seeking broad, curious applied scientists and engineering interns to join our diverse, full-stack team. In addition to designing, building, and delivering end-to-end robotic systems, our team is responsible for core infrastructure and tools that serve as the backbone of our robotic applications, enabling roboticists, applied scientists, software and hardware engineers to collaborate and deploy systems in the lab and in the field. Come join us!
US, WA, Bellevue
Employer: Amazon.com Services LLCPosition: Research Scientist IILocation: Bellevue, WA Multiple Positions Available1. Research, build and implement highly effective and innovative methods in Statistical Modeling, Machine Learning, and other quantitative techniques such as operational research and optimization to deliver algorithms that solve real business problems.2. Take initiative to scope and plan research projects based on roadmap of business owners and enable data-driven solutions. Participate in shaping roadmap for the research team.3. Ensure data quality throughout all stages of acquisition and processing of the data, including such areas as data sourcing/collection, ground truth generation, data analysis, experiment, evaluation and visualization etc.4. Navigate a variety of data sources, understand the business reality behind large-scale data and develop meaningful science solutions.5. Partner closely with product or/and program owners, as well as scientists and engineers in cross-functional teams with a clear path to business impact and deliver on demanding projects.6. Present proposals and results in a clear manner backed by data and coupled with conclusions to business customers and leadership team with various levels of technical knowledge, educating them about underlying systems, as well as sharing insights.7. Perform experiments to validate the feature additions as requested by domain expert teams.8. Some telecommuting benefits available.The pay range for this position in Bellevue, WA is $136,000-$184,000 (yr); however, base pay offered may vary depending on job-related knowledge, skills, and experience. A sign-on bonus and restricted stock units may be provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits, dependent on the position offered. This information is provided by the Washington Equal Pay Act. Base pay information is based on market location. Applicants should apply via Amazon's internal or external careers site.#0000
US, VA, Arlington
The Central Science Team within Amazon’s People Experience and Technology org (PXTCS) uses economics, behavioral science, statistics, and machine learning to proactively identify mechanisms and process improvements which simultaneously improve Amazon and the lives, well-being, and the value of work to Amazonians. We are an interdisciplinary team, which combines the talents of science and engineering to develop and deliver solutions that measurably achieve this goal. As Director for PXT Central Science Technology, you will be responsible for leading multiple teams through rapidly evolving complex demands and define, develop, deliver and execute on our science roadmap and vision. You will provide thought leadership to scientists and engineers to invent and implement scalable machine learning recommendations and data driven algorithms supporting flexible UI frameworks. You will manage and be responsible for delivering some of our most strategic technical initiatives. You will design, develop and operate new, highly scalable software systems that support Amazon’s efforts to be Earth’s Best Employer and have a significant impact on Amazon’s commitment to our employees and communities where we both serve and employ 1.3 million Amazonians. As Director of Applied Science, you will be part of the larger technical leadership community at Amazon. This community forms the backbone of the company, plays a critical role in the broad business planning, works closely with senior executives to develop business targets and resource requirements, influences our long-term technical and business strategy, helps hire and develop engineering leaders and developers, and ultimately enables us to deliver engineering innovations.This role is posted for Arlington, VA, but we are flexible on location at many of our offices in the US and Canada.
US, VA, Arlington
Employer: Amazon.com Services LLCPosition: Data Scientist IILocation: Arlington, VAMultiple Positions Available1. Manage and execute entire projects or components of large projects from start to finish including data gathering and manipulation, synthesis and modeling, problem solving, and communication of insights and recommendations.2. Oversee the development and implementation of data integration and analytic strategies to support population health initiatives.3. Leverage big data to explore and introduce areas of analytics and technologies.4. Analyze data to identify opportunities to impact populations.5. Perform advanced integrated comprehensive reporting, consultative, and analytical expertise to provide healthcare cost and utilization data and translate findings into actionable information for internal and external stakeholders.6. Oversee the collection of data, ensuring timelines are met, data is accurate and within established format.7. Act as a data and technical resource and escalation point for data issues, ensuring they are brought to resolution.8. Serve as the subject matter expert on health care benefits data modeling, system architecture, data governance, and business intelligence tools. #0000
US, TX, Dallas
Employer: Amazon.com Services LLCPosition: Data Scientist II (multiple positions available)Location: Dallas, TX Multiple Positions Available:1. Assist customers to deliver Machine Learning (ML) and Deep Learning (DL) projects from beginning to end, by aggregating data, exploring data, building and validating predictive models, and deploying completed models to deliver business impact to the organization;2. Apply understanding of the customer’s business need and guide them to a solution using AWS AI Services, AWS AI Platforms, AWS AI Frameworks, and AWS AI EC2 Instances;3. Use Deep Learning frameworks like MXNet, PyTorch, Caffe 2, Tensorflow, Theano, CNTK, and Keras to help our customers build DL models;4. Research, design, implement and evaluate novel computer vision algorithms and ML/DL algorithms;5. Work with data architects and engineers to analyze, extract, normalize, and label relevant data;6. Work with DevOps engineers to help customers operationalize models after they are built;7. Assist customers with identifying model drift and retraining models;8. Research and implement novel ML and DL approaches, including using FPGA;9. Develop computer vision and machine learning methods and algorithms to address real-world customer use-cases; and10. Design and run experiments, research new algorithms, and work closely with engineers to put algorithms and models into practice to help solve customers' most challenging problems.11. Approximately 15% domestic and international travel required.12. Telecommuting benefits are available.#0000