Customer-obsessed science
Research areas
-
October 12, 202614 min read“Priming” reuses pretrained Transformer weights to build models with more efficient architectures at less than 1% of the original training cost and with throughputs up to twice as high.
-
-
-
August 21, 20269 min read
-
July 30, 20268 min read
Featured news
-
NeurIPS 20212021For supervised learning with tabular data, decision tree ensembles produced via boosting techniques generally dominate real-world applications involving iid training/test sets. However for graph data where the iid assumption is violated due to structured relations between samples, it remains unclear how to best incorporate this structure within existing boosting pipelines. To this end, we propose a generalized
-
NeurIPS 2021 Workshop on Efficient Natural Language and Speech Processing2021Training neural machine translation (NMT) models in federated learning (FL) settings could be inefficient both computationally and communication-wise, due to the large size of translation engines as well as the multiple rounds of updates required to train clients and a central server. In this paper, we explore how to efficiently build NMT models in an FL setup by proposing a novel solution. In order to
-
Physical Review X2021While designing the energy-momentum relation of photons is key to many linear, nonlinear, and quantum optical phenomena, a new set of light-matter properties may be realized by employing the topology of the photonic bath itself. In this work we experimentally investigate the properties of superconducting qubits coupled to a metamaterial waveguide based on a photonic analog of the Su-Schrieffer-Heeger model
-
Kronecker factorization for preventing catastrophic forgetting in large-scale medical entity linkingNeurIPS 2021 Workshop on Machine Learning in Public Health2021Multi-task learning is useful in NLP because it is often practically desirable to have a single model that works across a range of tasks. In the medical domain, sequential training on tasks may sometimes be the only way to train models, either because access to the original (potentially sensitive) data is no longer available, or simply owing to the computational costs inherent to joint retraining. A major
-
ICCV 2021 Workshop on the 1st Video Scene Parsing in the Wild Challenge2021Semantic segmentation is a challenging problem due to difficulties in modeling context in complex scenes and class confusions along boundaries. Most literature either focuses on context modeling or boundary refinement, which is less generalizable in open-world scenarios. In this work, we advocate a unified framework (UN-EPT) to segment objects by considering both context information and boundary artifacts
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all