Publications

Pre-trained Gaussian processes for Bayesian optimization

Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zachary Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

Journal of Machine Learning Research (JMLR), 2024
Blog PDF Code

Transfer Learning for Bayesian Optimization on Heterogeneous Search Spaces

Zhou Fan, Xinran Han, Zi Wang

Transactions on Machine Learning Research (TMLR), 2024
PDF Code

REDUCR: Robust Data Downsampling Using Class Priority Reweighting

William Bankes, George Hughes, Ilija Bogunovic, Zi Wang

arXiv:2312.00486 [cs.LG], 2023
PDF

Gaussian Process Probes (GPP) for Uncertainty-Aware Probing

Zi Wang*, Alexander Ku*, Jason Baldridge, Thomas L. Griffiths, Been Kim

Advances in Neural Information Processing Systems (NeurIPS), 2023
PDF Code

Grammar Prompting for Domain-Specific Language Generation with Large Language Models

Bailin Wang, Zi Wang, Xuezhi Wang, Yuan Cao, Rif A. Saurous, Yoon Kim

Advances in Neural Information Processing Systems (NeurIPS), 2023
PDF Code

Plex: Towards Reliability using Pretrained Large Model Extensions

Dustin Tran, Jeremiah Zhe Liu, Michael W Dusenberry, Du Phan, Mark Collier, Jie Ren, Kehang Han, Zi Wang, Zelda E Mariet, Huiyi Hu, Neil Band, Tim G. J. Rudner, Zachary Nado, Joost van Amersfoort, Andreas Kirsch, Rodolphe Jenatton, Nithum Thain, E. Kelly Buchanan, Kevin Patrick Murphy, D. Sculley, Yarin Gal, Zoubin Ghahramani, Jasper Snoek, Balaji Lakshminarayanan

arXiv:2207.07411 [cs.LG]; ICML2022 Workshop on Pre-Training and ICML2022 Workshop on Principles of Distribution Shift, 2022
Blog PDF Code Short version

Towards Learning Universal Hyperparameter Optimizers with Transformers

Yutian Chen, Xingyou Song, Chansoo Lee, Zi Wang, Qiuyi Zhang, David Dohan, Kazuya Kawakami, Greg Kochanski, Arnaud Doucet, Marc'aurelio Ranzato, Sagi Perel, Nando de Freitas

Advances in Neural Information Processing Systems (NeurIPS), 2022
Blog PDF Code

HyperBO+: Pre-training a universal hierarchical Gaussian process prior for Bayesian optimization

Zhou Fan, Xinran Han, Zi Wang

NeurIPS Workshop on Gaussian Processes, Spatiotemporal Modeling, and Decision-making Systems, 2022
PDF Poster

Pre-training helps Bayesian optimization too

Zi Wang, George E. Dahl, Kevin Swersky, Chansoo Lee, Zelda Mariet, Zachary Nado, Justin Gilmer, Jasper Snoek, Zoubin Ghahramani

ICML2022 Workshop on Adaptive Experimental Design and Active Learning in the Real World, 2022
PDF Code Slides

Learning compositional models of robot skills for task and motion planning

Zi Wang*, Caelan Reed Garrett*, Leslie Pack Kaelbling, Tomás Lozano-Pérez

International Journal of Robotics Research (IJRR), 2021
Project page PDF Code

Deep Uncertainty and the Search for Proteins

Zelda Mariet, Ghassen Jerfel, Zi Wang, Christof Angermüller, David Belanger, Suhani Vora, Maxwell Bileschi, Lucy Colwell, D Sculley, Dustin Tran, Jasper Snoek

Machine Learning for Molecules Workshop at NeurIPS 2020, 2020
PDF