Zhen Wang / 王震
Hi! I'm Zhen, currently a postdoctoral researcher at UC San Diego, working with Prof. Zhiting Hu and Prof. Eric P. Xing. I earned my PhD from The Ohio State University, advised by Prof. Huan Sun. I have the privilege of working closely with leading research teams at UCSD, CMU, and MBZUAI.
My research focuses on machine learning and natural language processing, developing adaptive and reliable AI systems that enhance human productivity and creativity.
When I’m tired of chatting with ChatGPT, you’ll likely find me outdoors. I love hiking, playing pickleball, taking road trips, and visiting national parks whenever possible. I’m also a passionate sports fan, cheering for the Buckeyes, Dodgers, Lakers, Inter Miami, and Chiefs (at least for now!).
Email /
GitHub /
Twitter /
Google Scholar
|
At a rooftop in Anchorage, Alaska 2019
|
Research Overview
My research revolves around the interplay between World Models and Language Models, advancing the frontier of machine reasoning and self-optimization. By enhancing LMs with WMs and enabling them to self-improve, I aim to create AI systems that proactively assist both non-experts and experts in tackling real-world challenges, especially in scientific discovery. Specifically, my research answers the following questions with systematic and principled approaches.
-
World Model and Language Model (WMxLM): WMs form the cornerstone of next-generation foundation models. How can we enable the next-generation reasoning of LMs with WM formulation? How to leverage STOA LMs as the foundation to build more powerful WMs? How to integrate WMs into LMs to simulate (domain-specific) complex environments and reliably predict the future?
-
Self-Optimized Language Model Systems: How can LMs dynamically optimize and adapt their behavior in real-time? How can an LM reflect on its own errors and optimize itself on the fly? How to optimize LMs during inference time, maybe with the help of WMs? How to self-optimize the model within a multi-agent system?
-
AI-Accelerated Scientific Discovery: How can AI systems, particularly agentic LMs augmented with World Models and self-optimization, accelerate breakthroughs in scientific research? How to build scientific agentic systems to boost scientists' research productivity? How to generate and validate highly-plausible scientific hypotheses? How to build more powerful scientific foundation or world models?
Research Opportunities: I consistently seek out highly motivated students, particularly from underrepresented groups, to join me in various research projects both during the school year and throughout the summer. If you are interested in LLM augmentation (reasoning, tool-using, planning, etc), LLM agents, and AI4Science research, kindly email me expressing your interest.
|
News
-
10/2024: Excited to release Decentralized Arena, a decentralized and democratic LLM benchmarking system, where all LLMs participating in judging each other. It's an automated, fully transparent, faster, more scalable, and less biased version of Chatbot Arena. Check our HF leaderboard.
-
10/2024: Happy to help release the TxT360: A Top-Quality LLM Pre-training Dataset Requires the Perfect Blend. It is the first dataset to globally deduplicate 99 CommonCrawl snapshots and 14 high-quality data sources. Download the dataset for your LLM pre-training here.
-
09/2024: DRPO (Dynamic Rewarding with Prompt Optimization) was accepted to the main conference of EMNLP 2024. It is the first tuning-free method to self-align LLMs with human preferences, without any model tuning or human preference annotations.
-
07/2024: Excited to be selected to attend 2024 AI+Science Summer School at the University of Chicago!
-
07/2024: LLM Reasoners has been accepted to COLM 2024. Congrats to the LLM Reasoners team. Check out our brilliant +1k stars GitHub package for advanced reasoning with LLMs!
-
02/2024: Received a research grant from OpenAI to support our research in agentic systems!
-
01/2024: Wrote a blog, Reflecting on ChatGPT’s First Year: Evolutions, Twists, and Smooth Directions, discussing recent NLP research directions heavily impacted by ChatGPT-related techniques. Welcome to any comments!
-
01/2024: Invited to serve as a Reviewer for KDD 2024, ICML 2024, and COLM 2024 (The first conference on language modeling! Happy to contribute to making this a success!)
-
01/2024: PromptAgent was accepted to ICLR 2024! The first principled framework to formalize the problem of API-based discrete prompt optimization and benchmark the exploration efficiency and prompt transferability!
-
12/2024: Attended NeurIPS 2023 at NOLA! Happy to meet many old and new friends!
-
11/2023: Honored to receive the Top Reviewer Award of NeurIPS 2023. Thanks for the complimentary registration!
-
11/2023: Honored to receive the Best Paper Award at SoCal NLP 2023.
-
11/2023: Three papers, RAP, ToolkenGPT, and PromptAgent, will be presented at SoCal NLP 2023 at UCLA on Nov. 17th, 2023.
-
10/2023: Reasoning via Planning has been featured in the recently published State of AI Report 2023. Check the great report here!
-
10/2023: Reasoning via Planning paper that augments LLM reasoning with external world models and principled planning was accepted to the main conference of EMNLP 2023!
-
09/2023: ToolkenGPT paper that augments LLMs with efficient and plug-and-play tool learning was accepted as an oral presentation of NeurIPS 2023!
-
08/2023: Invited to serve as a Reviewer for ICLR 2024.
-
07/2023: Invited to serve as a PC member for AAAI 2024.
-
06/2023: Invited to give a talk at George Mason University on June 13th, 2023.
-
06/2023: Invited to give a talk at North Carolina State University on June 3rd, 2023.
-
06/2023: Invited to serve as a Reviewer for EMNLP 2023.
-
05/2023: One paper about prompting LLMs with probabilistic reasoning was accepted to ACL 2023!
-
03/2023: Invited to serve as a Reviewer for NeurIPS 2023.
-
03/2023: Invited to serve as an Area Chair for NLPCC 2023.
-
02/2023: Kicked off my postdoc adventure! 😎 Super stoked to work with the brilliant minds from UCSD, CMU, MBZUAI, and beyond to push the boundaries of those incredible large language models and harness their power for human society and other scientific domains! 🚀🔬💡
-
01/2023: One paper, Multitask Prompt Tuning, was accepted to ICLR 2023!
-
01/2023: One paper, Entity Tracking via Effective Use of Multi-Task Learning Models, was accepted to EACL 2023!
-
01/2023: Invited to serve as a Reviewer for ICML 2023.
-
12/2022: Invited to serve as a PC Member for KDD 2023 Research Track.
-
12/2022: Happy to finish my first in-person NLP course teaching, and I'm impressed by what students have achieved after learning the very advanced NLP techniques. Check out this quick summary of their amazing final projects!
-
11/2022: Passed the Ph.D. dissertation defense, Toward Knowledge-centric Natural Language Processing: Acquisition, Representation, Transfer, and Reasoning. Thanks to all my committee members, Prof. Huan Sun, Srinivasan Parthasarathy, Yu Su, and Wei-Lun Chao.
-
08/2022: Will be teaching CSE 5525: Foundations of Speech and Language Processing (Undergrad & Graduate) as an instructor at OSU this fall.
-
08/2022: Invited to serve as a PC member for AAAI 2023.
-
07/2022: Attended NAACL 2022 in Seattle. Presented our CQA Knowledge Transfer paper. Glad to meet all my old and new friends!
-
06/2022: Invited to serve as a PC member for EMNLP 2022.
-
06/2022: Happy to give a talk about Efficient Adaptation of Large Language Models at the MIT Summer Working Group on Large LMs.
-
06/2022: Our TacoBot earned the third-place honor in the inaugural Alexa Prize TaskBot Challenge!
-
06/2022: Happy to give a tutorial about natural language processing and large language models in TDAI Deep Learning Summer School along with Prof. Huan Sun. Slides can be found here.
-
05/2022: Excited to join MIT-IBM Watson AI Lab in Cambridge, Boston as a research intern working with Rameswar Panda and Yoon Kim on efficient adaptation/pruning for large language models.
-
03/2022: Our team TacoBot moved forward to finals of the Alexa Prize TaskBot challenge!
-
03/2022: Honored to receive the 2022 Graduate Research Award of the CSE department.
-
02/2022: One paper, Coherence boosting: When your pretrained language model is not paying enough attention, was accepted to ACL 2022!
-
02/2022: Our team TacoBot moved forward to the semifinals of the Alexa Prize TaskBot challenge! Try "Alexa, let's work together" or "Alexa, assist me" in your Alexa devices or the app when you want to do a DIY or cooking task!
-
12/2021: Passed the Ph.D. candidacy exam with the proposal, "Knowledge-centric Natural Language Processing: Acquisition, Representation, and Reasoning." Thanks to all my committee members, Prof. Huan Sun, Srinivasan Parthasarathy, Yu Su, and Wei-Lun Chao.
-
05/2021: Our team was selected to participate in the Alexa Prize TaskBot Challenge as one of 10 teams over 125 applications initiated from 15 countries! Looking forward to building a smart dialogue system to guide users through complex, multi-step plans (e.g., Cooking and DIY tasks) via multimodal interactions.
-
05/2021: Started Research Intern at Microsoft Research! Excited to work with Nebojsa Jojic and Kolya Malkin on Conditional Text Generation!
-
03/2021: Invited to serve as a PC member of EMNLP 2021.
-
03/2021: Attended WSDM 2021 virtually and presented our work on modeling context pair interaction and learning graph pair emebddings.
-
03/2021: Honored to win Graduate Student Research Poster Award (Top 5) for the 2021 Annual Student Research Poster Exhibition in our CSE department.
-
02/2021: Panelist on the panel discussion in Department of Astronomy, "2001: A Space Odyssey - Science Fiction vs. Science Fact", discussing Science Fiction, Life in Universe, Time & Relativity and Anthropology.
-
01/2021: Received SIGIR Student Travel Grant for WSDM 2021.
-
01/2021: Attended CDAC Rising Stars in Data Science Workshop with the agenda here.
-
12/2020: Honored to be selected to the Rising Stars in Data Science workshop hosted by the Center for Data and Computing (CDAC) at the University of Chicago.
-
12/2020: Invited to serve as a PC member of ACL 2021.
-
10/2020: Invited to serve as a PC member of NAACL 2021.
-
10/2020: One paper, Modeling Context Pair Interaction for Pairwise Tasks on Graphs, was accepted to WSDM 2021 (Acceptance Rate: 18.6%).
-
07/2020: Attended ACL 2020 virtually and presented our paper via QA sessions and pre-recorded video.
-
05/2020: Started Research Intern at NEC Labs America! Excited to work with Dr. Bo Zong on Commonsense Reasoning for NLU.
-
04/2020: One paper, Rationalizing Medical Relation Prediction from Corpus-level Statistics, about building self-interpretable deep learning model for relation prediction was accepted by ACL 2020 (Acceptance Rate: 22.7%).
-
04/2020: Invited to serve as a PC member of NLPCC 2020.
-
09/2019: One paper, Graph Embedding on Biomedical Networks: Methods, Applications, and Evaluations, was accepted by Bioinformatics.
-
08/2019: Attended KDD 2019 in Anchorage, Alaska, and presented our work in an oral talk.
-
06/2019: Received SIGKDD Student Travel Award for KDD 2019.
-
04/2019: One paper, SurfCon: Synonym Discovery on Privacy-Aware Clinical Data, about knowledge extraction from text was accepted by KDD 2019 (Research Track, Acceptance Rate: 14.2%, Oral).
-
08/2018: One paper about Code Summarization was accepted by KDD 2018, Deep Learning Day.
-
06/2018: Attended NAACL 2018 in New Orleans, LA.
|
|