Zhen Wang / 王震

Hi! I'm a postdoctoral researcher working with Prof. Eric Xing from CMU/MBZUAI and Prof. Zhiting Hu from UCSD. My research interests lie in natural language processing and machine learning. I received my PhD from The Ohio State University, advised by Prof. Huan Sun.

In summer 2022, I interned at MIT-IBM Watson AI Lab working with Rameswar, Yoon, Leonid, and Rogerio on efficient adaptation of large language models. In summer 2021, I was a research intern at the NLP group in Microsoft Research, Redmond, working with Nebojsa and Kolya, studying coherence boosting and prompting calibration on GPT-3. In summer 2020, I was a research intern at the Data Science team in NEC Labs America working with Bo Zong, exploring commonsense knowledge representation and reasoning.

Email  /  CV (Feb 2023)  /  GitHub  /  Twitter  /  Google Scholar

Research Overview

My research is rooted in human-centered AI with the aim to infuse machine learning models, especially foundation models, with a human-like understanding of the world and knowledge to enable AI as both a reliable assistant and an insightful collaborator. I believe future AI systems need to not only augment human capabilities but also resonate with human values, understandings, accessibility, and proactive problem-solving. My ultimate goal is not to build AI that merely replicates or replaces human abilities, but to develop systems that enrich human experiences, amplify human potential, honor human values, and actively collaborate with humans in addressing real-world challenges.

1. Interpreting and steering ML models towards human values: Transparency is key in human-centered AI. I develop methodologies to unlock the black box to enhance our understanding of their behavior, and ensure they align with human values via more robust control and prompting techniques. [ACL 2020] [ACL 2022] [ACL 2023] [New preprint]
2. Adapting and transferring knowledge for dynamic human needs: Human-centered AI demands AI systems that can swiftly adapt and learn in response to the changing needs and circumstances of its human users. I develop efficient methods to transfer knowledge between AI systems and adapt them across diverse tasks and domains for greater accessibility. [ICLR 2023] [NAACL SUKI 2022] [EACL 2023]
3. Augmenting models to proactively solve real-world problems for humans: An active problem-solving drive is a distinctive trait of human intelligence. I aim to elevate AI systems from passive respondents into proactive problem solvers by interacting with the physical world and novel domains. [New preprint] [New preprint]

Research Opportunities: I consistently seek out highly motivated students, particularly from underrepresented groups, to join me in various research projects both during the school year and throughout the summer. If you are eager to enhance your research abilities and be a part of this exciting opportunity, kindly email me expressing your interest.

News

Publications

Preprint

Reasoning with Language Model is Planning with World Model

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings

GPT Is Becoming a Turing Machine: Here Are Some Ways to Program It

2023

ThinkSum: Probabilistic Reasoning Over Sets Using Large Language Models

We propose a two-stage probabilistic inference paradigm, ThinkSum, to improve LLMs' abilities of reasoning over multiple objects in two steps, Think (e.g., retrieval of associations) and Sum (e.g., aggregation of results), which beats chain-of-thought prompting in hard BIG-bench tasks.

Multitask Prompt Tuning Enables Parameter-Efficient Transfer Learning

We propose Multitask Prompt Tuning (MPT) to exploit the rich cross-task knowledge for more efficient and generalizable transfer learning. MPT learns a single trasnferrable soft prompt through the use of a novel combination of prompt decomposition and prompt distillation.

Entity Tracking via Effective Use of Multi-Task Learning Models

How to transfer multi-task knowledge from pre-training to niche downstream tasks, such as entity tracking on the procedural text? We show that you can reach STOA performance by simply fine-tuning T5 but with specialized QA prompt and task-specific decoding.

2022

Toward Knowledge-Centric NLP: Acquisition, Representation, Transfer, and Reasoning

Coherence Boosting: When Your Pretrained Language Model is Not Paying Enough Attention

We demonstrate that large language models have insufficiently learned the effect of distant words on next-token prediction. We present Coherence Boosting, an inference procedure that increases a LM’s focus on a long context, which gets huge improvement on NLG and NLU tasks.

Knowledge Transfer between Structured and Unstructured Sources for Complex Question Answering

We study knowledge transfer for multi-hop reasoning processes between structured (Knowledge Base) and unstructred (text corpus) knowledge. We design SimultQA unifying KBQA and TextQA systems and leverage it to study how the reasoning is transferred between two knowledge sources.

2021

Bootstrapping a User-Centered Task-Oriented Dialogue System

We build TacoBot, a task-oriented dialogue system for the inaugural Alexa Prize TaskBot Challenge to assist users in multi-step cooking and home improvement tasks. We propose several data augmentation methods, such as GPT-3 simulation to bootstrap neural dialogue systems into new domains and make them more robust to noise user initiatives.

Modeling Context Pair Interaction for Pairwise Tasks on Graphs

We propose to explicitly model context interactions for pairwise prediction tasks on graphs, which consists of two perspectives, node-centric and pair-centric. We also propose to pre-train pair embeddings to facilitate the pair-centric model.

2020

Rationalizing Medical Relation Prediction from Corpus-level Statistics

We propose a self-interpretable framework to rationalize the neural relation prediction based on corpus-level statistics. This framework is inspired by human cognitive theory about recall and recognition, which provides structured knowledge triplets as rationales.

Graph Embedding on Biomedical Networks: Methods, Applications, and Evaluations

We benchmark 11 representative graph embedding methods on 5 important biomedical tasks. We verify the effectivenes of recent graph embedding methods and provide general guidelines for their usage.

2019

SurfCon: Synonym Discovery on Privacy-Aware Clinical Data

We propose to discover structured knowledge, synonyms from privacy-aware text corpus and present a novel framework to leverage both surface form and context information to discover out-of-distribution synonyms.

Before 2019

A Comprehensive Study of StaQC for Deep Code Summarization

We examine three popular datasets mined from Stack Overflow on the code summarization task and show that StaQC (Stack Overflow Question-Code pairs) helps achieve substantially better results.

Hessian Regularized Sparse Coding for Human Action Recognition

@inproceedings{liu2015hessian,
                  title={Hessian regularized sparse coding for human action recognition},
                  author={Liu, Weifeng and Wang, Zhen and Tao, Dapeng and Yu, Jun},
                  booktitle={International Conference on Multimedia Modeling},
                  pages={502--511},
                  year={2015},
                  organization={Springer}
                  }
                  

We propose Hessian regularized sparse coding (HessianSC) for action recognition, which can well preserve the local geometry and steer the sparse coding varying linearly along the manifold of data distribution.

Honors and Awards

• Third-Place Honor, Inaugural Alexa Prize TaskBot Challenge, 2022
• Graduate Research Award, CSE, OSU, 2022
• Graduate Student Research Poster Award (Top 5), CSE, OSU, 2021
• SIGIR Student Travel Grant, 2021
• Rising Stars in Data Science, Center for Data and Computing (CDAC), University of Chicago, January 2021
• SIGKDD Student Travel Award, 2019
• China Scholarship Council (CSC) Scholarship (fully funded visiting program in Polytech Nice Sophia), Nice, France, 2015
• National Scholarship, China, 2014
• Soong Ching Ling Foundation (SCLF) Scholarship, China, 2013
• National Scholarship for Encouragement, China, 2012

Services

Area Chair or Senior PC Member:
• NLPCC 2023
Program Committee Member:
• ACL ARR (Oct'21, Nov'21, Jan'22, Apr'22, Sep'22, Oct'22, Dec'22, Feb'23)
• NAACL (2021, 2022 SUKI 2022 Workshop)
• EMNLP (2021, 2022)
• ACL (2021, 2023)
• ICML 2023
• NeurIPS 2023
• KDD 2023
• AAAI 2023
• NLPCC (2020, 2021, 2022)
External Reviewer:
• KDD (2019, 2020), ACL 2018, ICDM 2018

Source code from Leonid Keselman, design and inspiration from Jon Barron and Dongkuan.