Jiawei Liu


I am a PhD student working with Prof. Lingming Zhang on Programming Languages, Formal Methods, and Software Engineering at UIUC.

My research goal is to simplify the making of great software, by simplifying programming and improving software quality. Here are some topics I work on:

  • ūüõ°ÔłŹ Correctness: How to detect and mitigate errors in emerging systems?
  • ūü§Ė Code LLMs: How to build and evaluate LLMs for generating better code?

ūü§ó Feel free to drop me an email if you are interested in my research.

Papers Show All

  1. NeurIPS’23
    Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
    Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang,  and Lingming Zhang
    Thirty-seventh Conference on Neural Information Processing Systems. 2023
  2. ESEC/FSE’23
    Atifact AvailableAtifact Reusable
    NeuRI: Diversifying DNN Generation via Inductive Rule Inference
    Jiawei Liu, Jinjun Peng, Yuyao Wang,  and Lingming Zhang
    Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2023
    ūüŹÜ ¬†ACM SIGSOFT Distinguished Paper Award
  3. ASPLOS’23
    Atifact AvailableAtifact FunctionalResults Reproduced
    NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers
    Jiawei Liu, Jinkun Lin, Fabian Ruffy, Cheng Tan, Jinyang Li, Aurojit Panda,  and Lingming Zhang
    Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 2023
    ūüŹÜ ¬†Distinguished Artifact Award
  4. OOPSLA’22
    Atifact AvailableAtifact Reusable
    Coverage-guided tensor compiler fuzzing with joint IR-pass mutation
    Jiawei Liu, Yuxiang Wei, Sen Yang, Yinlin Deng,  and Lingming Zhang
    Proceedings of the ACM on Programming Languages 6 (OOPSLA1). Apr 2022
*PLSE conferences like OOPSLA and ESEC/FSE do not badge for reproducibility at artifact evaluation as it requires third-party re-implementation. Nonetheless, we got all badges we can get. :D


Organizing: LLM4Code@ICSE'24

Reviewer: TSE, TOSEM, DCAA@AAAI'23, R2FM@ICLR'24

Artifact Evaluation Committee: PLDI'23, OSDI'22, ATC'22

Invited Talk

Rigorous Evaluation of LLMs for Code (Slides) Generating Test-Cases for ML Compilers (Slides) LLMs for Software Testing (Guest Lecture) Automating DL Compiler Bug Finding with NNSmith Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutation (Slides)


UIUC, 2021~TBD   CS PhD @ PL/FM/SE

AWS AI Labs, Smr. 24 (TBD)   CodeWhisperer

Google TPU, Smr+Fall. 23   ML SDC

OctoML, Smr. 22   Pattern Language

Tongji University, 20{17~21}   B.Eng. in CS

Alibaba DAMO, Smr. 21 GNN4Assembly

NYU Systems Group, Smr. 20 Video Analytics

ByteDance AI Lab, Spr. 20   Model Serving