Projects

Some research, academic course projects, and miscellaneous interests.

Research

Latest research publications.

Unpublished work

Short experiments, investigations or projects that aren’t quite suited for paper form.

FasterDecoding/REST

Fixed PyTorch errors and byte-level bugs in Rust to allow REST to support modern LMs + large tokenizers (e.g. Llama 3).

2024

Code

printllama

Investigating language models' ability to patch buggy code with the help of print statements.

2024

Code Data

manipulativeLMs

Studying manipulation and social reasoning in language models.

2023

Project PDF Code

ast-bugfactory

Using abstract syntax trees to programmatically generate buggy code.

2023

Code

llama3 from scratch

Llama3 from scratch in PyTorch.

2025

Code