Projects

Chain-of-Thought Faithfulness in DeepSeek R1

Research & Publication Complete
Python · LLM evaluation · Prompt design · Statistical analysis

MSc thesis examining whether DeepSeek R1's stated reasoning actually reflects the factors driving its answers.

Details

Found that the model would change its final answer in response to a hint embedded in the prompt, without ever mentioning that hint anywhere in its chain-of-thought. Published in the ACL Anthology as part of IJCNLP-AACL 2025, CHOMPS workshop.

Read the paper →

Referee Bias Analysis

Personal Project Write-up in progress
R · GLM/GLMM · Statistical modelling

Examining whether football referees issue red cards at different rates depending on players' skin tone, using the Crowdstorming dataset.

Details

Built three increasingly complex GLM/GLMM models to test whether the effect held up as model complexity increased. Used as a refresher project for R after several years working mainly in Python. Next step is extending the analysis to yellow cards as an outcome variable.

Read the full write-up →