arXiv paper proposes CPA counterfactual pairwise augmentation to boost small pointwise LLM judges

[arXiv] A preprint by Mohammad Zangooei, Peyvand Teymoori, Mohammad Robati Shirzad and Soroosh Shahtalebi introduces CPA (Counterfactual Pairwise Augmentation), a method for improving small language models used as pointwise judges. According to the paper, pointwise labels under-determine the decision boundary during fine-tuning; CPA synthesizes and audits, for each pointwise item, a counterfactual response to the same query intended to carry the opposite label, frames the accepted pair as a pairwise task, and fine-tunes the judge jointly on pointwise and pairwise data while deploying it in pointwise mode only. A second-order analysis in the paper argues that joint training can hold the pointwise optimum where the pairwise loss is flat and absorb its curvature where it is sharp, outperforming the strategy of merging separately trained pointwise and pairwise experts. On separate Qwen3-8B LoRA adapters for six binary criteria, the paper reports that CPA improves criterion-averaged pointwise macro-F1 by 2.5 points over pointwise-only training, outperforms model merging on all six criteria at every tested merge weight, and surpasses Gemini 3.6 Flash, the strongest zero-shot frontier judge evaluated, by 11.8 points. The findings are from a preprint and have not been peer-reviewed.