Younggi Park

Vincent, One Puzzle for Our Ensemble Toward High-quality Patches

As mentioned in the previous post, our strategy for patching is to prepare multiple agents to ensure both the robustness and correctness of the system. To this end, we developed various patch agents, each specialized for different LLM models and tools. In this post, we would like to introduce Vincent agent, one of the patch agents running under our ensemble-based patching system. Right Root cause, Wrong Patches What surprised us during the competition was that LLMs alone are already quite doing well at generating proper patches. Given a sanitizer report, LLMs could freely explore the codebase by itself and reason correctly about the given bug—especially when the problematic code appeared near the call stacks in the report.