Research Assistant · Data Mining Research Lab, University of Dhaka
Aug 2023 - PresentDhaka, Bangladesh
Supervisor: Md. Fahim Arefin (DU CSE), in collaboration with Prof. Tarannum Shaila Zaman (UMBC, Information Systems).
- Designed and implemented LLM-ProS, a novel evaluation framework for benchmarking LLM performance on ICPC World Finals problems. Curated a 166-problem dataset (2011-2024), built automated submission pipelines via Codeforces Gym, and analyzed five state-of-the-art models across correctness, resource utilization, and chain-of-thought reasoning. Published at ICSE 2025 (LLM4Code).
- Extended this work into A-ProS, an autonomous multi-model agentic framework that separates solution generation from specialized debugging feedback under a 2×3 factorial design. Developed the full orchestration pipeline, Codeforces browser automation (Selenium + Playwright), verdict capture, and SQLite logging. Ran ablations on persistent vs. stateless context and trust calibration (ECE) across critic models. Accepted at ACM TOSEM 2026.
- Completed undergraduate thesis “A Hybrid LLM Feedback Framework for Automated Competitive Programming Workflows,” proposing an iterative test-driven benchmarking pipeline integrating OpenAI o3-mini with specialist LLMs (DeepSeek, Qwen) for error diagnosis and code refinement via Codeforces-based validation.
- (Ongoing) Polyglot Codebase Debugging and Cross-Language Program Repair with LLMs and Agentic AI - investigating the 40-60 point performance gap of LLM agents on cross-boundary bugs in Java+TypeScript and Python+Go enterprise stacks. Designing a localize-then-edit agent built on SCIP-based unified cross-language call graphs and REST/gRPC schema-aware reasoning, extending IBM iSWE-style AST tooling across language boundaries. Targeting an empirical taxonomy paper (MSR/ICSE) and a full systems evaluation on SWE-PolyBench and xCodeEval for ICSE/FSE 2027.


