LiMO: Line-level Machine-generated Code Detection for Diverse Programming Languages

  • Kim, Taekhyun; 
  • Jang, Hyejoon; 
  • Kim, Suyoung; 
  • Jin, Zhenming; 
  • Kim, Suin; 
  • ... Bak, JinYeong
Citations

WEB OF SCIENCE

0
Citations

SCOPUS

0

초록

As large language models (LLMs) continue to advance, their code generation capabilities show significant promise in coding tasks. However, the detection of machine-generated code (MGC) remains crucial, particularly in educational settings where academic integrity and fairness are critical concerns. While most existing methods focus on document-level detection, users frequently copy partial code lines, stating the importance of line-level detection. To address this gap, we propose LiMO, a fine-grained MGC detection method that incorporates both line-level syntactic structure and coding stylistic information. We utilize a line-wise perplexity value derived from code generation models to capture syntactic features and introduce a coding convention feature that quantifies deviations from standard coding practices, such as Python's PEP 8 standards. This hybrid approach enables more accurate MGC detection at both the document- and line-levels. To better reflect real-world scenarios where human and machine-generated code coexist, we introduce a new dataset, Human-Machine Generated Codes (HMGC). It is constructed using easy-to-access LLMs (GPT-3.5, GPT-4, and Gemini) and spans diverse languages (Python, Java, and C++). Through comprehensive experiments, LiMO consistently and significantly outperforms all existing baselines, achieving the best performance across all evaluation metrics at both document- and line-levels.1

키워드

coding style feature; line-level detection; machine generated code detection
제목
LiMO: Line-level Machine-generated Code Detection for Diverse Programming Languages
저자
Kim, Taekhyun; Jang, Hyejoon; Kim, Suyoung; Jin, Zhenming; Kim, Suin; Bak, JinYeong
DOI
10.1145/3748522.3779718
발행일
2026
유형
Proceedings Paper
저널명
Proceedings of the ACM Symposium on Applied Computing
페이지
917 ~ 925