AI vs. Humans: Developer Coding Support Preferences

AI vs. Humans: Developer Coding Support Preferences

How developers engage with ChatGPT compared to Stack Overflow

This study examines how software engineers integrate AI chatbots versus human-powered Q&A platforms into their coding workflows.

Key Findings:

  • LLMs provide immediate, personalized responses but may present incorrect information confidently
  • Stack Overflow offers community-vetted solutions but requires more effort to find relevant answers
  • Developers use these tools differently but complementarily in their coding process
  • AI chatbots are reshaping how developers seek coding assistance

Why It Matters: Understanding these interaction patterns helps engineering teams optimize their development environments and training approaches while highlighting opportunities to improve both AI and human-powered support systems.

Original Paper: "Always Nice and Confident, Sometimes Wrong": Developer's Experiences Engaging Large Language Models (LLMs) Versus Human-Powered Q&A Platforms for Coding Support

5 | 323