Researchers have found that large language models (LLMs) tend to parrot buggy code when tasked with completing flawed snippets.

That is to say, when shown a snippet of shoddy code and asked to fill in the blanks, AI models are just as likely to repeat the mistake as to fix it.

  • xia
    link
    fedilink
    English
    arrow-up
    1
    ·
    22 hours ago

    I noticed they aggresively build out todo comments, even if it’s not possible to do in place they take a wild stab at it.