@ylai@lemmy.ml to AI@lemmy.mlEnglish • 11 months agoChatGPT gets code questions wrong 52% of the timewww.theregister.comexternal-linkmessage-square10fedilinkarrow-up1164arrow-down15
arrow-up1159arrow-down1external-linkChatGPT gets code questions wrong 52% of the timewww.theregister.com@ylai@lemmy.ml to AI@lemmy.mlEnglish • 11 months agomessage-square10fedilink
minus-square@Kuvwert@lemm.eelinkfedilink7•11 months ago52% In the first year is pretty cool, excited to see how it will evolve.
minus-squarecircuitfarmerlink2•11 months agoProbably far enough that anyone with an actual interest will be out of a job.
minus-square@SirGolanlink2•11 months agoGPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.
52% In the first year is pretty cool, excited to see how it will evolve.
Probably far enough that anyone with an actual interest will be out of a job.
GPT4 with reflexion prompting gets 90% correct (for HumanEval coding benchmark). The paper this is based on is misleading at best.