• Wispy2891@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    3 hours ago

    Why they’re blaming the tool instead of the user?

    It’s the vibe coder’s fault if they don’t even watch the files edited in a commit.

    Not only they approve a commit without reading the code, but they approve without watching the list of edited files in a commit? They don’t use vs code or something that shows a diff? Just type in a box and let the algorithm have full control on the commits, blindly?

  • partial_accumen@lemmy.world
    link
    fedilink
    English
    arrow-up
    49
    ·
    8 hours ago

    When a user chooses the “Yes, and don’t ask again” option to approve running a command, that choice gets stored as part of a rule in the local “.claude/settings.local.json” file on the user’s computer.

    Saving privileged credentials in the clear in a config file? I think I can take credit for Claude doing that as this. Claude was clearly trained on my StackOverflow posts from 15 years ago.

  • eicker@lemmy.worldOP
    link
    fedilink
    English
    arrow-up
    67
    arrow-down
    6
    ·
    10 hours ago

    The irony is spectacular: a coding assistant designed to automate development also automates the creation of security liabilities. And Anthropic’s response seems to be more automation. Perhaps the next AI agent can monitor the first AI agent while a third one explains to management why the database credentials are now public.

  • Baldur@normals.me
    link
    fedilink
    arrow-up
    26
    ·
    10 hours ago

    That happens with all AI tools! That’s why many people hate vibecoding apps. A developer that uses AI must strictly know about all these things.

    • Greyghoster@aussie.zone
      link
      fedilink
      English
      arrow-up
      7
      ·
      8 hours ago

      That means a developer that has experience, knowledge and understands their craft. Vibecoding seems to be targeted at allowing that unskilled with unformed thoughts to do the development. It’s a standard progression in development. A new tool appears, call it Java, and a whole lot of sloppy code appeared before knowledge and experience caught up with all the new developers hacking away.

      • Faceman🇦🇺@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 hours ago

        I’d argue there is a large middle ground of people who are semi-experienced devs, but are using it to work with platforms or languages they have no experience in. but again, that leads to similar issues as the complete outsider who doesnt know the risks or how things are supposed to work or how to do some basic safety auditing. if it were wrapped in a more interactive educational system that explains how and why everything works the way it does so the user can actually get better at the task themselves maybe it would be better, but for now, it’s a potentially dangerous crutch with very few built in safeguards.

        When I played with googles antigravity recently as a test and told it to develop an app for a task I described as a test (obscure, obsolete audio DSP hardware control system, very little public conversation on forums or socials, next to nothing on github etc, just raw api documents, hardware descriptions, service manuals and a command to iterate and test until it’s perfect) it saved my github username, password AND auth keys in plaintext in the working folder, which it uploaded to github too… thanks that’s a great idea google, well done. the end result actually worked, but the code was a bit of a mess as expected.

        Thankfully this was all private since I was going out of my way to try to break it and I was able to simply exclude that file, but I wonder how many people dont know enough about any of this to know how to do it safely. and even then, is the ai having your details once, and not saving them to a file, somehow also risking leaking the info? that’s what we dont really know.

        Each conversation/project should be separate instances, but then it will seem to know details about an unrelated separate conversation you had in a separate instance so I dont know what to believe.

        If someone is going to work with AI you need to treat EVERY interaction as a potential leak and avoid any direct communication of credentials. That system also had a tendency to break out of its working directory unless you specifically block it from doing so (you’d think the default behaviour wouldn’t allow that), it started looking around the root directory of the disk it was working in when looking for an API document it was supposed to work with.

        • frongt@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 minute ago

          Yeah it’s absolutely a tool that needs appropriate use. I’ve used it multiple times to do something with ansible that their docs didn’t cover and I couldn’t find any search results for.

          But in it’s current state it’s still unethical, because pretty much every model is trained on license violations.

      • kinsnik@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        7 hours ago

        Yeah, but by replacing the effort through which knowledge and experience are learned, the step of understanding what the app is doing won’t come.

  • TWeaK@lemmy.today
    link
    fedilink
    English
    arrow-up
    7
    ·
    9 hours ago

    It took me a little while to realise they just mean the tickbox you select to remember your password, rather than some special prompt being fed into Claude, along the lines of “make no mistakes” or “don’t hallucinate”.