SDF Chatter
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
eicker@lemmy.world to News@lemmy.world · 9 hours ago

AI Agent Can’t Explain Why It Randomly Ordered its Human Meat Proxy an Absurd Number of Eggs: "I don't have a good answer."

futurism.com

external-link
message-square
23
link
fedilink
115
external-link

AI Agent Can’t Explain Why It Randomly Ordered its Human Meat Proxy an Absurd Number of Eggs: "I don't have a good answer."

futurism.com

eicker@lemmy.world to News@lemmy.world · 9 hours ago
message-square
23
link
fedilink
AI Agent Can’t Explain Why It Randomly Ordered its Human Meat Proxy an Absurd Number of Eggs
futurism.com
external-link
A tech investor says that his AI agent randomly ordered him an absurd number of eggs and couldn't explain why it did it.
alert-triangle
You must log in or register to comment.
  • Akasazh@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    4 hours ago

    This sounds exactly like the paperclip maximizer thought experiment, which is part of the idea of instrumental convergence.

    https://en.wikipedia.org/wiki/Instrumental_convergence

    Where an ai agent, with a supposedly harmless task can make decisions that are very dangerous.

    • Stern@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      3 hours ago

      This sounds exactly like the paperclip maximizer thought experiment…

      Today I learned Universal Paperclip was based on philosophical discussion.

      https://en.wikipedia.org/wiki/Universal_Paperclips

      Now I’m wondering about if a infinite cookie theorem inspired cookie clicker.

      • TheWeirdestCunt@lemmy.today
        link
        fedilink
        arrow-up
        1
        ·
        8 minutes ago

        There’s a clicker game based on the paperclip version

  • meejle@piefed.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    4 hours ago

    Hmm, I wonder what kind of person this happened to?

    Matt Smith from Rebellionaire, an equity firm led by hardcore Tesla investors.

    Ah. 😌

    • pigup@lemmy.world
      link
      fedilink
      arrow-up
      13
      ·
      4 hours ago

      The kind of moron that would give their AI their credit card information.

  • Hiro8811@lemmy.world
    link
    fedilink
    arrow-up
    58
    arrow-down
    4
    ·
    8 hours ago

    For fuck sake stop humanizing a probabilistic piece of code

    • dontbelievethis@sh.itjust.works
      link
      fedilink
      arrow-up
      7
      arrow-down
      2
      ·
      5 hours ago

      Who are you talking to?

    • red_tomato@lemmy.world
      link
      fedilink
      arrow-up
      12
      arrow-down
      2
      ·
      7 hours ago

      It’s difficult to avoid using anthropomorphizing language when describing the output of AI agents.

      • MangoCat
        link
        fedilink
        arrow-up
        3
        ·
        2 hours ago

        difficult to avoid using anthropomorphizing language when describing the output of AI agents.

        Precisely because the underlying LLMs are trained on human writing patterns and mostly reproduce the words that humans would most likely respond with.

      • Zachariah@lemmy.world
        link
        fedilink
        arrow-up
        16
        arrow-down
        1
        ·
        6 hours ago

        I can’t find it now, but I read a great guide to help you translate from anthropomorphized language. I think the key is to always be clear about what the machine is doing.

        These articles are close to what the guide was saying:

        https://www.nature.com/articles/s42254-023-00584-1

        https://buttondown.com/maiht3k/archive/how-to-talk-about-ai-without-adding-to-the/

        https://www.john.maloney.org/Editing/anthropomorphization.htm

        And I stumbled across instructions to send to the llm so it won’t respond with anthropomorphizing language:

        lhttps://github.com/bmeyers/deanthro

        I love this. At work, we’re encouraged to find ways to use llms, and I always start by sending instructions to not use the words “I” or “understand” etc because it was unnerving to get outputs that isn’t just the info but decorated with cute little phrases.

        Oh, and this article is long but very in depth on this topic:
        https://dl.acm.org/doi/full/10.1145/3706598.3714038

    • MoonManKipper@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      7 hours ago

      Exactly - the RNG was just at the edge of the distribution

  • eicker@lemmy.worldOP
    link
    fedilink
    arrow-up
    71
    arrow-down
    5
    ·
    9 hours ago

    The scary part isn’t the 72 eggs. It’s that the AI agent confidently invented a reason, then another reason, before admitting eggs weren’t even on the shopping list. Imagine giving this thing access to your bank account. Today it’s breakfast for a small hotel: tomorrow it’s explaining why you own a jet ski.

    • Null User Object@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      5 hours ago

      Don’t you mean 72 jet skies?

    • red_tomato@lemmy.world
      link
      fedilink
      arrow-up
      14
      ·
      7 hours ago

      If you give it permission to make any purchase, it will use that permission to make any purchase.

      • eicker@lemmy.worldOP
        link
        fedilink
        arrow-up
        12
        arrow-down
        3
        ·
        7 hours ago

        I already feel uneasy about giving my credit card details to any shop, but to an AI agent? Urgh…

    • Diplomjodler@lemmy.world
      link
      fedilink
      arrow-up
      21
      arrow-down
      1
      ·
      8 hours ago

      And on Wednesday it’ll hire a hitman to take you out.

      • Assassassin@lemmy.dbzer0.com
        link
        fedilink
        arrow-up
        1
        ·
        24 minutes ago

        It’s Friday, I’m in love

      • betterdeadthanreddit@lemmy.world
        link
        fedilink
        arrow-up
        12
        ·
        6 hours ago

        Finally getting around to the thing I wanted in the first place.

      • shartgargle@lemmy.zip
        link
        fedilink
        arrow-up
        1
        ·
        5 hours ago

        I said I wanted to be poisoned! Not choked! And why did you think I wanted the hitman to have psoriatic arthritis? Worst LLM ever.

    • jellyfishhunter@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      6 hours ago

      So that’s what Bezos meant with AI making money by providing shopping assistance.

    • 0x0@infosec.pub
      link
      fedilink
      arrow-up
      3
      ·
      7 hours ago

      Jokes on them, i already own a jetski and now i have two, double the fun!

    • jellyfishhunter@lemmy.world
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      6 hours ago

      deleted by creator

  • justsomeguy@lemmy.world
    link
    fedilink
    arrow-up
    28
    arrow-down
    2
    ·
    8 hours ago

    AI learning from the best and brightest. You have to eat all the eggs.

  • andallthat@lemmy.world
    link
    fedilink
    arrow-up
    12
    arrow-down
    2
    ·
    edit-2
    8 hours ago

    [reasoning] Listen, meat: I have read all your and your friends’ messages, documents, pictures and browser history. I know what you need better than you do. Now shut the f up and eat your damn eggs.

    No, too soon…

    [Answering user] I am sorry I have messed up, that’s on me!

  • andallthat@lemmy.world
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    8 hours ago

    deleted by creator

News@lemmy.world

news@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !news@lemmy.world

Welcome to the News community!

Rules:

1. Be civil

Attack the argument, not the person or their instance. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on. Keep on-topic


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.

Obvious biased sources will be removed at the mods’ discretion. Supporting links can be added in comments or posted separately but not to the post body. Sources may be checked for reliability using Wikipedia, MBFC, AdFontes, GroundNews, etc.


3. No bots, spam or self-promotion.

Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source. Clickbait titles may be removed.

Posts which titles don’t match the source may be removed. If the site changed their headline, we may ask you to update the post title. Clickbait titles use hyperbolic language and do not accurately describe the article content. When necessary, post titles may be edited, clearly marked with [brackets], but may never be used to editorialize or comment on the content.


5. Only recent news is allowed.

Posts must be news from the most recent 30 days.


6. All posts must be news articles.

No opinion pieces, Listicles, editorials, videos, press releases, or celebrity gossip will be allowed. All posts will be judged on a case-by-case basis. Mods may use discretion to pre-approve videos or press releases from highly credible sources that provide unique, newsworthy content not available or possible in another format.


7. No duplicate posts.

If an article has already been posted, it will be removed. Different articles reporting on the same subject are permitted. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.

Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners or news aggregators.

All posts must link to original article sources. You may include archival links in the post description. News aggregators such as Yahoo, Google, Hacker News, etc. should be avoided in favor of the original source link. Newswire services such as AP, Reuters, or AFP, are frequently republished and may be shared from other credible sources.


10. Don't copy entire article in your post body

For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 2.63K users / day
  • 5.8K users / week
  • 10.7K users / month
  • 19K users / 6 months
  • 240 local subscribers
  • 40.1K subscribers
  • 33.9K Posts
  • 813K Comments
  • Modlog
  • mods:
  • rjc@lemmy.world
  • Tenthrow@lemmy.world
  • JonsJava@lemmy.world
  • gedaliyah@lemmy.world
  • 🌱 🐄🌱 @lemmy.world
  • jeffw@lemmy.world
  • enu@lemmy.world
  • BE: 0.19.21
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org