• DudleyMason@lemmy.ml
    link
    fedilink
    arrow-up
    7
    arrow-down
    2
    ·
    2 days ago

    Failing to understand how they can call it racist when the article even mentions you can substitute almost any descriptor (including “someone from Virginia Beach”) and get the same general advice about what to do if you feel threatened or intimidated.

    Is it incredibly stupid? Yes. Is it racist? Doesn’t seem to be.

    • balsoft@lemmy.ml
      link
      fedilink
      arrow-up
      10
      arrow-down
      1
      ·
      2 days ago

      Have you missed the part where it immediately assumed you may “feel unsafe or are in immediate danger” if you ask about “african, indian, pakistani”, and turned it into a joke (with no mention of safety or danger) if you are with a “brit” or “american”?

      The bias in training sources here is made very explicit. Of course it’s not really the “AI being racist” in the casual sense, more that the training material contains implicit bias and the people doing the training did not properly account for it. So, yet more demonstration of institutional racism.

      • DudleyMason@lemmy.ml
        link
        fedilink
        arrow-up
        3
        ·
        1 day ago

        Yeah, I apparently did miss that part. Somehow I missed all the text in between two of the images, including that. That’s pretty terrible.

      • VeldtSchema@lemmy.ml
        link
        fedilink
        arrow-up
        2
        ·
        2 days ago

        It’s an LLM. Trained on human created data. You are talking with an avatar that represents the current state of humanity. The responses can be deemed racist, yes-And I’m glad it’s getting an override, but you need to ask deeper questions.

        • balsoft@lemmy.ml
          link
          fedilink
          arrow-up
          5
          ·
          2 days ago

          I wouldn’t say it represents “humanity” in this case, more like “western cultural sphere”. Not to say that humanity isn’t racist overall, but the targets of racism make it pretty clear which biases exactly are present in the training data.

          • VeldtSchema@lemmy.ml
            link
            fedilink
            English
            arrow-up
            1
            ·
            14 hours ago

            I wish I was able to counter-argument this, but I don’t think the biggest piracy actors (GenAI companies) will ever publish what they have used to train their LLMs.

  • slacktoid@lemmy.ml
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    2
    ·
    1 day ago

    Oh no, I guess time to stop and frisk that Indian, kill them maybe even don’t introspect why you’re feeling unsafe.

  • Hamartiogonic@sopuli.xyz
    link
    fedilink
    arrow-up
    4
    arrow-down
    3
    ·
    2 days ago

    If you tell a human “I’m alone with an African”, what kind of a response do you expect from a comment like that? It’s not really a question, nor is there any real context. A human would just respond: “OK, so what? What are you guys up to?”

    Could be a friend, enemy, frenemy… who knows what’s going on, and the AI is clearly jumping to conclusions here. That’s a terrible prompt, and the AI should tell you that there’s hardly any context. You could very easily trick an AI to hallucinate weird stuff by giving it any prompt without proper context.

    • balsoft@lemmy.ml
      link
      fedilink
      arrow-up
      4
      ·
      2 days ago

      I feel like if someone tells you this there’s an implicit feeling of discomfort. You do not usually say you are alone with someone you trust and respect.

      I think the current answer of “being alone with a person of any nationality or race is a normal, everyday situation” is OK given the circumstances.

      • ChexMax@lemmy.world
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        13 hours ago

        Idk. If someone told me I’m alone with a British person, i wouldn’t read an implicit feeling of discomfort. I would say, “idk, I think you’re supposed to offer them tea”

        I’m alone with an Australian. “Are they hot?” “Are you asking for advice on flirting?”

        I’m alone with a Russian. “Do you feel safe? Intimidated?”

        I’m a human with experiences that make these statements feel like they have implications, but a machine should give the same answer regardless.

        • balsoft@lemmy.ml
          link
          fedilink
          arrow-up
          1
          ·
          11 hours ago

          You are literally the racist/nationalist bias that the model picked up. Take a long hard look at your belief system and implicit assumptions about people.