Taiwanna Anderson’s life changed forever in December 2021, when she found her 10-year-old daughter Nylah unconscious, hanging from a purse strap in a bedroom closet.

Barely an adolescent, Nylah wasn’t suicidal. She had merely come across the “Blackout Challenge” in a feed of videos curated her for her by TikTok’s algorithm. The challenge circulating on the video-sharing app encouraged users to choke themselves with household items until they blacked out. When they regained consciousness, they were supposed to then upload their video results for others to replicate. After several days in a hospital’s intensive care unit, Nylah succumbed to her strangulation injuries. Anderson sued TikTok over product liability and negligence that she alleges led to Nylah’s death.

For years, when claimants tried to sue various internet platforms for harms experienced online, the platforms benefited from what amounted to a get-out-of-jail-free card: Section 230 of the Communications Decency Act, a 1996 statute that offers apps and websites broad immunity from liability for content posted to their sites by third-party users. In 2022, a federal district judge accepted TikTok’s Section 230 defense to dismiss a lawsuit filed by Anderson based on the assessment that TikTok didn’t create the blackout challenge video Nylah saw—a third-party user of TikTok did.

But on Tuesday, the federal Third Circuit Court of Appeals released an opinion reviving the mother’s lawsuit, allowing her case against TikTok to proceed to trial. TikTok may not have filmed the video that encouraged Nylah to hang herself, but the platform “makes choices about the content recommended and promoted to specific users,” Judge Patty Shwartz wrote in the appellate court’s opinion, “and by doing so, is engaged in its own first-party speech.”

  • @schnurrito@discuss.tchncs.de
    link
    fedilink
    183 months ago

    Section 230 was invented for things like mailing lists, newsgroups, phpBB-style forums, wikis. IMHO all of those are great things that we should definitely continue to have.

    Notice something? None of these have recommendation algorithms. If someone posts something to any of these kinds of platforms, it will be shown deterministically to those who have chosen to look at or subscribe to the place where it is posted; but it will not be shown to anyone else.

    I think it makes sense, regardless of how the current law should be interpreted, to say that operators of these kinds of platforms aren’t liable for what users do with them, but once you install a recommendation algorithm to show things to more users who haven’t actively made the choice to look for/at those things, you are liable for the choices of that recommendation algorithm.

    I admit that there are gray areas in that distinction, particularly whether search results should count as recommendation algorithms; but that is the general idea of what the law should ideally be.

    Current large social media platforms get so much data uploaded to them all the time that their recommendation algorithms basically constitute a choice on the part of the social media platform to promote some of that data over other data. This makes these kinds of social media platforms essentially media companies, and everyone agrees that media companies are liable for what they promote.

    • @barsquid@lemmy.world
      link
      fedilink
      23 months ago

      Search is a gray area that can be resolved in the courts. Like searching “blackout challenge” and seeing blackout content is different from searching “cartoons” and seeing blackout content.

      • @schnurrito@discuss.tchncs.de
        link
        fedilink
        33 months ago

        Yes; more interesting is which videos are at the top of a search for, say, “Kamala Harris” or “Donald Trump”; if those videos tell lies about these people (which could cause them to lose an election in a few months), what is the liability there?

    • @jaybone@lemmy.world
      link
      fedilink
      23 months ago

      PhpBB style forums have plugins for things like trending threads and posts right? At some point it becomes a slippery slope.

      • @ted@sh.itjust.works
        link
        fedilink
        33 months ago

        Trending posts is not a recommendation algorithm, in my opinion. I think the slope stops at curation (interests-based algorithms targeted at specific users).

        I.e. reddit homepage is now curated, Lemmy sorting methods are not.

        • @Not_mikey@slrpnk.net
          link
          fedilink
          13 months ago

          Lemmy sorting is still interest based if your not scrolling through /all , it’s just that those are declared interests, you subscribe to the tennis community, as opposed to inferred interests, the algorithm figured out you like tennis based on your watching habits. It’s still curated it’s just self curated instead of algorithmically curated.

          So I guess you could say it stops at how the interests are compiled and whether the interest was given explicitly by the user but then you get into how a user understands certain actions like likes. Do people like something to just give feedback to the poster, then it shouldn’t be used at all. Do they like something because they want to boost it and have their wider community to see it, then the algorithm can take that into account when giving it to friends / followers. Do they like something because they want to see more of it, then the algorithm can use that information for recommending things that user will see. My guess is people use it as some combination of all 3, and as long as the social media tells its users at the beginning that the heart button is all 3 they could get away with saying there algorithm is explicit while not changing much.

        • Then if they go this route, they better make sure that they clearly define what they mean by a “Recommendation Algorithm” or an “interests-based algorithm” because the opinions of individuals won’t hold up in court.

          If it’s not defined an attorney could easily argue that Lemmy’s “Scaled” algorithm is a “recommendation algorithm” and you would hope that the judge understood enough about programming to know where to draw the line.

      • @schnurrito@discuss.tchncs.de
        link
        fedilink
        13 months ago

        normally they don’t, perhaps there are such plugins available, but the normal way of using them is to have those threads on top that have most recently been posted in, and that concept should definitely be protected by section 230 and equivalents