These companies should be criminally liable for training their models on child porn.

  • FlashMobOfOne@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    edit-2
    1 hour ago

    Yes, they certainly are, and most of the major platforms are being used for this and it’s widely known. Copilot’s prompt reviewers reported it to Microsoft, per leaked documents. Grok has been known to be in use for this basically since its inception. Meta’s LLM is used for it, and they know.

    I can’t speak for Gemini, Claude, or ChatGPT, but it wouldn’t surprise me at all if they’re being used for it too.

    These platforms are unregulated by anything other than civil lawsuits (though some international governments are starting to move on it), so yes, they’re going to appeal to every demographic, including the worst of the worst, in a desperate bid to one day be profitable.

    There was one guy arrested for it recently, a state-level deputy AG, but that dude’s the exception. Hopefully there will be more to come.

    I researched this topic recently and made a video about it.

  • Glitchvid@lemmy.world
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    1
    ·
    6 hours ago

    One concerning thing is that when these AI companies are pushed to crack down on this, they’ll retrain and bias their models to only recognize traditional “pornstar” body types as ‘adult’.

    This is a problem when they then get used as a mass content flagging and moderation tool — it’s not hard to imagine some adult woman taking nudes (as people do) and just because they don’t have a huge bust, getting auto flagged as having illegal material. Not to mention body types that aren’t even real, like the art made in furry communities.

    It’s not like there isn’t precedent, recently Discord banned a ton of people because its scanning system started throwing false positives, and that was only corrected because it made such a stink.

    • Virtvirt588@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 hours ago

      This is a problem when they then get used as a mass content flagging and moderation tool — it’s not hard to imagine some adult woman taking nudes (as people do).

      The problem is with sexual abuse material not nudity on its own, there is a clear distinction between those two. It seems like this is the major problem when it comes to “crack-downs” on this.

      • RumRunningDevil@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 hour ago

        Is there a distinction between CSAM and nudes of a minor though? I understand how just same lady’s nudes and pornography have a distinction but I don’t think the same can or should be said about children, unless I’m misunderstanding you?

    • outlawcarl@fedinsfw.app
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      6 hours ago

      Yeah we will drown in flase postives, my other worry is they will spend on this auto scaning of media call it problem solved slash bugets for other things and predators move to dumb tech or really encoded shit.

      Thats if there even is enouth money/compute to scan everything…

    • abadidonque@feddit.uk
      link
      fedilink
      English
      arrow-up
      4
      ·
      5 hours ago

      They should be made to retrain their models using only images of those palaeolithic venus figurines.

    • howdy@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      6 hours ago

      AI shouldn’t train on porn at all. Too many ethical issues.

  • Snowclone@lemmy.world
    link
    fedilink
    English
    arrow-up
    28
    arrow-down
    12
    ·
    8 hours ago

    https://tsjournal.org/index.php/jots/article/view/29

    exposure to csam, through self reporting, increases the risk the viewer will seek contact with children, in case you need more arguments against csam. I’ve heard the argument that AI generated images may be a harm reduction situation. it’s not. it’s incredibly damaging to the viewer if they are seeking it out, it makes them more likely to abuse, if they are exposed to it as victims it can cause lasting damage, much of it is just remixed images of actual child abuse victims, and that revictimizes them, and causes serious damage as well. We really need to stop pretending the companies that make this software aren’t responsible for this software.

      • Snowclone@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        58 minutes ago

        why would watching children be abused from real or stimulated sources be the same as playing a violent video game?

        • Lumisal@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          26 minutes ago

          You’re right. A video game is far more interactive. Heck these days you can even put on a headset and really simulate the action of murdering people. Grand Theft Auto is a whole detailed simulation on muder, theft, and more. Wayyy more immersive than just plain video.

          Clearly then, by your own logic and the study’s conclusion, watching simulated sources make people more likely to do the thing after all. I mean, what sick person fantasizes about murdering strangers?

          Obviously we must ban the existence of violent video games or crime in society will spiral out of control.

      • MaggiWuerze@feddit.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 hours ago

        I would argue, that in both cases it only (or at least only meaningfully) affects people who already have a leaning towards the specific issue.

    • it_depends_man@lemmy.world
      link
      fedilink
      English
      arrow-up
      26
      arrow-down
      12
      ·
      7 hours ago

      This study explores a sample of 1,546 anonymous individuals

      I have a study of 23023012301230123050503450 anonymous individuals, of which 78% agreed that you smell like doo doo. Yep. True story. If you disagree, you hate science. How could you do this?

      I shouldn’t be this sarcastic, the journal is called " Journal of Online Trust and Safety (JOTS) " with a name like that, how could I ever be so arrogant to not believe 1546 anonymous individuals on the internet? Shame on me, really.

      • Virtvirt588@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        1
        ·
        4 hours ago

        Agreed, studies on this topic are always what someone on the other end wants to hear. The premise is inconsistent and the conclusion doesnt hold. If this study was done about something less “taboo” it would’ve been lost and forgotten.

      • howdy@lemmy.ml
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        3
        ·
        6 hours ago

        reddit moment…

        you can’t just dismiss an argument because the study is small. Sure it’s small, but it’s not easy to get large data on this subject.

        The concept of csam exposure influencing behaviour is highly plausible.

        • Senal@programming.dev
          link
          fedilink
          English
          arrow-up
          3
          ·
          edit-2
          36 minutes ago

          Aside from the other good replies you have around the subject, i’ll address something more fundamental to your argument.

          you can’t just dismiss an argument because the study is small.

          You absolutely can dismiss a study for being too small. In some cases you really should.

          If you can’t procure and retain a meaningful sample size, then you shouldn’t be running the experiment (or more usefully, designing an experiment that works with smaller sample sizes, or one that uses a demographic where you can get adequate sample sizes).

          It’s one of the reasons why participant gathering is usually done up front.

          • frongt@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 hour ago

            True. But over 1500 responses is a massive sample size for a survey like this.

            I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.

            • Senal@programming.dev
              link
              fedilink
              English
              arrow-up
              2
              ·
              36 minutes ago

              True. But over 1500 responses is a massive sample size for a survey like this.

              Genuine question, based on what?

              Like, I’m just seeing a number, I’ve no idea if it’s big or small in the context of this area of study.

              I’d be interested to know why that’s considered a good result.

              I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.

              Agreed, I’d assume a basic level of scientific rigour.

        • ohulancutash@feddit.uk
          link
          fedilink
          English
          arrow-up
          6
          arrow-down
          2
          ·
          edit-2
          3 hours ago

          Maybe not dismiss, but you can think twice before giving it much credit.

          The government is currently looking at making anti-semitism a zero-tolerance offence in schools, in the wake of the Bell Review, which showed that 41% of Jewish pupils had suffered anti-semitic abuse at school. These are indeed troubling numbers, but baffling as 70% of British Jewish pupils are in Jewish schools. Are nearly 20% of anti-semitic incidents really occurring in Jewish schools? Or is it a flaw in the study, which had a sample size of 92 children of which 70 responded?

          If we just need to be plausible, then why bother with the time and expense of studies at all? Sure, its plausible that antisemitism is on the rise in schools, but so are exclusions to a truly troubling all-time high. Is it really wise to add greatly to that number based on the experience of 29 study respondants? That isn’t even a classroom’s worth.

          Small data sets can severely distort results and need to be taken with that firmly in mind.

        • WhatAmLemmy@lemmy.world
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          5 hours ago

          I agree with the plausibility of the concept, but anonymous surveys aren’t really something we should be calling a “study”. They’re barely considered evidence as they’re open to extreme errors, bias, and manipulation; especially by respondents.

        • it_depends_man@lemmy.world
          link
          fedilink
          English
          arrow-up
          17
          arrow-down
          4
          ·
          5 hours ago

          The concept of csam exposure influencing behaviour is highly plausible.

          The entire scientific community and publishing industry is a minefield. So is CSAM and the call for more restrictive governing of the internet.

          The thing I know for sure is that there are people on this planet who have a political and a financial motive to lie and fabricate studies to justify their politics.

          The thing I’m mostly skeptical on is the scientific process. Not because it can’t work, but because that entire field too, has bad incentives. “Reputation” is held up, frankly, by boomers who have trouble operating a printer, but did some important theoretical work before the internet was made public and by politics and a disinterested public that doesn’t apply scrutiny to what their “intellectual elite” is actually doing.

          The internet is a KNOWN source of bad information. Those 1546 “anonymous individuals” could be one bored 4chan user, or one chinese/russian/us spy agency worker justifying the next expansion of their budget.

          is highly plausible.

          Is not science. It’s guesswork.

          I appreciate that it is difficult to collect good information on this subject, but that’s just how it is. Tough luck. As a scientist, a proper scientist, you don’t get to publish “it’s plausible” from a source you can’t verify as fact.

          Second guessing science isn’t anti-science.

          • Snowclone@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            edit-2
            30 minutes ago

            wow it sounds like you hate surveys and science. sorry about that.

            my comment on an internet news article was that child sexual abuse material even if generated by AI isn’t a harm reduction, as it is shown to cause harm in multiple ways. if you want to argue that being exposed to csam as a viewer isn’t harmful to the viewer or doesn’t make them feel more inclined to abuse children in real life, that’s fine, you can do that AND hate science. it’s OK, man.

            I’m not trying to get you to agree surveys and science as a whole are valid.