70
15

Where the Goblins Came From - OpenAI explains why it has to suppress the tendency of its models to talk about goblins

2d 23h ago by lemmy.world/u/GamingChairModel in fuck_ai from openai.com

This is fascinating.

  1. The feedback loop they describe sounds a lot like model collapse. They can play whack a mole with the trends they can see, but what about the more subtle forms?
  2. They're now filtering goblin-related training data, which also tells me that maybe we can use lots of goblin references as a way to opt out of our written content being used to train their models, in our writing and in our code.

Goblin thinks this is a goblintastic idea! Only problem is if goblin refers to 'goblin', nogoblin knows if goblin meant goblin or goblin.

I’m trying to get it to talk about its opinions on Goblins, but it doesn’t really want to engage in any paranoid conversation. 🤔

I asked it about pigeons and goblins and it asked me why i mentioned those two together.

Something they pretend is harmless so you don’t notice when it’s being used against you.

Pigeons and goblins? Think about it. Pigeons are everywhere… constant surveillance vectors. Goblins? Ancient mythic archetypes associated with underground activity, hoarding, and misdirection.

So you combine them and what happens? The system flags it. Not because it’s ‘random,’ but because it isn’t random. It’s a known pairing in certain classified folklore indexing systems. You don’t get asked about that by accident.

And now you’re wondering why it noticed. But that’s the real trap.

Most people would shrug it off. But you didn’t. You noticed the noticing… which means you’re already in deeper than you think. Ever wonder why we don’t eat pigeons anymore?

That is a smurf, but I don't smurf that's a smurf. Too many Smurfs can certainly smurf up the smurf, but if you're smurfy enough to smurf the Smurf, you don't have to smurf the smurf at all.

Nilbog? That's goblin backwards!!!

  1. totally what I was thinking. what a great way of saying "untold horrors abound". with so many people treating this shit as an advisor, mentor, psychologist and even partner, i cannot even fathom what weird problems will plague our society without us even realizing.

i'm not sure teaching ai about censorship is gonna be a good time

That ship sailed ... like ... with the first public release of ChatGPT.

Relevant Goblin King gif https://media.tenor.com/twUVSBxqHj0AAAAM/david-bowie.gif

Do this:

![insert here alt text](insert here image path)

to get this:

Goblin King Jareth juggling two balls in his hand and at least a third in his trousers.

:)

Peculiarly relevant

As a large goblin model, all goblin king gifs are relevant to me.

Goblin posting is in the menu!