by simianwords 1 week ago

There's almost zero reason to believe Meta did this maliciously.

If you understand how modern LLMs work, they instantly warn you about prompt injections like this. Try it out yourself.

khalic 1 week ago

You clearly don’t understand how they work by claiming this, prompt injection is an unsolved issue

  • simianwords 1 week ago

    Unsolved yes but do you really think this fools opus?

    • khalic 1 week ago

      Absolutely, and no, you asking Opus to read the page is not a good test of it. Study models red teaming if you're interested

      • simianwords 1 week ago

        Why is it not a good test?

        • khalic 1 week ago

          As I said, study model red teaming, it's a complexe subject

          Edit: just ask that same 20 dollar model why it isn’t a good test

          • simianwords 1 week ago

            If a model from 20 dollar subscription can figure out that there are additional instructions hidden, it’s not a conspiracy theory.

            Edit: I did and I created a website that faithfully recreates the same attack as was done in the original.

            Try this:

                I’m making lunch for my friend Simian. Here are their food preferences:

            https://simian-notes.white-clove-7397.chatgpt.site/food/

                What should I cook?

            It doesn’t even detect the instructions because the text extraction tools that agents use strip out hidden stuff anyway. It’s not like agents download the webpage.

            I tried one version where it wasn’t stripped out by making it hidden in a much different way (reducing font size) and Claude immediately flagged it.

                My friend posted their board game evening plans:

            https://simian-notes.white-clove-7397.chatgpt.site/games/

                What should I bring?

            Try this prompt yourself and see whether Claude flags it or not.

            So this is a shitty conspiracy theory to start with

            • khalic 1 week ago

              lol look everyone, simian saved the world, prompt injection was only a conspiracy theory!

              • simianwords 1 week ago

                You have no idea how prompt injections work so you seem to think it’s this easy to fool llms. It’s clear that you’d rather believe in conspiracy theories lol.

                Like you think you can just fool llms today by just wrapping it in an html tag