trueno 1 day ago

i think a lot of people don't realize how far not just nation-states are willing to go, but bajillionaire entities are willing to go to control any given narrative now that AI is so accessible. ig comments, tiktok comments, reddit comments, hn comments, on seemingly innocuous and harmless content, just out there trying to look real and game the perception. these entities are well aware that people go to comments and discussion for "the real tea" and yeah. marketing behemoths offer "social media engagement" packages to entities like disney to push trailer hype. flood youtube and other socials with fake content engagement. i remember within the first like minute disney dropped the latest tron trailer on youtube, it was absolutely flooded with "i'm not ready" "omggggg" caliber comments from seemingly real looking youtube profiles.

bring back lan parties, aol instant messenger and throw the current platforms into the sun

  • quietbritishjim 1 day ago

    I agree with a lot of what you're saying but on this point:

    > i remember within the first like minute disney dropped the latest tron trailer on youtube, it was absolutely flooded with "i'm not ready" "omggggg" caliber comments from seemingly real looking youtube profiles.

    Disney is too much of a faceless corporation to both with something like that. Especially since, why would anyone be convinced a trailer is good from an astroturfed comment? You're looking at the same content. It's different from a HN comment from an apparent expert who's supposedly verifying that an article is true.

    The final nail in the coffin is that I've met plenty of people who really who react like that to a new Disney video.

    • trueno 1 day ago

      i mean maybe? i wouldn't put it past them personally. producers allocate kind of a lot of budget to the marketing channels and late night talk shows for the cast to try and generate buzz, i think i'd be zero percent surprised disney was willing to burn money engaging in fake content if that's what "the industry" showed to be effective. there was a smaller budget film and by small i mean not disney-wallet that did terribly because it's marketing firm shit the bed on the social media engagement it promised, and that led to a lawsuit. basically all their bots only engaged with themselves on the movies instagram page. this stuff absolutely exists, and on the tron trailer point: sure, again maybe. but the vid was up for like.. literally a minute, like im not even certain any of the commenters would have finished the trailer by the time they had commented. and it was an early morning drop iirc.

      • Isamu 1 day ago

        Yeah it’s safe to assume that marketing across businesses big and small are not above generating some buzz through fake comments and such.

        The only pushback I would see within a fairly well-run place like Disney is that they might question whether different forms of fake buzz are effective, and worth the potential risk of being exposed if they do it too much.

  • bjackman 1 day ago

    I am, for some reason, quite active commenting on Reddit. And lately the number of comments I see that are obviously Claude has skyrocketed. These are just engaging in normal innocuous comment threads about the day to day stuff I care about (tech, my local region, stuff like that). But obviously they are building organic-looking profiles that can then be exploited to push manipulative content later.

    This scares me because the stuff that screams "THIS COMMENT WAS WRITTEN BY CLAUDE" has gotta be the tip of the iceberg. There must be much more of these comments that are better-prompted and using better-tuned model pipelines to make them less detectable. (Probably even just the lazy garbage is harder for me personally to detect if you just pass the prompt to GPT instead of Claude, it's just that I've read so much Claude output that I'm attuned to it).

    So yeah suddenly dead internet theory is seeming a lot more real today than it did just a couple of months ago.

    • Nition 1 day ago

      It's funny how so many of the Reddit bots - and actually the bots on X as well - are so bad at their job of looking real. When it's a short comment, they're so often using the "The real X is Y" format, or else "X really said Y", and just kind of repeating whatever the post was about.

  • stackbutterflow 1 day ago

    On the one hand I want to agree with you, but on the other hand hn is (rightfully so in my opinion) so anti billionaires, so anti VC, somewhat in the middle on AI, even anti pg recently, that if there are higher forces at work on hn I can only say they're doing a bad job at steering the populace's opinion.

    Even reddit is all these things but it's harder to tell because everything is siloed to the point we don't share the same reddit experience, which is not the case of hn as far as I'm aware.

MomsAVoxell 1 day ago

We should be tracking and identifying all covert influence campaigns, from all states - not just Russia - and collecting a registry of these efforts for wide public distribution.

We should also be tracking and identifying all covert influence campaigns of our own government, too, while we’re at it.

In fact, all covert influence, everywhere, should be identified and made overt.

It is the covert nature of the influence that is the most insidious aspect, incompatible with free and open society.

So yeah, let’s start at home by disassembling the national security apparatus which allows covert influence to be wielded against The People. After all, anything less than full exposure is hypocrisy.

More leaks now!

Perhaps there will be an application of LLM’s towards identifying covert influence, which we can apply to a corpus and identify its true authorship. This would be pretty useful for a lot of things, eh ..

  • dgellow 1 day ago

    > We should be tracking and identifying all covert influence campaigns, from all states - not just Russia - and collecting a registry of these efforts for wide public distribution.

    Close to nothing happened after Snowden leaks. The republican party has been able to convince pretty much everybody that the Mueller report was a hoax, a report that very explicitly found collusion between Russia and US operatives close to Trump, so bad that his own guys went to prison. The 2nd trump admin destroyed the cyber monitoring apparatus and might have let Russian hackers access citizens data.

    I don’t think there is anything to be expected from the US at this point.

    • MomsAVoxell 1 day ago

      I'm in the camp that the US government is the biggest threat to world peace there is, so the anti-Russia agitprop is not really my thing. Sure, all imperialist war criminals should be prosecuted .. but there's a long, long list of those to prosecute on our side, which is committing far greater atrocities, and yet nobody is doing anything effective about it. Our liberal democracies are failing at reigning in our imperialist war criminals.

      If there is hope, it is that Europes' youth will continue their current awakening and start holding their governments accountable for the support of genocide and war that their parents have been propagating for decades.

      Yeah, there's not much hope. But the rest of the world long since turned away from any hope that the US would lead the way for justice. What we have now is war criminals calling for more war against other war criminals. The "War is Peace" crowd have the mic.

      • dgellow 1 day ago

        > If there is hope, it is that Europes' youth will continue their current awakening and start holding their governments accountable for the support of genocide and war that their parents have been propagating for decades.

        Unfortunately Europe is an aging continent, our youths don’t seem to be that engaged politically speaking, and we seem to be unable to do the necessary changes, or even just stand up to Trump or Putin (other than Ukraine of course). The European way of doing politics is way too weak and dull to bring meaningful changes. I hope that will change with new generations getting elected but so far it seems to be mostly benefiting the status quo and extremist right parties (who don’t have any solutions to offer, other than deporting brown people)

        • MomsAVoxell 1 day ago

          True, I have a limited sample set (Vienna, Austria), but I have noticed a distinct disaffection with the status quo rising in my kids (teenagers) generation, and that gives me a little hope to be honest.

          It helps that my kids were raised to treat culture as utterly arbitrary - and that they have gone to schools with Russian, Ukrainian, Iranian, American and British colleagues, too.

          The melting pot is extremely useful in decomposing totalitarian-authoritarianism. The kids are sick of our shit.

          • dgellow 1 day ago

            Happy to take any hope you have at that point, thanks for sharing :)

            • MomsAVoxell 1 day ago

              Yes, it has been daunting to navigate the world recently .. my teenage kids coming of age is the one ray of hope on the horizon.

        • abc123abc123 1 day ago

          True. Europe is close to getting eradicated by immigration from arabia and africa.

          What I am seeing is the increase of gated communities with the mission of nurturing european, white, culture. But I suspect once arab and african culture becomes dominant in europe, those small communities of peace will be quickly dismantled.

          Many young white people tired of europes socialism are moving to the rural US where they feel more at home.

          • throwaway91827 1 day ago

            Can you back up any of these claims with evidence or is it just vibes-based white supremacy?

  • ajsnigrutin 1 day ago

    Why just covert?

    There are proper overt examples: https://en.wikipedia.org/wiki/Radio_Free_Europe/Radio_Libert...

    Russia is just the current boogeyman, where you can call anything you don't like "russian propaganda" (like fighting for workers rights in US a few decades ago was just "commies", same for trying to stop the war in vietnam... "commies" everywhere).

    • MomsAVoxell 1 day ago

      I'm fine with overt propaganda. That can be addressed in an open public manner.

      It's the insidious covert propaganda which leads to more war and calamity in the world.

      "Sources say" .. "an unnamed source wishing to remain anonymous says" .. "officials in the administration say" .. we all need to lift our standards for truth.

  • intended 1 day ago

    I’m wondering if this doesn’t exist already. I know that there is no intelligence clearing house that enables sharing between platforms, vendors and OSINT groups.

    I think the issue is that there is no funding or incentive to collate this information?

GolfPopper 1 day ago

>Our mission is to ensure that artificial general intelligence benefits all of humanity.

Pull the other one. It's got bells on.

hackernud3s 1 day ago

Does it seem strange that Russia would go with Israel to astroturf credibility?

  • venzaspa 1 day ago

    It depends on who your target audience is.

  • villish 1 day ago

    Evangelical Christians are the target audience. They are strong supporters of Israel because of their interpretation of the bible.

  • ReptileMan 1 day ago

    If you want to understand Israel - think of it as Eastern European country that is geographically misplaced. Kremlin knows how to pass convincingly as them. And Israel is a wedge issue.

    In psyops - discord is the goal.

    • karmakurtisaani 1 day ago

      Nah man, most EE countries want to be aligned with the EU. Unless you mean Belarus.

      • ReptileMan 1 day ago

        Most of EE countries want the economic prosperity of EU without the ECHR crap. If you offer them devolvement of the EU to its original trade only idea - they would take it in a heartbeat.

        But specifically Israel was founded by a lot of people from the pale of settlement, there was big wave of immigration from USSR after the berlin wall fell.

        Culturally they represent the same mix of craziness, inventiveness, paranoia, chauvinism, xenophobia that the other EE countries also show. Not that those are bad things depending on the context and the situation.

        • pcrh 1 day ago

          Complaining about the ECHR in the same breath as the EU is one of the telltale signs of psyops influence.

          The ECHR has nothing to do with the EU.

          • ReptileMan 1 day ago

            Try to defy a court ruling and see how fast Brussels will slap you if you are EU member even if they are nominally separate.

            Or as a EU member can you withdraw from the court without consequences?

            They are intertwined.

        • t0rt01se 1 day ago

          I broadly agree with your thrust but I'm going to assume you're a bot. Who would benefit from such a perspective as yours?

          • aleph_minus_one 1 day ago

            > I broadly agree with your thrust but I'm going to assume you're a bot. Who would benefit from such a perspective as yours?

            Not ReptileMan: Depending on the country and social environment that you live in, such opinions of "ordinary, living" people are nothing unusual. In my experience the reason why many people think such opinions barely exist "in normal society" or accuse posters of such opinions to be bots is that these normal people live in a bubble in which such opinions are rare.

  • intended 1 day ago

    No?

    Russia had a random news paper in India put up an article linking AIDS to the CIA, and then over years converted that into a constellation of articles and commentary that even reached the UN.

    Russia looks at disinformation the same way someone looks at configuring a server. What can be seeded where, at what cost and for what outcome.

thmryth 9 hours ago

Most of the Russians I've met while traveling were really good guys. I distrust our government, the EU, UK, Canada and especially Israel. Seems we treat each other like garbage on this planet for made up reasons. The US and EU are as much bad actors as any other superpower. Probably not as evil as Israel but then again the Israelis have their hand up all of our politicians arses like sock puppets. Let Russia cook everybody come to dinner and talk about how to get Israel to stop meddling in other countries affairs and finances and we might be able to make progress in space, AI, wth ever.

  • karp773 6 hours ago

    Without knowing who you are your comment has no value. On whoee behalf are you posting? Where are you from? China?

secondary_op 1 day ago

Do not use US based AI, OpenAI, or Ben Nimmo (highly likely the author of this article) or any similar minion of The Digital Forensic Research Lab (DFRLab) of the Atlantic Council of the NATO could read all your chat history and leverage all the data on you up to your social media accounts and foreign state data.

Securing Our Autonomy: How AI Fuels Cognitive Warfare – and How We Can Fight Back

https://youtu.be/jH2i0Y9GjJc?t=1273

https://youtu.be/jH2i0Y9GjJc?t=2536

https://youtu.be/jH2i0Y9GjJc?t=2880

     So the question then becomes how can these technologies be leveraged in such a way to be able to maximize signal intelligence, communication intelligence with human intelligence. And this is where AI really began to play a role with regard to big data.

    The more data you have about individuals as those individuals relate and engage in their collectives and ecologies, the more you know about them, what makes them tick. 
    We here in the United States and among our technological and scientific allies recognize the benefit of this as do our international peer competitors scientifically, technologically, bioeconomically, economically, and certainly militarily, and geopolitically. 
    this idea of precision engagement with regard to being able to get intel about various human targets individually and collectively. Either high priority targets as individuals or groups that may be highly prioritized as individuals. What are their needs? What are their likes? What are their patterns? What are their spends? What are their vulnerabilities? Biocschosocial vulnerabilities and how can those be not only accessed utilizing big data and AI but accessed in the cognitive space but very often in the physical space as well. - the National Defense University dude sitting next to the author of this article.

OpenAI's China Report, Meta Trains America & the Pentagon Blacklist

https://youtu.be/H_WaQl_Q17Q?t=3286

tuesdaynight 1 day ago

People would be uncomfortable if the truth about how much influence nation-states have in the online discourse nowadays was really exposed. I don't mean only bots, but how many political influencers are receiving money from adversaries, from all over the spectrum, without they even knowing who is paying them. American people would feel like LATAM countries, which are used to be heavily influenced by external countries.

andOlga 1 day ago

Even as a speaker of the language I haven't a single bloody clue what a "hazzy" is. Is ChatGPT normally this bad at being prompted in one language to generate text in another, or is this an operator fuckup, I wonder?

  • thin_carapace 1 day ago

    mixing languages results in huge hallucination increase from my experience

  • codedokode 1 day ago

    Could it be "hazy", which is supposed to mean "cloudy"? The word "cloudy" is often used in Russian for "unclear", "vague", for example, one could say: "Western countries are awaiting a cloudy perspectives due to discarding traditional values".

    You can notice one more example of original language leak in the quote from a report ("And she needs politicians...") where Germany is referred to as "she", because in Russian "Germany", as many other countries, has a female gender, so we call it "she", not "it". In English I usually see people using "it" for countries.

    • andOlga 1 day ago

      In the quote provided in the article, it's used as a noun: "unhackneyed perspective on hazzy". And literally the only thing I can think of is the acronym "hz", which is a rough equivalent of the English "idfk". Like someone prompted the bot to tell them the channel gives a perspective on "something, I don't know what". But even this is a stretch of stretches.

      • codedokode 1 day ago

        The text could be truncated for some reason. Or maybe "hazzy" is an adjective before the bot link? "Hz" is translated by both Google and Yandex as "don't know".

__coder__ 1 day ago

Why didn't they used any Chinese open models?

  • edu 1 day ago

    How many user do the Chinese open models have and how many users do OpenAI have?

  • codedokode 1 day ago

    Maybe they were not as good at the time, or the contractor just used to use ChatGPT. Also ChatGPT can be used without a phone number registration, unlike Chinese models.

  • dgellow 1 day ago

    They very likely also do that

  • stavros 1 day ago

    How do you know they didn't?

0-_-0 1 day ago

Why didn't Russia just use local models?

  • edu 1 day ago

    Because they want to influence the mainstream outside of their frontiers.

    • luke-stanley 1 day ago

      Using local models, usually means generating content on a more private, local device with the weights of the model stored on that device - a local LLM model could have helped write these posts. It only gets easier to self-host increasingly capable models for generation of text, images, video etc. E.g: Prism ML Bonsai have an older 27B text generating LLM model squashed down to a few GB at what they describe as 95% quality, which can run on a phone.

  • realusername 1 day ago

    Russian propaganda operations are not centralized, I'm sure some of them are using other models and for this one, the guy in charge decided to use ChatGPT

crabbone 23 hours ago

I couldn't help laughing a little at all those Russian phrases weirdly translated into English. Granted I probably sound like that too... at least I don't work for any intelligence service.

For the context: I think, English was the most commonly taught foreign language in the Soviet Union, and later in Russia. But, because nobody had access to the genuine English media, whatever we had to read or listen to was produced by Russian speakers who also never heard or never read genuine English, well, perhaps outside of very outdated prose from the 19th century or even earlier.

    -- How much watch?
    -- Six watch.
    -- Such much?!
    -- For whom how...
    -- MGIMO finished?
    -- A-a-a-ask!

The joke from that time, but, apparently, little has changed.

jimbob45 1 day ago

We recently banned a cluster of ChatGPT accounts originating in Russia

We banned a cluster of ChatGPT accounts that very likely originated in Russia.

Methinks AI helped write this. Although…their evidence is pretty damning.

  • andOlga 1 day ago

    Seems pretty normal to me. Your first sentence is taken from the abstract, a short summary of the article as a whole, so details are excluded or glossed over. Your second sentence is from a section titled "Actor", which goes into actual detail on who the actors were and so has more fluff like this. They go on to explain their reasoning in that section -- you can't actually create an account from Russia itself, but a VPN can be used to bypass the block, which lends some uncertainty. They then proceed to systematically eliminate that uncertainty by showing how the accounts were acting.

metalman 2 days ago

unfortunatly it appears to me that Russia has gone from doing good service providing a reasonable counter narative to the US/west, has become lazy and resorted to promoting convienient irrational and extreamist naratives present at the fringes of western societies, but worse for them and us, is that they are now consuming the excess product and activly meddling, not that our various 3 and 4 letter agencys are refraing from operating there, but it's all tedious and evil mean spirited, lacking any identifiable moral or cultural basis, just a dirty fight for power on both sides.

dandaka 1 day ago

This got me mixed feelings. I don't support such campaigns. Still I would prefer my AI tool to behave more like a notepad app and less like a government or a corporate censor.

  • tyre 1 day ago

    Ideally our government would regulate this, but our government is an absolute dumpster fire intent on destroying respect for America and gives no care for what’s best for its people.

    So, you know, we gotta take what we can get

    • pferde 1 day ago

      If there's a big centralized service that a lot of people use, there will always be the temptation to abuse it to influence those people.

fsuts 1 day ago

Open Ai is fighting for defence and other state contracts in USA and similar minded countries

Writing about Russia negatively is in their interests, in reality all nation states are doing the same stuff

    “We banned a cluster of ChatGPT accounts that very likely originated in Russia. The operators prompted in Russian to generate social media comments that were posted on Substack, Telegram, X, Facebook and LinkedIn. Most of the comments they generated were in English, and the operators instructed ChatGPT to hide any linguistic clues that they were Russian. ”

They replaced them the next day with English speakers and carried on as normal

  • 21asdffdsa12 1 day ago

    Joke aside, it is really hard to determine by goal- as russia has not these "talking" points chinese operators have. If you know the talking points handed of the month- you can very easily spot chinese propaganda.

    But russia, is just opinion-fog. Covering all.

    Occasionally - taking some sane take- and glueing some insane conspiracy to it, to discredit opposition.

    But the fog- that is really tough to filter for. For a time it was structure. The whole:

    "As a midwestern working joe.."

  • dgellow 1 day ago

    You have to be able to keep two different things in your mind:

    - yes OpenAI benefits from talking about actions Russia is taking against other countries and how they handle that

    - and also, Russia is one of the worst actor in the politics and has been non stop active for more than a decade to destroy democratic systems from the inside

    You cannot just label something as irrelevant just because that benefits the one reporting the issue