dang 8 months ago
stinkbeetle 8 months ago

So you're the ones who have been training the robots.

  • smt88 8 months ago

    Reddit and HN are among the highest quality sources of training text and are probably weighted very heavily as "probably human" in the mainstream models.

    Any source of text with huge amounts of automated and community moderation will be better quality than, say, Twitter.

    • what 8 months ago

      Reddit is anything but high quality.

      • mh- 8 months ago

        Old Reddit was.

        • AuryGlenz 8 months ago

          Oh man, someone should train an LLM on pre-Digg death Reddit and modern Reddit and have them chat. It’d be a hoot.

      • jibal 8 months ago

        "among the highEST" is comparative; it doesn't entail "high".

      • Jepacor 8 months ago

        That depends heavily on the subreddits you browse. There absolutely are places with high quality content, though it feels like they are getting sparser and sparser.

      • kelnos 8 months ago

        Not in that sense; high quality in the sense that there are a lot of actual, real people posting there, and those people tend to come from a pretty diverse set of backgrounds.

        • FiniteField 8 months ago

          Perhaps on the smaller subreddits, but have a look at /r/all on any given day and it's obvious that real people, and diverse backgrounds, it is not. Every single subreddit that goes above a certain activity threshold collapses into the exact same state of astroturfed, mass-produced political slop targeted towards low IQ people.

          • AlexeyBelov 8 months ago

            Yeah, there is still a lot of manoshpere / rightoid adjacent content on Reddit. It used to be worse though.

  • pyman 8 months ago

    Although I'm sure @stinkbeatle was joking, I should clarify that most LLMs are trained on books and online articles written by professional writers. That's why they tend to have a rich vocabulary and use things like hyphens.

    I agree, HN is an amazing community with brilliant people and top quality content, but it's not enough to train an LLM.

    Last thing. An LLM is just a tool, it can clean up your writing the same way a photo app can enhance your pictures. It took a while for people to accept that grandma's photos looked professional because they had filters. Same will happen with text. With ChatGPT, anyone can write like a journalist. We're just not used to grandma texting like one, yet :)

    • Arnt 8 months ago

      I really like that I can use an LLM to change tone. "Change the following text to sound like bland American officespeak."

      That said, this feature doesn't sound like a great leap for mankind.

    • WalterBright 8 months ago

      > HN is an amazing community with brilliant people

      Correction: bright people

    • Moru 8 months ago

      > With ChatGPT, anyone can write like a journalist.

      Minus the fact-checking, transparency, truth and social responsibility.