A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
This is a science community. We use the Dawkins definition of meme.
I suppose this will become an arms race, just like with ad-blockers and ad-blocker detection/circumvention measures.
There will be solutions for scraper-blockers/traps. Then those become more sophisticated. Then the scrapers become better again and so on.
I don't really see an end to this madness. Such a huge waste of resources.
Madness is right. If only we didn't have to create these things to generate dollar.
This is surely trivial to detect. If the number of pages on the site is greater than some insanely high number then just drop all data from that site from the training data.
It's not like I can afford to compete with OpenAI on bandwidth, and they're burning through money with no cares already.
Yeah sure, but when do you stop gathering regularly constructed data, when your goal is to grab as much as possible?
Markov chains are an amazingly simple way to generate data like this, and a little bit of stacked logic it's going to be indistinguishable from real large data sets.
Imagine the staff meeting:
You: we didn't gather any data because it was poisoned
Corposhill: we collected 120TB only from harry-potter-fantasy-club.il !!
Boss: hmm who am I going to keep...
The boss fires both, "replaces" them for AI, and tries to sell the corposhill's dataset to companies that make AIs that write generic fantasy novels
I’m so happy to see that ai poison is a thing
It's so sad we're burning coal and oil to generate heat and electricity for dumb shit like this.
Wait till you realize this project's purpose IS to force AI to waste even more resources.
I mean, the long term goal would be to discourage ai companies from engaging in this behavior by making it useless
Here's a thing - it's not useless.
"Markov Babble" would make a great band name
Their best album was Infinite Maze.
Deployment of Nepenthes and also Anubis (both described as "the nuclear option") are not hate. It's self-defense against pure selfish evil, projects are being sucked dry and some like ScummVM could only freakin' survive thanks to these tools.
Those AI companies and data scrapers/broker companies shall perish, and whoever wrote this headline at arstechnica shall step on Lego each morning for the next 6 months.
Feels good to be on an instance with Anubis
Could you imagine a world where word of mouth became the norm again? Your friends would tell you about websites, and those sites would never show on search results because crawlers get stuck.
That would be terrible, I have friends but they mostly send uninteresting stuff.
Better yet. Share links to tarpits with your non-friends and enemies
No they wouldn't. I'm guessing you're not old enough to remember a time before search engines. The public web dies without crawling. Corporations will own it all you'll never hear about anything other than amazon or Walmart dot com again.
Nope. That isn't how it worked. You joined message boards that had lists of web links. There were still search engines, but they were pretty localized. Google was also amazing when their slogan was "don't be evil" and they meant it.
No. Only very selective people joined message boards. The rest were on AOL or compact. You're taking a very select group of.people and expecting the Facebook and iPad generations to be able to do that. Not going to happen. I also noticed some people below talking about things like geocities and other minor free hosting and publishing site that are all gone now. They're not coming back.
I was there. People carried physical notepads with URLs, shared them on BBS', or other forums. It was wild.
There was also "circle banners" of websites that would link to each others... And then off course "stumble upon"...
Yes! Web rings!
I forgot web rings! Also the crazy all centered Geocities websites people made. The internet was an amazing place before the major corporations figured it out.
AI is the "most aggressive" example of "technologies that are not done 'for us' but 'to us.'"
Well said.