Elon Musk recently announced that users will be limited to seeing a certain amount of tweets on a daily basis before streamlining the decision rapidly. Musk blamed AI startups for Twitter data scraping.
Now, only 600 posts can be viewed daily by unverified accounts, and only 300 can be viewed daily by “new”” unverified accounts. The restrictions for verified accounts still only allow reading up to 6,000 posts per day.
“To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits,” Musk wrote in the first of several tweets about the choice. Musk posted about the rate constraints repeatedly throughout the day, allowing people to watch more posts each time.
Verified accounts for paying users had a limit of 6,000 posts per day as of 10 a.m. Saturday, existing unverified accounts had a restriction of 600 posts per day; and new unverified accounts had a limit of 300 posts per day. According to Musk’s tweets, those figures rose to 10,000, 1,000, and 5,000 by 3 p.m., respectively.
To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits:
– Verified accounts are limited to reading 6000 posts/day
– Unverified accounts to 600 posts/day
– New unverified accounts to 300/day— Elon Musk (@elonmusk) July 1, 2023
Twitter data scraping: Elon Musk blames AI startups
For artificial intelligence (AI) training the large language models (LLMs) like those powering ChatGPT, Microsoft Bing, and Google Bard, Musk is criticizing businesses attempting to swallow data. Twitter data scraping is the reason behind all these limits, according to Musk.
However, he omitted to explain that, since taking over the business last fall, he has decided to fire more than half of Twitter’s workers, including personnel vital to sustaining its infrastructure. People have frequently warned that firing so many individuals would have an adverse effect on Twitter’s stability, and as a result of the unplanned layoffs, the firm even had to rehire some engineers who had been fired.
Elon Musk works on a ChatGPT competitor codenamed “TruthGPT”
Twitter bots are one of the biggest causes
Twitter now has an issue that goes beyond cryptocurrency spam accounts: accounts and bots that advertise sexual content and infiltrate Direct Messages and user conversations. There doesn’t appear to be a simple answer in sight either.
Even though the issue has been there for a long, Elon Musk’s hopeful statements about addressing bots and fraudulent accounts on Twitter after he acquired the platform make the rise in porn bots amusing.
Security research company MalwareHunterTeam revealed several Twitter accounts that are spam bots in a tweet that inject themselves into discussions as likes. This is done in an effort to get users to look at the profiles of these bot accounts and click on the links that are provided in their bios. Here is the tweet:
WTF, @elonmusk? Likes from 9 porn bots accounts in a row… It's a record for this account I think.
But all bot problems got solved months ago, right?
😂 pic.twitter.com/gN56SPNcR7— MalwareHunterTeam (@malwrhunterteam) June 27, 2023
What is data scraping?
Using software tools or scripts, data scraping is the process of obtaining data from websites, databases, or other sources. Twitter data scraping is also an example. There are several uses for data scraping, including:
- Market research: Data scraping can assist companies in learning more about their rivals, clients, goods, costs, trends, etc. Data scraping can also be used to find untapped markets, niches, or possibilities.
- Lead generation: Data scraping enables companies to identify prospective consumers or clients based on their preferences, needs, habits, or interests. Data scraping can also be used to gather contact details including social network profiles, email addresses, and phone numbers.
- Content creation: Data scraping can assist content producers in locating pertinent and interesting subjects, keywords, photographs, videos, or other media for their websites, blogs, social media platforms, etc. Data scraping can also assist in creating content automatically or somewhat automatically utilizing NLP approaches.
- Data analysis: Data scraping enables scientists and data analysts to gather substantial amounts of data from numerous sources and organize it into useful formats. Additionally, data enrichment, cleaning, validation, or visualization might aid in providing new information or insights from the data.
Both manually and automatically generated data can be scraped. Manual data scraping entails copying and pasting data into spreadsheets or other documents from websites or other sources.
Manual data scraping is laborious, time-consuming, and error-prone. Utilizing software programs or scripts to automatically crawl, interpret, extract, and save data from websites or other sources is known as automatic data scraping.
How to conduct data research on the web
Compared to human data scraping, automatic data scraping is quicker, simpler, and more accurate. That is probably what has been in use for Twitter data scraping too.
Featured image credit: Glenn Carstens-Peters on Unsplash.
