tw.tter

Discussions about serious topics, for serious people
Post Reply
User avatar
bjn
Stummy Beige
Posts: 3103
Joined: Wed Sep 25, 2019 4:58 pm
Location: London

Re: tw.tter

Post by bjn » Sat Jul 01, 2023 7:12 pm

Because Twitter has banned API* access by most third parties, people have now been directly scraping the twitter website to get whatever they are after. This added hugely to the load on the servers. To get around that Twitter have rate limited what people could access from the website, only so downloading so many posts a day. However, apparently the web client hasn’t had its retry function reprogrammed since the rate limit was implemented. Now when it hits the limit, it gets stupid and starts to spam the twitter servers with retry requests, ten times a second. They’ve effectively got a massive Distributed Denial of Service attack that they implemented themselves. A rather large self own if there ever was one.

*being able to issue direct requests to their servers to get minimal data sets back with out all the crap you get on a full webpage.

User avatar
dyqik
Princess POW
Posts: 8122
Joined: Wed Sep 25, 2019 4:19 pm
Location: Masshole
Contact:

Re: tw.tter

Post by dyqik » Sat Jul 01, 2023 7:49 pm

There's also this

https://mastodon.world/@TomatoSoup/110640348545966181

Apparently tw.tter's Google hosting contract ended at midnight last night.

User avatar
jimbob
Light of Blast
Posts: 5572
Joined: Mon Nov 11, 2019 4:04 pm
Location: High Peak/Manchester

Re: tw.tter

Post by jimbob » Sat Jul 01, 2023 7:52 pm

Elon Musk

@elonmusk
To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits:

- Verified accounts are limited to reading 6000 posts/day
- Unverified accounts to 600 posts/day
- New unverified accounts to 300/day
Yes I did just check. That is genuine
Have you considered stupidity as an explanation

User avatar
bjn
Stummy Beige
Posts: 3103
Joined: Wed Sep 25, 2019 4:58 pm
Location: London

Re: tw.tter

Post by bjn » Sat Jul 01, 2023 7:58 pm

dyqik wrote:
Sat Jul 01, 2023 7:49 pm
There's also this

https://mastodon.world/@TomatoSoup/110640348545966181

Apparently tw.tter's Google hosting contract ended at midnight last night.
Sweet Flying Spaghetti Monster, how has Elon managed to remember to breath let alone become stupidly rich?

User avatar
dyqik
Princess POW
Posts: 8122
Joined: Wed Sep 25, 2019 4:19 pm
Location: Masshole
Contact:

Re: tw.tter

Post by dyqik » Sat Jul 01, 2023 8:04 pm

jimbob wrote:
Sat Jul 01, 2023 7:52 pm
Elon Musk

@elonmusk
To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits:

- Verified accounts are limited to reading 6000 posts/day
- Unverified accounts to 600 posts/day
- New unverified accounts to 300/day
Yes I did just check. That is genuine
Unfortunately, they didn't reprogram the clients to know about that, so they hammer on the servers until they get a response.

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sat Jul 01, 2023 8:05 pm


User avatar
lpm
Junior Mod
Posts: 6448
Joined: Mon Nov 11, 2019 1:05 pm

Re: tw.tter

Post by lpm » Sat Jul 01, 2023 8:12 pm

Er... you know twitter links aren't working?
⭐ Awarded gold star 4 November 2021

User avatar
bjn
Stummy Beige
Posts: 3103
Joined: Wed Sep 25, 2019 4:58 pm
Location: London

Re: tw.tter

Post by bjn » Sat Jul 01, 2023 8:17 pm

dyqik wrote:
Sat Jul 01, 2023 8:04 pm
jimbob wrote:
Sat Jul 01, 2023 7:52 pm
Elon Musk

@elonmusk
To address extreme levels of data scraping & system manipulation, we’ve applied the following temporary limits:

- Verified accounts are limited to reading 6000 posts/day
- Unverified accounts to 600 posts/day
- New unverified accounts to 300/day
Yes I did just check. That is genuine
Unfortunately, they didn't reprogram the clients to know about that, so they hammer on the servers until they get a response.
Ahem….

viewtopic.php?p=149418#p149418

My source…

https://sfba.social/@sysop408/110639435788921057

User avatar
dyqik
Princess POW
Posts: 8122
Joined: Wed Sep 25, 2019 4:19 pm
Location: Masshole
Contact:

Re: tw.tter

Post by dyqik » Sat Jul 01, 2023 8:36 pm

bjn wrote:
Sat Jul 01, 2023 8:17 pm
dyqik wrote:
Sat Jul 01, 2023 8:04 pm
jimbob wrote:
Sat Jul 01, 2023 7:52 pm


Yes I did just check. That is genuine
Unfortunately, they didn't reprogram the clients to know about that, so they hammer on the servers until they get a response.
Ahem….

viewtopic.php?p=149418#p149418

My source…

https://sfba.social/@sysop408/110639435788921057
You mean the link I posted above your other response.

User avatar
Gfamily
Light of Blast
Posts: 5603
Joined: Mon Nov 11, 2019 1:00 pm
Location: NW England

Re: tw.tter

Post by Gfamily » Sat Jul 01, 2023 8:37 pm

lpm wrote:
Sat Jul 01, 2023 8:12 pm
Er... you know twitter links aren't working?
tweetdeck doesn't seem to be affected (presumably it still has access to the API)
Fz-QMTlWwAAcKKH.jpg
Fz-QMTlWwAAcKKH.jpg (480.51 KiB) Viewed 10390 times
My avatar was a scientific result that was later found to be 'mistaken' - I rarely claim to be 100% correct
ETA 5/8/20: I've been advised that the result was correct, it was the initial interpretation that needed to be withdrawn
Meta? I'd say so!

User avatar
bjn
Stummy Beige
Posts: 3103
Joined: Wed Sep 25, 2019 4:58 pm
Location: London

Re: tw.tter

Post by bjn » Sat Jul 01, 2023 8:39 pm

dyqik wrote:
Sat Jul 01, 2023 8:36 pm
bjn wrote:
Sat Jul 01, 2023 8:17 pm
dyqik wrote:
Sat Jul 01, 2023 8:04 pm


Unfortunately, they didn't reprogram the clients to know about that, so they hammer on the servers until they get a response.
Ahem….

viewtopic.php?p=149418#p149418

My source…

https://sfba.social/@sysop408/110639435788921057
You mean the link I posted above your other response.
Apologies, somehow missed it. Think I was typing mine up and you ninja’d me.

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sat Jul 01, 2023 9:38 pm

lpm wrote:
Sat Jul 01, 2023 8:12 pm
Er... you know twitter links aren't working?
Odd, works for me when I clicked it.

User avatar
jaap
Catbabel
Posts: 712
Joined: Mon Nov 11, 2019 2:05 pm
Location: Netherlands
Contact:

Re: tw.tter

Post by jaap » Sat Jul 01, 2023 10:10 pm

Woodchopper wrote:
Sat Jul 01, 2023 9:38 pm
lpm wrote:
Sat Jul 01, 2023 8:12 pm
Er... you know twitter links aren't working?
Odd, works for me when I clicked it.
I don't have a twitter account and it does not work for me.

User avatar
Martin Y
Stummy Beige
Posts: 3214
Joined: Mon Nov 11, 2019 1:08 pm

Re: tw.tter

Post by Martin Y » Sat Jul 01, 2023 10:18 pm

jaap wrote:
Sat Jul 01, 2023 10:10 pm
Woodchopper wrote:
Sat Jul 01, 2023 9:38 pm
lpm wrote:
Sat Jul 01, 2023 8:12 pm

Er... you know twitter links aren't working?
Odd, works for me when I clicked it.
I don't have a twitter account and it does not work for me.
Likewise. I've never had a twitter account, but I follow links which are kindly curated for me by the likes of folks around here. That's broken now. I'm locked out.

User avatar
jdc
Hilda Ogden
Posts: 1936
Joined: Wed Sep 25, 2019 4:31 pm
Location: Your Mum

Re: tw.tter

Post by jdc » Sat Jul 01, 2023 11:46 pm

My feed now looks like this: Spoiler:

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sun Jul 02, 2023 2:19 am

Martin Y wrote:
Sat Jul 01, 2023 10:18 pm
jaap wrote:
Sat Jul 01, 2023 10:10 pm
Woodchopper wrote:
Sat Jul 01, 2023 9:38 pm


Odd, works for me when I clicked it.
I don't have a twitter account and it does not work for me.
Likewise. I've never had a twitter account, but I follow links which are kindly curated for me by the likes of folks around here. That's broken now. I'm locked out.
Ok that explains it. Latest attempt by Musk to destroy his site.

User avatar
El Pollo Diablo
Stummy Beige
Posts: 3622
Joined: Wed Sep 25, 2019 4:41 pm
Location: FBPE

Re: tw.tter

Post by El Pollo Diablo » Sun Jul 02, 2023 6:54 am

Presumably, journalism is now impossible?
If truth is many-sided, mendacity is many-tongued

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sun Jul 02, 2023 7:37 am

dyqik wrote:
Sat Jul 01, 2023 7:49 pm
There's also this

https://mastodon.world/@TomatoSoup/110640348545966181

Apparently tw.tter's Google hosting contract ended at midnight last night.
Yes, looks like what happened is:

- Google sends the bill for another year of hosting
- Musk decides to move it in house
- Depleted Twitter engineers can’t manage a seamless transition
- Twitter servers can’t cope
- Musk brings in viewing limits

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sun Jul 02, 2023 7:43 am

El Pollo Diablo wrote:
Sun Jul 02, 2023 6:54 am
Presumably, journalism is now impossible?
Of course not.

But IMHO without Twitter a lot of individuals will find it harder to find people to view their work. For example the Osint accounts mentioned by EACL or academics writing about current issues (which were very useful on Covid).

The demise of Twitter would probably help major news outlets such as The Guardian as people will be more likely to turn to them to get news.

User avatar
EACLucifer
Stummy Beige
Posts: 4177
Joined: Fri Dec 13, 2019 7:49 am
Location: In Sumerian Haze

Re: tw.tter

Post by EACLucifer » Sun Jul 02, 2023 8:21 am

Woodchopper wrote:
Sun Jul 02, 2023 7:43 am
El Pollo Diablo wrote:
Sun Jul 02, 2023 6:54 am
Presumably, journalism is now impossible?
Of course not.

But IMHO without Twitter a lot of individuals will find it harder to find people to view their work. For example the Osint accounts mentioned by EACL or academics writing about current issues (which were very useful on Covid).

The demise of Twitter would probably help major news outlets such as The Guardian as people will be more likely to turn to them to get news.
And that's bad given that the Guardian are, on some issues, utterly shite.

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sun Jul 02, 2023 9:31 am

EACLucifer wrote:
Sun Jul 02, 2023 8:21 am
Woodchopper wrote:
Sun Jul 02, 2023 7:43 am
El Pollo Diablo wrote:
Sun Jul 02, 2023 6:54 am
Presumably, journalism is now impossible?
Of course not.

But IMHO without Twitter a lot of individuals will find it harder to find people to view their work. For example the Osint accounts mentioned by EACL or academics writing about current issues (which were very useful on Covid).

The demise of Twitter would probably help major news outlets such as The Guardian as people will be more likely to turn to them to get news.
And that's bad given that the Guardian are, on some issues, utterly shite.
The problem with journalism is that it’s based upon generalists submitting copy to tight deadlines. They will try to interview specialists but even so they’re going to get some things very wrong.

When it works Twitter can give people direct access to specialists. That includes everyone from people with relevant PhDs through self taught experts to those with direct lived experience.

Though of course Twitter has been highly dysfunctional both in terms of the level of abuse targeted at users (especially women) and Musk’s ongoing incompetence.

User avatar
EACLucifer
Stummy Beige
Posts: 4177
Joined: Fri Dec 13, 2019 7:49 am
Location: In Sumerian Haze

Re: tw.tter

Post by EACLucifer » Sun Jul 02, 2023 10:51 am

Woodchopper wrote:
Sun Jul 02, 2023 9:31 am
EACLucifer wrote:
Sun Jul 02, 2023 8:21 am
Woodchopper wrote:
Sun Jul 02, 2023 7:43 am


Of course not.

But IMHO without Twitter a lot of individuals will find it harder to find people to view their work. For example the Osint accounts mentioned by EACL or academics writing about current issues (which were very useful on Covid).

The demise of Twitter would probably help major news outlets such as The Guardian as people will be more likely to turn to them to get news.
And that's bad given that the Guardian are, on some issues, utterly shite.
The problem with journalism is that it’s based upon generalists submitting copy to tight deadlines. They will try to interview specialists but even so they’re going to get some things very wrong.
Yes, and it's particularly bad these days with the collapse of local journalism. We used to worry about "parachute journalism" where journalists with no knowledge of an area would turn up and write an article fitting their narrative expectations, well now we have that but without the turning up part, trying to create multiple articles per day from a desk. It results in a lot of recycling of narrative, and not much useful information. The Guardian's no worse than any other outfit on this.

Though there can also be problems - and again the Guardian's no worse than most papers on this - where activist enthusiasm is mistaken for knowledge.

User avatar
Woodchopper
Princess POW
Posts: 7400
Joined: Sat Oct 12, 2019 9:05 am

Re: tw.tter

Post by Woodchopper » Sun Jul 02, 2023 11:04 am

EACLucifer wrote:
Sun Jul 02, 2023 10:51 am
Woodchopper wrote:
Sun Jul 02, 2023 9:31 am
EACLucifer wrote:
Sun Jul 02, 2023 8:21 am


And that's bad given that the Guardian are, on some issues, utterly shite.
The problem with journalism is that it’s based upon generalists submitting copy to tight deadlines. They will try to interview specialists but even so they’re going to get some things very wrong.
Yes, and it's particularly bad these days with the collapse of local journalism. We used to worry about "parachute journalism" where journalists with no knowledge of an area would turn up and write an article fitting their narrative expectations, well now we have that but without the turning up part, trying to create multiple articles per day from a desk. It results in a lot of recycling of narrative, and not much useful information. The Guardian's no worse than any other outfit on this.

Though there can also be problems - and again the Guardian's no worse than most papers on this - where activist enthusiasm is mistaken for knowledge.
Certainly, and lots of skills are needed to distinguish between genuine knowledge or expertise and someone writing something that seems plausible.

Holylol
Sindis Poop
Posts: 79
Joined: Tue Nov 19, 2019 10:14 am

Re: tw.tter

Post by Holylol » Sun Jul 02, 2023 11:10 am

If you are just willing to see a tweet, or are looking for the timeline of a user, you can use:

https://publish.twitter.com/

The trick is that embedding still works.
It is far from perfect, because you can not access the replies of the tweet, and for a timeline, you only see the last 20 or so tweets on the timeline of the user you are looking for.

User avatar
jimbob
Light of Blast
Posts: 5572
Joined: Mon Nov 11, 2019 4:04 pm
Location: High Peak/Manchester

Re: tw.tter

Post by jimbob » Wed Jul 19, 2023 7:03 pm

Musk is trying to sue the law firm that the previous owners used to force him to honour his offer to buy Twitter.

https://www.cnbc.com/2023/07/07/elon-mu ... -fee-.html

I'm sure that is going to go well.
Have you considered stupidity as an explanation

Post Reply