Skip to content

Problem with twitter front-page ban#337

Open
sm-ghavami wants to merge 1 commit into
taspinar:masterfrom
sm-ghavami:javascript-patch-1
Open

Problem with twitter front-page ban#337
sm-ghavami wants to merge 1 commit into
taspinar:masterfrom
sm-ghavami:javascript-patch-1

Conversation

@sm-ghavami

Copy link
Copy Markdown

Some changes to bypass twitter restrictions

We've detected that JavaScript is disabled in your browser.
@neuensjohn

Copy link
Copy Markdown

Tested, this worked great for me. Thanks!

@Kiesco08 Kiesco08 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested and works for me too

@narain1

narain1 commented Aug 13, 2020

Copy link
Copy Markdown

works for me too

@renatocron

Copy link
Copy Markdown

worked for me too, only after patch.

@LeoVS09

LeoVS09 commented Aug 13, 2020

Copy link
Copy Markdown

Works for me, when this changes will be released?

@renatocron

renatocron commented Aug 13, 2020

Copy link
Copy Markdown

I don't know about this, I'm just testing today as beginner, every few tweets I got one from GamesRedDeer with tweet promoting a giveaway. With or without proxy. is this the expected result?
it's always 1293568121329061889, no matter what query I do

https://twitter.com/GamesRedDeer/status/1293568121329061889

This is only happening when -c is passed (CSV), 1293568121329061889 is not found on the json file.

@sspartzz257

Copy link
Copy Markdown

Can anyone provide a guide for someone new on how to use this commit request?

@renatocron

renatocron commented Aug 14, 2020 via email

Copy link
Copy Markdown

@sspartzz257

Copy link
Copy Markdown

Test and works for me

@ghost ghost left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix!

@christiangfv

Copy link
Copy Markdown

How I can implement this solution without modifying the module ?

@victorgois

Copy link
Copy Markdown

Worked as well. Thanks!

@warwickjones

Copy link
Copy Markdown

This worked a few times, and then I get this error message and only a fraction of my limit.

Failed to parse JSON while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=thGAVUV0VFVBaAwKqhpsTgySEWgoCogZGk3sohEjUAFQAlAFUAFQAVARUAFQAA&q=arson%20OR%20firebug%20since%3A2019-12-12%20until%3A2019-12-26&l=english" Traceback (most recent call last): File "/opt/anaconda3/lib/python3.8/site-packages/twitterscraper/query.py", line 109, in query_single_page html = json_resp['items_html'] or '' KeyError: 'items_html'

I also get errors for line 104 and 182 which doesn't resolve until a reinstall twitterscraper and the commit request.

Can anyone help? I'm a first time coder. Very, very new to this stuff.

@raskshit raskshit left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

@GivenToFlyCoder

Copy link
Copy Markdown

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!

Sometimes i repeat the searches with the same keywords, Accounts and dates, and a i get different tweets.

@HARDROCO

Copy link
Copy Markdown

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!

Sometimes I repeat the searches with the same keywords, Accounts, and dates, and a i get different tweets.

yeah same for me, I put the patch code and apparently the limit parameter doesn't work fine for instance I put "limit = 5" and I retrieve 142 tweets

@HARDROCO

Copy link
Copy Markdown

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
2233682

copy the green code lines and replace the red code lines in your query.py file and save it that's all
and make sure to create a copy before do it

@rizkysifaul

rizkysifaul commented Aug 19, 2020

Copy link
Copy Markdown

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
2233682

copy the green code lines and replace the red code lines in your query.py file and save it that's all
and make sure to create a copy before do it

Thank you so much, I can do scraping normally, with changing some code on query.py. Actually it is not stable because after succeeding at the first attempt, I got 0 tweets after that.

@Jasonnor Jasonnor left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It works for me!

@LinqLover

LinqLover commented Aug 25, 2020

Copy link
Copy Markdown
Contributor

Thanks for the PR! Anyone else receiving improper tweets (could be sponsored material) since using this patch?

Edit: Hm, the issue is even older. I just opened #342 for it. Still, our number of unmatching tweets has raised significantly since applying this PR ...

cidm-3 added a commit to aodsc/twitterscraper that referenced this pull request Aug 27, 2020
sm-ghavami Issue taspinar#337 Fix
@eugenelee123 eugenelee123 mentioned this pull request Sep 16, 2020
@jason1991220

Copy link
Copy Markdown

It doesn't work again. Return 0 tweet.

@Nellix

Nellix commented Sep 18, 2020

Copy link
Copy Markdown

I confirm that it is not working anymore since this midnight 18-09-2020.

@jason1991220

Copy link
Copy Markdown

I confirm that it is not working anymore since this midnight 18-09-2020.

404 error with init_url, anyone knows how to fix if?

INIT_URL = 'https://twitter.com/i/search/timeline?f=tweets&vertical='
'default&include_available_features=1&include_entities=1&'
'reset_error_state=false&src=typd&max_position=-1&q={q}&l={lang}'

@rhz

rhz commented Sep 19, 2020

Copy link
Copy Markdown

I get this ERROR:twitterscraper:An unknown error occurred! Returning tweets gathered so far.

@gautampal1947

Copy link
Copy Markdown

Some changes to bypass twitter restrictions

Seems this solution is NOT working again :-(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.