Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem with twitter front-page ban #337

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

sm-ghavami
Copy link

Some changes to bypass twitter restrictions

We've detected that JavaScript is disabled in your browser.
@neuensjohn
Copy link

Tested, this worked great for me. Thanks!

Copy link

@Kiesco08 Kiesco08 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested and works for me too

@narain1
Copy link

narain1 commented Aug 13, 2020

works for me too

@renatocron
Copy link

worked for me too, only after patch.

@LeoVS09
Copy link

LeoVS09 commented Aug 13, 2020

Works for me, when this changes will be released?

@renatocron
Copy link

renatocron commented Aug 13, 2020

I don't know about this, I'm just testing today as beginner, every few tweets I got one from GamesRedDeer with tweet promoting a giveaway. With or without proxy. is this the expected result?
it's always 1293568121329061889, no matter what query I do

https://twitter.com/GamesRedDeer/status/1293568121329061889

This is only happening when -c is passed (CSV), 1293568121329061889 is not found on the json file.

@sspartzz257
Copy link

Can anyone provide a guide for someone new on how to use this commit request?

@renatocron
Copy link

renatocron commented Aug 14, 2020 via email

@sspartzz257
Copy link

Test and works for me

Copy link

@0ihsan 0ihsan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fix!

@christiangfv
Copy link

How I can implement this solution without modifying the module ?

@victorgois
Copy link

Worked as well. Thanks!

@wajonespress
Copy link

This worked a few times, and then I get this error message and only a fraction of my limit.

Failed to parse JSON while requesting "https://twitter.com/i/search/timeline?f=tweets&vertical=default&include_available_features=1&include_entities=1&reset_error_state=false&src=typd&max_position=thGAVUV0VFVBaAwKqhpsTgySEWgoCogZGk3sohEjUAFQAlAFUAFQAVARUAFQAA&q=arson%20OR%20firebug%20since%3A2019-12-12%20until%3A2019-12-26&l=english" Traceback (most recent call last): File "/opt/anaconda3/lib/python3.8/site-packages/twitterscraper/query.py", line 109, in query_single_page html = json_resp['items_html'] or '' KeyError: 'items_html'

I also get errors for line 104 and 182 which doesn't resolve until a reinstall twitterscraper and the commit request.

Can anyone help? I'm a first time coder. Very, very new to this stuff.

Copy link

@raskshit raskshit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

@GivenToFlyCoder
Copy link

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!

Sometimes i repeat the searches with the same keywords, Accounts and dates, and a i get different tweets.

@HARDROCO
Copy link

Thanks! I'm using Query Search with User Search, this work for a while, sometimes i get a lot of tweets and sometimes i get 0 tweets!

Sometimes I repeat the searches with the same keywords, Accounts, and dates, and a i get different tweets.

yeah same for me, I put the patch code and apparently the limit parameter doesn't work fine for instance I put "limit = 5" and I retrieve 142 tweets

@HARDROCO
Copy link

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
2233682

copy the green code lines and replace the red code lines in your query.py file and save it that's all
and make sure to create a copy before do it

@rizkysifaul
Copy link

rizkysifaul commented Aug 19, 2020

Getting 0 tweets still after updating this query.py file with the provided changes .
Could anyone please explain how to implement the changes step wise.
Thanks

don't worry, you have to go here
2233682

copy the green code lines and replace the red code lines in your query.py file and save it that's all
and make sure to create a copy before do it

Thank you so much, I can do scraping normally, with changing some code on query.py. Actually it is not stable because after succeeding at the first attempt, I got 0 tweets after that.

Copy link

@Jasonnor Jasonnor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It works for me!

@LinqLover
Copy link
Contributor

LinqLover commented Aug 25, 2020

Thanks for the PR! Anyone else receiving improper tweets (could be sponsored material) since using this patch?

Edit: Hm, the issue is even older. I just opened #342 for it. Still, our number of unmatching tweets has raised significantly since applying this PR ...

cidm-3 added a commit to aodsc/twitterscraper that referenced this pull request Aug 27, 2020
sm-ghavami Issue taspinar#337 Fix
@eugenelee123 eugenelee123 mentioned this pull request Sep 16, 2020
@jason1991220
Copy link

It doesn't work again. Return 0 tweet.

@Nellix
Copy link

Nellix commented Sep 18, 2020

I confirm that it is not working anymore since this midnight 18-09-2020.

@jason1991220
Copy link

I confirm that it is not working anymore since this midnight 18-09-2020.

404 error with init_url, anyone knows how to fix if?

INIT_URL = 'https://twitter.com/i/search/timeline?f=tweets&vertical='
'default&include_available_features=1&include_entities=1&'
'reset_error_state=false&src=typd&max_position=-1&q={q}&l={lang}'

@rhz
Copy link

rhz commented Sep 19, 2020

I get this ERROR:twitterscraper:An unknown error occurred! Returning tweets gathered so far.

@gautampal1947
Copy link

Some changes to bypass twitter restrictions

Seems this solution is NOT working again :-(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.