Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

An example of Scrape from Twitter Users' profile with multiprocessing #154

Open
wants to merge 16 commits into
base: master
Choose a base branch
from
Open

An example of Scrape from Twitter Users' profile with multiprocessing #154

wants to merge 16 commits into from

Conversation

cenguix
Copy link
Contributor

@cenguix cenguix commented Nov 2, 2018

taspinar added 16 commits June 13, 2018 20:49
@taspinar
query.py : remove fake_useragent
a1055d9 
useragents will no longer be generated with the fake_useragent package.
At the moment seven of the most popular useragent strings are written hardcoded in query.py
In later stages this should be done via a separate module.

This fixes #118,
#115,
#90
@taspinar
fix merge issues
8604284
@taspinar
Merge branch 'master' of https://github.com/taspinar/twitterscraper
f473ad9
@taspinar
add possibility to scrape from user's profile
45e5fcc 
- Added CLA -u / --user to main.py which call the method query_tweets_from_user when set
- query.py: query_tweets_from_user method call query_single_page method with a different INIT and RELOAD URL.
- query.py: from_user argument is added to query_single_page so that a different pos value is returned.

This fixes #120
@taspinar
update readme, changelog and setup.py
1b3d0f0
@taspinar
update usage of the --user argument
d7b5366
@taspinar
Merge branch 'master' of https://github.com/taspinar/twitterscraper
7c044a7
@taspinar
Merge branch 'master' of https://github.com/taspinar/twitterscraper
8736328
@taspinar
Merge branch 'master' of https://github.com/taspinar/twitterscraper
f699dad
@taspinar
merge master with v0.8.0
eb00060
@taspinar
Update Readme.rst
8e02f7b 
-include examples and usage of -u / --user argument introduced in version 0.9.0
@taspinar
Update README.rst
6215755
@taspinar
Merge branch 'scrape_from_profile' of https://github.com/taspinar/twi…
ec3dd2f 
…tterscraper into scrape_from_profile
@taspinar
README.rst updated
98ac62d
@taspinar
update README.rst
74b35bb
@taspinar
Merge branch 'master' into scrape_from_profile
cbf97f3
@Camilo-Lesmes
Copy link

Camilo-Lesmes commented Nov 2, 2018 •
edited
Loading

hi, today I searched several times and I couldn't find anything but yesterday I got the tweets correctly

@taspinar
Copy link
Owner

taspinar commented Nov 4, 2018 •
edited
Loading

@cenguix This is not really the proper way to submit a PR, but I'll merge your code together with something I have developed for getting user account information.

@lapp0 lapp0 added the stale label Jun 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
stale
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@cenguix @Camilo-Lesmes @taspinar @lapp0