Skip to content

Issues: yasserg/crawler4j

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

147 Open 142 Closed
147 Open 142 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

I cannot deal this question
#479 opened Nov 8, 2024 by deyou123
Incompatible JE Version in Maven Dependency
#477 opened Oct 5, 2024 by afan0918
2
Question Regarding the Crawler Logic
#475 opened Jun 28, 2023 by vadimlevitzky
3
Authentication OpenID Connect not working with Crawler4j
#474 opened Feb 15, 2023 by faiezkharrat
when will release crawl4j new version?
#473 opened Dec 28, 2022 by epubreader
1
[Performance Bug Report] Specific input cause endless loop in UrlResolver.java
#472 opened Aug 22, 2022 by yinxiL
1
Can't fetch content of random pages
#471 opened Jul 25, 2022 by NingMorris
1
Could not find artifact Sleepycat
#470 opened Jun 10, 2022 by nbngoc93
2
Cannot fetch content of some website but python can.
#469 opened May 26, 2022 by ryan701212
1
Fix Maven dependencies in build.gradle
#468 opened Feb 6, 2022 by ytxmobile98
examples or code scraps of how to use crawler4j when pages contain js generated links? ...
#466 opened Nov 29, 2021 by Albretch
what is the purpose of threadShutdownDelaySeconds and cleanupDelaySeconds
#462 opened Jul 7, 2021 by plee0606
Units for maxDownloadSize are not defined in docs/comments
#460 opened Mar 30, 2021 by Original-Carl
Handle escaped * and $ characters in RobotsServer
#458 opened Dec 22, 2020 by Mideen
Enable Dependabot on the repo to keep dependencies up to date
#457 opened Nov 4, 2020 by sellersj
1
Q: any plan on releasing a new version with updated dependencies..
#456 opened Oct 14, 2020 by casperrafn
4
Wrong comment
#455 opened Oct 6, 2020 by samuellembke
config.setResumableCrawling(true) make it too slow
#452 opened Sep 27, 2020 by linweisen
Even if seeded with different domains, crawler4j crawls one domain at a time
#450 opened Aug 28, 2020 by theomails
Backslashes in path processed incorrect
#448 opened Aug 21, 2020 by ikalinin1
1
When I set depth to one level, I can see that only one thread is working
#447 opened Jul 23, 2020 by basilmusa
Future - Sustainability of project
#443 opened Apr 24, 2020 by papadako
2
Performance Issues
#442 opened Apr 24, 2020 by papadako
5
EMBED tag is not parsed causes we missed embedded URL
#441 opened Apr 3, 2020 by Mideen
URLcanonicalizer returns invalid URL as a valid one
#440 opened Apr 3, 2020 by Mideen
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.