Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bulk size limit #55

Open
Toffs-Rocky opened this issue Jan 17, 2019 · 2 comments
Open

bulk size limit #55

Toffs-Rocky opened this issue Jan 17, 2019 · 2 comments

Comments

@Toffs-Rocky
Copy link

Please post all product and debugging questions on our forum. Your questions will reach our wider community members there, and if we confirm that there is a bug, then we can open a new issue here.

For all general issues, please provide the following details for fast resolution:

  • Version:
  • Operating System:
  • Config File (if you have sensitive info, please remove it):
  • Sample Data:
  • Steps to Reproduce:

For mongodb 3.6, the max write batch size is 10,000. Can you change this value and improve mongodb output throughput?
Please refer to https://docs.mongodb.com/manual/reference/method/db.collection.insertMany/

@colinsurprenant
Copy link
Contributor

currently the default bulk is 900 and max is 999. IMO I don't see any reason in actually capping the max; I think the user should be responsible in figuring what the max is per their mongo version and adjust if there is a error on write.

@Toffs-Rocky
Copy link
Author

I found that this plugin only processes 1k/s when I set bulk as 1000. So how to improve throughput of it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants