[DISC] Benchmarking Chonkie Mega-Thread

[bhavnicksm]

One place for all Chonkie benchmarking related work quiries and future benchmarking planning.

Will update this...

[sky-2002]

hey @bhavnicksm , Would it be beneficial to incorporate a benchmark suite into the development workflow, similar to unit tests, to proactively identify and address performance bottlenecks during development?
I personally like these kind of tests, so any performance issues could be attributed to the respective code change at the time. I can add this. Let me know your thoughts and if you are aware of any tools or resources related to this.

[bhavnicksm]

hey @bhavnicksm , Would it be beneficial to incorporate a benchmark suite into the development workflow, similar to unit tests, to proactively identify and address performance bottlenecks during development? I personally like these kind of tests, so any performance issues could be attributed to the respective code change at the time. I can add this. Let me know your thoughts and if you are aware of any tools or resources related to this.

Yes! Would love a PR for this, @sky-2002!

But instead of unit tests, it's better if we keep them separate since benchmarking can take a while—we can run them manually since unit tests are run for every push to main at the moment.