Limit concurrency in markdown file processing to improve performance

[coderabbitai]

This issue aims to address the need for limiting concurrency in processing markdown files to improve performance and prevent potential resource exhaustion.

Currently, scripts/markdown/check-markdown.js processes markdown files asynchronously without a concurrency limit, which could lead to too many open file handles and impact system resources.

As discussed in PR #3378 and the related comment, it's important to implement concurrency control in the script.

Assigning to @akshatnema for further action.

[sambhavgupta0705]

@Aditya0732 and @Sarvesh2783
You both have opened PR for this ,if you both can tell your approach here so that we can decide with whom we should go forward

[Aditya0732]

@Aditya0732 and @Sarvesh2783 You both have opened PR for this ,if you both can tell your approach here so that we can decide with whom we should go forward

Hey @sambhavgupta0705, have added a detailed PR #3481 please check and let me know.