YARN-11752: Global Scheduler: Improve the container allocation time #7277
+8
−2
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of PR
After every 2 container allocation, The global scheduling strategy for capacity scheduler waits for 5 milliseconds. This affects the container allocation time as well the throughput. This commit tries to fix the same by following the same model as that of async scheduling where containers are allocated as many times as the number of the nodes in one wave before waiting for 5 milliseconds.
Similarly for global scheduling, all nodes in all partitions are iterated and the containers are allocated as many times as the number of the nodes in all the partition in one wave before waiting for 5 milliseconds.
Refer YARN-11752 for more details.
How was this patch tested?
For code changes:
LICENSE
,LICENSE-binary
,NOTICE-binary
files?