Make batch size configurable

[sky-2002]

@VikParuchuri
Currently batch size is set to 32 when device is cuda or mps, yes we can alter OcrBuilder but not able to do it when using PdfConverter.

Maybe reading these batch size form an env variable would be helpful

I can add if this sounds good

[sky-2002]

Maybe i misinterpreted, we can set them from OcrBuilder.recognition_batch_size and so on..

[VikParuchuri]

You can pass in the config via json file in the cli - --config_json PATH: Path to a JSON configuration file containing additional settings.

[VikParuchuri]

If you have a json file with {"recognition_batch_size": 16}, that will override the setting