Web API SDK is running in a single thread by default, so if you submit many requests at once they will queue up and will be processed one by one.
For improved throughput performance you need to launch more instances according to the planned load.
We have implemented Linux based docker image of the Web service, that can spawn multiple workers under one service instance (one IP). You may set workers' numbers based on the hardware limitation you have. Two cores with a minimum of 2GB RAM per worker are recommended.
For using docker / Linux instance you will need an online license. Our managers can help you with a trial license, you can contact them by this link.
Our licensing can be either transaction-based, and you can spawn as many workers as you need, or workers-based, where a specific number of workers you may launch at the same time is provided.
Indeed, you can use Windows as well, but you will need to set up many instances and load balance them externally with some 3rd party software like HAProxy or similar. It is feasible, but not convenient and has to be set up additionally.
Comments
Please sign in to leave a comment.