Integration with .NET core microservice

[tristan-kiel]

Hello,

I'm currently looking into utilizing spacy in a microservice environment and was hoping the community here could offer some help or guidance on an approach. I currently have a microservice written in .NET 10 that calls my python executable, does some spacy stuff, and then gives me a response. This is all working as intended and expected. However, whenever I call this application there is the upfront cost (~.75 seconds of real world time) that comes with loading my model (in this case, the basic en_core_web_sm) each time I call the exe.

I'm wondering if there's an implementation that could get around this up-front cost each time I want to use the spacy library. One possibility I've seen suggested would be running my python script as a service or process and making calls to it via some messaging protocol, but that may be introducing too many moving pieces.

Any thoughts or ideas on this would be appreciated. I'm very new to Python, less so c#, so please forgive my ignorance if I've missed something obvious.

Thanks,

Tristan