[Feature Request]: Make debug load faster (build option)

[Maicus]

Request Description

The initial time waiting for a debug build to load the inference engine is quite slow (Sometimes it takes up to a minute).
Also the inference itself is way slower.
This makes debugging other parts of the application more tedious than it needs to be.
I tried linking against the release build in debug but this doesnt seem to work and throws an error that it can't read the model file.

Exception from src/inference/src/model_reader.cpp:160:
Unable to read the model:  Please check that model format:  is supported and the model is correct. Available frontends: ir onnx paddle pytorch tf tflite

Unfortunately I didn't find any build config with which I can disable the debugging options.

Do you have any idea, if linking against the release build should work? Or if there is an option to speed up the debug build (maybe by disabling debugging features)

I would be happy for any help in that matter.

Feature Use Case

No response

Issue submission checklist

• The feature request or improvement must be related to OpenVINO

[ilya-lavrenov]

What file name are you trying to pass to ctor?

[Maicus]

I have a test function which just tries to create a simple network. Its here:

network.zip
(But this network loads quite fast since its so small)

If I run it in release linked against release it works. debug linked against debug it works as well.

The problem occurs when I try to load it when I build my test in debug and link against the release version of openvino.

FYI I use this version of openvino:
https://storage.openvinotoolkit.org/repositories/openvino/packages/2024.2/windows/w_openvino_toolkit_windows_2024.2.0.15519.5c0f38f83f6_x86_64.zip

But I don't think that its an issue with openvino.
I just think that its not possible to work in mixed config mode.