Lack of graceful failure for unsupported operators/models #321
Description
When following example from example/gte-large-en-v1.5-bf16, however, using a different bf16 model, VitisAI VAIML target fails to gracefully handle unsupported operations other than to skip them. This prevents developers (me) from creating optimized/tailored models for Ryzen AI NPU platform:
XLNX_ONNX_EP_REPORT_FILE set to: vitisai_ep_report.json
onnxruntime: 1.23.2.dev20251030
available providers: ['VitisAIExecutionProvider', 'DmlExecutionProvider', 'CPUExecutionProvider']
Creating VitisAI EP session for: C:\Users\Jack\aleph0\onnxnpu\export_npu.onnx
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260109 22:44:49.593398 26448 register_ssmlp.cpp:124] Registering Custom Operator: com.amd:SSMLP
I20260109 22:44:49.593398 26448 register_matmulnbits.cpp:110] Registering Custom Operator: com.amd:MatMulNBits
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1263] Vitis AI EP Load ONNX Model Success
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1264] Graph Input Node Name/Shape (2)
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1268] input_ids : [16x4096]
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1268] attention_mask : [16x4096]
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1274] Graph Output Node Name/Shape (1)
I20260109 22:44:49.800829 26448 vitisai_compile_model.cpp:1278] embeddings : [16x1024]
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:451] File base signature : 0d939f68764d320df0ad8da0273705bc
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:452] Algorithm-A: based on topologically ordered signature : e27653b2c2f08bfad7da23b53e74fde7
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:454] Algorithm-B: based on graph inputs/outputs signature : 2b869a8f961ec26f474267d89de07858
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:456] Algorithm-B: node count: 2046
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:432] Can not find signature in meptable , use in memory signature e27653b2c2f08bfad7da23b53e74fde7
I20260109 22:44:49.816762 26448 vitisai_compile_model.cpp:482] use cache key specified by user model
I20260109 22:44:49.848631 26448 vaiml_config.hpp:276] VAIP commit: 77958eb144c88e93882dd5342de4207594754b9c
I20260109 22:44:49.848631 26448 vaip_driver_info.cpp:192] Driver detection through setup api: 314
Adding RYZEN_AI_INSTALLATION_PATH=C:\Program Files\RyzenAI\1.6.1 to installation search path
ERROR: [VAIML-FRONTEND 2008] Failed selecting AIE kernels
F20260109 22:44:57.426333 26448 vaiml_mlopslib_partition_rule.cpp:648] ERROR: Unsupported ops JSON file not found: "C:\\Users\\Jack\\aleph0\\onnxnpu\\vitis_build\\vaip_cache\\model\\vaiml_partition_fe.flexml\\aie_partition_break_pairs.json"
Exception Code: 0xC000001D
0x00007FFEA04DEC86, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\flexml\flexml_extras\lib\vaiml.dll(0x00007FFE9F580000) + 0xF5EC86 byte(s), ?value@error@aiebu@@QEBAHXZ() + 0xBD4086 byte(s)
0x00007FFFC26B1989, C:\Windows\System32\ucrtbase.dll(0x00007FFFC25F0000) + 0xC1989 byte(s), raise() + 0x1D9 byte(s)
0x00007FFFC2694AB1, C:\Windows\System32\ucrtbase.dll(0x00007FFFC25F0000) + 0xA4AB1 byte(s), abort() + 0x31 byte(s)
0x00007FFEE387D623, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x360D623 byte(s), xir_deserialize_cif() + 0x238BD3 byte(s)
0x00007FFEE2C38B08, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29C8B08 byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x4B1FA8 byte(s)
0x00007FFEE2C3105F, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29C105F byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x4AA4FF byte(s)
0x00007FFEE2C2A727, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29BA727 byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x4A3BC7 byte(s)
0x00007FFEE2C339D5, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29C39D5 byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x4ACE75 byte(s)
0x00007FFEE2C41A1B, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29D1A1B byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x4BAEBB byte(s)
0x00007FFEE2B8383A, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x291383A byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x3FCCDA byte(s)
0x00007FFEE2B831FB, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x29131FB byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x3FC69B byte(s)
0x00007FFEE2B87F7E, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2917F7E byte(s), ?mutable_try_fuse@DpuSubgraphEntryProto@vaip_core@@QEAAPEAVTryFuseProto@2@XZ() + 0x40141E byte(s)
0x00007FFEE2E26E70, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BB6E70 byte(s), ?set_metadata@Model@vaip_cxx@@QEAAAEAV12@AEBV?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@std@@0@Z() + 0x3BF0 byte(s)
0x00007FFEE2E2D686, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BBD686 byte(s), ?load_context@vaip_core@@YA?AV?$shared_ptr@VPassContext@vaip_core@@@std@@AEBVpath@filesystem@3@@Z() + 0x1F26 byte(s)
0x00007FFEE2E2DA82, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BBDA82 byte(s), ?run_passes@IPass@vaip_core@@SAXV?$vector@V?$shared_ptr@VIPass@vaip_core@@@std@@V?$allocator@V?$shared_ptr@VIPass@vaip_core@@@std@@@2@@std@@AEAUGraph@onnxruntime@@@Z() + 0x22 byte(s)
0x00007FFEE2E3E1AF, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BCE1AF byte(s), ?compile_onnx_model_3@vaip_core@@YA?AV?$vector@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@V?$allocator@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@@2@@std@@AEBV?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@3@AEBUGraph@onnxruntime@@AEBV?$unordered_map@V?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@std@@V12@U?$hash@V?$basic_string@DU?$char�() + 0xC2CF byte(s)
0x00007FFEE2E31A90, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BC1A90 byte(s), ?run_passes@IPass@vaip_core@@SAXV?$vector@V?$shared_ptr@VIPass@vaip_core@@@std@@V?$allocator@V?$shared_ptr@VIPass@vaip_core@@@std@@@2@@std@@AEAUGraph@onnxruntime@@@Z() + 0x4030 byte(s)
0x00007FFEE2E32E3C, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BC2E3C byte(s), ?compile_onnx_model_3@vaip_core@@YA?AV?$vector@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@V?$allocator@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@@2@@std@@AEBV?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@3@AEBUGraph@onnxruntime@@AEBV?$unordered_map@V?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@std@@V12@U?$hash@V?$basic_string@DU?$char�() + 0xF5C byte(s)
0x00007FFEE2E3236D, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_vitisai_ep.dll(0x00007FFEE0270000) + 0x2BC236D byte(s), ?compile_onnx_model_3@vaip_core@@YA?AV?$vector@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@V?$allocator@V?$unique_ptr@VExecutionProvider@vaip_core@@U?$default_delete@VExecutionProvider@vaip_core@@@std@@@std@@@2@@std@@AEBV?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@3@AEBUGraph@onnxruntime@@AEBV?$unordered_map@V?$basic_string@DU?$char_traits@D@std@@V?$allocator@D@2@@std@@V12@U?$hash@V?$basic_string@DU?$char�() + 0x48D byte(s)
0x00007FFFADC72A52, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_vitisai.dll(0x00007FFFADC60000) + 0x12A52 byte(s)
0x00007FFFADC80C3E, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_vitisai.dll(0x00007FFFADC60000) + 0x20C3E byte(s)
0x00007FFEE9EA68B5, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xA768B5 byte(s), PyInit_onnxruntime_pybind11_state() + 0xA2B435 byte(s)
0x00007FFEE9EAA68C, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xA7A68C byte(s), PyInit_onnxruntime_pybind11_state() + 0xA2F20C byte(s)
0x00007FFEE9EAA1E3, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xA7A1E3 byte(s), PyInit_onnxruntime_pybind11_state() + 0xA2ED63 byte(s)
0x00007FFEE9EA9E58, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xA79E58 byte(s), PyInit_onnxruntime_pybind11_state() + 0xA2E9D8 byte(s)
0x00007FFEE9563F14, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0x133F14 byte(s), PyInit_onnxruntime_pybind11_state() + 0xE8A94 byte(s)
0x00007FFEE95547B1, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0x1247B1 byte(s), PyInit_onnxruntime_pybind11_state() + 0xD9331 byte(s)
0x00007FFEE9505787, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xD5787 byte(s), PyInit_onnxruntime_pybind11_state() + 0x8A307 byte(s)
0x00007FFEE94FE207, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0xCE207 byte(s), PyInit_onnxruntime_pybind11_state() + 0x82D87 byte(s)
0x00007FFEE94BF626, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0x8F626 byte(s), PyInit_onnxruntime_pybind11_state() + 0x441A6 byte(s)
0x00007FFEE9446271, C:\ProgramData\miniconda3\envs\ryzenai\Lib\site-packages\onnxruntime\capi\onnxruntime_pybind11_state.pyd(0x00007FFEE9430000) + 0x16271 byte(s)
0x00007FFF70CC2953, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x162953 byte(s), PyCFunction_GetFlags() + 0xE63 byte(s)
0x00007FFF70C74E6E, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x114E6E byte(s), _PyObject_MakeTpCall() + 0x13E byte(s)
0x00007FFF70C75195, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x115195 byte(s), PyObject_Vectorcall() + 0x35 byte(s)
0x00007FFF70D99934, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x239934 byte(s), _PyEval_EvalFrameDefault() + 0x6864 byte(s)
0x00007FFF70C75464, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x115464 byte(s), _PyFunction_Vectorcall() + 0x54 byte(s)
0x00007FFF70C74AE1, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x114AE1 byte(s), _PyObject_FastCallDictTstate() + 0xB1 byte(s)
0x00007FFF70C75725, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x115725 byte(s), _PyObject_Call_Prepend() + 0xA5 byte(s)
0x00007FFF70CF0BF6, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x190BF6 byte(s), PyType_Ready() + 0x4D96 byte(s)
0x00007FFF70CE1D86, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x181D86 byte(s), _PyType_Name() + 0x1B76 byte(s)
0x00007FFF70C74E6E, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x114E6E byte(s), _PyObject_MakeTpCall() + 0x13E byte(s)
0x00007FFF70C75195, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x115195 byte(s), PyObject_Vectorcall() + 0x35 byte(s)
0x00007FFF70D99934, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x239934 byte(s), _PyEval_EvalFrameDefault() + 0x6864 byte(s)
0x00007FFF70D92F66, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x232F66 byte(s), PyEval_EvalCode() + 0xE6 byte(s)
0x00007FFF70E348C0, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x2D48C0 byte(s), PyRun_FileExFlags() + 0x320 byte(s)
0x00007FFF70E349B6, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x2D49B6 byte(s), PyRun_FileExFlags() + 0x416 byte(s)
0x00007FFF70E34568, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x2D4568 byte(s), PyRun_StringFlags() + 0x178 byte(s)
0x00007FFF70E3118E, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x2D118E byte(s), _PyRun_SimpleFileObject() + 0x30E byte(s)
0x00007FFF70BEEB97, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x8EB97 byte(s), _Py_gitidentifier() + 0xACB7 byte(s)
0x00007FFF70BEF882, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x8F882 byte(s), _Py_gitidentifier() + 0xB9A2 byte(s)
0x00007FFF70BEFD98, C:\ProgramData\miniconda3\envs\ryzenai\python312.dll(0x00007FFF70B60000) + 0x8FD98 byte(s), Py_RunMain() + 0x18 byte(s)
0x00007FF7BC101490, C:\ProgramData\miniconda3\envs\ryzenai\python.exe(0x00007FF7BC100000) + 0x1490 byte(s), OPENSSL_Applink() + 0x380 byte(s)
0x00007FFFC346E8D7, C:\Windows\System32\KERNEL32.DLL(0x00007FFFC3440000) + 0x2E8D7 byte(s), BaseThreadInitThunk() + 0x17 byte(s)
0x00007FFFC504C53C, C:\Windows\SYSTEM32\ntdll.dll(0x00007FFFC4FC0000) + 0x8C53C byte(s), RtlUserThreadStart() + 0x2C byte(s)