为 NPU 管道指定pipeline_config以导出和导入缓存编译模型。
导出示例:
ov::AnyMap pipeline_config = { { "EXPORT_BLOB", "YES" }, { "BLOB_PATH", ".npucache\compiled_model.blob" } };
ov::genai::WhisperPipeline pipeline(model_path, "NPU", pipeline_config);
导入示例:
ov::AnyMap pipeline_config = { { "BLOB_PATH", ".npucache\compiled_model.blob" } };
ov::genai::WhisperPipeline pipeline(model_path, "NPU", pipeline_config);
为 NPU 管道指定pipeline_config以导出和导入缓存编译模型。
导出示例:
ov::AnyMap pipeline_config = { { "EXPORT_BLOB", "YES" }, { "BLOB_PATH", ".npucache\compiled_model.blob" } };
ov::genai::WhisperPipeline pipeline(model_path, "NPU", pipeline_config);
导入示例:
ov::AnyMap pipeline_config = { { "BLOB_PATH", ".npucache\compiled_model.blob" } };
ov::genai::WhisperPipeline pipeline(model_path, "NPU", pipeline_config);
举报