This commit is contained in:
SWHL committed 2022-08-19 16:05:08 +08:00
commit a250226149
1 file changed
+11 -8
+11 -8
View File
@@ -1,5 +1,7 @@
## rapidocr_openvino
**🚩注意:基于目前`openvino==2022.1.0`版,在推理批量图像时,存在申请内存不释放的问题,详情可参见[issue11939](https://github.com/openvinotoolkit/openvino/issues/11939)**
<details open>
<summary>目录</summary>
@@ -13,7 +15,7 @@
</details>
#### 基于OpenVINO推理引擎
- OpenVINO推理方向分类模型有误,已经提了[issue](https://github.com/openvinotoolkit/openvino/issues/11501)
- ~~OpenVINO推理方向分类模型有误,已经提了[issue](https://github.com/openvinotoolkit/openvino/issues/11501)~~
- 问题已经解决,但是需要自己编译OpenVINO,参见[Answer](https://github.com/openvinotoolkit/openvino/issues/11501#issuecomment-1096366363)
#### 安装
@@ -76,12 +78,12 @@ NOTE: 以`ch_ppocr_mobile_v2_det`中推理代码为例子
sess_opt = onnxruntime.SessionOptions()
sess_opt.log_severity_level = 4
sess_opt.enable_cpu_mem_arena = False
self.session = onnxruntime.InferenceSession(det_model_path, sess_opt)
self.input_name = self.session.get_inputs()[0].name
self.output_name = self.session.get_outputs()[0].name
session = onnxruntime.InferenceSession(det_model_path, sess_opt)
input_name = session.get_inputs()[0].name
output_name = session.get_outputs()[0].name
# 推理
preds = self.session.run([self.output_name], {self.input_name: img})
preds = session.run([output_name], {input_name: img})
```
- OpenVINO
@@ -92,9 +94,10 @@ NOTE: 以`ch_ppocr_mobile_v2_det`中推理代码为例子
ie = Core()
model_onnx = ie.read_model(det_model_path)
compile_model = ie.compile_model(model=model_onnx, device_name='CPU')
self.vino_session = compile_model.create_infer_request()
vino_session = compile_model.create_infer_request()
# 推理
self.vino_session.infer(inputs=[img])
vino_preds = self.vino_session.get_output_tensor().data
vino_session.infer(inputs=[img])
vino_preds = vino_session.get_output_tensor().data
```