Questions tagged [openvino]

OpenVINO™ toolkit, short for Open Visual Inference and Neural network Optimization toolkit, provides developers with improved neural network performance on a variety of Intel® processors and helps them further unlock cost-effective, real-time vision applications. The toolkit enables deep learning inference and easy heterogeneous execution across multiple Intel® platforms providing implementations across cloud architectures to edge devices.

The OpenVINO™ toolkit quickly deploys applications and solutions that emulate human vision. Based on Convolutional Neural Networks (CNN), the toolkit extends computer vision (CV) workloads across Intel® hardware, maximizing performance. The OpenVINO™ toolkit includes the Deep Learning Deployment Toolkit (DLDT).

The OpenVINO toolkit:

  • Enables CNN-based deep learning inference on the edge
  • Supports heterogeneous execution across an Intel® CPU, Intel® Integrated Graphics, Intel® FPGA, Intel® Movidius™ Neural Compute Stick, Intel® Neural Compute Stick 2 and Intel® Vision Accelerator Design with Intel® Movidius™ VPUs
  • Speeds time-to-market via an easy-to-use library of computer vision functions and pre-optimized kernels
  • Includes optimized calls for computer vision standards, including OpenCV*, OpenCL™, and OpenVX*

https://docs.openvinotoolkit.org/

https://01.org/openvinotoolkit

https://github.com/openvinotoolkit/openvino

https://github.com/openvinotoolkit/open_model_zoo

366 questions
1
vote
1 answer

looping over model inference that has 2 outputs

I am working with the openVINO zoo that has lots of pre-trained models. How does one handle in the post process of the data after inference when the model has 2 outputs, like this model? I am only looking to draw bounding boxes around people in the…
bbartling
  • 3,288
  • 9
  • 43
  • 88
1
vote
2 answers

Run Tensorflow model with Intel Open Vino Model Zoo

I just started learning computer vision(newbie to neutral network) If I want to make detect whether a human holding an umbrella or not with a pre-trained human model with an intel open vino model, First, I train umbrella images Second, Convert…
newbieLife
  • 39
  • 5
1
vote
2 answers

OpenVino can't install on ubuntu 22.04

can any one help me to install OpenVino in Ubuntu 22.04 LTS each time I try to install, it giving me errors (E: Unable to locate package openvino) . I tried to installing it with Exp1: sudo apt install openvino Exp2: sudo apt install openvino-..
1
vote
1 answer

Openvino unable to compile numpy array

Openvino throws "RuntimeError: Cannot get dims for non static shape" when an image is passed as numpy array to openvino Core().compile_model(). But the same image when passed after doing a cv2.imread() works fine. How do we pass a numpy array…
sri
  • 11
  • 3
1
vote
1 answer

Supported primitive descriptors list is empty for node when using sample pre-trained face-detection model openvino

I have run OpenVino many times on intel core series, RPI 4, NCS-1 and NCS-2. But I have the following issue when working with a Xeon CPU System: Intel Xeon CPU E5-2620 v4, 16GB RAM, Windows Server 2016 OpenVino Version: 2020.4 Model…
Pradyumn Pathak
  • 75
  • 1
  • 1
  • 6
1
vote
1 answer

Is it possible to convert an ONNX ConvInteger operator to OpenVINO while keeping tensor precision?

I am using the OpenVINO model optimizer framework to convert an ONNX model containing a single ConvInteger operation to OpenVINO IR format. mo --input_model {onnx_model} The ONNX ConvInteger operator has input and weight tensors with INT8/UINT8…
shmark
  • 11
  • 2
1
vote
2 answers

get weights for each layer of the model using OpenVINO API

I'd like to get the tensor of weights and biases for each layer of the network using the C++/Python API on the OpenVINO framework. I found this solution but unfortunately it uses an older API (release 2019 R3.1) that is no longer supported. For…
shahar
  • 11
  • 1
1
vote
3 answers

Yolov5s on Openvino

I have trained a model using yolov5 and it is working just fine: My ultimate goal is to use a model that I have trained on custom data (to detect the hook and bucket) in the Openvino framework. To achieve this, I first exported the best version of…
Alexandre Tavares
  • 113
  • 1
  • 1
  • 11
1
vote
1 answer

OpenVino anchor output Python

I am using openvino action recognition model to detect person's actions. I referred to the C++ Smart Classroom demo, but I have trouble parsing the output in python. The following is my code. I can see the output shapes for all acnhors. How can I…
Hasala
  • 126
  • 10
1
vote
1 answer

First tensorflow object detection model - from image to .pb (finally to myriad X blob for Oak-D) - rookie questions

This is my first model, i´m new to python and this is my second post on Stackoverflow so please let me know if there is anything i should elaborate and keep in mind there could be a easy solution to my problems. EDIT - I have found a way to test the…
1
vote
1 answer

OpenVINO cannot convert 1D CNN model with model optimizer

I convert my 1D CNN .h5 file to .pb file as the picture shows. (Please download my converted .pb file in need.) Then I try to use model optimizer to generate .bin and .xml files with the command python mo_tf.py --saved_model_dir…
TseHsien
  • 73
  • 8
1
vote
1 answer

Why am I getting different results when I use models with the same weights in different formats - \(.pt) \.onnx \(.bin, .xml)?

I have a model trained on YOLOv5s and is working fine. This is an input image: I can get an expected result using pytorch after doing an inference: This is an output image: The thing is, I need it in Openvino and regardless if I do the inference…
Alexandre Tavares
  • 113
  • 1
  • 1
  • 11
1
vote
1 answer

How do I read OpenVINO IR models from memory with the OpenVINO C API

I am having trouble reading OpenVINO IR networks (XML and bin) from memory using ie_core_read_network_from_memory() in the OpenVINO 2021.4 C API ie_c_api.h. I suspect that I am creating the network weight blob wrong, but I cannot find any…
mags
  • 489
  • 2
  • 11
1
vote
3 answers

OpenVINO GStreamer gvadetect is not applying model

I am super new to OpenVINO and GStreamer. I am trying to apply a pipeline in GStreamer plugin using OpenVINO. I downloaded the model as well it's proc files. I am trying to apply the model and it's proc to a video. For some reason I am not getting…
JSVJ
  • 500
  • 3
  • 14
1
vote
1 answer

Cannot install Tensorflow 2.4.1 as a dependency for OpenVino

When going through the process of installing OpenVino as documented here, I'm running: sudo ./install_prerequisites.sh and getting ERROR: Could not find a version that satisfies the requirement tensorflow~=2.4.1 (from versions: 2.5.0rc0, 2.5.0rc1,…
NominalSystems
  • 175
  • 1
  • 4
  • 13