Stack Overflow
Stack Overflow

Questions tagged [inference-engine]

65 questions
1
vote
1 answer

What are hybrid inference engines?

I've tried searching a lot for this, even so, if a similar post has been made I apologize. I understand that a rule engine has basically two methods of inferences, forward and backward chaining. I also believe I understand how both work…
anouarabrik
  • 11
  • 3
1
vote
1 answer

Inference engine prolog

I am trying to build an inference engine in prolog. For example, here are some rules R1 : A and B -> C R2 : E and F -> D R3 : G and T -> H I wanted to do it like this c :- a,b d :- e,f h :- g,t but I have to use a predicate "rule/1" defined as…
Sudo
  • 991
  • 9
  • 24
1
vote
0 answers

Building inference engine to extract appropriate file from database

I am working on numerical simulation software having a "reader" to exploit one simulation file. According to user input and other parameters, i have to extract the appropriate simulation file from database and send it to the client. 1- is it…
Anis D
  • 761
  • 11
  • 25
1
vote
2 answers

Generalization of set of facts in CLIPS (trying to find matching slot values in multislot slots)

I am trying to do something like 'facts generalization' in CLIPS (not sure which term describes it best of all) and I am not sure how to do this in a best way. Consider such situation. I have a set of facts which are described by the below…
Maksim Khaitovich
  • 4,742
  • 7
  • 39
  • 70
0
votes
0 answers

Loading a HF Model in Multiple GPUs and Run Inferences in those GPUs (Not Training or Finetuning)

Is there any way to load a Hugging Face model in multi GPUs and use those GPUs for inferences as well? Like, there is this model which can be loaded on a single GPU (default cuda:0) and run for inference as below: from transformers import…
NeuralAI
  • 43
  • 2
  • 10
0
votes
0 answers

how to get gpu memory usage information via onnxruntime c++ api?

i am now implementing a c++ inference program running on multi-gpus. I need to get every device gpu usage information to decide which gpu to run inference on. I only found the getGPUid API in onnxruntime c++ document, does it have other apis?
atalantara
  • 23
  • 5
0
votes
0 answers

Using a Property Chain with a reasoner is considered to be reasoning. Would it also be considered as reasoning if this is done via a SPARQL query?

We can define the followin property chain: SubObjectPropertyOf( ObjectPropertyChain( :hasParent :hasParent ) :hasGrandparent ) And using a reasoner would add the hasGrandparent relation accordingly. This process is obviously reasoning. I…
user3352632
  • 617
  • 6
  • 18
0
votes
0 answers

How to specify model artifact name from config.pbtxt file when using .pth extension

I am having a pytorch artifact named model.pth but the Triton server is looking only for model.pt file which is by default here…
Mahesh
  • 25
  • 6
0
votes
1 answer

How to correctly format input and resize output data whille using TensorRT engine?

I'm trying implementing deep learning model into TensorRT runtime. The model conversion step is done quite OK and i'm pretty sure about it. Now there's 2 parts i'm currently struggle with is memCpy data from host To Device (like openCV to Trt) and…
huanidz
  • 19
  • 2
0
votes
1 answer

OpenCV DNN inference with "training=True" for using sample mean and variance (Pix2Pix)

I have trained a Pix2Pix network using Keras Tensorflow, following this tutorial. The Pix2Pix uses Instance Normalization, such that when doing inference, we would need to have the Instance Normalization layers (batch norm for batch size of 1) to…
Denis
  • 664
  • 9
  • 24
0
votes
0 answers

RDF inferring subClass using OWL and Protégé

I am looking to make an ontology that will allow classification of types to map to another application. I need to find all instances that are of type Person without the triples explicitly defining that Jack is a Person. Currently using Protege I…
aldebaran star
  • 11
  • 3
0
votes
2 answers

Openvino inference engine on c++ with visual studio

I'm trying to use inferenceegine on c++ by runnung the samples test. every things is ok building samples is running with out any error or warnings. but when im trying to run binary files like object_detection_sample_ssd.exe or run main for this…
simo
  • 41
  • 1
  • 6
0
votes
1 answer

Tensorflow throws “TypeError: unhashable type: 'list'” error in Object detection session run

input_tensors=["import/image_tensor:0"], output_tensors=['import/detection_boxes:0', 'import/detection_scores:0', 'import/detection_classes:0', 'import/num_detections:0'] _input = [graph.get_tensor_by_name(tensor_name) for…
Shaik Ahmad
  • 449
  • 1
  • 3
  • 11
0
votes
1 answer

OpenCV build error while compiling with IE (Inference Engine)

OpenCV Version: 4.4.0 (latest) OpenVINO Version: 2020.4 (latest) The error happens when trying to build the project which is generated by CMake 3.18.0 on Windows 10. I have tried many times building from scratch (clear all caches, update the source…
Bahramdun Adil
  • 5,907
  • 7
  • 35
  • 68
0
votes
1 answer

openvino on macOS build issue

I followed the instruction on thier github https://github.com/openvinotoolkit/openvino to build it on macOS, done it and when i wrote a small code to check was all clear or not #include #include #include #include…
Александр Навасардян
  • 1
1 2
3
4 5