Questions tagged [serving]
93 questions
0
votes
0 answers
Why doesn't NGINX apply header response when serving an image?
I've got a problem with NGINX, serving a folder.
server {
listen [::]:80;
server_name xyz.xyz;
location / {
add_header 'Access-Control-Allow-Origin' '*';
autoindex on;
root /directory/to/folder;
}
}
When I…
Gustaff
- 13
- 2
0
votes
1 answer
Model Serving Databricks Status Failed
I'm trying to enable serving for my model but I keep getting Pending into Failed Status.
Here are the model event logs.
2022-11-15 15:43:13ENDPOINT_UPDATED
Failed to create model 3 times2022-11-15 15:43:03ENDPOINT_UPDATED
Failed to create cluster…
ghostiek
- 45
- 5
0
votes
0 answers
Can't get model inference using mlflow.pytorch.log_model, but could get it with mlflow.pyfunc.log_model
I've used mlflow.pyfunc.log_model and I was able to get model inference with this, but not withmlflow.pytorch.log_model. The error was Verify that the serialized input Dataframe is compatible with the model for inference.
data = torch.randn(10,…
Eusto
- 21
- 2
0
votes
1 answer
Output of model after serving different with keras model output
I have a model with input that has a shape like (145, 24, 24, 3)
With model load by tensorflow keras output will have a shape like (145, 4)
But when I convert input from tensor to list and POST it into model serving.
Output return (,4)
I was using…
Dat Le
- 1
- 4
0
votes
2 answers
tensorflow keras savedmodel lost inputs name and add unknow inputs
I'm currently implement the sequantial deep matching model (https://arxiv.org/abs/1909.00385) using tensorflow 2.3. And I included the preprocessing layer as part of the model via subclassing keras.layers.Layer.
The preprocessing part of code is…
Feng Zhou
- 21
- 3
0
votes
0 answers
Serving Static on AWS - Django - Python
I have all of my static images served locally on my Django website project. I need them to be hosted on AWS for my DEBUG = False to work. I have followed many tutorials on how to do this and have had no luck. I have posted my code below for a…
Russell Hertel
- 121
- 3
- 14
0
votes
1 answer
Serving service from kfserving github examples created with kubectl, but can not infere
I have installed minikube cluster and kfserving on a linux desktop.
Then I have followed two tutorials
https://github.com/kubeflow/kfserving/tree/master/docs/samples/v1beta1/custom/torchserve…
jabone
- 389
- 2
- 13
0
votes
1 answer
What is the difference between Deploying and Serving ML model?
Recently I have developed a ML model for classification problem and now would like to put in the production to do classification on actual production data, while exploring I have came across two methods deploying and serving ML model what is the…
alex3465
- 409
- 4
- 18
0
votes
0 answers
Nginx downloading php content instead of serving
I have a ubuntu server at digitalocean where I am trying to get php to work.
I have successfully created a subdomain with nginx, though nginx keeps downloading the php files, instead of serving them. This is my default:
server {
listen 80;
…
simon
- 2,235
- 6
- 33
- 53
0
votes
3 answers
res.set('Content-Type','image/jpg') is not working while serving image in node js
res.set('Content-Type', 'image/jpg') is not working while serving us files in node js. Please take a look at code what is wrong with this code. I am getting the User Value and avatar binary value from the database but not able to see it on the…
Atish kumar
- 21
- 5
0
votes
1 answer
gRPC - Accumulate requests from Multiple clients
Let's assume I have multiple clients sending requests to a server (gRPC service). I would like my server to be able to collect, let say 8 requests, process these requests at once, and then only send the result back to the clients. I'm not sure how…
Alex Ltr
- 1
- 1
0
votes
1 answer
Can't open a PDF downloaded using res.send(data)-express
I am having trouble whit this simple piece of code:
fs.readFile('public/PDF/Booklet_nl.pdf', (err,data)=>{
if(err){
throw err
}
res.send(data);
});
The file can be downloaded but I am not able to visualize the PDF in the browser.
user10663534
0
votes
2 answers
html file does not appear after logging without any error
I am new to server-side programming.
I am trying to serve a HTML file (mapview.html) after authentication ,but it does not appear without any error.
there is no problem with authentication process. I expect when I click on login button, the codes…
ehsanpaknahad
- 15
- 4
0
votes
1 answer
Why heroku app is serving my source files?
Why my heroku app is serving app directory? This directory and it's files should not appear like you see in the picture. Should display only static directory.
I use rimraf npm package to remove sourcemaps (.map files) and when I use serve -s build…
Marcinek
- 47
- 4
0
votes
1 answer
tf_serving grpc client connection reset by peer
I build a client to feed some data to my modelserver inside docker-container using grpc and c++.
when trying to connect i get message:
error 14
connection reset by peer.
client code:
std::cout << "calling prediction service on " << "localhost:8500"…
dhaunss
- 1
- 2