Questions tagged [clearml]

48 questions
0
votes
1 answer

Automating a Script with ClearML

I am using ClearML to automate a script. I'm new to the tool and I haven't found any tutorials for this. The goal I'm trying to accomplish is automate several python scripts so that a server is spun up and torn down as necessary to run them using…
bballboy8
  • 400
  • 6
  • 25
0
votes
1 answer

No preview images for dataset in ClearML web UI

After creating a new dataset via CLI for a bunch of images, I closed that dataset and thus uploaded it to our own, newly installed ClearML server. Now in the web UI the new dataset has been created and can be opened, the images are being listed.…
Matthias
  • 9,817
  • 14
  • 66
  • 125
0
votes
1 answer

ClearML webapp is slow

We manage our own ClearML server, on an EC2 instance AWS cloud. Instance type: t3.xlarge (4 vCPUs, 16 GiB Memory). Data disk: gp3 (size: 200 GB, IOPS: 3,000, Throughput: 125). We have 3 ClearML projects, one with 643,000 experiments, another with…
hilel14
  • 21
  • 2
0
votes
2 answers

How to run the ClearML Cleanup?

I've installed ClearML test manager solution using ClearML Docker-Compose. So now the whole thing is running using 6 containers (webserver,apiserver,redis,elasticsearch,fileserver and mongodb). I'm running the default Cleanup Service - However the…
Shimi
  • 3
  • 2
0
votes
1 answer

How to make ClearML not upload annotations twice when they have the same ID?

The following uploads two annotations, though I expected there to be only one from typing import List from allegroai import Dataset, DatasetVersion, SingleFrame, DataView from allegroai.dataframe.annotation import BoundingBox2D allegro_frame =…
Gulzar
  • 23,452
  • 27
  • 113
  • 201
0
votes
1 answer

ClearML, how to query the best performing model for a specific project and metric

I want to download the best performing model for a certain ClearlML project. I have the following content in my ClearML experiment platform: According to: https://clear.ml/docs/latest/docs/clearml_sdk/model_sdk#querying-models I can get a list of…
Mike B
  • 2,136
  • 2
  • 12
  • 31
0
votes
2 answers

ClearML - dynamically updating Plotly plots?

I have a question related to ClearML plot logging. We are currently using: self.task_logger.report_table("TableSpaceName", "Some Info", iteration=0, table_plot=df) To report tables. They appear under "PLOTS" section. Similarly, we are reporting…
sdgaw erzswer
  • 2,182
  • 2
  • 26
  • 45
0
votes
1 answer

Where do augmentations in ClearML run?

In ClearML Dataviews, it is possible to add augmentations. Where do these augmentations run? Options Original data gets downloaded to local, then runs (on which device? How is multiprocessing handled?) Only augmented data gets downloaded to local…
Gulzar
  • 23,452
  • 27
  • 113
  • 201
0
votes
1 answer

clearml-serving-triton | 2022-06-18 16:21:19,790 - clearml.Task - INFO - No repository found, storing script code instead

i found this error when running this command "docker-compose --env-file example.env -f docker-compose-triton.yml up". Actually, when i run this command for the first time, it worked. And then when I try to change to my friend's workspace it suddenly…
0
votes
1 answer

Remotely execute ClearML task using local-only repo

I want to execute ClearML task remotely. According to docs there are 2 options: 1) execute single python file; 2) ClearML would identify that script is part of repo, that repo will be cloned and installed into docker and executed on the worker. In…
0
votes
1 answer

ALB host based routing without domain name

I'm trying to configure host based routing in AWS ALB for ClearML server using this tutorial. However, I don't have a domain name. So can I only use alb's dns for this routing? For example, I will have the address as…
Nghĩa Lê
  • 53
  • 3
0
votes
1 answer

How to Deploy a ClearML Agent in a k8s setting?

I want to deploy a ClearML agent in the kubernetes environment while using the ClearML's Free Tier Demo server. I was able to deploy the Agent pod in the k8s cluster with the allegroai/clearml-agent docker image. But was not able to link this agent…
0
votes
1 answer

Export metrics of ClearML to Prometheus and show them in Grafana

Are there any metrics I can get from the API server? or any docker image I can point to the backend and get some metrics? Most important is the see how many tasks running in real-time (like we can see on the worker's page) and also check how much…
xdt
  • 3
  • 2
0
votes
1 answer

how to capture logger values using clearml

I am using clearml for testing algorithms and it works well with library Stable Baselines 3, in which clearml automatically captures all the output and plot them in the Scalars tab. However, when I switched to another library PFRL clearml no longer…
0
votes
1 answer

ClearML How to get configurable hyperparameters?

How do I get args like epochs to show up in the UI configuration panel under hyperparameters? I want to be able to change number of epochs and learning rate from within the UI.