Questions tagged [wandb]
134 questions
1
vote
1 answer
How do I print the wandb sweep url in python?
For runs I do:
wandb.run.get_url()
how do I do the same but for sweeps given the sweep_id?
fulls sample run:
"""
Main Idea:
- create sweep with a sweep config & get sweep_id for the agents (note, this creates a sweep in wandb's website)
- create…
Charlie Parker
- 5,884
- 57
- 198
- 323
1
vote
1 answer
Changing the WandB logging directory
I'm doing a lot of experiments with WandB, and it is on a shared server where logs and whatnot need to be placed in specific directories. WandB likes to store a lot of information (as it should, defined by me) so the folder grows rapidly, up to 5GB…
Jack Avante
- 1,405
- 1
- 15
- 32
1
vote
1 answer
W&B - How to construct custom string in sweep based on sweep parameters
I want to use W&B sweep parameters to dynamically construct a command line argument. How can I do this?
Modifying the W&B's example, suppose I have the following sweep:
program:
train.py
method: grid
parameters:
batch_size:
values: [8, 10,…
Rylan Schaeffer
- 1,945
- 2
- 28
- 50
1
vote
0 answers
monitor cpu, gpu, memory usage in colab (pro)
I want to track the usage of the above resources while training a model with pyspark. Is there any built in method from colab, I have purchased colab pro, in order to store those numbers in a txt file? The goal is to train a model to predict these…
Iliasp
- 143
- 8
1
vote
0 answers
define_metric parameter ‘hidden’ not working?
I want specific metrics to be used exclusively as x-axis/independend variable in the Weights&Biases-Dashboard graphs. But no matter how I set them up, there are automatically generated panels in the Dashboard that plot these metrics against the…
Tim_123
- 31
- 4
1
vote
1 answer
Can I pass 'wandb' object to another class in python?
I have written a modular code and I wanted to pass a wandb object to a class which has been written in another .py file. I instantiated a wandb object using:
import wandb
exp_name = "expriment name"
run = wandb.init(config = wandb.config, project=…
Milad Sikaroudi
- 677
- 6
- 16
1
vote
1 answer
W&B won't finish the process
I'm using pytorch_ligthning and wandb to conduct some experiments. The problem is that training will silently crash before finishing in the following way:
Epoch 997/1000
0.087
Epoch 998/1000
0.080
wandb: Waiting for W&B process to finish...…
James Arten
- 523
- 5
- 16
1
vote
1 answer
Experiment tracking for multiple ML independent models using WandB in a single main evaluation
Can you recommend from your experience about choosing a convenient tracking experiment tool and versioning only "Multi independent models, but one input->multi-models->one output" in order to get single main evaluation and conveniently compare…
AlexeyPrikhodko
- 43
- 6
1
vote
0 answers
How to solve errors in Kaggle while setting up PyTorch environment
I'm new to Kaggle Notebooks. I'm trying to set up adamp, torchsummary, pytorch_model_summary.
But it keeps raising an error. How should I sort out my problem?
Python version is 3.7.12
import numpy as np
import random
import os
import pandas as…
sherl0ck
- 13
- 5
1
vote
1 answer
Plotting the confuison matrix into wandb (pytorch)
I'm training a model and I'm trying to add a confusion matrix, which would be displayed in my wandb, but I got lost a bit. Basically, the matrix works; I can print it, but it's not loaded into wandb. Everything should be OK, except it's not. Can you…
1
vote
0 answers
YOLOv5 Evolution Results Not Reproducible wandb
I am running YOLOv5 in a sagemaker notebook.
The 10 epoch runs are using the following notebook script making use of the --evolve flag for hyperparameters.
!export WANDB_RUN_GROUP="evolution" && python…
Manuel Gozzi
- 21
- 6
1
vote
1 answer
Hyperparameter tunning with wandb - CommError: Sweep user not valid when trying to initial the sweep
I'mt rying to use wandb for hyperparameter tunning as described in this notebook (but using my dataframe and trying to do it on random forest regressor instead).
I'm trying to initial the sweep but I get the error:
sweep_configuration = {
…
Reut
- 1,555
- 4
- 23
- 55
1
vote
1 answer
How to exit the login of wandb?Two people have two accounts on one machine...Anyway other than relogin?
There are two people using wandb api on one machine. If one forgets to relogin before running, the other one's run will be shown in the prevois one's account. I wonder if there is a way to exit the login state and then the other one will know that…
JackHu-bme
- 27
- 2
1
vote
1 answer
is there any way to scale axis of plots in wandb?
I am working with weight and bias(wandb).
However, it logs by step. And that makes plot disturbing when comparing runs.
For example, I have a run A and run B(assume that they run with same dataset).
run A: 30epochs, 4 batch, 200step/epoch
run B:…
이준혁
- 267
- 4
- 14
1
vote
1 answer
wandb: get a list of all artifact collections and all aliases of those artifacts
The wandb documentation doesn't seem to explain how to do this - but it should be a fairly common use case I'd imagine?
I achieved mostly (but not completely) what I wanted like this, but it seems a bit clunky? I'd have expected to have an…
Alex L
- 4,168
- 1
- 9
- 24