Stack Overflow
Stack Overflow

Questions tagged [tqdm]

Questions related to progress bar tqdm usage in Python or shell.

tqdm is a Python progress bar working both under Python scripts and Unix-like shells.

Resources:

571 questions
13
votes
3 answers

Is there a chunksize argument for read_excel in pandas?

I'm trying to create a progress bar for reading excel data into pandas using tqdm. I can do this easily with a csv using the chunksize argument like so: data_reader = pd.read_csv(path, chunksize = 1000) for row in…
jsxgd
  • 403
  • 1
  • 5
  • 16
12
votes
0 answers

progress bar on pd.Series.apply function doesn't work on Windows. AttributeError: 'Series' object has no attribute '_is_builtin_func'

I would like to see the progress bar of the apply function in jupyter notebook. On Ubuntu everything works fine, on Windows 10 I receive an error. Code: from tqdm.notebook import tqdm tqdm.pandas() preprocessed_text_test =…
Ivan M.
  • 497
  • 6
  • 8
12
votes
1 answer

how to make a nested tqdm bars on jupyter notebook

Here is an example for nested tqdm bar import time import tqdm for i in tqdm.tqdm(range(3)): for j in tqdm.tqdm(range(5)): print(i," : ", j) I try it on jupyter notebook but it does not show any thing without error! However, it works…
Jeanne
  • 1,241
  • 3
  • 19
  • 28
12
votes
3 answers

Can tqdm be used with Database Reads?

While reading large relations from a SQL database to a pandas dataframe, it would be nice to have a progress bar, because the number of tuples is known statically and the I/O rate could be estimated. It looks like the tqdm module has a function…
seewalker
  • 1,123
  • 10
  • 18
11
votes
4 answers

Is it possible to use tqdm for a process that isn't a loop?

I am writing a program in which an operation takes a few seconds (loading a large file). Luckily, it always takes the same amount of time. So, for the sake of the user, I want to make a progress bar. However, tqdm seems to be designed for loops.…
Nicolas Gervais
  • 33,817
  • 13
  • 115
  • 143
11
votes
2 answers

How can I get a tqdm progress_apply bar in VS Code notebooks?

I am trying to display a progress bar when I perform "vector" progress_apply operations on pandas dataframes, in MS Visual Studio Code. In VS Code with the Python extension enabled, I tried in a cell import pandas as pd from tqdm import…
Davide Fiocco
  • 5,350
  • 5
  • 35
  • 72
11
votes
4 answers

tqdm: extract time passed + time remaining?

I have been going over the tqdm docs, but no matter where I look, I cannot find a method by which to extract the time passed and estimated time remaining fields (basically the center of the progress bar on each line: 00:00<00:02). 0%| |…
Coolio2654
  • 1,589
  • 3
  • 21
  • 46
11
votes
1 answer

How to make a progress bar on a web page for pandas operation

I have been googling for a while and couldn't figure out a way to do this. I have a simple Flask app which takes a CSV file, reads it into a Pandas dataframe, converts it and output as a new CSV file. I have managed to upload and convert it…
Logan Yang
  • 2,364
  • 6
  • 27
  • 43
11
votes
1 answer

progress bar slows down code by factor of 5 using tqdm and multiprocess

I added a progress bar to my 2.7 python code using tqdm but it has slowed down my code significantly. Without the progress bar for one example it takes 12 seconds while with the progress bar it takes 57 seconds. The code without the progress bar…
0_o
  • 333
  • 3
  • 9
11
votes
4 answers

How to use tqdm to iterate over a list

I would like to know how long it takes to process a certain list. for a in tqdm(list1): if a in list2: #do something but this doesnt work. If I use for a in tqdm(range(list1)) i wont be able to retrieve the list values. Do you know how…
user2505650
  • 1,293
  • 6
  • 20
  • 38
11
votes
3 answers

How to use tqdm in bash for loops?

I have this for loop for example that takes so much time to finish so I want to use tqdm to have a nice progress bar like in python. But I can't find any way to do it? for f in `find mydir -name *.jpg -print`; do cp $f images/${f//\//_}; done How…
yukashima huksay
  • 5,834
  • 7
  • 45
  • 78
11
votes
1 answer

printing text below tqdm progress bar

I would like to display text in a ring-like buffer below a tqdm progress bar. This text would not necessarily be updated with every update of the bar. When using the .write() function of tqdm, text is only printed to the right of the bar, which is…
pdice
  • 111
  • 1
  • 4
11
votes
1 answer

How to use tqdm through multi process in python?

I'm trying to use tqdm through multi processes. And the behavior is not as expected. I think the point is that the value of pbar doesn't update through the processes. So how to deal with this problem? I have also tried to use Value to update pbar.n…
Sraw
  • 18,892
  • 11
  • 54
  • 87
10
votes
1 answer

how to use tqdm with multithreading?

I am trying to use tqdm to report the progress of each file downloads from three links, I wanted to use multithreading to download simultaneously from each link at the same time update the progress bar. But when I execute my script, there are…
skullknight
  • 109
  • 1
  • 1
  • 4
10
votes
6 answers

Using tqdm on a for loop inside a function to check progress

I'm iterating over a large group files inside a directory tree using the for loop. While doing so, I want to monitor the progress through a progress bar in console. So, I decided to use tqdm for this purpose. Currently, my code looks like this: for…
Mayank Gautam
  • 111
  • 1
  • 1
  • 4
1 2 3
…
38 39