How to get rid of zeros of each array in a list of array in Python?

Question

I am trying to do time series data analysis on all the fracking wells in pennsylvania, and naturally a lot of these are dry wells with 0 production. I want to create the histogram of each array inside the list without zero in it, therefore the total length of each array will shrink a little bit

P = [data3P, data4P, data5P, data6P, data7P, data8P, data9P, data10P]
for i in P 
N = []
for i in data3P:
if i >0:
    N.append(i)
N

I think I should do it in a for loop, but just not sure how to do that for all the arrays in the list. Shall I use a double for loop?

It looks Pythonic, so maybe `P = [data3P, data4P, ...]` then `P = [i for i in P if i > 0]` — TessellatingHeckler, Dec 14 '15 at 23:42
Have you got any non-working code to share? What are those data objects (numbers, arrays...)? If this is Python and they are arrays, maybe try `filter(None, P)`. — Matt Hall, Dec 14 '15 at 23:43
The truth value of an array with more than one element is ambiguous. Use a.any() or a.all() This is the error message from TessellatingHeckler, must be something wrong with what I did — Bowen Liu, Dec 14 '15 at 23:51

score 0 · Answer 1 · edited May 23 '17 at 12:07

0

If you are dealing with large amounts of data, numpy is your friend. You can create a masked array (where the zeros are masked), and apply the regular histogram function, see this answer for an example.

edited May 23 '17 at 12:07

Community

1
1

answered Dec 15 '15 at 01:06

Benjamin

11,560
13
70
119

Thanks. I got "hist is not defined", which library shall I import to make it work. – Bowen Liu Dec 15 '15 at 05:51
@BowenLiu You need to use `pyplot.hist` – erip Dec 15 '15 at 13:00
@BowenLiu, you need to import numpy as np. See: http://docs.scipy.org/doc/numpy-1.10.0/reference/maskedarray.html. pyplot.hist is a reference to matplotlib, not the tool I was talking about. – Benjamin Dec 15 '15 at 16:18

score 0 · Answer 2 · answered Dec 15 '15 at 12:54

0

I'm not 100% sure if this is what you need, but if you want to gather all the NumPy arrays datanP but without any zeros they might contain, you can do this:

[a[a!=0] for a in P]

It would help if you showed what one of those input arrays looks like, and what you'd like to get out of the processing you're trying to do.

answered Dec 15 '15 at 12:54

Matt Hall

7,614
1
23
36

That's an inefficient way to work with numpy arrays, plus it returns a list, not a numpy array. – Benjamin Dec 15 '15 at 18:07
It's not if he has a list of arrays. I can't tell what the input actually is. – Matt Hall Dec 15 '15 at 18:15

How to get rid of zeros of each array in a list of array in Python?

2 Answers2