Get the average date from multiple dates - pandas

Question

DataFrame where Date is datetime:

   Column   |       Date             
:-----------|----------------------:
    A       |   2018-08-05 17:06:01 
    A       |   2018-08-05 17:06:02 
    A       |   2018-08-05 17:06:03 
    B       |   2018-08-05 17:06:07 
    B       |   2018-08-05 17:06:09 
    B       |   2018-08-05 17:06:11

Return Table is;

   Column   |       Date            
:-----------|----------------------:
    A       |   2018-08-05 17:06:02 
    B       |   2018-08-05 17:06:09

I did the same thing with idxmin & idexmax for max and mins. But can't figure out a way to do average. — humanlearning, Aug 24 '18 at 15:02

score 10 · Accepted Answer · answered Aug 24 '18 at 15:21

For your example.

Your data:

df = pd.DataFrame(data=[['A', '2018-08-05 17:06:01'],
                   ['A', '2018-08-05 17:06:02'],
                   ['A', '2018-08-05 17:06:03'],
                   ['B', '2018-08-05 17:06:07'],
                   ['B', '2018-08-05 17:06:09'],
                   ['B', '2018-08-05 17:06:11']],
            columns = ['column', 'date'])

Solution:

df.date = pd.to_datetime(df.date).values.astype(np.int64)

df = pd.DataFrame(pd.to_datetime(df.groupby('column').mean().date))

Output:

                      date
column                    
A      2018-08-05 17:06:02
B      2018-08-05 17:06:09

I hope it will be helpful.

Andreas L. · Answer 2 · 2020-06-29T12:44:32.670

Preparing a sample dataframe:

# Initiate dataframe
date_var = "date"
df = pd.DataFrame(data=[['A', '2018-08-05 17:06:01'],
                        ['A', '2018-08-05 17:06:02'],
                        ['A', '2018-08-05 17:06:03'],
                        ['B', '2018-08-05 17:06:07'],
                        ['B', '2018-08-05 17:06:09'],
                        ['B', '2018-08-05 17:06:11']],
                  columns=['column', date_var])

# Convert date-column to proper pandas Datetime-values/pd.Timestamps
df[date_var] = pd.to_datetime(df[date_var])

Extraction of the desired average Timestamp-value:

# Extract the numeric value associated to each timestamp (epoch time)
# NOTE: this is being accomplished via accessing the .value - attribute of each Timestamp in the column
In:
[tsp.value for tsp in df[date_var]]
Out:
[
    1533488761000000000, 1533488762000000000, 1533488763000000000,
    1533488767000000000, 1533488769000000000, 1533488771000000000
]

# Use this to calculate the mean, then convert the result back to a timestamp
In:
pd.Timestamp(np.nanmean([tsp.value for tsp in df[date_var]]))
Out:
Timestamp('2018-08-05 17:06:05.500000')

I was looking for a way to include a DateTime column in a groupby aggregation. Your solution's the one that fixed fact that pandas originally excludes them. — Laurent, Sep 23 '20 at 07:39

Get the average date from multiple dates - pandas

2 Answers2

Linked

Related