Stack Overflow
Stack Overflow

Questions tagged [feather]

Feather is a file format for storing data frames. It allows fast data exchange between Python and R.

147 questions
1
vote
1 answer

R feather package compilation error (g++) on FreeBSD

I am trying to install the feather package on FreeBSD machine and it crashes due to the following error: error: 'snprintf' was not declared in this scope. g++ is used for compilation. Any hint on how to deal with this problem will be much…
sztal
  • 287
  • 2
  • 10
1
vote
1 answer

getting wrong dates from a feather file via pandas

A feather file generated by R, has a start_time column that contains both date and time. The date is from year 2016. I am reading the same file in pandas using below code df = feather.read_dataframe(file) When I am displaying the df, it shows the…
Ratib Hussaini
  • 11
  • 1
1
vote
1 answer

Reading Pandas data frame stored with Feather into R

I just attempted to read into R a Pandas dataframe stored to disk with Feather. After reading the dataframe in, I checked the type of the object and instead of seeing 'data.frame' as the result, I see 'tbl_df' 'tbl' 'data.frame'. Any idea what is…
Chris
  • 3,109
  • 7
  • 29
  • 39
1
vote
0 answers

read_feather over network drive slow

I have a data.frame of moderate size, and I tested storing and retrieving it to a network drive using both rds (uncompressed) and feather format. But the result shows that while write_feather is much faster than saveRDS, read_feather is much slower…
qoheleth
  • 2,219
  • 3
  • 18
  • 23
1
vote
0 answers

R package issues deploying shiny to beta.rstudioconnect.com

I had a shiny app that was deploying without problems on beta.rstudioconnect.com. I added some maps to it and then could no longer get it to work; one of the packages did not appear to be supported. I thought I might be able to get around this by…
val
  • 1,629
  • 1
  • 30
  • 56
1
vote
1 answer

Feather install error with pip3

Hey everyone while I am trying to pip3 install feather this error popup on the screen. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "", line 1, in File…
Mohamed Salah Hassan
  • 11
  • 1
1
vote
0 answers

Error while reading with feather package

I am reading the scv file of ~50Mb with read_feather of feather package. While reading the error is generated as follows: Error in .Call("feather_coldataFeather", PACKAGE = "feather", feather, : negative length vectors are not allowed I have…
Dimon D.
  • 438
  • 5
  • 23
0
votes
2 answers

Feather read failure from pandas with pd.cut data

The following read-write sequence through feather throws with error: ArrowInvalid: Ran out of field metadata, likely malformed dg = pd.DataFrame({'A': pd.cut((1, 2, 3), bins=[0, 1, 2])}) file_name =…
gg99
  • 445
  • 6
  • 12
0
votes
1 answer

How can I convert a feather file to CSV using Python?

How to convert feather file into csv file using python? I tried using feather module, pyarrow.feather I could only read it but I couldn't convert it to csv format. # when using pandas import pandas as pd df =…
Zeina Yousri
  • 11
  • 1
0
votes
1 answer

Is there a way to write read/write chunks in the feather format on Python?

I am pretty new to python and databases. I am trying to write my dataset in the feather format. The dataset is large and segmented, I want to store my data in chunks and retrieve only certain chunks when I need them. Would this be possible ? I…
MeganNN
  • 1
  • 1
0
votes
0 answers

Pint support for saving to Parquet, hdf5 and Feather files

Pandas dataframes with Pint dtypes do not appear to be saving to Parquet or Hdf5 format. Is there no support for this, or am I doing this wrong. import pandas as pd import numpy as np import pint,pint_pandas eq =…
kbk78
  • 139
  • 4
0
votes
1 answer

Most efficient way to save / load huge DataFrames?

I have a single pd.DataFrame with 4.3 million rows and 2 columns, like so: Id Features 27693 [1.6555750043281372e-09, -6.016701912292214e-2...] 27694 [-1.5324687581597672e-32, 1.0946759676292507e-4...] Features is a column that stores…
Johnny
  • 117
  • 10
0
votes
2 answers

Reading/writing apache feather files from a compiled python script fails

I'm trying to create a script that converts a csv file to a feather file, then compile that script to a stand-alone exe which can be invoked from other applications supplying two parameters - path to a csv file and a path to the output feather file.…
dqu
  • 1
  • 1
0
votes
1 answer

python polars - kernel keep crashing while concatenating thousands of csv/feather files

I'm working with thousands csv/feather files (each contains ~xxx) on python. I initially use pandas to do the task but it takes so long, hence I try to use polars. Note: the pandas version of my code is similar to the one below, it works just fine,…
Amri Rasyidi
  • 172
  • 1
  • 10
0
votes
0 answers

pyarrow.lib.ArrowInvalid: Not a Feather V1 or Arrow IPC file

Python 3.7 feather-format==0.4.1 throws error below. Traceback (most recent call last): File "./cv.py", line 86, in get_training('HeLa-S3'), File "./cv.py", line 19, in get_training …
bade
  • 1
  • 1
1 2 3
…
9 10