Stack Overflow
Stack Overflow

Questions tagged [feather]

Feather is a file format for storing data frames. It allows fast data exchange between Python and R.

147 questions
0
votes
0 answers

Reading in feather file in pyarrow error - ArrowInvalid: Unrecognized compression type: LZ4

I am trying to read a feather file into Python using pyarrow like so: import pyarrow.feather as feather feather.read_feather("../data/my_file.feather") However, when I run this, I get the following error message: ArrowInvalid: Unrecognized…
Annie Chen
  • 61
  • 7
0
votes
1 answer

Installing R packages from python project's requirements.txt

I have a python project that uses two R packages. I have to use these packages because they don't exist for Python as of today. While my project works great, one obstacle is that users have to install these two packages using R (or R studio) in…
RforResearch
  • 401
  • 8
  • 16
0
votes
1 answer

pandas read feather ArrowInvalid

When I'm trying to read a feather file I got this Error: ArrowInvalid: Column 0: In chunk 0: Invalid: Buffer #1 too small in array of type int64 and length 14712: expected at least 117696 byte(s), got 3450
Anna Iliukovich-Strakovskaia
  • 1,383
  • 1
  • 9
  • 20
0
votes
1 answer

Error: "Undefined symbol" when trying to import pyarrow/feather

I installed feather via conda install feather-format -c conda-forge In the process, pyarrow and possibly more packages were installed by conda. When trying to do import feather, I get the following error message: ImportError Traceback (most recent…
user3825755
  • 883
  • 2
  • 10
  • 29
0
votes
2 answers

How check column existence in feather data file "before" reading in R?

I have to read the data file in feather format with predefined set of columns. It generates an error if the column does not exists in the data file. How to check it "before" reading data set library(feather) # 1. Data set df_mtcars <- mtcars # 2.…
Andrii
  • 2,843
  • 27
  • 33
0
votes
1 answer

Error when writing Pandas DataFrame to feather file

While running: df.to_feather(file_path) The following error occurred: Traceback (most recent call last): File "X:\FAKE\script.py", line 37, in df_to_feather df.to_feather(file_path) File…
SomeBruh
  • 440
  • 3
  • 18
0
votes
0 answers

pyarrow issue loading in feather module

I have been following the recommendations from this issue but this hasn't solved my issue https://github.com/conda-forge/geopandas-feedstock/issues/45 I have tried to create new testing environments, reinstalled all relevant packages and still run…
Finn Lawson
  • 11
  • 1
  • 5
0
votes
1 answer

Reading Arrow Feather files in C++

I've scoured the Arrow docs, but haven't found much clarity on how to read Feather files generated via pyarrow back into C++. import pyarrow.feather as feather feather.write_feather(df, 'test_file.feather') Is this not a recommended flow? It looks…
winter
  • 441
  • 1
  • 4
  • 5
0
votes
1 answer

How to read into dataframe from feather bytes object

I have bytes object (it's feather data) in pandas dataframe as : df[0]: 0 b'FEA1\x00\x00\x00\x00\x05\x00\x00\x00\x00\x00... Name: 0, dtype: object How to deserialization object from df[0] (feather data) into dataframe ?
jBee
  • 193
  • 1
  • 1
  • 11
0
votes
1 answer

Why does feather need pyarrow? (or: How to load feather data without downgrading to pandas 24?)

I get this error message: Missing optional dependency 'pyarrow'. Use pip or conda to install pyarrow. when I run a simple command to load feather data, ie: pd.read_feather("data.feather"). Surely I can install pyarrow from conda-forge, but that…
Martien Lubberink
  • 2,614
  • 1
  • 19
  • 31
0
votes
1 answer

Taking forever to save a pandas dataframe from google colab session to my google drive

I mounted my google drive in my colab notebook, and I have a fairly big pandas dataframe and try to mydf.to_feather(path) where path is in my google drive. it is expected to be 100meg big and it is taking forever. Is this to be expected? it seems…
kawingkelvin
  • 3,649
  • 2
  • 30
  • 50
0
votes
1 answer

R: Compilation error "ISO C++ forbids in-class initialization of non-const static member" when installing feather package

I'm using R version 3.1.2 and want to install the "feather" package in RStudio: install.packages("feather", type="source") Using a source version because there doesn't seem to be a binary version. It does extract the file and checks for MD5 sums…
Sally
  • 168
  • 1
  • 10
0
votes
1 answer

Sitefinity 10, feather API controller and autenthication

We have set up our platform using sitefinity and MVC (Feather widgets). This works well for the website itself. We now want to develop an app aswell that is going to user REST services. For this we have implemented…
KCJ Hendriks
  • 43
  • 9
0
votes
2 answers

Feather.compat import ModuleNotFoundError: No module named 'feather.compat'

Same problem as defined in this post, but there has been no solved answer. Wondering if there is something going on between pyarrow and feather. I tried environments where: I installed with conda install feather-format -c conda-forge Installed…
WRosko
  • 73
  • 10
0
votes
0 answers

ModuleNotFoundError: No module named 'feather.compat'

I installed feather using conda install feather-format -c conda-forge and I believe that it was successfully installed but when I try to run a program with from feather.compat import pdapi I get an error saying that there is no module named…
Stephanie Zhang
  • 1
1 2 3
…
9
10