Odo migrates between many formats. These include in-memory structures like list, pd.DataFrame and np.ndarray and also data outside of Python like CSV/JSON/HDF5 files, SQL databases, data on remote machines, and the Hadoop File System.
Questions tagged [odo]
38 questions
0
votes
1 answer
Reading jsonlines with odo
I was expecting something like this to work:
from odo import odo
import pandas as pd
odo('jsonlines://offentliggoerelser.jsonl', pd.DataFrame)
However, I get an exception
NotImplementedError: Unable to parse uri to data resource:…
Finn Årup Nielsen
- 6,130
- 1
- 33
- 43
0
votes
1 answer
ODO command in python and how to upload missing files from CSV as NULL with simple command
i try to load data from a csv file into a mysql table using odo in python.
the csv file contains blank cells. The odo command files when it encounters blank cells.
how can I use the odo command to load the data and insert a null value by default…
Goofball
- 735
- 2
- 9
- 27
0
votes
1 answer
load CSV into MySQL table with ODO python package - date error 1292
I'm trying to import a simple CSV file that I downloaded from Quandl into a MySQL table with the odo python package
t = odo('C:\ProgramData\MySQL\MySQL Server 5.6\Uploads\WIKI_20160725.partial.csv', 'mysql+pymysql://' + self._sql._user+':'
…
Goofball
- 735
- 2
- 9
- 27
0
votes
1 answer
How do you pass an encoding to odo when loading a csv file?
The odo documentation is quite sparse, it does not explain how to pass further parameters when, say loading a csv file. For example, how do I tell odo that the file is latin1 encoded?
data=[]
odo('mylatin1.csv',data)
Hexatonic
- 2,251
- 2
- 21
- 26
0
votes
1 answer
Error when loading csv on mysql using Python and odo module
I decided to try odo for handling my csv data because it supposedly is way faster than doing it with pandas, but I can't make it work.
This is their documentation about migrating a 30gb csv file to a MySQL database:
In [1]: %time t = odo('all.csv',…
estemendoza
- 3,023
- 5
- 31
- 51
0
votes
1 answer
Pandas / odo / bcolz selective loading of rows from a large CSV file
Say we have large csv file (e.g. 200 GB) where only a small fraction of rows (e.g. 0.1% or less) contain data of interest.
Say we define such condition as having one specific column contain a value from a pre-defined list (e.g. 10K values of…
Amelio Vazquez-Reina
- 91,494
- 132
- 359
- 564
-1
votes
2 answers
Read csv into database SQLite3 ODO Python
I am trying to read in a csv into a new table in a new databased using ODO, SQLite3 and Python.
I am following these…
Chuck
- 3,664
- 7
- 42
- 76
-2
votes
1 answer
ValueError: time data '27th August 2017 23:32:58' does not match format '%d-%m-%Y %H:%M:%S' (match)
i am using pandas and odo to import csv files into a database, there is a date field in file with this format 27th August 2017 23:06:25 i would like to convert is to this format %d-%m-%Y %H:%M:%S.
Here is my the piece of code i am using:
df['Date']…
Joseph Daudi
- 1,557
- 3
- 17
- 33