Stack Overflow
Stack Overflow

Questions tagged [odo]

Odo migrates between many formats. These include in-memory structures like list, pd.DataFrame and np.ndarray and also data outside of Python like CSV/JSON/HDF5 files, SQL databases, data on remote machines, and the Hadoop File System.

More info: https://odo.readthedocs.io/en/latest/index.html

38 questions
1
vote
1 answer

Copy Pandas Dataframe to Postgres with odo

There is this top python library odo that I would love to use to transfer data from Pandas to my postgres db . it looks so convenient but i don't manage to use it :( . Has someone an idea what I am missing. It must be a little thing .....…
Remi-007
  • 145
  • 1
  • 11
1
vote
0 answers

Use odo to load csv file to MySql, get error: Column names of incoming data don't match column names of existing SQL table

ValueError: Column names of incoming data don't match column names of existing SQL table
Names in SQL table: ['id', 'variable_code', 'zcta', 'value', 'Year'] Names from incoming data: ['variable_code', 'zcta', 'value', 'Year'] The problem is…
Love_Code
  • 47
  • 1
  • 2
  • 9
1
vote
0 answers

OperationalError: (sqlite3.OperationalError) unable to open database file

first I know that there are some questions like this and I read them but they were not useful for me. I have some .csv files from financial markets and I want to transfer them to a SQLite3 database table. I used Odo a Python package for this purpose…
SaeedMMX
  • 23
  • 1
  • 7
1
vote
1 answer

using odo to load CSV -> postgres on AWS

I'm trying to do something fairly simple, but either odo is broken or I don't understand how datashapes work in the context of this package. The CSV file: email,dob tony@gmail.com,1982-07-13 blah@haha.com,1997-01-01 ... The code: from odo import…
lollercoaster
  • 15,969
  • 35
  • 115
  • 173
1
vote
1 answer

Inserting 'NA' as a string into SQLite table using odo function on Python

Consider the following file (stock_prices.csv) in CSV format: Symbol,Price RY,96.61 NA,58.69 BNS,80.35 When using the odo function in Python to insert the CSV file into a SQLite database table, the NA ticker appears to be inserted as a None…
bktags
  • 13
  • 3
1
vote
1 answer

Getting 'integer out of range' error sqlalchemy

So, I am using odo for data migration but came across this error: sqlalchemy.exc.DataError: (psycopg2.DataError) integer out of range Both the source and the destination tables have the same schema but in the sql statement being executed in the…
delalli
  • 67
  • 2
  • 11
1
vote
1 answer

Odo a CSV file into PostgreSQL database

I am new to PostgreSQL and odo. I've created the following: (I am working on Ubuntu). I've created superuser testuser and with this user (role) I've created postgresql database testuser (by running psql and then CREATE DATABASE testuser;). In this…
quapka
  • 2,799
  • 4
  • 21
  • 35
1
vote
2 answers

How to resolve utf-8 error when using odo function ? OperationalError: (sqlite3.OperationalError) Could not decode to UTF-8 column

I am new to odo. I have a simple function for migrating databases: from blaze import Data, odo, like def migrate(source, target, table_names=None): src_db = Data(source) tbl_names = (src_db.fields, table_names)[table_names is not None] …
Rahuketu86
  • 475
  • 2
  • 6
  • 17
0
votes
0 answers

Want to show Products line in Payment View in ODOO

I have a Payment view (model is account.payment) in which it displays the bill section in tree view by click on that it redirects to that bill view (model is account.move) and shows tree view for products in it. i want to show this tree view of…
RAK
  • 109
  • 7
0
votes
1 answer

Inserting to schema-specific table with python's odo

I'm using python's odo to move data from a pandas dataframe to a postgresql database. The goal is that each "user" sees their own data in their schema, but with an identical data model and table/view naming schema between "users". With normal SQL I…
philshem
  • 24,761
  • 8
  • 61
  • 127
0
votes
1 answer

How can I import a csv file without primary key to sqlite3

I want to populate a fresh database with inital data stored in csv files. I tried to use odo to populate an existing table with the content of a csv file. My files do not have a primary key and the number of columns do not match as the database has…
Bjoern
  • 171
  • 1
  • 11
0
votes
1 answer

fetch data from mysql database using Python' odo library

I need to fetch data from a MySQL database into Pandas dataframe using odo library in Python. Odo's documentation only provides information on passing a table name to fetch the data but how do I pass a SQL query string that fetches the required data…
user2714753
  • 115
  • 3
  • 11
0
votes
1 answer

SQLite Python Blaze - Attempting to create a table after dropping a table of same name returns old schema

I am trying to work out why the schema of a dropped table returns when I attempt to create a table using a different set of column names? After dropping the table, I can confirm in an SQLite explorer that the table has disappeared. Once trying to…
user3867061
  • 73
  • 2
  • 16
0
votes
2 answers

ODO cannot access S3 with S3ResponseError: 403 Forbidden

I am using odo library to transfer a pandas dataframe to S3. However I am getting following error : import pandas as pd df = pd.DataFrame([[1, 2], [3, 4], [5, 6], [7, 8]], columns=["A", "B"]) odo(df,'s3://path_to_s3_folder') S3ResponseError:…
Spandan Brahmbhatt
  • 3,774
  • 6
  • 24
  • 36
0
votes
1 answer

Getting data from odo.resource(source) to odo.resource(target)

I'm trying to extend the odo library with functionality to convert a GDAL dataset (raster with spatial information) to a NetCDF file. Reading in the gdal dataset goes fine. But in the creation stage of the netcdf I need some metadata of the gdal…
kdd
  • 656
  • 5
  • 7
1
2
3