Questions tagged [monetdblite]

MonetDBLite is an embedded version of MonetDB, a relational database with a SQL interface. MonetDB uses a columnar storage model and is most suited for analytical workloads. Currently, MonetDBLite is available for R.

MonetDBLite is an embedded version of MonetDB, a relational database with a SQL interface. MonetDB uses a columnar storage model and is most suited for analytical workloads. Currently, MonetDBLite is available for R. Details: https://www.monetdb.org/blog/monetdblite-r

46 questions
2
votes
1 answer

Unable to combine large survey dataframes in R using MonetDB and MonetDBLite

I am trying to concatenate or rbind 12 years of survey data, each with several million observations and a hundred or so variables so as to analyze annual trends while accounting for the survey structure. The recent release of MonetDBLite for R…
charlie
  • 602
  • 4
  • 12
1
vote
2 answers

are COPY commands possible with MonetDBe-Python?

I was having some trouble bulk-loading records to go faster than what cursor.executemany would allow. I hoped the bulk operations documented with regular MonetDB here might work, so I tried an export as a test. e.g. cursor.execute("COPY SELECT *…
dcc310
  • 1,038
  • 1
  • 9
  • 13
1
vote
0 answers

monetdblite performance trace

MonetDBLite has no trace capabilities. The Release version compiled with Visual Studio is faster than the one compiled with MinGW64, optimizations used on both (/O2). But even so, the fastest version seems to be 3-4 times slower than the time…
DanZ
  • 15
  • 6
1
vote
1 answer

R Data Types to MonetDB Data Types

I am trying to insert a data frame into MonetDB using DBI::dbWriteTable() with the MonetDBLite driver and am having to adjust column types in both the MonetDB table and the R data frame. I am wondering if there is a mapping of data types from R to…
bdetweiler
  • 1,544
  • 1
  • 16
  • 27
1
vote
3 answers

SQL concatenate many tsv files into single table in a database, while keeping track of file source (MonetDBLite)

I am using the MonetDBLite R package to create a MonetDB. I can create database tables just fine using the instructions from here, with the following code: library(DBI) library(MonetDBLite) # Write tsv file of mtcars write.table(mtcars,…
lmrta
  • 305
  • 1
  • 2
  • 13
1
vote
1 answer

Can't access existing MonetDB with dplyr

I created a MonetDBLite database yesterday, populated it, and was accessing it with dplyr, however this morning I don't seem able to use dplyr. Here's my connection: statcast_db <-…
BillPetti
  • 511
  • 2
  • 7
  • 14
1
vote
1 answer

MonetDBLite Left Join Syntax

Working in R and trying to add a column to an existing MonetDBLite table by running a left join with a second table using the following code: dbSendQuery(mdb, "UPDATE table1 SET table1.variable = table2.variable FROM table1 LEFT JOIN table2…
charlie
  • 602
  • 4
  • 12
1
vote
0 answers

R: Out of memory approach to rbind large data.frames using MonetDBLite

I would like to mimic the solution once given to this question: R: how to rbind two huge data-frames without running out of memory, but using R::MonetDBLite rather than R::SQLite I tried the following without…
Cazz
  • 83
  • 7
1
vote
0 answers

Error msg monetdblite: free" value larger than "size"

I am trying to connect to a monetdblite databases, which worked fine minutes ago. After closing the connection in another session, reopening R, I am getting this error msg: con <- dbConnect(MonetDBLite(), path_db) Error in…
bartleby
  • 107
  • 1
  • 5
1
vote
1 answer

Create a connection to a DBMS in R

I'm using the libraries DBI to create a connection to a monetdblite database in R but I keep getting the same error. Here is the reproducible example and the error message I get. Any ideas on how to solve this ? # Load Packages library(MonetDB.R) …
rafa.pereira
  • 13,251
  • 6
  • 71
  • 109
1
vote
1 answer

R: Installing MonetDBLite 0.2.0 under Red Hat Enterprise Linux Server 6.7

I am trying to install/compile the MonetDBLite package version 0.2.0 under R version 3.2.1 (the most recent one provided by the cluster on which I am working) on a system running Red Hat Enterprise Linux Server 6.7. However the Intel C++ Compiler…
ngarnadt
  • 13
  • 3
1
vote
1 answer

R: Installing MonetDBLite under Ubuntu 14.04 LTS

I try to use MonetDBLite for R to analyze survey data for free on an Ubuntu 14.04 OS. Installing MonetDBLite from source via install.packages("MonetDBLite", repos=c("http://dev.monetdb.org/Assets/R/", …
stats-hb
  • 958
  • 13
  • 31
0
votes
2 answers

Monetdb Loader Function Issue - Embedded Python 3 has not been installed

This is the error when trying to run a Python loader function through mclient. TypeException:user.main[4]:'pyapi3.eval' undefined: Embedded Python 3 has not been installed. Please install it first, then start server with --set embedded_py=3 When…
0
votes
1 answer

Loading huge tables with `INSERT INTO test VALUES` in MonetDBLite

In my use case I'm generating data at runtime, and the cost of serializing such data into a CSV file and then loading to MonetDBLite using COPY will be potentially greater than using something like INSERT INTO tablename VALUES. Given that…
jackb
  • 695
  • 8
  • 26
0
votes
1 answer

monetdblite: Is it possible to configure "monetdb_query" to run multiple statements?

I am trying to run the following script "create table T1(i int); create table T2(i int);" in a fresh new database using MonetDBLite C and its "monetdb_query" API, but "monetdb_query" function seems to execute only first statement. Is it any way…
DanZ
  • 15
  • 6