Stack Overflow
Stack Overflow

Questions tagged [partitioning]

Partitioning is a performance strategy whereby you divide possibly very large groups of data into some number of smaller groups of data.

Partitioning is a performance strategy whereby you divide possibly very large groups of data into some number of smaller groups of data.

The expectation is that with algorithms of order exponentially greater than N the total time it takes to process the smaller groups and combine the results is still less than the time it would take to process the one larger set of data.

Partitioning is similar to range partitioning in many ways. As in partitioning by RANGE, each partition must be explicitly defined.

3138 questions
1
vote
1 answer

Linear partitioning using recursivity

I know that there are similar questions, but I can`t modify my code using them. Imagine that we have some works to do whith this costs of times n=[8,6,7,2,1,4], and 3 workers to do them. So if we want to calculate the best way to make the partition…
Lierni
  • 11
  • 1
1
vote
1 answer

Simulating and manipulating a partitioned database on multiple locations

Let's say that I created the following table : CREATE TABLE TABLE1 ( id INT NOT NULL country VARCHAR(10) NOT NULL name VARCHAR(10) NOT NULL productType VARCHAR(10) NOT NULL ) If for example I have different values for producType ( type1, type2 ..…
Ouissal
  • 1,519
  • 2
  • 18
  • 36
1
vote
1 answer

Data partitioning functions in h2o and caret seem to be leaking data?

I am suspecting that both h2o's and caret's data partitioning functions may be leaking data somehow. The reason why I suspect this is that I get two, completely different results when using either h2o's h2o.splitFrame function or caret's…
ogukku
  • 53
  • 7
1
vote
1 answer

How can I add values to a type to be able to do a database fragmentation based on it?

Lets say that I create the following table : CREATE TABLE MYTABLE (COLUMN1 INT NOT NULL, COLUMN2 myType NOT NULL); I want to create a type named myType, that can only have 4 values, for example "blue" , "white" , "green" and "red". Should I create…
Ouissal
  • 1,519
  • 2
  • 18
  • 36
1
vote
0 answers

Partition step remains in started state with multiple nodes

Spring integration is working fine on a single node cluster. However the partitionStep is not getting completed and remains in STARTED state forever when we deploy our application on multiple nodes. It seems that PartitionStep is waiting in the…
Harvinder Bhutani
  • 11
  • 2
1
vote
1 answer

Algorithm for permutations of line subdivision

I'm trying to find a code/algorithm to get all possible permutations of subdividing a line or a segment. Here goes, supposed you have a 5 inches line, you could divide it in 5 chunks of 1 inche each, or 2 x 2 inches segments + 1 segment of 1…
Orion
  • 39
  • 3
1
vote
0 answers

how can i use table partition and row level secrity on tables together in postgresql?

I want to partition a table and then use row level security on those table to grant access to application users.Partition is based on organisation id and as such and is dynamic.
aman
  • 77
  • 9
1
vote
2 answers

Partitioning aggregates with groups

I'm trying to partition an aggregate similar to the example in the ElasticSearch documentation, but am not getting the example to work. The index is populated with event-types: public class Event { public int EventId { get; set; } public…
Reyhn
  • 997
  • 1
  • 11
  • 22
1
vote
1 answer

Indexing and Partitioning: Improving SqlServer 2008 R2 query performance

I have a database in 'SQL Server 2008 R2' that its size is about 5 TB and it grows in size continuously. I have some problem with running a simple query on tbl1 with hundreds of million rows: select x1,x2,x3 from tbl1 where date > '2017-04-03…
Pedram
  • 828
  • 9
  • 24
1
vote
1 answer

Partition groups of data by group

I have the following dataset: df<- as.data.frame(c(rep("a", times = 9), rep("b", times = 18), rep("c", times = 27))) colnames(df)<-"Location" Year<-c(rep(1:3,times = 3), rep(1:6, times = 3), rep(1:9, times = 3)) df$Year<-Year df<- df %>% …
jlab
  • 252
  • 2
  • 18
1
vote
2 answers

Restarting numbering within partition once value change

I'm struggling with quite simple (I think) topic, which I can not get to run. An example data: |ready_signal|timestamp | |4 |2017-03-17 17:58:25| |4 |2017-03-17 17:58:24| |4 |2017-03-17 17:58:23| |0 …
Matik
  • 25
  • 3
1
vote
2 answers

Quicksort Recursion - StackOverFlow

I'm implementing a recursive quicksort however I'm receiving stackoverflow and not sure where the bug lies :( I'm sorting 1 million ints from 10-50. I works for sizes less than 1 million like 100 thousand etc. public Quicksort(int NUM_TESTS, int…
Ketameme
  • 101
  • 6
1
vote
0 answers

Local Partitioning in Spring batch

I'm actually using local partitioning to export customer table that has 100K rows to multiple XML files ( as i can't export data to one file because StaxEventItemWriter isn't Thread-safe) but i don't get better results with multiple Threads even…
kaissun
  • 3,044
  • 4
  • 20
  • 35
1
vote
1 answer

Odd partitions using last_day

Hi lads I'm trying to automatize a partitioning process here, and well ren into something odd. Why wouldnt'the following work? create table flp_aa (cdate date, value varchar2(255)) PCTUSED 0 PCTFREE 10 INITRANS 1 MAXTRANS 255 STORAGE ( …
filippo
  • 5,583
  • 13
  • 50
  • 72
1
vote
1 answer

is it possible to emultate oracle partitioning with SQLAlchemy or any ORM tools?

i'm almost a newbie to database stuffs. we are using oracle 10g standard edition as our datastore. +30m new rows are being inserted to a single table daily.(it's the hugest amount among what we've been managing so far) the rows will be displayed in…
knifenomad
  • 21
  • 3
1 2 3
…
99 100