Stack Overflow
Stack Overflow

Questions tagged [data-partitioning]

Data partitioning deals with the dividing of a collection of data into smaller collections of data for the purpose of faster processing, easier statistics gathering and smaller memory/persistence footprint.

337 questions
0
votes
0 answers

Generate all partitions of integer array

The Bell numbers count the number of partitions of a set. I want to generate all possible partitions of my integer array. For example, I have the following integer array: {1, 2, 3, 4}. Then there are 15 partitions. Is there any simple way to…
Denis
  • 3,595
  • 12
  • 52
  • 86
0
votes
0 answers

Partitioning an array into 3 columns with JS

Given an unknown array of integers of an unknown length, whose values are also unknown, how can I organize them into three columns, so that the sum of the left most group is the largest, the middle the second largest and the third is the smallest…
jamil
  • 555
  • 5
  • 18
0
votes
1 answer

Azure table store: Best way to configure partition and row key for comment data?

I'm very new to Azure table storage, and the concept of a partition key is still an area where I'm not yet confident to know if I'm proceeding correctly. Below is my proposed solution for storing blog post comment data. I've commented everything so…
BenjiFB
  • 4,545
  • 10
  • 46
  • 53
0
votes
1 answer

Partition method

I am trying to understand exactly what this method does, it say its suppose to "Keep swapping the outer-most wrongly-positioned pairs". I put this into a program and tried different array but the result make no sense to me, what exactly does this…
Shellscriptbeginner
  • 897
  • 1
  • 6
  • 8
0
votes
1 answer

Partitioning or Indexing for millions of records in a table?

I have a table containing 20+ millions(will go to 60+ within month) of records. Now I have to fetch records very fast. I am using MyISAM engine and i don't want to create problem during insertion(heard indexing can hurt insertion) of records. So…
Aamir
  • 738
  • 2
  • 17
  • 41
0
votes
2 answers

How to split data 70:30 and get a different range of data everytime you split it

I'm currently using R to do feature selection through the use of Random Forest regression. I want to split my data 70:30, which is easy enough to do. However, I want to be able to do this 10 times, with each 10 times obtaining a different set of…
user2062207
  • 955
  • 4
  • 18
  • 34
0
votes
3 answers

Is there a standard user interface paradigm for configuring the partition of a set of elements?

Consider you have a set of objects X (e.g., A, B, C, D) that you wish to divide into non-empty subsets that cover all of X. Mathematically, a partition of the set. So, at first you might treat them as all different, {{A}, {B}, {C}, {D}}.…
Brad
  • 53
  • 1
  • 3
0
votes
2 answers

How to wait for threads to finish without blocking GUI?

I have array of 2863 objects. I want in two "runs" per 1000 objects read array data by 4 threads (running PC # of CPUs). Currenly my source code is partitioning data to correct number of threads and runs: Single run size (default) = 1000…
ta007
  • 1
  • 1
  • 1
0
votes
2 answers

Recursive algorithm for all k-way partitions of a list

I am writing a function that should output all k-way partitions of a list A. This problem is clearly recursive, and the implementation should be straightforward: def gen_partition_k_group( A, k): # if len(A) == 0 : # EDITED FOLLOWING…
usual me
  • 8,338
  • 10
  • 52
  • 95
0
votes
0 answers

table partition with primary key

I have one table in mysql. here is schema for that table. TableName : LoginDet ~~~~~~~~~~~~~~~~~~~~ loginid mediumint(8) PrimaryKey AutoIncrement logindate timestamp Not null userid mediumint(8) unsigned Table's primaryKey…
Manish Sapkal
  • 5,591
  • 8
  • 45
  • 74
0
votes
2 answers

MATLAB: Partition vector in multiple parts using begin and end indices

I have an 1xN array with data, from which I want to cut out the relevant parts. Basically I have two arrays - beginIndex and endIndex - that indicate which parts of data I need to extract. Example: data = 1:10; beginIndex = [1 5 9]; endIndex = [3 6…
Simon
  • 9,255
  • 4
  • 37
  • 54
0
votes
1 answer

Cube process incremental 1 partition vs multiple

I have a large cube where processing times have become too long. I want to change my cube partitioning and processing options. I understand that process incremental will pull new records into the cube. My question is, is there an advantage of having…
Kyle Weller
  • 2,533
  • 9
  • 35
  • 45
0
votes
1 answer

Can I create hash index in a partitioned table?

I have a pretty big table with 300 millions records(table storage is about 13GB). I have partitioned this table into 10 partitions, but every partition still have almost 30 millions records, that makes the select xxx where column1 = "yyy" very slow…
WoooHaaaa
  • 19,732
  • 32
  • 90
  • 138
0
votes
1 answer

Data partitioning by columns

I have a this big matrix of 50 rows and 1.5M columns. From these 1.5M columns, the first two are my headers. I am trying to divide my data by columns into small pieces. So for example each small set will be 50 lines and 100 columns. But each small…
user1007742
  • 571
  • 3
  • 11
  • 20
0
votes
1 answer

How can I add an incremental number to each element in a grouped series?

I am facing a problem where I have a table called Group and a table called Entry. The Group table has a primary key Id. The Entry table has a primary key Id, a foreign key to the Group table's Id called GroupId. The Entry table has one more column…
Michael J. Gray
  • 9,784
  • 6
  • 38
  • 67
1 2 3
…
22 23