Stack Overflow
Stack Overflow

Questions tagged [partition]

Use this tag for questions about code that partitions data, memory, virtual machines, databases or disks.

In computing, partition may refer to

  • Disk partitioning, the division of a hard disk drive
  • Partition (database), the division of a database
  • Logical partition (virtual computing platform) (LPAR), a subset of a computer's resources, virtualized as a separate computer
  • Memory partition, a subdivision of a computer's memory, usually for use by a single job
  • Binary space partitioning

source: https://en.wikipedia.org/wiki/Partition

Note that non-programming questions about database partitioning are likely to be better received on Database Administrators and disk partitioning on Server Fault.

1547 questions
0
votes
1 answer

Connect Crystal Report to multiple Databases

Is there a way to connect a crystal report to multiple databases? My database (SQL Server) is periodically archived and sometimes, I need to access data from an older "partition"/archive, let's call them DB109 and DB110. I need to produce one…
mysticamber
  • 11
  • 3
0
votes
1 answer

Why is `getNumPartitions()` not giving me the correct number of partitions specified by `repartition`?

I have a textFile in and RDD like so: sc.textFile(). I try to repartition the RDD in order to speed up processing: sc.repartition(). No matter what I put in for , it does not seem to change, as indicated by: RDD.getNumPartitions()…
makansij
  • 9,303
  • 37
  • 105
  • 183
0
votes
4 answers

MSSQL2012 (Over/Partition) Last 12 months, nulls included?

So, I've got one problem: getting an actual sum/avg with over, partitioning through product codes, of the last 12 months (counting the one being processed), in a scenario where there are products that may not exist in a month. Tried to start with a…
João Ciocca
  • 776
  • 1
  • 10
  • 23
0
votes
1 answer

Not able to partition table on Hive- Error in metadata

I have created a table in Hive with data loaded into it. I want to partition it on Column spec: DoJ where value is 2012 I used: ALTER TABLE employee ADD PARTITION (year='2012') location '/home/rvarun/2012/part2012'; I am getting the error:…
s1rrv
  • 15
  • 7
0
votes
1 answer

Synchronization between Spark RDD partitions

Say that I have an RDD with 3 partitions and I want to run each executor/ worker in a sequence, such that, after partition 1 has been computed, then partition 2 can be computed, and after 2 is computed, finally, partition 3 can be computed. The…
kevin
  • 559
  • 1
  • 4
  • 5
0
votes
1 answer

Create N copies of a vector based on number of nonzero values in that vector

I have a 64-by-1 vector which contains 27 non-zero values. I want to create N copies from that vector such that each copy contains only 4 non-zero values (in that case the first 6 copies will have 4 non-zero values and the last copy will contain…
Mohab Mostafa
  • 109
  • 1
  • 8
0
votes
2 answers

Force Cassandra to save particular key values to be partitioned to Specific node.

How to use the ByteOrderedPartitioner (BOP) to force specific key values to be partitioned according to a custom requirement. I want to force Cassandra to partition and replicate data according to custom requirements, without introducing a custom…
Krv Perera
  • 119
  • 2
  • 15
0
votes
1 answer

How to break a audit and history table to find the nth event after nth event in SQL

I have a audit table in SQL that simply contains some narrative, the datestamp and a linkid that links narratives to a particular object. When reading this table I would search by object id and then order the narratives by date to understand what is…
user2599240
  • 91
  • 1
  • 2
  • 4
0
votes
2 answers

kafka different topics set different partitions

As I know, 'num.partitions' in kafka server.properties will be worked for all topics. Now I want to set partitionNumber=1 for topicA and partitionNumber=2 for topicB. Is that possible to implementation with high level api?
fcbflying
  • 693
  • 1
  • 7
  • 23
0
votes
0 answers

ALTER INDEX taking long time on Oracle

I have table which partitioned by date and index is different table space. So first I tried this query. ALTER TABLE USER.XXX TRUNCATE SUBPARTITION SP_201508_D11 UPDATE GLOBAL INDEXES; But it's never finish. So removed this part UPDATE GLOBAL…
user347918
  • 161
  • 1
  • 2
  • 11
0
votes
1 answer

How do you get rid of system files from your home folder?

I have been playing around with the RecoveryHD partition of my mac and mounted it which I think has made some system files show up in my home folder. I am not sure but I think it is the case. Now I want to remove these files so I unmounted the…
Jonah Fleming
  • 1,187
  • 4
  • 19
  • 31
0
votes
1 answer

how to specify the partition for mapPartition in spark

What I would like to do is compute each list separately so for example if I have 5 list ([1,2,3,4,5,6],[2,3,4,5,6],[3,4,5,6],[4,5,6],[5,6]) and I would like to get the 5 lists without the 6 I would do something like…
Philippe C
  • 667
  • 2
  • 9
  • 16
0
votes
2 answers

Creating sequentially increasing groups based on number change

How can I code this in oracle SQL? I have the below data Current Result I want to generate a result that looks like the following: Desired Result So, I essentially want the group ID to increase as the row number changes back to 1. I am trying to…
user3056152
  • 33
  • 6
0
votes
1 answer

Empty array returned by mapPartitions in PySpark

hello could someone explain to me why mapPartitions reacts differently to those two functions? (I have looked at this this thread and I don't think my problem comes from the fact that my iterable is TraversableOnce as I create…
Philippe C
  • 667
  • 2
  • 9
  • 16
0
votes
2 answers

SQL Oracle - Find all combination of events possible based on date

I have a table with the following information: Data Sample **Table 1** palletNumber-- event-- --recordDate -----1-----------A-------01/11/2015 01:00 -----1-----------B-------01/11/2015 02:00 -----1-----------C-------01/11/2015…
Aurax22
  • 111
  • 3
  • 13
1 2 3
…
99 100