Stack Overflow
Stack Overflow

Questions tagged [partition]

Use this tag for questions about code that partitions data, memory, virtual machines, databases or disks.

In computing, partition may refer to

  • Disk partitioning, the division of a hard disk drive
  • Partition (database), the division of a database
  • Logical partition (virtual computing platform) (LPAR), a subset of a computer's resources, virtualized as a separate computer
  • Memory partition, a subdivision of a computer's memory, usually for use by a single job
  • Binary space partitioning

source: https://en.wikipedia.org/wiki/Partition

Note that non-programming questions about database partitioning are likely to be better received on Database Administrators and disk partitioning on Server Fault.

1547 questions
0
votes
2 answers

What will happen when partition value is greater than the number of reduce tasks?

For example in map reduce program, I have given number of reduce tasks as 3 and custom Partitioner returns value 5 for a condition then what will happen? Its a Question which may be silly please clarify me Thanks in advance
user1932624
  • 1
  • 1
0
votes
3 answers

SQL Query: partition count varies based on variable or hard coded parameter

I have a table which have partition. On that table we are creating a view which is using partition by. When we query view by passing date context from variables, it does not use partition context for query. Please help me sort this out. Following is…
Puneet Jain
  • 21
  • 1
  • 5
0
votes
1 answer

MAX Date series before another date grouped

I have two tables in a stage-gate project management system, one (simplified) table containing a project ID and actual gate dates for each gate, 1-5. In the other I have a historic record of all forecast data; Projected Revenue, Projected Margins,…
scottM
  • 3
  • 2
0
votes
2 answers

Delete rows from partition table - Best way

I want to delete around 1 million records from a table which is partitioned and table size is around 10-13 millions , As of now only 2 partition exist in the table containining July month data and august month data, and i want to delete from July…
aadi
  • 27
  • 1
  • 5
0
votes
0 answers

how does hashpartitioner work in spark?

Say I have lots data in a couple of s3 files, about 5 GB each, which I read in using sc.textFile I need to join the data from the two files, therefore, I opt to use the HashPartitioner technique, and I set a partition count of 20. The submitted job…
bhomass
  • 3,414
  • 8
  • 45
  • 75
0
votes
1 answer

How to do Partition in Pig?

I am learning HADOOP for last 1 months. I am using Partition in hive table. How to do Partition in Pig? It would be very useful for my assessment if any one says the answer. Thanks, Anbu K.
user4941703
0
votes
1 answer

DOORS requirement partition not shown

I'm using; DOORS client 9.6.1.0 and DOORS server 9.2.0.0. The problem; An export of a partition file I made last week is no longer shown in the Exported Partitions view on my DOORS client. Therefore I cant synchronise or rejoin it. I'm wondering if…
crispie
  • 1
0
votes
2 answers

d3.js: How to size D3 partition table based on both children and parents value

I am trying to build a basic icicle partition tree in D3 and I can't seem to get the value function to do what I want. Basically, I want each node to be sized according to it's value and the sum of it's children. As mentioned in: d3.js: size of…
DrSpaceman
  • 3
  • 3
0
votes
1 answer

Pig: how to list Hive partitions and add new partitions to Hive

I have a Hive table: CREATE EXTERNAL TABLE IF NOT EXISTS t1 ( column1 string, column2 string ) PARTITIONED BY (datestamp string) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' LOCATION '/path'; In Hive I can list partitions of this table…
Joe
  • 11,983
  • 31
  • 109
  • 183
0
votes
1 answer

Deriving month year from column and use that in range partition

Combining 2 questions here as part of my requirement. I want to do monthly range partition on date column and date column will store the value in Year-month format 1) Is there any function to get date in this format for eg: i/p - 04-07-2015 o/p -…
aadi
  • 27
  • 1
  • 5
0
votes
1 answer

Can we insert and truncate partitions parallely?

I have a large partitioned table with local indexes created on it and there are mulitple threads perform 2 operations on this table these are.. truncate the existing partition insert into partition Thread-1 will operate on parition-1 Thread-2…
sharad
  • 43
  • 4
0
votes
0 answers

Android Emulator Storage Increase Not Recognized

I'm running out of space on my emulator. I increased the storage size, but the device doesn't seem to recognize it. I've tried a few things with the adb commands like -partition-size and adjusting the config.ini file by changing the…
DevJem
  • 656
  • 1
  • 13
  • 21
0
votes
1 answer

Query performance issue with 226 million records

We have a table with 226million records. table has a composite primary key of travel id and revision the max of records revision under each travel id is close to 5000. now we are querying as below select * from (select * from travel where…
Francis John
  • 171
  • 2
  • 4
  • 13
0
votes
1 answer

I tried to restore a dmg image onto an external drive and got 'Recovery partition restores can only be done on GPT partitions'

I already formatted the external drive into smaller 200GB partitions with Extended Journal on my Mac Yosemite 10.10.4. Don't know what it is complaining about.
Tran Tienqa
  • 11
  • 4
0
votes
1 answer

Hive date based partitions

I have data in the following form on HDFS:- /basedir/yyyymmdd/fixedname/files Where the yyyymmdd is the date folder and files are the list of files added in the directory. I need a table in hive to pick up data from yyyymmdd/fixedname directory.…
user720694
  • 2,035
  • 6
  • 35
  • 57
1 2 3
…
99 100