Questions tagged [hbase]

HBase is the Hadoop database (columnar). Use it when you need random, real time read/write access to your Big Data. This project's goal is the hosting of very large tables -- billions of rows X millions of columns -- atop clusters of commodity hardware.

HBase is an open source, non-relational, distributed,versioned, column-oriented database modeled after Google's Bigtable and is written in Java. Bigtable: A Distributed Storage System for Structured by Chang et al. Just as Bigtable leverages the distributed data storage provided by the Google File System, HBase provides Bigtable-like capabilities on top of Hadoop Distributed File System(HDFS). HBase includes: It is developed as part of Apache Software Foundation's Apache Hadoop project and runs on top of HDFS (Hadoop Distributed File System), providing Bigtable-like capabilities for Hadoop.

  • Convenient base classes for backing Hadoop MapReduce jobs with HBase tables including cascading, hive and pig source and sink modules
  • Query predicate push down via server side scan and get filters
  • Optimizations for real time queries
  • A Thrift gateway and a REST-ful Web service that supports XML, Protobuf, and binary data encoding options
  • Extensible jruby-based (JIRB) shell
  • Support for exporting metrics via the Hadoop metrics subsystem to files or Ganglia; or via JMX
6961 questions
12
votes
5 answers

Hbase Client RPC Timeout

I'm running Hbase 1.0.1/Hadoop 2.5.2. I'm trying to run a scan on a table but I'm getting RPC timeouts. I've changed the Hbase RPC timeout to 2 minutes which I can confirm frm the UI... hbase.rpc.timeout
JohnnyD
  • 477
  • 1
  • 4
  • 19
12
votes
2 answers

What it the difference between Hbase and BigTable?

Can anyone tell me what is the difference between Apache HBase database and Bigtable? Or are they same? Which one supports relations, if any? If they are Big Searcher what is the difference?
salar
  • 137
  • 1
  • 2
  • 11
12
votes
3 answers

How describe Hbase column family?

I am looking for a command which describes the columnfamily inside the table from the HBase Shell. I could not get any command to try this.
sahiljain
  • 2,215
  • 1
  • 29
  • 39
12
votes
2 answers

How does HBase enable Random Access to HDFS?

Given that HBase is a database with its files stored in HDFS, how does it enable random access to a singular piece of data within HDFS? By which method is this accomplished? From the Apache HBase Reference Guide: HBase internally puts your data in…
Matthew Moisen
  • 16,701
  • 27
  • 128
  • 231
12
votes
4 answers

HBase row key design for monotonically increasing keys

I've an HBase table where I'm writing the row keys like: ~1 ~2 ~3 ... ~9 ~10 The scan on the HBase shell gives an output: ~1 ~10 ~2 ~3 ... ~9 How should a row key be…
Mayank
  • 5,454
  • 9
  • 37
  • 60
12
votes
3 answers

row keys through the hbase shell?

I am using scan 'table_name', { COLUMNS => 'column_family:column_qualifier', LIMIT => 2 } to list 2 rows in a hbase table but I would like to know if it is possible to achieve following using hbase shell: Questions list all row keys through the…
user2360096
  • 133
  • 1
  • 2
  • 6
12
votes
6 answers

HBase ERROR: hbase-default.xml file seems to be for and old version of HBase (null)

I am trying to write a program to connect to HBase. However when I execute following command HBaseConfiguration.create(); I get following error: . "hbase-default.xml file seems to be for and old version of HBase (null), this version is…
Rohit
  • 155
  • 1
  • 2
  • 8
12
votes
2 answers

Is it better to use HBase columns or serialize data using Avro?

I working on a project that stores key/value information on a user using HBase. We are in the process of redesiging the HBase schema we are using. The two options being discussed are: Use HBase column qualifiers as names for the keys. This would…
Shawn H
  • 1,227
  • 1
  • 12
  • 18
12
votes
3 answers

Multiple databases or namespace in Hbase

Is there a way to setup Hbase so we can create multiples databases inside the same cluster ?
Fabien
  • 965
  • 3
  • 11
  • 23
12
votes
4 answers

HBase column families: how many?

Probably there are a lot of similar questions but they dont' answer to my scenario (at least I'm not able to get the point). I have, lets say, a table in HBase with 4 column families. Main reason is that each column family has different VERSIONS…
Andrea
  • 2,714
  • 3
  • 27
  • 38
12
votes
2 answers

Random access performance in HBase & block size in HDFS

HBase can use HDFS as back-end distributed file system. However, their default block size is quite different. HBase adopts 64KB as default block size, while HDFS adopts at least 64MB as default block size, which is at least 1000 times larger than…
ccshih
  • 1,190
  • 3
  • 17
  • 25
12
votes
4 answers

Hbase mapreduce error

I write job mapreduce.The input is a table in hbase. When job run, had error : org.apache.hadoop.hbase.client.ScannerTimeoutException: 88557ms passed since the last invocation, timeout is currently set to 60000 at…
cldo
  • 1,735
  • 6
  • 21
  • 26
11
votes
3 answers

How to get multiple versions from one specific row and column in HBase

As we know, hbase has a feature that a specific Row and specific Column can record recent change values by timestamps. So my question is, HOW TO list all the changed values using any HBase command? I googled a lot, but didn't find any useful links.
mlzboy
  • 14,343
  • 23
  • 76
  • 97
11
votes
1 answer

HBase multiple column families performance

I have 2 HBase tables - one with a single column family, and other has 4 column families. Both tables are keyed by same rowkey, and the column families all have a single column qualifier each, with a json string as value (each json payload is about…
ps0618
  • 111
  • 4
11
votes
1 answer

Running "hbase shell" giving error in OSX

Getting following error when trying to run hbase shell in OSX(version: 10.11.4): warning: -J-Dfile.encoding=UTF-8 argument ignored (launched in same VM?) warning: -J-XX:MaxPermSize=1024m argument ignored (launched in same VM?) warning: -J-Xmx4096m…
Saurabh
  • 71,488
  • 40
  • 181
  • 244