Quantcast
Channel: MarsHut
Viewing all articles
Browse latest Browse all 6551

mapreduce.LoadIncrementalHFiles hangs..

$
0
0
Last piece of the puzzle!

My Mapreduce succeeded in generating hdfs file, However, bulk load with the
following code:

LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf);

loader.doBulkLoad(newExecutionOutput, candidateSendTable);

Just hangs there without any output. I tried to run

hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
<hdfs://storefileoutput> <tablename>

It seems to get into some kind of infinite loop..

*2014-06-19 18:06:29,990 DEBUG [LoadIncrementalHFiles-1]
client.HConnectionManager$HConnectionImplementation: Removed
cluster-04:60020 as a location of
[tablenae],1403133308612.060ff9282b3b653c59c1e6be82d2521a. for
tableName=[table] from cache*

*2014-06-19 18:06:30,004 DEBUG [LoadIncrementalHFiles-1]
mapreduce.LoadIncrementalHFiles: Going to connect to server
region=[tablename],,1403133308612.060ff9282b3b653c59c1e6be82d2521a.,
hostname=cluster-04,60020,1403211430209, seqNum=1 for row with hfile group
[{[B [ at ] 3b5d5e0d,hdfs://mypath}]*

*2014-06-19 18:06:45,839 DEBUG [LruStats #0] hfile.LruBlockCache:
Total=3.17 MB, free=383.53 MB, max=386.70 MB, blocks=0, accesses=0, hits=0,
hitRatio=0, cachingAccesses=0, cachingHits=0,
cachingHitsRatio=0,evictions=0, evicted=0, evictedPerRun=NaN*

*Any guidence on how I can debug this?*

*Thanks much!*

*Chen*

Viewing all articles
Browse latest Browse all 6551

Trending Articles