Last piece of the puzzle!
My Mapreduce succeeded in generating hdfs file, However, bulk load with the
following code:
LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf);
loader.doBulkLoad(newExecutionOutput, candidateSendTable);
Just hangs there without any output. I tried to run
hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
<hdfs://storefileoutput> <tablename>
It seems to get into some kind of infinite loop..
*2014-06-19 18:06:29,990 DEBUG [LoadIncrementalHFiles-1]
client.HConnectionManager$HConnectionImplementation: Removed
cluster-04:60020 as a location of
[tablenae],1403133308612.060ff9282b3b653c59c1e6be82d2521a. for
tableName=[table] from cache*
*2014-06-19 18:06:30,004 DEBUG [LoadIncrementalHFiles-1]
mapreduce.LoadIncrementalHFiles: Going to connect to server
region=[tablename],,1403133308612.060ff9282b3b653c59c1e6be82d2521a.,
hostname=cluster-04,60020,1403211430209, seqNum=1 for row with hfile group
[{[B [ at ] 3b5d5e0d,hdfs://mypath}]*
*2014-06-19 18:06:45,839 DEBUG [LruStats #0] hfile.LruBlockCache:
Total=3.17 MB, free=383.53 MB, max=386.70 MB, blocks=0, accesses=0, hits=0,
hitRatio=0, cachingAccesses=0, cachingHits=0,
cachingHitsRatio=0,evictions=0, evicted=0, evictedPerRun=NaN*
*Any guidence on how I can debug this?*
*Thanks much!*
*Chen*
My Mapreduce succeeded in generating hdfs file, However, bulk load with the
following code:
LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf);
loader.doBulkLoad(newExecutionOutput, candidateSendTable);
Just hangs there without any output. I tried to run
hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
<hdfs://storefileoutput> <tablename>
It seems to get into some kind of infinite loop..
*2014-06-19 18:06:29,990 DEBUG [LoadIncrementalHFiles-1]
client.HConnectionManager$HConnectionImplementation: Removed
cluster-04:60020 as a location of
[tablenae],1403133308612.060ff9282b3b653c59c1e6be82d2521a. for
tableName=[table] from cache*
*2014-06-19 18:06:30,004 DEBUG [LoadIncrementalHFiles-1]
mapreduce.LoadIncrementalHFiles: Going to connect to server
region=[tablename],,1403133308612.060ff9282b3b653c59c1e6be82d2521a.,
hostname=cluster-04,60020,1403211430209, seqNum=1 for row with hfile group
[{[B [ at ] 3b5d5e0d,hdfs://mypath}]*
*2014-06-19 18:06:45,839 DEBUG [LruStats #0] hfile.LruBlockCache:
Total=3.17 MB, free=383.53 MB, max=386.70 MB, blocks=0, accesses=0, hits=0,
hitRatio=0, cachingAccesses=0, cachingHits=0,
cachingHitsRatio=0,evictions=0, evicted=0, evictedPerRun=NaN*
*Any guidence on how I can debug this?*
*Thanks much!*
*Chen*