Comments for new Put("lars".toBytes("UTF-8")) http://blog.lars-francke.de some crap about the future Tue, 14 Feb 2012 14:38:54 +0000 hourly 1 http://wordpress.org/?v=3.1.3 Comment on Performance testing HBase using YCSB by testing http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-187 testing Tue, 14 Feb 2012 14:38:54 +0000 http://blog.lars-francke.de/?p=62#comment-187 even am getting the same error!..any help? even am getting the same error!..any help?

]]> Comment on Performance testing HBase using YCSB by Sal http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-186 Sal Sat, 11 Feb 2012 19:45:05 +0000 http://blog.lars-francke.de/?p=62#comment-186 Thanks for all the wonderful information here. I am trying to run the tool and running into the following exception: [root@salmana-linux build]# java -cp "ycsb.jar:db/hbase/lib/*:db/hbase/conf/" com.yahoo.ycsb.Client -load -db com.yahoo.ycsb.db.HBaseClient -P /local/mnt/YCSB/workloads/workloada -p columnfamily=family -p recordcount=1000 -s YCSB Client 0.1 Command line: -load -db com.yahoo.ycsb.db.HBaseClient -P /local/mnt/YCSB/workloads/workloada -p columnfamily=family -p recordcount=1000 -s Loading workload... Starting test. Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration at java.lang.Class.getDeclaredConstructors0(Native Method) at java.lang.Class.privateGetDeclaredConstructors(Class.java:2389) at java.lang.Class.getConstructor0(Class.java:2699) at java.lang.Class.newInstance0(Class.java:326) at java.lang.Class.newInstance(Class.java:308) at com.yahoo.ycsb.DBFactory.newDB(Unknown Source) at com.yahoo.ycsb.Client.main(Unknown Source) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) ... 7 more [root@salmana-linux build]# Thanks for all the wonderful information here. I am trying to run the tool and running into the following exception:

[root@salmana-linux build]# java -cp “ycsb.jar:db/hbase/lib/*:db/hbase/conf/” com.yahoo.ycsb.Client -load -db com.yahoo.ycsb.db.HBaseClient -P /local/mnt/YCSB/workloads/workloada -p columnfamily=family -p recordcount=1000 -s
YCSB Client 0.1
Command line: -load -db com.yahoo.ycsb.db.HBaseClient -P /local/mnt/YCSB/workloads/workloada -p columnfamily=family -p recordcount=1000 -s
Loading workload…
Starting test.
Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Class.java:2389)
at java.lang.Class.getConstructor0(Class.java:2699)
at java.lang.Class.newInstance0(Class.java:326)
at java.lang.Class.newInstance(Class.java:308)
at com.yahoo.ycsb.DBFactory.newDB(Unknown Source)
at com.yahoo.ycsb.Client.main(Unknown Source)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
… 7 more
[root@salmana-linux build]#

]]> Comment on Performance testing HBase using YCSB by Julio http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-185 Julio Sat, 26 Nov 2011 20:54:33 +0000 http://blog.lars-francke.de/?p=62#comment-185 Hi! very useful post! but actually I still have problem with HBase... I'm launching ycsb like this: java -cp build/ycsb.jar:db/hbase/lib/hadoop-core-0.20-append-r1056497.jar:db/hbase/lib/hbase-0.90.4.jar:db/hbase/lib/commons-logging-1.1.1.jar:db/hbase/lib/zookeeper-3.3.2.jar:db/hbase/lib/log4j-1.2.16.jar:db/habase/conf/ com.yahoo.ycsb.Client -load -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -s and I've got: YCSB Client 0.1 Command line: -load -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -s Loading workload... Starting test. 11/11/26 21:31:14 WARN hbase.HBaseConfiguration: instantiating HBaseConfiguration() is deprecated. Please use HBaseConfiguration#create() to construct a plain Configuration 0 sec: 0 operations; 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:host.name=julio-System-Product-Name 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc. 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-openjdk/jre 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.class.path=build/ycsb.jar:db/hbase/lib/hadoop-core-0.20-append-r1056497.jar:db/hbase/lib/hbase-0.90.4.jar:db/hbase/lib/commons-logging-1.1.1.jar:db/hbase/lib/zookeeper-3.3.2.jar:db/hbase/lib/log4j-1.2.16.jar:db/habase/conf/ 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/i386/server:/usr/lib/jvm/java-6-openjdk/jre/lib/i386:/usr/lib/jvm/java-6-openjdk/jre/../lib/i386:/usr/java/packages/lib/i386:/usr/lib/i386-linux-gnu/jni:/lib/i386-linux-gnu:/usr/lib/i386-linux-gnu:/usr/lib/jni:/lib:/usr/lib 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.compiler= 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.38-11-generic-pae 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.name=julio 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/julio 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/julio/inz/YCSB 11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection 11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181 11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session 11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x133e11517d60011, negotiated timeout = 40000 10 sec: 0 operations; 20 sec: 0 operations; 30 sec: 0 operations; if it will be helpful I can not create column family under hbase and even stop it. Do you have any idea what might be wrong? Previously i was successful to run cassandra with ycsb. About hbase shell I got: julio@julio-System-Product-Name:~/inz/YCSB$ hbase-0.90.4/bin/hbase shell HBase Shell; enter 'help' for list of supported commands. Type "exit" to leave the HBase Shell Version 0.90.4, r1150278, Sun Jul 24 15:53:29 PDT 2011 hbase(main):001:0> create 'usertable', 'data' ERROR: org.apache.hadoop.hbase.NotAllMetaRegionsOnlineException: org.apache.hadoop.hbase.NotAllMetaRegionsOnlineException: Timed out (10000ms) Here is some help for this command: Create table; pass table name, a dictionary of specifications per column family, and optionally a dictionary of table configuration. Dictionaries are described below in the GENERAL NOTES section. Examples: hbase> create 't1', {NAME => 'f1', VERSIONS => 5} hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} hbase> # The above in shorthand would be the following: hbase> create 't1', 'f1', 'f2', 'f3' hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true} please help me! best regards Julio Hi!

very useful post! but actually I still have problem with HBase… I’m launching ycsb like this:

java -cp build/ycsb.jar:db/hbase/lib/hadoop-core-0.20-append-r1056497.jar:db/hbase/lib/hbase-0.90.4.jar:db/hbase/lib/commons-logging-1.1.1.jar:db/hbase/lib/zookeeper-3.3.2.jar:db/hbase/lib/log4j-1.2.16.jar:db/habase/conf/ com.yahoo.ycsb.Client -load -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -s

and I’ve got:

YCSB Client 0.1

Command line: -load -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -s

Loading workload…

Starting test.

11/11/26 21:31:14 WARN hbase.HBaseConfiguration: instantiating HBaseConfiguration() is deprecated. Please use HBaseConfiguration#create() to construct a plain Configuration

0 sec: 0 operations;

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:host.name=julio-System-Product-Name

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_22

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-openjdk/jre

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.class.path=build/ycsb.jar:db/hbase/lib/hadoop-core-0.20-append-r1056497.jar:db/hbase/lib/hbase-0.90.4.jar:db/hbase/lib/commons-logging-1.1.1.jar:db/hbase/lib/zookeeper-3.3.2.jar:db/hbase/lib/log4j-1.2.16.jar:db/habase/conf/

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/lib/jvm/java-6-openjdk/jre/lib/i386/server:/usr/lib/jvm/java-6-openjdk/jre/lib/i386:/usr/lib/jvm/java-6-openjdk/jre/../lib/i386:/usr/java/packages/lib/i386:/usr/lib/i386-linux-gnu/jni:/lib/i386-linux-gnu:/usr/lib/i386-linux-gnu:/usr/lib/jni:/lib:/usr/lib

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:java.compiler=

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.arch=i386

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.38-11-generic-pae

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.name=julio

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.home=/home/julio

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/julio/inz/YCSB

11/11/26 21:31:14 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=180000 watcher=hconnection

11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181

11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session

11/11/26 21:31:14 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x133e11517d60011, negotiated timeout = 40000

10 sec: 0 operations;

20 sec: 0 operations;

30 sec: 0 operations;

if it will be helpful I can not create column family under hbase and even stop it. Do you have any idea what might be wrong? Previously i was successful to run cassandra with ycsb.
About hbase shell I got:
julio@julio-System-Product-Name:~/inz/YCSB$ hbase-0.90.4/bin/hbase shell
HBase Shell; enter ‘help’ for list of supported commands.
Type “exit” to leave the HBase Shell
Version 0.90.4, r1150278, Sun Jul 24 15:53:29 PDT 2011

hbase(main):001:0> create ‘usertable’, ‘data’

ERROR: org.apache.hadoop.hbase.NotAllMetaRegionsOnlineException: org.apache.hadoop.hbase.NotAllMetaRegionsOnlineException: Timed out (10000ms)

Here is some help for this command:
Create table; pass table name, a dictionary of specifications per
column family, and optionally a dictionary of table configuration.
Dictionaries are described below in the GENERAL NOTES section.
Examples:

hbase> create ‘t1′, {NAME => ‘f1′, VERSIONS => 5}
hbase> create ‘t1′, {NAME => ‘f1′}, {NAME => ‘f2′}, {NAME => ‘f3′}
hbase> # The above in shorthand would be the following:
hbase> create ‘t1′, ‘f1′, ‘f2′, ‘f3′
hbase> create ‘t1′, {NAME => ‘f1′, VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true}

please help me!

best regards
Julio

]]> Comment on Performance testing HBase using YCSB by vamshi http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-184 vamshi Wed, 21 Sep 2011 10:05:47 +0000 http://blog.lars-francke.de/?p=62#comment-184 Hi , this post is very good, and its helpful for me to check my hbase performance. I am using hbase on single machine in pseudo distributed mode. hadoop-0.20.2 and hbase-0.90.4 . To run ycsb benchmark on my machine, I followed till the last command i.e ant it worked well, but, when i executed ant dbcompile-hbase i got following errors. It is showing errors in build.xml so, i couldn't solve it. please help me to overcome these errors and successfully run ycsb benchmark. hduser@vamshi-laptop:~/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e$ ant dbcompile-hbase Buildfile: build.xml compile: makejar: BUILD FAILED /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:41: The following error occurred while executing this line: /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:58: /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build/ycsb.jar is read-only. Total time: 0 seconds so i ran the same in with sudo before command. hduser@vamshi-laptop:~/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e$ sudo ant dbcompile-hbase Buildfile: build.xml compile: makejar: dbcompile-hbase: dbcompile: [javac] Compiling 1 source file to /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build/classes [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:30: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.HTable; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:32: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.Get; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:33: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.Put; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:34: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.Delete; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:35: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.Scan; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:36: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.Result; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:37: package org.apache.hadoop.hbase.client does not exist [javac] import org.apache.hadoop.hbase.client.ResultScanner; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:40: package org.apache.hadoop.hbase.util does not exist [javac] import org.apache.hadoop.hbase.util.Bytes; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:41: package org.apache.hadoop.hbase does not exist [javac] import org.apache.hadoop.hbase.HBaseConfiguration; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:51: cannot find symbol [javac] symbol : class HTable [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] public HTable _hTable=null; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:80: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] _columnFamilyBytes = Bytes.toBytes(_columnFamily); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:102: cannot find symbol [javac] symbol : class HBaseConfiguration [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] HBaseConfiguration config = new HBaseConfiguration(); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:102: cannot find symbol [javac] symbol : class HBaseConfiguration [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] HBaseConfiguration config = new HBaseConfiguration(); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:103: cannot find symbol [javac] symbol : class HTable [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] _hTable = new HTable(config, table); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:138: cannot find symbol [javac] symbol : class Result [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Result r = null; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol [javac] symbol : class Get [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Get g = new Get(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol [javac] symbol : class Get [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Get g = new Get(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Get g = new Get(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:162: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] byte[] value = r.getValue(_columnFamilyBytes, Bytes.toBytes(field)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:163: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] result.put(field,Bytes.toString(value)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:165: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] System.out.println("Result for field: "+field+" is: "+Bytes.toString(value)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol [javac] symbol : class Scan [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Scan s = new Scan(Bytes.toBytes(startkey)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol [javac] symbol : class Scan [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Scan s = new Scan(Bytes.toBytes(startkey)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Scan s = new Scan(Bytes.toBytes(startkey)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:213: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] s.addColumn(_columnFamilyBytes,Bytes.toBytes(field)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:218: cannot find symbol [javac] symbol : class ResultScanner [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] ResultScanner scanner = null; [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:222: cannot find symbol [javac] symbol : class Result [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] for (Result rr = scanner.next(); rr != null; rr = scanner.next()) [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:225: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] String key = Bytes.toString(rr.getRow()); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:237: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] byte[] value = rr.getValue(_columnFamilyBytes,Bytes.toBytes(field)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:238: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] rowResult.put(field,Bytes.toString(value)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:241: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] System.out.println("Result for field: "+field+" is: "+Bytes.toString(value)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:251: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] String value = Bytes.toString(scanMap.get(fieldkey)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:252: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] rowResult.put(Bytes.toString(fieldkey),value); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:255: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] System.out.println("Result for field: "+Bytes.toString(fieldkey)+" is: "+value); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol [javac] symbol : class Put [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Put p = new Put(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol [javac] symbol : class Put [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Put p = new Put(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Put p = new Put(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:324: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] p.add(_columnFamilyBytes,Bytes.toBytes(entry.getKey()),Bytes.toBytes(entry.getValue())); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:324: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] p.add(_columnFamilyBytes,Bytes.toBytes(entry.getKey()),Bytes.toBytes(entry.getValue())); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol [javac] symbol : class Delete [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Delete d = new Delete(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol [javac] symbol : class Delete [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Delete d = new Delete(Bytes.toBytes(key)); [javac] ^ [javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol [javac] symbol : variable Bytes [javac] location: class com.yahoo.ycsb.db.HBaseClient [javac] Delete d = new Delete(Bytes.toBytes(key)); [javac] ^ [javac] 42 errors BUILD FAILED /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:28: The following error occurred while executing this line: /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:51: Compile failed; see the compiler error output for details. Hi , this post is very good, and its helpful for me to check my hbase performance. I am using hbase on single machine in pseudo distributed mode. hadoop-0.20.2 and hbase-0.90.4 . To run ycsb benchmark on my machine, I followed till the last command i.e
ant
it worked well, but, when i executed
ant dbcompile-hbase
i got following errors. It is showing errors in build.xml so, i couldn’t solve it. please help me to overcome these errors and successfully run ycsb benchmark.

hduser@vamshi-laptop:~/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e$ ant dbcompile-hbase
Buildfile: build.xml

compile:

makejar:

BUILD FAILED
/home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:41: The following error occurred while executing this line:
/home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:58: /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build/ycsb.jar is read-only.

Total time: 0 seconds

so i ran the same in with sudo before command.

hduser@vamshi-laptop:~/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e$ sudo ant dbcompile-hbase
Buildfile: build.xml

compile:

makejar:

dbcompile-hbase:

dbcompile:
[javac] Compiling 1 source file to /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build/classes
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:30: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.HTable;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:32: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.Get;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:33: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.Put;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:34: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.Delete;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:35: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.Scan;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:36: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.Result;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:37: package org.apache.hadoop.hbase.client does not exist
[javac] import org.apache.hadoop.hbase.client.ResultScanner;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:40: package org.apache.hadoop.hbase.util does not exist
[javac] import org.apache.hadoop.hbase.util.Bytes;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:41: package org.apache.hadoop.hbase does not exist
[javac] import org.apache.hadoop.hbase.HBaseConfiguration;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:51: cannot find symbol
[javac] symbol : class HTable
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] public HTable _hTable=null;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:80: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] _columnFamilyBytes = Bytes.toBytes(_columnFamily);
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:102: cannot find symbol
[javac] symbol : class HBaseConfiguration
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] HBaseConfiguration config = new HBaseConfiguration();
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:102: cannot find symbol
[javac] symbol : class HBaseConfiguration
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] HBaseConfiguration config = new HBaseConfiguration();
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:103: cannot find symbol
[javac] symbol : class HTable
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] _hTable = new HTable(config, table);
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:138: cannot find symbol
[javac] symbol : class Result
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Result r = null;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol
[javac] symbol : class Get
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Get g = new Get(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol
[javac] symbol : class Get
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Get g = new Get(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:145: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Get g = new Get(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:162: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] byte[] value = r.getValue(_columnFamilyBytes, Bytes.toBytes(field));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:163: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] result.put(field,Bytes.toString(value));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:165: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] System.out.println(“Result for field: “+field+” is: “+Bytes.toString(value));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol
[javac] symbol : class Scan
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Scan s = new Scan(Bytes.toBytes(startkey));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol
[javac] symbol : class Scan
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Scan s = new Scan(Bytes.toBytes(startkey));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:199: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Scan s = new Scan(Bytes.toBytes(startkey));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:213: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] s.addColumn(_columnFamilyBytes,Bytes.toBytes(field));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:218: cannot find symbol
[javac] symbol : class ResultScanner
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] ResultScanner scanner = null;
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:222: cannot find symbol
[javac] symbol : class Result
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] for (Result rr = scanner.next(); rr != null; rr = scanner.next())
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:225: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] String key = Bytes.toString(rr.getRow());
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:237: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] byte[] value = rr.getValue(_columnFamilyBytes,Bytes.toBytes(field));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:238: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] rowResult.put(field,Bytes.toString(value));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:241: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] System.out.println(“Result for field: “+field+” is: “+Bytes.toString(value));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:251: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] String value = Bytes.toString(scanMap.get(fieldkey));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:252: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] rowResult.put(Bytes.toString(fieldkey),value);
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:255: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] System.out.println(“Result for field: “+Bytes.toString(fieldkey)+” is: “+value);
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol
[javac] symbol : class Put
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Put p = new Put(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol
[javac] symbol : class Put
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Put p = new Put(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:317: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Put p = new Put(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:324: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] p.add(_columnFamilyBytes,Bytes.toBytes(entry.getKey()),Bytes.toBytes(entry.getValue()));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:324: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] p.add(_columnFamilyBytes,Bytes.toBytes(entry.getKey()),Bytes.toBytes(entry.getValue()));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol
[javac] symbol : class Delete
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Delete d = new Delete(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol
[javac] symbol : class Delete
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Delete d = new Delete(Bytes.toBytes(key));
[javac] ^
[javac] /home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/db/hbase/src/com/yahoo/ycsb/db/HBaseClient.java:389: cannot find symbol
[javac] symbol : variable Bytes
[javac] location: class com.yahoo.ycsb.db.HBaseClient
[javac] Delete d = new Delete(Bytes.toBytes(key));
[javac] ^
[javac] 42 errors

BUILD FAILED
/home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:28: The following error occurred while executing this line:
/home/hduser/Documents/HBASE_SOFTWARE/brianfrankcooper-YCSB-8d3aa2e/build.xml:51: Compile failed; see the compiler error output for details.

]]> Comment on Performance testing HBase using YCSB by » 使用YCSB执行HBase性能测试 HBase.info -- All things about HBase http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-183 » 使用YCSB执行HBase性能测试 HBase.info -- All things about HBase Wed, 29 Jun 2011 07:27:05 +0000 http://blog.lars-francke.de/?p=62#comment-183 [...] 原文链接：http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/ [...] [...] 原文链接：http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/ [...]

]]> Comment on Processing OpenStreetMap data with Hive by Antonio Rodriges http://blog.lars-francke.de/2010/07/22/processing-openstreetmap-data-with-hive/#comment-181 Antonio Rodriges Thu, 16 Jun 2011 16:15:04 +0000 http://blog.lars-francke.de/?p=7#comment-181 Thank you for your experience. However it would be very interesting to have some examples of processing spatial queries with Hadoop which PostGIS enables. Have you had any experience with spatial queries on Hadoop? Thank you. Thank you for your experience.

However it would be very interesting to have some examples of processing spatial queries with Hadoop which PostGIS enables. Have you had any experience with spatial queries on Hadoop?

Thank you.

]]> Comment on Performance testing HBase using YCSB by Anonymous http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-179 Anonymous Fri, 25 Feb 2011 10:22:25 +0000 http://blog.lars-francke.de/?p=62#comment-179 Hi , thanks for share this , it is very useful. I follow your introduction to do hbase performance test with below command, I can see the output , but there is no data insert into usertable. it look like no data insert into hbase, but why I can still get AverageLatency of update operation. Command: java -cp /home/bill/dev/hadoop/YCSB/build/ycsb.jar:hbase-0.90.0/lib/*:hbase-0.90.0/conf/ com.yahoo.ycsb.Client -t -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -p operationcount=1000000 -s -threads 10 -target 100 > transactions.dat YCSB result: 11/02/25 17:51:07 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/bill/dev/hadoop/YCSB 11/02/25 17:51:07 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=10.50.11.168:2181 sessionTimeout=180000 watcher=hconnection 11/02/25 17:51:07 INFO zookeeper.ClientCnxn: Opening socket connection to server /10.50.11.168:2181 11/02/25 17:51:08 INFO zookeeper.ClientCnxn: Socket connection established to dc0sfperf02-app09/10.50.11.168:2181, initiating session 11/02/25 17:51:08 INFO zookeeper.ClientCnxn: Session establishment complete on server dc0sfperf02-app09/10.50.11.168:2181, sessionid = 0x12e5c32ebda0007, negotiated timeout = 180000 10 sec: 131 operations; 13.1 current ops/sec; [UPDATE AverageLatency(ms)=389.39] [READ AverageLatency(ms)=1090.95] 20 sec: 464 operations; 33.3 current ops/sec; [UPDATE AverageLatency(ms)=0.13] [READ AverageLatency(ms)=633.08] 30 sec: 759 operations; 29.5 current ops/sec; [UPDATE AverageLatency(ms)=0.05] [READ AverageLatency(ms)=632.69] 40 sec: 1062 operations; 30.3 current ops/sec; [UPDATE AverageLatency(ms)=0.07] [READ AverageLatency(ms)=636.93] 50 sec: 1381 operations; 31.9 current ops/sec; [UPDATE AverageLatency(ms)=0.12] [READ AverageLatency(ms)=634.26] 60 sec: 1685 operations; 30.4 current ops/sec; [UPDATE AverageLatency(ms)=0.09] [READ AverageLatency(ms)=642.77] Hi , thanks for share this , it is very useful. I follow your introduction to do hbase performance test with below command, I can see the output , but there is no data insert into usertable. it look like no data insert into hbase, but why I can still get AverageLatency of update operation.

Command:
java -cp /home/bill/dev/hadoop/YCSB/build/ycsb.jar:hbase-0.90.0/lib/*:hbase-0.90.0/conf/ com.yahoo.ycsb.Client -t -db com.yahoo.ycsb.db.HBaseClient -P workloads/workloada -p columnfamily=family -p operationcount=1000000 -s -threads 10 -target 100 > transactions.dat

YCSB result:
11/02/25 17:51:07 INFO zookeeper.ZooKeeper: Client environment:user.dir=/home/bill/dev/hadoop/YCSB
11/02/25 17:51:07 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=10.50.11.168:2181 sessionTimeout=180000 watcher=hconnection
11/02/25 17:51:07 INFO zookeeper.ClientCnxn: Opening socket connection to server /10.50.11.168:2181
11/02/25 17:51:08 INFO zookeeper.ClientCnxn: Socket connection established to dc0sfperf02-app09/10.50.11.168:2181, initiating session
11/02/25 17:51:08 INFO zookeeper.ClientCnxn: Session establishment complete on server dc0sfperf02-app09/10.50.11.168:2181, sessionid = 0x12e5c32ebda0007, negotiated timeout = 180000
10 sec: 131 operations; 13.1 current ops/sec; [UPDATE AverageLatency(ms)=389.39] [READ AverageLatency(ms)=1090.95]
20 sec: 464 operations; 33.3 current ops/sec; [UPDATE AverageLatency(ms)=0.13] [READ AverageLatency(ms)=633.08]
30 sec: 759 operations; 29.5 current ops/sec; [UPDATE AverageLatency(ms)=0.05] [READ AverageLatency(ms)=632.69]
40 sec: 1062 operations; 30.3 current ops/sec; [UPDATE AverageLatency(ms)=0.07] [READ AverageLatency(ms)=636.93]
50 sec: 1381 operations; 31.9 current ops/sec; [UPDATE AverageLatency(ms)=0.12] [READ AverageLatency(ms)=634.26]
60 sec: 1685 operations; 30.4 current ops/sec; [UPDATE AverageLatency(ms)=0.09] [READ AverageLatency(ms)=642.77]

]]> Comment on Setting up a Hadoop cluster – Part 1: Manual Installation by Lars Francke http://blog.lars-francke.de/2011/01/26/setting-up-a-hadoop-cluster-part-1-manual-installation/#comment-171 Lars Francke Fri, 28 Jan 2011 11:36:52 +0000 http://blog.lars-francke.de/?p=85#comment-171 Hi Assaf, thank you for your comment. About LVM: I didn't do any benchmarking and I have to admit that my knowledge here is limited (coming from a purely development background) but I kept to references I found about this on various blogs (and the book I believe). See for example here: http://www.cloudera.com/blog/2009/12/7-tips-for-improving-mapreduce-performance/ Re OS: I've deployed a small cluster on Ubuntu before (that was an earlier CDH version though) and I didn't encounter any problems I can remember. Unfortunately I didn't take good notes (unlike this time) so I'm afraid I can't be any help here either. The infrastructure at GBIF where I set this latest cluster up was already Fedora/CentOS so it made sense to keep it the same. If you encounter any specific problems on Ubuntu let me know and I'll try to help where I can. Cheers, Lars Hi Assaf,

thank you for your comment.

About LVM: I didn’t do any benchmarking and I have to admit that my knowledge here is limited (coming from a purely development background) but I kept to references I found about this on various blogs (and the book I believe). See for example here: http://www.cloudera.com/blog/2009/12/7-tips-for-improving-mapreduce-performance/

Re OS: I’ve deployed a small cluster on Ubuntu before (that was an earlier CDH version though) and I didn’t encounter any problems I can remember. Unfortunately I didn’t take good notes (unlike this time) so I’m afraid I can’t be any help here either. The infrastructure at GBIF where I set this latest cluster up was already Fedora/CentOS so it made sense to keep it the same.

If you encounter any specific problems on Ubuntu let me know and I’ll try to help where I can.

Cheers,
Lars

]]> Comment on Setting up a Hadoop cluster – Part 1: Manual Installation by Assaf Yardeni http://blog.lars-francke.de/2011/01/26/setting-up-a-hadoop-cluster-part-1-manual-installation/#comment-170 Assaf Yardeni Thu, 27 Jan 2011 07:37:44 +0000 http://blog.lars-francke.de/?p=85#comment-170 Lars, Great post. One of the best I have encountered. Why not use LVM on the data nodes? I should maybe think about why should I use LVM... Re OS are you familiar with cluster deployed on top of Ubuntu? Do you have any pros & cons you can list. Thanks, Assaf Lars,
Great post. One of the best I have encountered. Why not use LVM on the data nodes? I should maybe think about why should I use LVM…
Re OS are you familiar with cluster deployed on top of Ubuntu? Do you have any pros & cons you can list.

Thanks,
Assaf

]]> Comment on Performance testing HBase using YCSB by Lars Francke http://blog.lars-francke.de/2010/08/16/performance-testing-hbase-using-ycsb/#comment-34 Lars Francke Wed, 03 Nov 2010 13:58:24 +0000 http://blog.lars-francke.de/?p=62#comment-34 To reply to myself: Copy your <code>hbase-site.xml</code> with all the configuration options to the <code>db/hbase/conf</code> directory and add it to your classpath like this: <code>java -cp "build/ycsb.jar:db/hbase/lib/*:db/hbase/conf/" ...</code> To reply to myself:

Copy your hbase-site.xml with all the configuration options to the db/hbase/conf directory and add it to your classpath like this: java -cp "build/ycsb.jar:db/hbase/lib/*:db/hbase/conf/" ...

]]>