Simple Jmeter Guide in Spark Testing

1. Special Tips

1.1 SQL format

Though the Spark SQL requests share the same sampler format(JDBC Request) with queries against SQL Database, there is still a little difference: The Spark SQL requests should not be put the semicolon(;) at the end. You need to remove it or the query won't work. As for the query type in the configuration of JDBC Request, select statement can meet many kinds of JDBC requests even include the create and set.

1.2 Auto Commit Setting

 In the JDBC Connection Configuration, set “Auto Commit” to True, or the Spark SQL won't support it.

Here is a reference for how to solving this issue https://github.com/prasanthj/jmeter-hiveserver2

1.3 Hidden Part of GUI

 Dragging the right border of GUI and you will see the hidden part. It shows the duration of test, the console window button(Click it to display/hide console) and currently running threads(users)/total threads(users).

1.4 WorkBench

 In the test plan sometimes you want just execute part of the thread groups. Then you can cut the part you don't want to be executed and then paste it in the workbench. However, remember recovering it before exit Jmeter or you will lose it.

1.5 Clear History

 If you execute several times of the test plan, you will find history record would not be excluded. To 

clear the history. Click the button in the buttons bar to clear it. One is for part remove and the another is for global clearing.

1.6 Heap Dump

 If the running of test plan stuck and costs several hours(if you don't set the running duration), see the logs or the command line of jmeter: there might be a heap dump which means that you set so many threads that your machine can not handle it. In that time, even the result shows at end. Sometimes the final result just refelect your machine performance, not your server clusters'.

2. Download and Configuration

2.1 The Jmeter

2.2 Related Jar

3. Test Plan

3.1 Basic Components

3.2 Process

4. Running and Monitoring

4.1 Tips

5. Result Analysis

5.1 Overall Result

5.2 Each Sampler(Request) Result__