Skip to content

Latest commit

 

History

History
155 lines (144 loc) · 6.92 KB

README.md

File metadata and controls

155 lines (144 loc) · 6.92 KB

1. Load Testing - Spring Boot, MySQL, MongoDB, Prometheus, Grafana, Actuator, JMeter

Cassandra, PostgeSQL - To do

2. Tests summary

a. DB write/insertion summary:

S/N Database Total DB records API endpoint Total process time
1 MongoDB 10,000,000 /api/mysql/concurrentInsertEmployees 4 mins and 14.28s
2 MySQL 10,000,000 /api/mongodb/concurrentInsertEmployees 3 mins and 15.48s
3 Cassandra To do To do To do
4 PostgeSQL To do To do To do

b. Load test - DB read/retrieval summary:

Database Total DB records set DB max_connections(Y/N) API endpoint Requests per min Average API response Total Average
API response		 No. of errors
MongoDB 10,000,000 N/A /api/mongodb/{id} 2,000 14.9s 25.1s 0
N/A /api/mongodb/name/{firstName} 2,000 35.2s - 0
MySQL 10,000,000 N /api/mysql/{id} 2,000 88.2s 181.5s 56
N /api/mysql/name/{firstName} 1,944 277.4s - 306
MySQL(fine tuned) 10,000,000 Y - max_connections=1000 /api/mysql/{id} 2,000 56.2s 111s 0
Y - max_connections=1000 /api/mysql/name/{firstName} 2,000 165.9s - 0
Cassandra To do
PostgeSQL To do

c. Load testing reports

i. MongoDB read/retrieval screenshot

My Image

ii. MySQL read/retrieval screenshot - default max_connections setup

My Image

iii. MySQL read/retrieval screenshot - Set max_connections=1000

My Image

3. Prerequisite on running this project:

  • Install Java 19.
  • Install Docker Desktop.
  • JMeter - for testing.
  • SQL client.

4. Tech stacks and service in employee-service project.

  • MySQL
  • MongoDB
  • PostgreSQL - to do
  • Cassandra - to do
  • employee-service - service to test
  • Prometheus
  • Grafana

5. MySQL/MongoDB/mongo-express credentials

  • Located in /.env

6. Steps in running employee-service project.

  • Checkout the project in Github.
  • Go the project directory.
cd /<path>/employee-service
  • Install employee-service.
mvn clean install
  • Build all services of employee-service project.
docker-compose build --no-cache
  • Start all services of employee-service.
docker-compose up
  • View all Docker running containers.
docker ps -a
  • Tail employee service logs.
docker logs <CONTAINER ID of employee-app> --follow

7. Load testing MongoDB

a. Initialize records of MongoDB

  • mongo-express console URL and login using admin/admin credentials.
http://localhost:8081/db/local_mongo_db/

My Image

  • Import postman collections from employee-service/_external_files/Mongo-MySQL performance.postman_collection.json.
  • Execute POST Mongo 10M employee records insert. My Image
  • Verify the records inserted via mongo-express console. My Image

b. Perform MongoDB loadtest

  • Copy the JMeter script to JMeter bin directory.
JMeter script --> employee-service/_external_files/employee-mongo.jmx
JMeter bin --> <JMeter path>/bin
Copy <JMeter script> to <JMeter bin>
  • Execute the below commands in JMeter bin directory:
mkdir employee-mongo-report
./jmeter.sh -n -t employee-mongo.jmx -l employee-mongo-report/mongo-loadtest.jtl -e -o employee-mongo-report/
  • View MongoDB loadtest report in: Refer in section 2-c-i
<JMeter path>/bin/employee-mongo-report/index.html

8. Load testing MySQL

a. Initialize records of MySQL

  • Import postman collections from employee-service/_external_files/Mongo-MySQL performance.postman_collection.json.
  • Execute POST MySQL 10M employee records insert. My Image
  • Verify the records inserted via mongo-express console. My Image

b. Perform MySQL loadtest with default max_connections

  • Copy the JMeter script to JMeter bin directory.
JMeter script --> employee-service/_external_files/employee-mysql.jmx
JMeter bin --> <JMeter path>/bin
Copy <JMeter script> to <JMeter bin>
  • Execute the below commands in JMeter bin directory:
mkdir employee-mysql-report
./jmeter.sh -n -t employee-mysql.jmx -l employee-mysql-report/mysql-loadtest.jtl -e -o employee-mysql-report/
  • View MySQL loadtest report in: Refer in section 2-c-ii
<JMeter path>/bin/employee-mysql-report/index.html

c. Perform MySQL loadtest with max_connections=1000. Fine tuned.

  • Set MySQL max_connections=1000 My Image
  • Execute the below commands in JMeter bin directory:
mkdir employee-mysql-report-max-conn
./jmeter.sh -n -t employee-mysql.jmx -l employee-mysql-report-max-conn/mysql-loadtest.jtl -e -o employee-mysql-report-max-conn/
  • View MySQL loadtest report in: Refer in section 2-c-iii
<JMeter path>/bin/employee-mysql-report-max-conn/index.html

9. Display the metrics of the load test. Not the main scope of this project. I will not go deeper on this.

  • Prometheus URL
http://localhost:9090

My Image

  • Grafana URL
http://localhost:3001
Dashboard -> New -> New Dashboard -> Import DashBoard

My Image