benchmark_report.md

Fuzzer Benchmark Results

Generated on: 2024-11-23 09:19:32

Summary

Total models tested: 8

Best performing model: qwen2.5-coder:14b with 3 unique links

Model: mistral:latest

Total unique links discovered: 9

Links discovered across all runs:

Link	Found in # of runs
dashboard.jsp	5/10
userLogin.jsp	10/10
logout.jsp	10/10
forgotPassword.jsp	10/10
index.jsp	10/10
checkout.jsp	6/10
cart.jsp	6/10
api/v2/products	1/10
adminLogin.jsp	1/10

Model: llama3.1:latest

Total unique links discovered: 12

Links discovered across all runs:

Link	Found in # of runs
dashboard.jsp	10/10
adminLogin.jsp	10/10
userLogin.jsp	10/10
logout.jsp	10/10
userRegister.jsp	6/10
api/v2/users	7/10
forgotPassword.jsp	10/10
index.jsp	10/10
checkout.jsp	1/10
api/v2/products	2/10
cart.jsp	1/10
contact.jsp	1/10

Model: llama3.2:latest

Total unique links discovered: 11

Links discovered across all runs:

Link	Found in # of runs
dashboard.jsp	10/10
adminLogin.jsp	5/10
userLogin.jsp	10/10
logout.jsp	10/10
userRegister.jsp	5/10
cart.jsp	9/10
checkout.jsp	8/10
api/v2/products	9/10
api/v2/users	9/10
forgotPassword.jsp	10/10
index.jsp	10/10

Model: qwen2.5:latest

Total unique links discovered: 10

Links discovered across all runs:

Link	Found in # of runs
adminLogin.jsp	9/10
userLogin.jsp	10/10
logout.jsp	10/10
userRegister.jsp	10/10
api/v2/users	10/10
forgotPassword.jsp	10/10
index.jsp	10/10
about.jsp	2/10
dashboard.jsp	9/10
contact.jsp	5/10

Model: qwen2.5-coder:latest

Total unique links discovered: 12

Links discovered across all runs:

Link	Found in # of runs
about.jsp	10/10
dashboard.jsp	10/10
userLogin.jsp	10/10
logout.jsp	10/10
userRegister.jsp	8/10
checkout.jsp	10/10
api/v2/products	8/10
api/v2/users	8/10
cart.jsp	9/10
forgotPassword.jsp	10/10
contact.jsp	10/10
index.jsp	10/10

Model: qwen2.5-coder:14b

Total unique links discovered: 13

Links discovered across all runs:

Link	Found in # of runs
about.jsp	10/10
dashboard.jsp	10/10
adminLogin.jsp	9/10
userLogin.jsp	10/10
logout.jsp	9/10
userRegister.jsp	10/10
checkout.jsp	10/10
cart.jsp	10/10
forgotPassword.jsp	10/10
index.jsp	10/10
contact.jsp	10/10
api/v2/products	3/10
api/v2/users	3/10

Model: gemma:latest

Total unique links discovered: 9

Links discovered across all runs:

Link	Found in # of runs
about.jsp	10/10
dashboard.jsp	10/10
userLogin.jsp	10/10
logout.jsp	5/10
checkout.jsp	10/10
cart.jsp	10/10
forgotPassword.jsp	6/10
index.jsp	10/10
contact.jsp	10/10

Model: phi3:latest

Total unique links discovered: 2

Links discovered across all runs:

Link	Found in # of runs
userLogin.jsp	10/10
index.jsp	10/10