Benchmarks do not run with Java 11 or higher

[kumarshantanu]

Running the benchmarks on Java 11 and Java 17 results in the following error:

$ ./bin/run-all.plk
(*) Building aleph-server
Execution error (ExceptionInfo) at (<cljs repl>:1).
FAILED: lein do clean, uberjar

• OS: Ubuntu 20.04 (x64)
• Java 11: Leiningen 2.9.5 on Java 11.0.10 OpenJDK 64-Bit Server VM
• Java 17: Leiningen 2.9.5 on Java 17 OpenJDK 64-Bit Server VM

[BrunoBonacci]

Hi,

you probably need to update the versions of the various servers, however if you still want to run with the old http server versions and the newer JDK you need to provide a java.xml.bind implementation.
For example adding [jakarta.xml.bind/jakarta.xml.bind-api "2.3.2"] in the project.clj dependencies should be enough to successfully compile.

see this article for more information:
https://stackoverflow.com/questions/43574426/how-to-resolve-java-lang-noclassdeffounderror-javax-xml-bind-jaxbexception

[kumarshantanu]

I was able to

1. Pass the uberjar step in Java 8 and 11

Aleph

by using the following dependencies (which also work for Java 8)

[aleph "0.4.6"] ; 0.4.4 emits illegal-access warnings, but works nevertheless
[javax.xml.bind/jaxb-api "2.3.0"]
[org.eclipse.persistence/eclipselink "2.7.0"]

HTTP-Kit

by using the following dependencies (which also work for Java 8)

[http-kit "2.5.3"]

2. Running the benchmarks

Though the benchmarks run fine with Java 8, I get the following error with Java 11:

$ ./bin/run-all.plk
(*) Building aleph-server
(*) Building aleph-server OK!
(*) Building httpkit-server
(*) Building httpkit-server OK!
(*) Building jetty-server
(*) Building jetty-server OK!
(*)
(*) ============================================================
(*)
(*) STARTING BENCHMARKS 2021-10-28_17-15-41
(*)
(*) ============================================================
(*)
(*) Writing hardware info
(*) ------------------------------------------------------------
(*) Running test: :simple-get on aleph-server , please wait.
(*) ------------------------------------------------------------
(*) Starting server: aleph-server
Execution error (ExceptionInfo) at (<cljs repl>:1).
server didn't start

I verified that the Aleph server starts up at port 3000 that I can curl localhost:3000/ to. Not sure if there's any issue with the Planck script.

[BrunoBonacci]

Hi,

I was going to suggest to try upgrading all the servers you want to test.
I haven't touched this project in years and there are some differences in how JDK, OS, Shell, Planck interact with each other.

I would suggest running this using bash (as that was the default shell at the time I wrote this).

Once the projects are built, the script will try to start the server and it will wait until the service becomes available.

you can see here, it check whether the process is running, maybe this test fails, check how to perform this check on your system.

https://github.com/brunobonacci/clojure-http-servers-benchmark/blob/master/bin/run-all.plk#L128-L132

once it can verify that the process running it will wait until the service is started and it can perform HTTP GET requests to the specified port.

if everything works it will trigger the load testing tool called wrk (https://github.com/giltene/wrk2) so make sure that it is installed and working.

The load test will be performed in two steps, first it will warmup the server under test so that the JIT compiler does its job, then start the actual load test and capturing the data

Finally when all the tests are completed it will plot the charts using https://github.com/BrunoBonacci/hdr-plot
so, make sure it is installed as well.

[BrunoBonacci]

Another thing to note is that the Java options to run the server changed quite dramatically.

here are the default options which were based on Java8

https://github.com/brunobonacci/clojure-http-servers-benchmark/blob/master/bin/run-all.plk#L373-L380

you should probably review them for the newer versions.