Nexmark simulates an online auction setting and was originally designed as an benchmark for the Niagara streaming system (see http://datalab.cs.pdx.edu/niagara/NEXMark/).
In this scenario there are three streams Person, Auction and Bid and stored information (Category). At every time, new users can register themself in the system and create new auctions. Each user can also generate bids for auction. The Schema can be found in the picture above.
As default: Each time a client connects new (to one of the four streams) a new simulation is started (with reproducable data). To get consisten data, connections to the other three streams, will use the same simulation. So e.g., if you connect to a person stream and have no other connections to the server, the simulation start from the beginning. If you connect to another stream, e.g., bid, and you are still connected to the person stream, the bid stream fits to the person stream. If you connect to the bid stream after you disconnected from the person stream, a new simulation will be started. This behavior can be changed with an start up optoin.
We adapted this scenario for Odysseus and allow to configure the scenario.
We recommend using the docker version. Here all depedencies are already provided inside the docker-image
You could download nexmark from dockerhub (for windows and macos you could use the Docker Desktop):
docker pull odysseusol/nexmark docker run -d -p 65440-65443:65440-65443 odysseusol/nexmark #if you want to configure nexmark (Remark: Change YOURLOCALFOLDER to you folder e.g. "c:/volume/nexmark", that contains NEXMarkGeneratorConfiguration.properties, absolute paths are necessary here) docker run -d -v "YOURLOCALFOLDER:/var/lib/nexmark" -p 65440-65443:65440-65443 odysseusol/nexmark #if you want to run nexmark even after restarts and configure nexmark (Remark: Change YOURLOCALFOLDER with you folder e.g. "c:/volume/nexmark") docker run -d --restart unless-stopped -v "YOURLOCALFOLDER:/var/lib/nexmark" -p 65440-65443:65440-65443 odysseusol/nexmark
Remark: If you want to configure in docker environments you could use the example files from: https://odysseus.informatik.uni-oldenburg.de/download/nexmark/config/. Only the file named NEXMarkGeneratorConfiguration.properties will be used. So change the name or adapt the file if you want to use the SLOW version.
You will see that the benchmark opens 4 servers on ports 65440 - 65443 where you can connect to.
Now Odysseus can use the nexmark sources. Each time an Odysseus query connects to one of the servers a new scenario is started, i.e. the same users and the same auctions are generated, so the same queries will always create the same results.The created events are consistent, e.g. there will be no bid for an auction that has not been created.
Go to http://odysseus.informatik.uni-oldenburg.de/download/nexmark/ and download a version that fits to your operatoring system (e.g. nexmark.win32.win32.x86_64.zip for a 64bit Windows).
Nexmark needs at least Java 11.
Unzip the archive and start the "nexmark.exe" within the nexmark folder. This should look like in the following:
Remark: Especially, if there are multiple JDK installed, you could get an error like "No exit data available" and Nexmark does not start. This is typically because the wrong JDK is bound. In this case you could open the nexmark.ini File and add two lines bevore -vmargs (Change path to your jvm.dll location for Java 11)
-vm C:/Program Files/Java/jdk-11.0.8/bin/server/jvm.dll
Nexmark has some standard configuration that will be used in our examples.The configuration can be changed in
The following parameters can be adapted:
pr:This is the starting port of the first server (Auction). The next servers (PERSON, BID, CATEGORY) will get the next 3 ports.
gcf:This parameter references a file that describes the behaviour of the nexmark server, e.g. how long is the delay between different elements in the stream. We deliver two standard configurations that can be found in the plugin
/config/NEXMarkGeneratorConfiguration_SLOW.properties: Here elements are delivered with a rather slow rate. This should be used when creating queries.
/config/NEXMarkGeneratorConfiguration.properties: Here elements are created with a higher rate. This can be used to test, if the application scales.
useGlobalGenerator: If this flag is set Nexmark will start the simulation with the first access from any client and resumes the simulation until the program is stopped explicity.
When using docker, you will need to bind a volume with -v (see example above)
In the following code block is an example of a nexmark configuration (/config/NEXMarkGeneratorConfiguration_SLOW.properties). All time elements are in milliseconds.
The following elements can be used:
<?xml version="1.0" encoding="ISO-8859-1"?> <!DOCTYPE properties SYSTEM "http://java.sun.com/dtd/properties.dtd"> <properties> <!-- Konfiguration des NEXMarkGenerators --> <!-- Zeitangaben in MS --> <entry key="minDistBetweenPersons">5000</entry> <entry key="maxDistBetweenPersons">5000</entry> <entry key="minDistBetweenAuctions">2000</entry> <entry key="maxDistBetweenAuctions">2000</entry> <entry key="minDistBetweenBids">500</entry> <entry key="maxDistBetweenBids">500</entry> <!-- Faktor um den die Zeit beschleunigt werden soll. --> <entry key="accelerationFactor">1</entry> <!-- wie lange Auktionen offen bleiben sollen --> <entry key="minAuctionDuration">600000</entry> <entry key="maxAuctionDuration">600000</entry> <!-- Zeit zwischen zwei Bursts (MIN und MAX) in ms --> <!-- Ein Wert von 0 bei beiden simuliert ohne Bursts. --> <!-- Diese Zeit wird nicht vom "accelerationFactor" beeinflusst --> <entry key="minTimeBetweenBursts">0</entry> <entry key="maxTimeBetweenBursts">0</entry> <!-- Dauer eines Bursts --> <!-- Ein Wert von 0 bei beiden simuliert ohne Bursts. --> <!-- Diese Zeit wird nicht vom "accelerationFactor" beeinflusst --> <entry key="minBurstDuration">0</entry> <entry key="maxBurstDuration">0</entry> <!-- Beschleunigungsfaktor waehrend eines Bursts --> <entry key="burstAccelerationFactor">0</entry> </properties>