Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update instructions for running on LLNL system in docs #540

Closed
wants to merge 1 commit into from
Closed
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 9 additions & 7 deletions docs/llnl-tutorial.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,14 +28,14 @@ CTS (Ruby, Dane, Magma)
This example uses the openmp version of the Saxpy benchmark on one of our CTS systems (Ruby, Dane, Magma).
The variant ``cluster`` determines which of the three systems to initialize.

First, initialize the desired cluster variant of the LLNL cts ruby (or dane, magma) system using the existing
First, initialize the desired cluster variant of the LLNL ruby (or dane, magma) system using the existing
system specification in Benchpark::

benchpark system init --dest=ruby-system cts cluster=ruby
benchpark system init --dest=ruby-system llnl-cluster cluster=ruby

To run the openmp, strong scaling version of the AMG20223 benchmark, initialize it for experiments::

benchpark experiment init --dest=amg2023-benchmark amg2023 +openmp
benchpark experiment init --dest=amg2023-benchmark amg2023+openmp

Then setup the workspace directory for the system and experiment together::

Expand All @@ -48,7 +48,8 @@ Run the setup script for dependency software, Ramble and Spack::

Then setup the Ramble experiment workspace, this builds all software and may take some time::

cd ./workspace/amg2023-benchmark/Cts-6d48f81/workspace/
system_id=$(benchpark system id ./ruby-system)
cd ./workspace/amg2023-benchmark/${system_id}/workspace/
ramble --workspace-dir . --disable-progress-bar workspace setup

Next, we run the AMG2023 experiments, which will launch jobs through the
Expand All @@ -65,10 +66,11 @@ version of the Saxpy benchmark on Tioga.
The parameters for initializing the system are slightly different due to the
different variants defined for the system. For example, the variant ``~gtl`` turns off gtl-enabled MPI, ``+gtl`` turns it on::

benchpark system init --dest=tioga-system tioga ~gtl
benchpark experiment init --dest=saxpy-benchmark saxpy +rocm
benchpark system init --dest=tioga-system llnl-elcapitan ~gtl
benchpark experiment init --dest=saxpy-benchmark saxpy+rocm
benchpark setup ./saxpy-benchmark ./tioga-system workspace/
. workspace/setup.sh
cd ./workspace/saxpy-benchmark/Tioga-975af3c/workspace/
system_id=$(./bin/benchpark system id ./tioga-system)
cd ./workspace/saxpy-benchmark/${system_id}/workspace/
ramble --workspace-dir . --disable-progress-bar workspace setup
ramble --workspace-dir . --disable-progress-bar on