Skip to content

Latest commit

 

History

History
141 lines (89 loc) · 2.79 KB

README.md

File metadata and controls

141 lines (89 loc) · 2.79 KB

MAGiQ(CombBLAS)

Combinatorial BLAS(version 1.6.1, Jan 2018)

Prerequisites

  • MPI (see first a few lines in CMakeLists.txt)

  • cmake >= 3.0

  • C++11/C++14

Compile && Run

Compile

  1. normal compilation

    mkdir -p build
cd ../build && cmake .. && make -j

  2. use COMBBLAS_DEBUG mode to enable combblas debug information output:

    mkdir -p build
cd ../build && cmake -D COMBBLAS_DEBUG=ON .. && make -j

  3. use MAGIQ_DEBUG mode to enable magiq debug information output:

    mkdir -p build
cd ../build && cmake -D MAGIQ_DEBUG=ON .. && make -j

  4. build on Shaheen

    first load proper modules:

    module swap PrgEnv-cray/6.0.4 PrgEnv-gnu
module load cray-mpich

    change the first two line of CMakeLists.txt, make following changes :

    -SET(CMAKE_CXX_COMPILER mpic++)
-SET(CMAKE_C_COMPILER mpicc)
+SET(CMAKE_CXX_COMPILER CC)
+SET(CMAKE_C_COMPILER cc)

    then do as above three sections suggested, by setting compiler to CC/cc you can only run the executable file with srun.

Run

  1. run(in $MAGiQ_ROOT/build) hard coded program:

    mpirun -np 16 ./magiq_src/magiqScal ../data/paracoder_lubm1B.nt

  2. run(in $MAGiQ_ROOT/build) sparql parser program:

    mpirun -np 16 ./magiq_src/magiqParse ../data/paracoder_lubm1B.nt ../examples/queries/lubm/q7.txt 1

  3. run on Shaheen

    example job script on Shaheen:

    #!/bin/bash
#SBATCH --account=k1210
#SBATCH --job-name=test
#SBATCH --output=otest
#SBATCH --error=etest
#SBATCH --nodes=1
#SBATCH --time=10:00
#SBATCH --hint=nomultithread
#SBATCH --ntasks-per-node=1
#SBATCH --ntasks=1
#SBATCH --exclusive

module swap PrgEnv-cray/6.0.4 PrgEnv-gnu
module load cray-mpich

cd /project/k1285/CombBLAS/
srun ./build/magiq_src/magiqParse ./examples/data/poster.nt ./examples/queries/poster/query.txt

Project Structure

docs

some documents about this project

example

example graph data and query files

external

all dependencies

include

CombBLAS header files

magiq_include

contains header file for magiq(CombBLAS) implementation

magiq_src

contains src file for magiq(CombBLAS) implementation

  • magiqScal.cpp

    hard coded program for lubm queries

  • magiqParse.cc

    automatic query translation and execution

src

CombBLAS source files

build

not shown on github, all things are compiled here

Proceeding && Link

EuroSys'19: Matrix Algebra Framework for Portable, Scalable and Efficient Query Engines for RDF Graphs

Sparsql Parser Repository: GitHub