Skip to content

Commit

Permalink
Update env scripts for MatMul Algo settings
Browse files Browse the repository at this point in the history
- Remove the assignement of MatMul algo from environment scripts.
- Add comment for recommended values.

Change-Id: Ib51dd28c75b00a6368364cd2947d04acf7ca71b3
Signed-off-by: Rahul Jauhari <[email protected]>
Reviewed-on: http://gerrit-git.amd.com/c/amd/ec/ZenDNN_ONNXRuntime/+/1138979
Reviewed-by: Chandra Kumar Ramasamy <[email protected]>
Tested-by: Pratap Gadi <[email protected]>
(cherry picked from commit a9523c0)
Reviewed-on: http://gerrit-git.amd.com/c/amd/ec/ZenDNN_ONNXRuntime/+/1139041
Reviewed-by: Kiriti Pendyala <[email protected]>
Tested-by: Kiriti Pendyala <[email protected]>
  • Loading branch information
Rahul Jauhari authored and Rahul Jauhari committed Oct 18, 2024
1 parent 87caab2 commit ac831a6
Showing 1 changed file with 6 additions and 6 deletions.
12 changes: 6 additions & 6 deletions scripts/zendnn_ONNXRT_env_setup.sh
Original file line number Diff line number Diff line change
Expand Up @@ -188,9 +188,12 @@ echo "ZENDNN_INT8_SUPPORT=$ZENDNN_INT8_SUPPORT"
export ZENDNN_RELU_UPPERBOUND=0
echo "ZENDNN_RELU_UPPERBOUND=$ZENDNN_RELU_UPPERBOUND"

# ZENDNN_MATMUL_ALGO is set to FP32:3 and BF16:0 by default
export ZENDNN_MATMUL_ALGO=FP32:3,BF16:0
echo "ZENDNN_MATMUL_ALGO=$ZENDNN_MATMUL_ALGO"
# Matmul Algorithms Settings. By default, it is ZENDNN_MATMUL_ALGO=FP32:4,BF16:3.
# We recommend to override the default settings for NLPs & LLMs models by
# uncommenting the following 'export' and 'echo' commands. Note: Do not
# uncomment for AMP (Auto-Mixed Precision) mode runs of any models.
# export ZENDNN_MATMUL_ALGO=FP32:3,BF16:0
# echo "ZENDNN_MATMUL_ALGO=$ZENDNN_MATMUL_ALGO"

#Use local copy of ZenDNN library source code when building ONNXRT
#Default is build from local source for development and verification.
Expand Down Expand Up @@ -296,9 +299,6 @@ echo "ZENDNN_QUANTIZE_CONV_ADD_FUSION_ENABLE: $ZENDNN_QUANTIZE_CONV_ADD_FUSION_E
export ZENDNN_QCONV_CLIP_FUSION_ENABLE=0
echo "ZENDNN_QCONV_CLIP_FUSION_ENABLE: $ZENDNN_QCONV_CLIP_FUSION_ENABLE"

export ZENDNN_WEIGHT_CACHING=1
echo "ZENDNN_WEIGHT_CACHING: $ZENDNN_WEIGHT_CACHING"

# By default build Open sourced ONNXRuntime and ZenDNN
export ZENDNN_ONNXRUNTIME_USE_OPENSOURCE=1
echo "ZENDNN_ONNXRUNTIME_USE_OPENSOURCE: $ZENDNN_ONNXRUNTIME_USE_OPENSOURCE"
Expand Down

0 comments on commit ac831a6

Please sign in to comment.