scripts/01-rocm-env-for-triton.sh

# Required for Strix Halo / RDNA3.5 on vLLM
export TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL=1
export FLASH_ATTENTION_TRITON_AMD_ENABLE="TRUE"
export VLLM_TARGET_DEVICE=rocm
export VLLM_USE_MMAP=0
export VLLM_ROCM_USE_AITER=0
export VLLM_ROCM_USE_AITER_MOE=0
export VLLM_USE_TRITON_AWQ=1
Updating toolbox and pushing GitHub Action 2025-11-30 14:57:37 +00:00			`# Required for Strix Halo / RDNA3.5 on vLLM`
			`export TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL=1`
Installing flash_attn, as this is now neded by vLLM 2025-11-30 17:49:29 +00:00			`export FLASH_ATTENTION_TRITON_AMD_ENABLE="TRUE"`
updated envs for better strix halo support on vllm 2025-12-19 08:30:02 +00:00			`export VLLM_TARGET_DEVICE=rocm`
			`export VLLM_USE_MMAP=0`
			`export VLLM_ROCM_USE_AITER=0`
			`export VLLM_ROCM_USE_AITER_MOE=0`
			`export VLLM_USE_TRITON_AWQ=1`