Customizing Environments¶

Using virtual Python environments¶

To make a PyTorch virtual environment for Cerebras¶

Clone the Cerebras modelzoo, if it is not already cloned. Check out the R 2.6.0 release.

mkdir ~/R_2.6.0
cd ~/R_2.6.0
export HTTPS_PROXY=http://proxy.alcf.anl.gov:3128
git clone https://github.com/Cerebras/modelzoo.git
cd modelzoo
git tag
git checkout Release_2.6.0

Note: a git pull will not update the tags; if modelzoo/setup.py does not exist after tag checkout, please re-clone modelzoo.

Note: to access any external resources from a Cerebras user node, you will need to have a proxy environment variable set (or equivalent). wget needs the lower-case proxy environment variable.

export HTTPS_PROXY=http://proxy.alcf.anl.gov:3128
export https_proxy=http://proxy.alcf.anl.gov:3128

Then build the virtual environment

mkdir ~/R_2.6.0
cd ~/R_2.6.0
# Note: "deactivate" does not actually work in scripts.
deactivate
rm -r venv_cerebras_pt
/usr/bin/python3.11 -m venv venv_cerebras_pt
source venv_cerebras_pt/bin/activate
pip install --upgrade pip
pip install -e modelzoo

Activation and deactivation¶

To activate a virtual environment

source ~/R_2.6.0/venv_cerebras_pt/bin/activate

To deactivate a virtual environment,

deactivate