GroqView profiler and visualizer tool¶
This section covers how to remotely use the GroqView profiler and visualizer tool.
GroqView sample¶
Groq compiles produce an accurate and detailed model of the performance of a model's execution on GroqCard accelerators. There is no need to run a model on GroqCards to use GroqView.
The GroqView example adds the groqview=True parameter to the groqit call, then calls the groqview() method on the model returned by groqit.
This is the relevant code when using GroqFlow. It tries to retrieve the compiled model from the cache, compiles the model on a cache miss, then calls groqview().
From groqflow/examples/pytorch/groqview.py:
# Build model
gmodel = groqit(pytorch_model, inputs, groqview=True)
# Open GroqView
gmodel.groqview()
Run the sample¶
On a GroqRack node, run the groqview.py sample (or any script that includes similar code). Note the port number chosen by GroqView.
You will see something like the following. The port number may be different.
Forward the port to your machine with a browser¶
On your laptop/user machine with a display, set up a 2-hop ssh tunnel.
Set $GN_HOSTNAME to the name of the host where the job is running, and replace <username> with your ALCF username. Modify the port number if GroqView has chosen a different port, which might happen if another user is also using GroqView. Another user may also be using the port on the login host. groq-login-04.ai.alcf.anl.gov can be used as well.
export GN_HOSTNAME=groq-r01-gn-09
ssh -L 8439:localhost:8439 <username>@groq-login-03.ai.alcf.anl.gov -t ssh -L 8439:localhost:8439 -N $GN_HOSTNAME
When complete, Ctrl+C or equivalent in the console where the ssh tunnel was started will terminate both parts of an ssh tunnel set up this way.
Access the GroqView server for your application¶
Point a Google Chrome-family web browser at this URL, adjusting the port number if necessary. (Chrome, Brave, Vivaldi, Opera tested.)