Democratizing AI Accelerators for HPC Applications:
Challenges, Success, and Support


Wednesday, 20 November 2024
5:15pm - 6:45pm EST
Location: B211
Atlanta, Georgia, USA.

held in conjunction with SC24: The International Conference for High Performance Computing, Networking, Storage and Analysis

Welcome

A recent surge in novel AI accelerator hardware (e.g. from Cerebras, Groq, SambaNova, Graphcore, Intel, and Tenstorrent) has sparked intense interest in running HPC applications and driven algorithmic research on these architectures. However, the maturity levels of associated tooling and software stacks vary significantly, with gaps in documentation and support. This BoF aims to explore trends in AI accelerators for HPC, ideal programming models, software stack support, code portability, training resources, and common challenges. We hope to foster a community of users interested or experienced in using AI accelerators for HPC applications.

Link to SC24 BoF Page

Agenda

Time Topic
5.15-5.20 PM Welcome
Murali Emani, ANL
5.20-6.00 PM Flash Talks (4 minutes each)
Developing Custom Applications at Wafer-Scale
Leighton Wilson, Cerebras Systems
Accelerating Scientific Applications with SambaNova Reconfigurable Architecture [Slides]
Vijay Tatkar , SambaNova Systems
HPC with the Groq MLIR Compiler
Sanjif Shanmugavelu, Groq
Tenstorrent Scale-out framework for HPC applications
Felix LeClaire, Tenstorrent
Talk Title TBD
Brian C. Van Essen, LLNL
Experience with AI Testbeds at ALCF
Siddhisanket Raksar, ANL
RISC-V: An explosion in AI accelerators for HPC
Nick Brown, EPCC
Cache Me If You Can: Outpacing Traditional Hardware
Hatem Ltaief, King Abdullah University of Science & Technology
6.00-6.30 PM Panel Discussion
Moderator: Tal Ben-Nun (LLNL)
Panelists:
Vendors:
  • Leighton Wilson (Cerebras Systems)
  • Vijay Tatkar (SambaNova Systems)
  • Sanjif Shanmugavelu (Groq)
  • Felix LeClaire (Tenstorrent)
    • Facilities:
  • Brian C. Van Essen (LLNL)
  • Siddhisanket Raskar (ANL)
    • Users:
  • Nick Brown (EPCC)
  • Hatem Ltaief (KAUST)
    • 6.30-6.45 PM Audience Q&A

    Organizers

  • Murali Emani, Argonne National Laboratory (ANL)
  • Siddhisanket Raskar, Argonne National Laboratory (ANL)
  • Jophin John, Leibniz Supercomputing Centre
  • Juan J. Durillo, Leibniz Supercomputing Centre
  • Tal Ben-Nun, Lawrence Livermore National Laboratory (LLNL)
  • Brian Van Essen, Lawrence Livermore National Laboratory (LLNL)
  • Hatem Ltaief, King Abdullah University of Science & Technology (KAUST)
  • Nick Brown, Edinburgh Parallel Computing Centre (EPCC)

    • Past Events