A Short Course on HPC, BigData and AI

SERC Workshop (January 2024) 


IISc Personnel Registration Link:  https://bit.ly/SERC-2020Jan

Other organizations: http://iisc.online/shortterm/home.html

Course objective:
To introduce the fundamentals of parallel computing including parallel architectures, programming models and commonly used parallel programing constructs/libraries/languages, AI/Deep learning and BigData and to  present motivating algorithms and applications to real-world problems. Programming labs will provide experience in using the parallel programming and AI-related constructs..

Day   9:30 –11:00    11:30-1:00     2:00 —  3:00  3:30-5:30 (with a tea break from 3:45 to 4:00 PM)  
Day 1 


HPC Overview Parallel Computing Architectures  ( RG)    Parallelization Principles  (RG)     OpenMPProgramming I  (Akhila)  Roles of Job Schedulers, Cluster Mgmt. Tools Basics of Job Scripts (JL) 
followed by OpenMP Lab 1
Day 2 
OpenMP Programming  II (Akhila)   MPI Programming I (Aditya)   Parallel File systems 
OpenMP Lab 
Day 3 
GPU Architecture /NGC Theory (NVIDIA)
Basic DL/ML Theory/ Group Formation and Next Day Agenda  (NVIDIA)
 Roles of Profilers, and Debuggers (JL)   MPI Programming Lab 
BigData and Spark 
Real-world HPC program : A Case Study (Bala  MPI Programming II (VSS) Parallel Algorithms and High Performance Libraries (VSS)
Day 5 
NGC Hands on/Tensorflow and Pytorch (NVIDIA)
Hands on(Image Classification and Localization )/NLP Theory (NVIDIA)
Machine learning workflow with RAPIDS (NVIDIA)