A Short Course on HPC, BigData and AI

SERC Workshop (January 2024) 


IISc Personnel Registration Link:  https://bit.ly/SERC-2020Jan

Other organizations: http://iisc.online/shortterm/home.html

Course objective:
To introduce the fundamentals of parallel computing including parallel architectures, programming models and commonly used parallel programing constructs/libraries/languages, AI/Deep learning and BigData and to  present motivating algorithms and applications to real-world problems. Programming labs will provide experience in using the parallel programming and AI-related constructs..

Day   9:30 –11:00    11:30-1:00     2:00 —  3:00  3:30-5:30 (with a tea break from 3:45 to 4:00 PM)  
Day 1 


HPC Overview Parallel Computing Architectures  ( RG) PDF   Parallelization Principles  (RG)  PDF
   OpenMPProgramming I  (Akhila) PDF
Roles of Job Schedulers, Cluster Mgmt. Tools Basics of Job Scripts (JL) 
followed by OpenMP Lab 1 PDF
Day 2 
OpenMP Programming  II (Akhila)  PDF MPI Programming I (Aditya) PDF
Parallel File systems 
(Filbert/Aditya)  PDF
OpenMP Lab  exercises
Day 3 
GPU Architecture /NGC Theory (NVIDIA)
Basic DL/ML Theory/ Group Formation and Next Day Agenda  (NVIDIA) PDF1   PDF2
 Roles of Profilers, and Debuggers (JL)  PDF MPI Programming Lab  PDF
BigData and Spark 
Real-world HPC program : A Case Study (Bala) PDF
MPI Programming II (VSS) PDF
Parallel Algorithms and High Performance Libraries (VSS) PDF  PDF
Day 5 
NGC Hands on/Tensorflow and Pytorch (NVIDIA)
Hands on(Image Classification and Localization )/NLP Theory (NVIDIA)
Machine learning workflow with RAPIDS (NVIDIA)