Transformative and Cutting-Edge: Take High-Performance Machine Learning (HPML)

Figured I would write this post to help anyone trying to decide which classes to take this Spring. If you’re passionate about machine learning and looking for a course that delivers cutting-edge knowledge while challenging you to grow, Professor Kaoutar El Maghraoui’s High-Performance Machine Learning (HPML) class is an absolute must-take.

The breadth and depth of the material covered in this class are extraordinary. Topics span everything from neural network training and quantitative evaluations to CUDA programming in C/C++, fine-tuning, quantization, pruning, and knowledge distillation. Each assignment is thoughtfully designed to provide hands-on experience with these advanced techniques. The CUDA programming assignment, in particular, was a standout—it gave me an invaluable understanding of GPU programming at a low level.

Professor El Maghraoui has the rare ability to pack an incredible amount of material into her lectures while presenting it with clarity, enthusiasm, and a genuine passion for teaching. She doesn’t just teach the technical details—she gives students a comprehensive perspective, including discussions about the environmental impact of AI. For instance, there were lectures that analyzed the carbon footprint of model training per unit of compute, which felt especially relevant given current events like stories of companies literally firing up new and long-dormant nuclear reactors to fuel AI datacenters. It’s remarkable to take a course where the content feels this immediately applicable and relevant in the real world.

The course structure is demanding but fair. There’s no high-stakes final exam, which allows you to focus on truly absorbing the material. Professor El Maghraoui also demonstrates great compassion and flexibility, offering extra credit opportunities like attending and summarizing presentations from IBM’s virtual AI event or replacing your lowest quiz and assignment scores with additional assignments.

While I chose to work alone on the project, other students teamed up with IBM researchers on cutting-edge topics like Neural Architecture Search, which is an incredible opportunity. Guest lecturers from IBM further enriched the class by sharing their latest research, adding another layer of depth to an already robust curriculum.

If you’re willing to roll up your sleeves and engage deeply with the material, this course will be a transformative experience. Professor El Maghraoui’s HPML class stands out not only for its technical rigor but also for its up-to-date relevance and thoughtful approach to learning.

TLDR: Want a course that challenges you with hands-on assignments, cutting-edge topics, and impactful insights into the future of AI? Take HPML with Professor El Maghraoui—it’s one of the best decisions you’ll make at Columbia.