Parallel Python

Summary

You’ve now learned the basics of functional programming, and how to write parallel Python scripts that can run across the cores of your desktop, or across the processors of a distributed or HPC cluster.

If you want to learn more then take a look at the documentation for the in-built Python modules multiprocessing and concurrent.futures.

The MPI4Py documentation will give you a lot of detail on making more advanced parallel Python programs.

For information on another approach to making your Python code faster, see the course Accelerating Python.

Credits

This course was originally written by Christopher Woods and published at https://chryswoods.com/parallel_python/. Some changes were made by the ACRC at the University of Bristol. The course was revised by Matt Williams.

All text is published under a Creative Commons Attribution 4.0 International License with all code snippets licensed as MIT.

The source for the material can be found on GitLab where fixes are welcome.