AllReduce Collective
Mathematics for AI and Machine Learning
From the book
This pictogram belongs to the Mathicon figure library for Allreduce. It follows the same visual conventions as the book diagrams even when it is not tied to a single printed mind-map node.
What this drawing shows
What you see. Shows values flowing around a ring of ranks and reducing to one shared result, the AllReduce collective.
In the book. Look up AllReduce Collective in the manuscript index or chapter mind maps.
Where to read next
Look up AllReduce Collective in the book index to find the matching figure or discussion. The pictogram follows the same visual conventions as the printed diagrams.
