Reaves.dev

v0.1.0

built using

Phoenix v1.7.17

Topology

Stephen M. Reaves

::

2024-10-29

Notes about Lecture 7 for CS-6220

Required Readings

Summary

Network Models

GLinear (1D)00110--1221--2332--3
GMesh (2D)cluster_topcluster_midcluster_bota(0,0)b(0,1)a--be(1,0)a--ec(0,2)b--cf(1,1)b--fd(0,3)c--dg(1,2)c--gh(1,3)d--he--fi(sqrt(p - 1),0)e--if--gj(sqrt(p - 1),1)f--jg--hk(sqrt(p - 1),2)g--kl(sqrt(p - 1),3)h--li--jj--kk--l
GFully connected00110--1220--2330--3440--4550--51--21--31--41--52--32--42--53--43--54--5
Diameter
Take all pairs of nodes, compute the shortest path, then find the longest shortest path.
TypeLinks (λ \lambda )Diameter (Δ \Delta )
LinearP1 P-1 P1 P-1
Mesh2(P1)P2P 2\left( \sqrt{P} - 1 \right) \sqrt{P} \approx 2P 2(P1) 2\left(\sqrt{P} - 1\right)
Fully connectedP(P1)2 \frac{P\left(P-1\right)}{2} 1 1

You care about the number of links because its a proxy for cost

Diameter is a proxy for the longest distance any message may travel in the absense of network contention

Bisection (Band)Width

bisection width
Minimum number of links to remove to cut network in half
TypeBisection (B B )
Linear1 1
MeshP \sqrt{P}
Fully connectedP24 \frac{P^2}{4}

In all-to-all personalized exchanges, all communication will go through bisection.

bisection bandwidth
Assuming all links have equal speed, bisection bandwidth is the product of bisection width and link speed.

Mappings and Congestion

What happens when you design an algorithm for a linear topology but it runs on something like a mesh?

If the links of the physical network are a superset of the logical network, there will be no (extra) contention caused by the mapping

congestion
Maximum number of logical edges that map to a physical edge

A lower bound of congestion is the logical bisection width divided by physical bisection width.