Happened-before

In computer science, the happened-before relation (denoted: $\to \;$ ) is a relation between the result of two events, such that if one event should happen before another event, the result must reflect that, even if those events are in reality executed out of order (usually to optimize program flow). This involves ordering events based on the potential causal relationship of pairs of events in a concurrent system, especially asynchronous distributed systems. It was formulated by Leslie Lamport.^[1]

The happened-before relation is formally defined as the least strict partial order on events such that:

If events $a\;$ and $b\;$ occur on the same process, $a\to b\;$ if the occurrence of event $a\;$ preceded the occurrence of event $b\;$ .
If event $a\;$ is the sending of a message and event $b\;$ is the reception of the message sent in event $a\;$ , $a\to b\;$ .

If two events happen in different isolated processes (that do not exchange messages directly or indirectly via third-party processes), then the two processes are said to be concurrent, that is neither $a\to b$ nor $b\to a$ is true.^[2]

If there are other causal relationships between events in a given system, such as between the creation of a process and its first event, these relationships are also added to the definition. For example, in some programming languages such as Java,^[3] C, C++ or Rust, a happens-before edge exists if memory written to by statement A is visible to statement B, that is, if statement A completes its write before statement B starts its read.

Like all strict partial orders, the happened-before relation is transitive, irreflexive (and vacuously, asymmetric), i.e.:

$\forall a,b,c$ , if $a\to b\;$ and $b\to c\;$ , then $a\to c\;$ (transitivity). This means that for any three events $a,b,c$ , if $a$ happened before $b$ , and $b$ happened before $c$ , then $a$ must have happened before $c$ .
$\forall a,a\nrightarrow a$ (irreflexivity). This means that no event can happen before itself.
$\forall a,b,$ if $a\to b$ then $b\nrightarrow a$ (asymmetry). This means that for any two events $a,b$ , if $a$ happened before $b$ then $b$ cannot have happened before $a$ .

Let us observe that the asymmetry property directly follows from the previous properties: by contradiction, let us suppose that $\forall a,b,$ we have $a\to b\;$ and $b\to a$ . Then by transitivity we have $a\to a,$ which contradicts irreflexivity.

The processes that make up a distributed system have no knowledge of the happened-before relation unless they use a logical clock, like a Lamport clock or a vector clock. This allows one to design algorithms for mutual exclusion, and tasks like debugging or optimising distributed systems.

Citations

^ Lamport, Leslie (1978). "Time, Clocks and the Ordering of Events in a Distributed System", Communications of the ACM, 21(7), 558-565.
^ "Distributed Systems 3rd edition (2017)". DISTRIBUTED-SYSTEMS.NET. Retrieved 2021-03-20.
^ Goetz et al. 2006, pp. 339–342, §16.1.3 The Java Memory Model in 500 words or less.

References

Goetz, Brian; Peierls, Tim; Bloch, Joshua; Bowbeer, Joseph; Holmes, David; Lea, Doug (2006). Java Concurrency in Practice. Addison Wesley. ISBN 0-321-34960-1.

[1] Lamport, Leslie (1978). "Time, Clocks and the Ordering of Events in a Distributed System", Communications of the ACM, 21(7), 558-565.

[2] "Distributed Systems 3rd edition (2017)". DISTRIBUTED-SYSTEMS.NET. Retrieved 2021-03-20.

[FOOTNOTEGoetzPeierlsBlochBowbeer2006339–342§16.1.3_The_Java_Memory_Model_in_500_words_or_less-3] Goetz et al. 2006, pp. 339–342, §16.1.3 The Java Memory Model in 500 words or less.

[1]

[2]

[3]

See also

Citations

References