Tree traversal without recursion: the tree as a state machine, Hacker News

  

I am currently working my way throughHigher-Order Perl, a highly recommended tome on effective and practical use of functional programming techniques in Perl. As you’d expect from a book that spends a lot of time discussing such concepts as function composition and recursion, the subject of tree traversal makes a frequent apperance:

  

1. First, as an introductory example to recursion;

    

2. then, when discussing how to turn recursive functions into iterators using an explicit stack (which permits breadth-first searching);

    

3. again recursively, in the section on tail call elimination, where the tail-recursive call is eliminated first, and the other recursive call is then replaced by an explicit stack.   

There may be even more appearances later in the book that I’ve yet to discover; as I said, I’m not through with it yet. However, the book changes topic after that, at least momentarily, so I stopped to ponder. It occurred to me that this is the entire extent to which discussions of tree traversal typically go. Another obvious option that occurred to me many years ago is not discussed anywhere that I’ve seen, though it is occasionally mentioned as a possibility in passing:

  

You can get rid of any stacks whatsoever by keeping a parent pointer in the tree node data structure. Effectively, this turns the tree into a (sort of) state machine. While traversing, you need no memory other than the current and previous node / state. The traversal algorithm is very simple:

  

1. If the previous node is this node’s parent node, descend to the left child node.

    

2. If the previous node is this node’s left child node, descend to the right child node.

    

3. If the previous node is this node’s right child node, ascend to the parent node.

  

Obviously, if there is no left child to descend to, you try the right one; and if there is no right child to descend to, you ascend to the parent. Traversal is complete when an attempt to ascend to the parent node fails because there is no parent. Pre-, post- and in-order traversal can be implemented simply by changing which of the conditions implies that the current node must be visited: if you visit the node when coming from…

  

1. … the parent node, you get pre-order traversal.

    

2. … the left child node, you get in-order traversal.

    

3. … the right child node, you get post-order traversal.

  

Assuming all tree nodes are instances of a class which hasparent,leftandrightmethods and usesundefto signify the absence of a pointer, then the following is an implementation of the in-order version of the traversal algorithm in Perl:

  

sub traverse_tree {   my ($ tree_root, $ visitor_callback)=@_;   my ($ curr_node, $ prev_node)=$ tree_root;    while ($ curr_node) {     my $ next_node;      if ($ prev_node==$ curr_node->parent) {       $ next_node=$ curr_node->left;       if (not $ next_node) {         $ visitor_callback ->($ curr_node);         $ next_node=$ curr_node->right || $ curr_node->parent;       }     }     elsif ($ prev_node==$ curr_node->left) {       $ visitor_callback ->($ curr_node);       $ next_node=$ curr_node->right || $ curr_node->parent;     }     elsif ($ prev_node==$ curr_node->right) {       $ next_node=$ curr_node->parent;     }      ($ prev_node, $ curr_node)=($ curr_node, $ next_node);   } }

  

This is the most straightforward implementation, which does have a fault: there is some code duplication between the coming-from-parent and coming-from-left-child states. The complication comes about because node visiting must be ensured even when the node does not have the particular pointer to come from;egin the case of in-order traversal, you visit the current node when you come from the left child node; but when a node has no left child node, you must still ensure that the node will be visited. The discovery that the left child node is absent will happen when the previous node was the parent, and so that state must ensure to visit the current node before going on to try to descend to the right.

  

The fix is ​​conceptually simple, but not easy to express in code. You need a way to fall through from the body of one branch to another’s without checking the condition for that branch, much the way C’sswitchstatement works, where branches fall through by default and require an explicitbreakto exit. Aswitchstatement in C is simply a structured expression of a jump table (but note that you couldn’t actually use aswitchstatement in C for this because thecaseconditions in this algorithm wouldn’t be constant expressions); so the Perl version will need a couple of explicitgotos:

  

sub traverse_tree {   my ($ tree_root, $ visitor_callback)=@_;   my ($ curr_node, $ prev_node)=$ tree_root;    while ($ curr_node) {     my $ next_node;      {       goto FROM_PARENT if $ prev_node==$ curr_node->parent;       goto FROM_LEFT if $ prev_node==$ curr_node->left;       goto FROM_RIGHT if $ prev_node==$ curr_node->right;        FROM_PARENT:         last if $ next_node=$ curr_node->left;        FROM_LEFT:         $ visitor_callback ->($ curr_node);         last if $ next_node=$ curr_node->right;        FROM_RIGHT:         $ next_node=$ curr_node->parent;     }      ($ prev_node, $ curr_node)=($ curr_node, $ next_node);   } }

  

In this rendition of the algorithm, the reformulation required to implement pre- or post-order traversal is trivial: you just move the callback invocation to the appropriate label.

  

(It is in fact quite simple to implement all three variants in a single function: just put a call in every branch and make them conditional on an extra parameter, eg$ visitor_callback ->($ curr_node) if $ order==-1;where$ order==0means in-order traversal and in that case the parameter is optional.)