Wrangling Massive Task Graphs with VineReduce

Douglas Thain at HTC26

June 11, 2026

Ben Tovar and Douglas Thain introduce Vine Reduce, a TaskVine framework designed to efficiently execute massive task graphs by generating work hierarchically instead of constructing the entire graph upfront. The approach dramatically reduces workflow setup time while enabling scalable, data-intensive computing for applications ranging from high-energy physics to large-scale scientific analysis.

HTC26 HTCondor