Wrangling Massive Task Graphs with VineReduce
Douglas Thain at HTC26
June 11, 2026
Ben Tovar and Douglas Thain introduce Vine Reduce, a TaskVine framework designed to efficiently execute massive task graphs by generating work hierarchically instead of constructing the entire graph upfront. The approach dramatically reduces workflow setup time while enabling scalable, data-intensive computing for applications ranging from high-energy physics to large-scale scientific analysis.
HTC26
HTCondor