Justin Hiemstra discusses access to data via tokens that you bring to the Origin to get your data. Hiemstra’s talk explores the problems this complex system is trying to solve, why we don’t use something simple like passwords and what Pelican is going to make it easier for users.
CHTC Fellows discuss the work and goals of their Fellows Projects - for CHTC and Pelican
Jason Kwan presents on the use of high-throughput computing in metagenomics research, discussing how CHTC allows for large-scale searches and metagenomic assemblies that require a lot of RAM.
The OSG David Swanson award is awarded each year in memory of David Swanson to an attendee of the OSG School who has gone on to do interesting things. This year’s recipient, Brandi Pessman, presents on how spiders respond to rising noise levels in cities. Using high-throughput computing, Brandi digitally reconstructed spider webs to track spider movements during web construction.
Recent technological advances have revealed an enormous diversity of lifeforms by sequencing their genomes. There are now millions of available genomes, each comprised of thousands of genes. The universe of newly discovered genes is expanding far faster than our ability to study them in the laboratory. Here, Erik Wright presents how high-throughput computing is unlocking the function of novel genes at an unfathomable scale.
Christina Koch presents on facilitation impacts at HTC25. Lead Research Computing Facilitator Christine Koch describes the facilitation services provided to researchers and ways to connect. In addition, Koch discusses PATh’s role as a resource provider for NAIRR and building a data community.
Fermilab is the first High Energy Physics institution to transition from X.509 user certificates to authentication tokens in production systems. All the experiments that Fermilab hosts are now using JSON Web Token (JWT) access tokens in their grid jobs. The tokens are defined using the WLCG Common JWT Profile. Many software components have been either created or updated for this transition, and the changes to those components are described. Most of the software is available to others as open source. There have been some glitches and learning curve issues but in general the system has been performing well and is being improved as operational problems are addressed.
Miron Livny provides the opening remarks for HTC25. Livny discusses the Center for High Throughput Computing (CHTC) vision: Distributed high throughput computing and research computing facilitation are powerful enables or scientific discovery; The value proposition of throughput computing for researchers with AI workloads, and translational (computer) science. He also discusses that building a lasting relationship with a community requires an evolving value proposition and mutual trust.
Jim Basney presents on CILogon, a 15+ year effort to enable secure longon to scientific cyberinfrastructure (CI) for seamless identity and access management using federated identities (SAML, OIDC, OAuth, JWT) so researchers log on with their existing credentials.
Mátyás Selmeci discusses placement tokens, experimental work in the area of authorization to make it easier to grant, audit, and revoke access to the job placement services that an Access Point provides.
Frank Wuerthwein, OSG Executive Director, discusses the current state of OSG, the compute and data services provided by OSG, fun facts on usage, and goals for the future.
Brian Bockelman, the Pelican Platform PI, discussed what Pelican does, and how it can be used. Bockelman discusses the Pelican Project that builds a software platform that delivers data to throughput computing and the Open Science Data Federation (OSDF), a global deployment of the platform.
Prakriti Garg presents on using throughput computing to study the gene regulatory network using network inference and unsupervised learning
Oana Carja discusses using the OSPool and high throughput computing in the field of biological evolution, with the aim of understanding the rules that govern evolutionary processes.
Wheat, Senior Professor of Computer Science at Oral Roberts University, discusses the campus CC* awards, contributing to the OSPool and its impact on the ORU faculty and students.
NSF NCAR’s labs and programs collectively cover a breadth of research topics in Earth system science, from the effects of the Sun on Earth’s atmosphere to the role of the ocean in weather and climate prediction, as well as supporting and training the next-generation of Earth system scientists. However, with the current legacy `download and analyze’ model followed by most of our remote users, we are not realizing the full research potential of NCAR’s wealth of datasets. Our goal is to integrate NCAR’s curated data collections with the OSDF data and compute fabric to broaden access capabilities. In this talk, we present progress on this collaboration and demonstrate geoscience workflows which ingest data from NCAR’s Research Data Archive using pelicanFS via OSDF caches.
Kevin Thompson from the Office of Advanced Cyberinfrastructure of the National Science Foundation discussed the Camus Cyberinfrastructure (CC) vision. Thompson discusses the CC Program that is Coordinated in networking, compute and storage. Thompson also discusses the contributors to the OSPool and the services of the OSDF.
Sarvani Chadalapaka discusses UC Merced’s Cyberinfrastructre and Research Technologies Mission and both its contribution and use of OSG resources, noting that they chose OSG because of its alignment with CC* requirements, pre-proposal and deployment support and training and onboarding support.
Patricia Tran, bioinformatics and computational pipeline scientist, bioinformatics research support service, discusses working with big data in biology and the requirements to be scalable, flexible and use high throughput computing.
Peter Pizzimenti, Associate Director of Research Computing at Syracuse University, discusses why Syracuse invests in research computing, What it takes to support research computing and where they are going.
Join Brian Bockelman, Douglas Thain, Ewa Deelman, Manish Parashar, Miron Livny, and Peter Couvares for a panel discussion on translational computer science.
Michael Couso, a research computing support supervisor, discussed how the University of Montana became a contributor to the OSPool. Couso discussed connecting to the OSPool and opening the door to a broad community and the process of scaling up and growing outward.
Since its establishment in 2006, the MIT Tier-2 computing center has been a long-standing contributor to CMS computing efforts. Recently, an opportunity arose to take part in the usage of a shared tape storage system operated by Harvard University. In the context of a pilot project to explore this system we acquired tape cartridges with a total capacity of 15 PB and successfully integrated them for use by CMS. A key challenge was the lack of direct access to the tape libraries. To address this, we developed a novel setup that is currently unique within the CMS infrastructure. In this talk, we present our technical approach and share insights that may benefit other sites considering participation in shared tape storage systems.
Christina Koch, OSG Rsearcher Facilitation Lead, and Tim Cartwright, OSG Campus Coordinator, discuss how buildling the community of contributors is an inseparable aspect of providing the OSDF, OSPool and OSStore.
Pascal Paschos discusses PATh Collaboration Services that coordinates effort at the intersction of multple services for collaborations at global scale of intrastructure and communities, nothing the 20 - 25% grown in cpu hours and 70% growth in gpu hours over the past year.
Mark Larson discusses the computing requirements and resouces needed for the Muon Collider and the solutions to these computing challenges. Larson also discusses the experience running HTCondor jobs and how the OSG/PATh provided resources have proven exremely useful.
While there are perhaps hundreds of petabytes of datasets available to researchers, instead of swimming in seas of data there is often a feel of sitting in a data desert: there’s a mismatch between what sits in carefully curated repositories around the world versus what’s accessible at the computational resources locally available. The Pelican Project (https://pelicanplatform.org/) aims to bridge the gap between repositories and compute by providing a software platform to connect the two sides. Pelican’s flagship instance, the Open Science Data Federation (OSDF), serves billions of objects and more than a hundred petabytes a year to national-scale resources. This tutorial, targeted at end-user data consumers and data providers, will cover the data access model of Pelican, guide participants to access and share data through an existing data federation, and consider how data movement via Pelican and the OSDF can enable their research computing.
Dacheng Xu discussed the SENON Collaboration, the goals of data reprocessing, the data flow, their use of the Pegasus workflow management software, and use of HTCondor
Justin Hiemstra presents about Snakemake and research computing workflows
The Event Workflow Management System (EWMS) enables previously impractical scientific workflows by transforming how HTCondor is used for massively parallel, short-runtime tasks. This talk explores what’s now possible from a user’s perspective. Integrated into IceCube’s Realtime Alert pipeline and powered by OSG’s national-scale compute resources, EWMS’s debut application delivers directional reconstructions of high-energy neutrinos within minutes. This talk will showcase how EWMS is accelerating discovery today and explore how its capabilities could unlock new research across domains—from astrophysics to protein modeling, large-scale text mining, and beyond.
The MIT Tier-2 computing center, established in 2006, has been a long-standing contributor to CMS computing. As hardware ages and computing demands evolve, we are undertaking a major redesign of the center’s infrastructure. In this talk, we present a holistic cost analysis that includes not only hardware purchases but also power consumption, cooling, and rack space—factors often excluded from conventional cost models. We evaluate the cost-effectiveness of maintaining aging hardware versus timely replacement, and propose optimal hardware retirement and procurement policies.
Benedikt Riedel discusses IceCube Computing, an global heterogeneous resources pool - powered by PATh services and products using mostly shared and opportunistic resources. Riedel also discussed the Event Workflow Management Serivce and current and future integrations.
Irvin Lopez-Audetat discusses the Monitoring Infrastructure for Network and Computing Environment Research (MINCER) project that aims to provide a foundation for in-depth insight and analysis of distributed heterogeneous computing environments, supporting and enhancing research and education in computer and network systems. Our approach is to work in conjunction with the Open Science Grid (OSG).
Tom Smith from the BNL Scientific Computing and Data Facility (SCDF) discusses its integration with HTCondor, upgrade strategies, monitoring, and wish list.
The Algorithms Research and Development Group (ARDG) at the National Radio Astronomy Observatory (NRAO) has been using HTCondor and compute resources at the Open Science Grid (OSG) to significantly improve throughput in radio astronomy imaging by up to 2 orders of magnitude in single imaging workflows, and we are currently putting efforts towards extending these imaging capabilities to multiple imaging workflows. Besides developing and maintaining software to efficiently process data and manage the imaging workflows, we found that monitoring and diagnosing workflow executions is critical to achieve and maintain high throughput. We will present and discuss some of the tools and methodology that we use to assess workflow health and efficiency, which enable us to visualize and solve problems, eventually also contributing to optimizing and advancing capabilities of HTCondor and the OSG.
Corrado Gatto discussed REDTOP’s main physics goals, cost estimates for its work, the Collaboration, the storage & CPU expected data rates, the Montecarlo Campaign 2025 and the OSG Usage Statistics from that work.
Cole Bollig discusses how the EP enforces disk usage, how to enable disk enforcement and the benefits gained.
Brian Bockelman presents on the Pelican work debugging Pelican client failures and approaches to learn what happened.
Computational notebooks have become a critical tool of scientific discovery, by wrapping together code, results, and visualization into a common package. However, moving complex notebooks between different facilities is not so easy: complex workflows require precise software stacks, access to large data, and large backend computational resources. The Floability project aims to connect these two worlds, making it possible to specify, share, and execute computational workflows through the familiar notebook interface. This talk will introduce the Floability concept of a workflow “backpack” and demonstrate applications in high energy physics, machine learning, and geosciences.
We present the initial design and proposed implementation for a series of long-baseline, distributed inference experiments leveraging ARA — a platform for advanced wireless research that spans approximately 500 square kilometers near Iowa State University, including campus, the City of Ames, local research and producer farms, and neighboring rural communities in central Iowa. These experiments aim to demonstrate, characterize, and evaluate the use of distributed inference for computer vision tasks in rural and remote regions where high-capacity, low-latency wireless broadband access and backhaul networks enable edge computing devices and sensors in the field to offload compute-intensive workloads to cloud and high-performance computing systems embedded throughout the edge-to-cloud continuum. We highlight the role of HTCondor as the common scheduler and workload manager used to distribute the inference workload across ARA and beyond. We also discuss some of the unique challenges in deploying HTCondor on ARA.
Bujji Selagamsetty discusses his CHTC GPU workflow. He also noted improvements to CHTC Flow, including HTChirp to poll job ad information and self-scheduling job length and device specific tuning. In his current work he asks what are the regions od 3D audio space where a. speech is more perceptible and b. noise is more distracting. Can we map this space at a fine enough granularity to create more personalized, spatial audio experiences? Selagamsetty summarizes his CHTC experience working on this project.
Ian Ross discussed the ML PATh supplement to profile the effects of training on inference on distributed, hetergeneous capacity, Ross talks about the HTCondor’s Annex integration with NAIRR sites and use of some new DAG features that could simplify some things.
New requirements from HEP data analysis includes limited access to login nodes, resource needed from the experiments program rather than the login nodes and efficient data access for collaborative workflows etc. We have developed an Interactive aNalysis worKbench (INK), a web-based platform leveraging the HTCondor cluster. INK transforms traditional batch-processing resources into a user-friendly, web-accessible interface, enabling researchers to leveage the cluster computing and storage resources directly via their browsers.
Greg Thain discusses what is a functional language and the development of a new functional programming language and how thinking in a functional way helps us solve real problems.
Amber Lim discusses how to run GPU jobs in CHTC and the OSPool, the researcher-to-AI-workflow-proficiency pipeline, and what you should consider during development.
John Peters focuses on Feature Extraction in AI workflows and how to leverage CHTC using small zips, Snakemake and caching.
Sameer D’Costa, a scientist with the Computational Biology Group at the Great Lakes Bioenergy Research Center, is investigating Zymomonas mobilis (bacteria) that is really good at turning sugar into alcohol and could be engineered for industrial use. D’Costa share his deep learning computational plan and workflow to compute complees in Z. Mobilis.
The Compact Muon Solenoid (CMS) experiment at CERN generates and processes vast volumes of data requiring significant computing capacity. To meet these demands, CMS has adopted a federated throughput computing model distributed across a global infrastructure based on HTCondor, the CMS Submission Infrastructure. Seamless integration of heterogeneous resources from multiple sites allows for operating a unified, virtualized pool. This infrastructure currently provides access to over 500,000 CPU cores, enabling CMS to efficiently execute a wide variety of data processing and simulation workloads.
This federation, however, comes with substantial operational challenges, notably, the need for robust and scalable monitoring. To ensure reliability, performance, and rapid diagnosis of issues, we have developed a comprehensive monitoring ecosystem that spans job execution, resource availability, and system health across the entire pool. This talk will present the architecture of the CMS federated compute infrastructure, detail the role of HTCondor in enabling global workload distribution, and highlight recent developments in monitoring that are critical to operating such a large-scale system effectively.
Pegasus is a widely used scientific workflow management system built on top of HTCondor DAGMan. This talk will highlight how Pegasus is deployed within the NSF ACCESS ecosystem and the NAIRR Pilot. We will cover access point deployments, including the hosted ACCESS Pegasus platform (Open OnDemand and Jupyter), workflow execution nodes in HPC environments, and a JupyterLab-based access point within the Purdue Anvil Composable Subsystem. On the execution side, we will discuss several provisioning strategies, including HTCondor Annex, custom virtual machines on the Jetstream2 cloud, simple glidein configurations for campus clusters, and a dynamically autoscaled TestPool environment designed for workflow development and testing.
Tim Theisen discusses how to upgrade your HTCondor Pool without users noticing.
HTCondor is the leading system for building a dynamic overlay batch scheduling system on resources managed by any scheduling system, by means of glideins. One fundamental property of these setups is the use of late binding of containerized user workloads. From a resource provider point of view, a compute resource is thus claimed before the user container image is selected. Kubernetes allows for both multi-container requests and dynamic updates to the container image being used. In this talk we show how HTCondor can exploit these features to both increase the effectiveness and the security of gildeins running on top of Kubernetes-managed resources.
Michael Pelletier discusses the usefulness of uptime metrics, how built-in daemon attributes are linked to service uptime, how to create custom attribute such as an UptimeExecMonthly attribute. While the DaemonStartTime and MonitorSelfAge attributes of HTCondor daemons provide a slice of insight as to the uptime and availability of the service, they’re not well-suited for tracking longer-term up/down-time stats over the course of days, weeks, or months. Longer-time-period uptime statistics are essential for contractual Service Level Agreement (SLA) management, and are an important aspect of monitoring the overall health of large HTCondor pools.
Ariana Negreiro disusses the Digital Livestock Lab at the UW-Madison Dept of Animal and Dairy Sciences which focuses on research applications of ML and computer vision for farm management and genetic selection. Negreiro disucssed the data processing pipeline and the CHTC Resources (HTCondor, Pelican and DAGMAN) that they rely upon for their work.
Todd Tannenbaum discusses what’s new in the HTCondor Software Suites (HTCSSS) and what’s coming up. Topics include Release numbering Scheme, using container images, new authenticated docker support, Pelican local cache on the EP, sharing input common files, and more.
Miron Livny provides the closing remarks for HTC25.
TJ Knoeller discusses the HTCondor original who use case (who is using the Execution Point (EP), the Execution Point Architecture, Strategy, and the modern who use case. He further discusses condor_who options and the new condor_who strategy.
Todd Miller discusses the current tranfer logic, noting that the present mechanism will be released in 24.9, effectively without a UI/UX. The next step, the shiny future plans for 24.10, is to make common file transfer as observable as input file transfer.
Nickolas Pingel science he discusses are the direct result of the “Transformational Survey of Local Group galaxies with the Karl Jansky Very Large Array and HTCondor”, which was funded by the The Office of the Vice Chancellor for Research and Graduate Education’s Research Forward initiative. The success of this project was due to the collaboration between Astronomy and CHTC staff (Bockelman, Livny), who provided direct training and help via dedicated staff members. Pingel talks about the research of radio astronomers which focuses on light emitted in the radio regime. Pingel notes that the early results from these surveys are ushering in a new observational regime for measuring the thermodynamics of the CNM across a diverse range of astrophysical environments.
Conor Bendett shares about his work using HTC for comparative genonimcs for large public datasets. He further discusses CHTC and HTCondor and his experience: noting that there are lots of pipelining small tools; not always the easiest to manage; troubleshooting memory/disk space can be time consuming (unpredictableoutputs) and the great support from CHTC facilitators.
Justin Hiemstra discusses scheduled storage, the core idea we’re exploring with Kingfisher. He further discusses Pelican and how it discovers namespaces, how Local or remote policies are joined to populate a Lot DB and how XRootD tracks usage statistics for a Lot DB.
Aydan Bailey discussed getting started with CHTC for his research, his use of CHTC guides and Offie hours and the challenges setting up Docker image for running custom software. Bailey also dsicussed the advanges of the ResearchDrive integration, that provides a secure, shareable storage and much faster transfers between the storage location and CHTC servers.
Curt Dodds describes the process of deploying the National Data Platform Endpoint (formerly Point of Presence / POP) on local infrastructure to provide a data streaming service for a published science dataset where the data origin is located in Hawaii. From the perspective of a software engineer, he covers the process of deploying the endpoint into a Kubernetes cluster or using Docker Compose. Dodds explains how he integrated access to local data with the endpoint and describe some useful lessons that were learned. Finally, from the perspective of a science user, he demonstrates how to use the deployed endpoint to preprocess data and stream the results to a Jupyter notebook to visualize the data.
Brian Bockelman, PI of the Pelican Platform, describes how the OSDF can partner with CICI PIs (and other producers of research datasets) to share their data and build a community of users, using the OSDF as a platfrom that can control data access, track data access and distribute data to individuals and computing systems.
Ilkay Altintas, PI of the National Data Platform, shares how the NDP serves as a central organizing point for different datasets by providing cataloguing and search functionality.
