News Articles

European Condor Week Banner

2023 European HTCondor Workshop

We are very pleased to announce that the 2023 European HTCondor Workshop will be held from Tuesday 19th September to Friday 22nd September, at IJCLab in Orsay, France.

CDIS Building Render

Construction Commences on CHTC's Future Home in New CDIS Building

On April 25th, UW-Madison broke ground on the new School of Computer, Data & Information Sciences and CHTC’s new home.

Microscope beside computer by Tima Miroshnichenko from Pexels.

OSPool As a Tool for Advancing Research in Computational Chemistry

Assistant Professor Eric Jonas uses OSG resources to understand the structure of molecules based on their measurements and derived properties.

Headshot of Hannah Cheren

Get To Know Student Communications Specialist Hannah Cheren

During her two year tenure with the Morgridge Institute for Research - Research Computing lab, Hannah Cheren made significant science writing contributions and along the way changed the direction of her life.

Image of a server room by Elias from Pixabay.

The CHTC Philosophy of High Throughput Computing – A Talk by Greg Thain

HTCondor Core Developer Greg Thain spoke to UW faculty and researchers about research computing and the missions and goals of the Center for High Throughput Computing (CHTC).

Image obtained from the official ASP2022 page on the African School of Physics website.

Distributed Computing at the African School of Physics 2022 Workshop

Over 50 students chose to participate in a distributed computing workshop from the 7th biennial African School of Physics (ASP) 2022 at Nelson Mandela University in Gqeberha, South Africa.

Quantum AI Logo. Image from Quantum AI Product Manager Catherine Vollgraff Heidweiller’s research blog post.

Google Quantum Computing Utilizing HTCondor

Google’s launch of a Quantum Virtual Machine emulates the experience and results of programming one of Google’s quantum computers, managed by an HTCondor system running in Google Cloud.

Image of Todd T taking a selfie with a tropical beach in the background.

Get To Know Todd Tannenbaum

Staff profile of the HTCSS Software Lead, Todd Tannenbaum.

Computer screen with lines of code. Uploaded by AltumCode on Unsplash.

Empowering Computational Materials Science Research using HTC

Ajay Annamareddy, a research scientist at the University of Wisconsin-Madison, describes how he utilizes high-throughput computing in computational materials science.

Christina Koch presenting to Kaiping Chen's class.

CHTC Leads High Throughput Computing Demonstrations

Students and researchers acquire high-throughput computing knowhow from CHTC led demonstrations.

Record Number of Cores in OSPool

OSPool's Growing Number of Cores Reaching New Levels

Campuses contributing to the capacity of the OSPool led to record breaking number of cores this December, 2022. On December 9th, the OSPool, which provides computing resources to researchers across the country, crossed the 70,000 cores line –– for the very first time.

Staff and researchers from the OSG User School 2022.

OSG User School 2022 Researchers Present Inspirational Lightning Talks

The OSG User School student lightning talks showcased their research, inspiring all the event participants.

Research Computing Facilitators Christina Koch (left) and Rachel Lombardi (right).

CHTC Facilitation Innovations for Research Computing

After adding Research Computing Facilitators in 2013-2014, CHTC has expanded its reach to support researchers in all disciplines interested in using large-scale computing to support their research through the shared computing capacity offered by the CHTC.

Conference Room

High-throughput computing: Fostering data science without limits

The Center for High-Throughput Computing (CHTC), a joint partnership of UW-Madison School of Computer, Data & Information Sciences and the Morgridge Institute, sees this onslaught of data and says: Bring it on.

HPCwire 2022 Readers' Choice Awards - Best use of HPC in the Cloud ( Use Case )

UW–Madison's Icecube Neutrino Observatory Wins HPCwire Award

The UW-Madison Center for High Throughput Computing’s (CHTC) collaboration with the San Diego Supercomputer Center on the IceCube Neutrino Observatory received recognition with the HPCwire 2022 Readers’ Choice Award for Best Use of High Performance Computing (HPC) in the Cloud (Use Case).

Pool Record Banner

Over 240,000 CHTC Jobs Hit Record Daily Capacity Consumption

The Center for High Throughput (CHTC) users continue to be hard at work smashing records with high throughput computational workloads. On October 20th, more than 240,000 jobs completed that day, reporting a total consumption of more than 710,000 core hours. This is equivalent to the capacity of 30,000 cores running non-stop for 24 hours.

The colors on the chart correspond to the total number of core hours – nearly 884,000 – utilized by researchers at participating universities on PATh Facility hardware located at SDSC.

PATh Extends Access to Diverse Set of High Throughout Computing Research Programs

UCSD announces the new PATh Facility and discusses its impact on science.

Image from the original article posted by the UW–⁠Madison Information Technology department.

Solving for the future: Investment, new coalition levels up research computing infrastructure at UW–Madison

Summary of Corissa Runde’s article from the UW-Madison Department of Information Technology website.

Christina Koch stands with NIAID students attending the OSG user school.

NIAID/ACE students attend this year’s OSG User School 2022

This past July, the OSG User School 2022 welcomed students from across the globe to learn how to use high-throughput computing (HTC) in their scientific research. This year five students from Makerere University in Uganda and the University Of Sciences, Techniques, and Technologies of Bamako in Mali, Africa, participated as a part of The U.S. National Institute of Allergy and Infectious Diseases (NIAID) and the African Centers for Excellence in Bioinformatics and Data-Intensive Science (ACE) partnership program.

OSG User School

OSG User School Concludes

After a week of participating in the OSG User School 60+ students are being released to use impact research across the globe. In this one week event, students learn to run large-scale computing workloads at their campus or using the national-scale OSPool provided by the OSG Consortium.

Image of two black holes from Cody Messick’s presentation slides.

LIGO's Search for Gravitational Waves Signals Using HTCondor

Cody Messick, a Postdoc at the Massachusetts Institute of Technology (MIT) working for the LIGO lab, describes LIGO’s use of HTCondor to search for new gravitational wave sources.

Retirements and New Beginnings: The Transition to Tokens

May 1, 2022 officially marked the retirement of OSG 3.5, GridFTP, and GSI dependencies. OSG 3.6, up and running since February of 2021, is prepared for usage and took its place, relying on WebDAV and bearer tokens.

Image of the black hole in the center of our Milky Way galaxy.

The Future of Radio Astronomy Using High Throughput Computing

Eric Wilcots, UW-Madison dean of the College of Letters & Science and the Mary C. Jacoby Professor of Astronomy, dazzles the HTCondor Week 2022 audience.

Photo by Dan Myers on Unsplash

Expediting Nuclear Forensics and Security Using High Throughput Computing

Arrielle C. Opotowsky, a 2021 Ph.D. graduate from the University of Wisconsin-Madison’s Department of Engineering Physics, describes how she utilized high throughput computing to expedite nuclear forensics investigations.

Justin Hiemstra, a Machine Learning Application Specialist for CHTC’s GPU Lab, discusses the testing suite developed to test CHTC's support for GPU and ML framework compatibility.

Testing GPU/ML Framework Compatibility

Justin Hiemstra, a Machine Learning Application Specialist for CHTC’s GPU Lab, discusses the testing suite developed to test CHTC’s support for GPU and ML framework compatibility.

For the first time, UW Statistics undergraduates could participate in a course teaching high throughput computing (HTC). John Gillett, lecturer of Statistics at the University of Wisconsin-Madison, designed and taught the course with the support of the Center for High Throughput Computing (CHTC).

UW Statistics Course using HTC

For the first time, UW Statistics undergraduates could participate in a course teaching high throughput computing (HTC). John Gillett, lecturer of Statistics at the University of Wisconsin-Madison, designed and taught the course with the support of the Center for High Throughput Computing (CHTC).

Matthew Garcia, a Postdoctoral Research Associate in the Department of Forest & Wildlife Ecology at the University of Wisconsin–Madison, discusses how he used the HTCondor Software Suite to combine HTC and HPC capacity to perform simulations that modeled the dispersal of budworm moths.

Using HTC and HPC Applications to Track the Dispersal of Spruce Budworm Moths

Matthew Garcia, a Postdoctoral Research Associate in the Department of Forest & Wildlife Ecology at the University of Wisconsin–Madison, discusses how he used the HTCondor Software Suite to combine HTC and HPC capacity to perform simulations that modeled the dispersal of budworm moths.

Using high throughput computing to investigate the role of neural oscillations in visual working memory

Jacqueline M. Fulvio, lab manager and research scientist for the Postle Lab at the University of Wisconsin-Madison, explains how she used the HTCondor Software Suite to investigate neural oscillations in visual working memory.

Image of all OSPool Contributors in past month

OSPool Hits Record Number of Jobs

The OSPool processed over 2.6 million jobs during the week of April 14th - 17th this year and ran over half a million jobs on two separate days that week.

PATh Facility hardware

Introducing the PATh Facility: A Unique Distributed High Throughput Computing Service

Researchers can now request credits on the PATh Facility, the PATh project’s new service intended for distributed high throughput computing workflows supporting NSF science.

Computer rendering of DNA. Image credit: Sangharsh Lohakare (@sangharsh_l) on Unsplash.

The role of HTC in advancing population genetics research

Postdoctoral researcher Parul Johri uses OSG services, the HTCondor Software Suite, and the population genetics simulation program SLiM to investigate historical patterns of genetic variation.

Collage of photos from HTCondor Week

A Long-Awaited Reunion: HTCondor Week 2022 in Photos

HTCondor Week 2022 featured over 40 exciting talks, tutorials, and research spotlights focused on the HTCondor Software Suite (HTCSS). Sixty-three attendees reunited in Madison, Wisconsin for the long-awaited in-person meeting, and 111 followed the action virtually on Zoom.

HTCondor Week Image

HTCondor Week 2022 Concludes

Thank you to all in-person and virtual participants in HTCondor Week 2022. Over the course of the event we had over 40 talks spanning tutorials, applications and science domains using HTCSS. We hope to see you next year!

Simulated image of Sagittarius A* black hole. Image library credit: EHT Theory Working Group, CK Chan.

High-throughput computing as an enabler of black hole science

The stunning new image of a supermassive black hole in the center of the Milky Way was created by eight telescopes, 300 international astronomers and more than 5 million computational tasks. This Morgridge Institute article describes how the Wisconsin-based Open Science Pool helped make sense of it all.

Map of Africa; Mali and Uganda are highlighted where their respective flags point. Image credit: © 2010 Roland Urbanek. Flags are edited in and overlayed on the image.

NIAID/ACE - OSG collaboration leads to a successful virtual training session

The U.S. National Institute of Allergy and Infectious Diseases (NIAID) and the African Centers for Excellence in Bioinformatics and Data-Intensive Science (ACE) partnered with the OSG Consortium to host a virtual high throughput computing training session for graduate students from Makerere University and the University Of Sciences, Techniques, and Technologies of Bamako (USTTB).

An aerial view of Jefferson Lab. Photo courtesy of Jefferson Lab.

Expanding, uniting, and enhancing CLAS12 computing with OSG’s fabric of services

A mutually beneficial partnership between Jefferson Lab and the OSG Consortium at both the organizational and individual levels has delivered a prolific impact for the CLAS12 Experiment.

The GRIFFIN Spectrometer. (Image credit: Kirk Chantraine, TRIUMF Photowalk 2018).

Learning and adapting with OSG: Investigating the strong nuclear force

David Swanson Memorial Award winner, Connor Natzke’s journey with the OSG Consortium began in 2019 as a student of the OSG User School. Today, nearly three years later, Natzke has executed 600,000 simulations with the help of OSG staff and prior OSG programming. These simulations, each of them submitted as a job, logged over 135,000 core hours provided by the Open Science Pool (OSPool). Natzke’s history with the OSG Consortium reflects a pattern of learning, adapting, and improving that translates to the acceleration and expansion of scientific discovery.

Connor Natzke awarded David Swanson Memorial Award

Connor Natzke was awarded the 2022 David Swanson Memorial Award at the March OSG All-Hands Meeting. The memorial was established to honor our late colleage David Swanson who contributed to campus research across the country.

Celebrating a dynamic OSG All-Hands Meeting 2022

In March, 251 OSG users, resource providers, and staff convened virtually for the OSG All-Hands Meeting 2022. This article provides a brief summary of the talks and discussions that took place, and includes links to the video recordings of all talks.

Cows Feeding with machine Learning overlay

Machine Learning and Image Analyses for Livestock Data

In this presentation from HTCondor Week 2021, Joao Dorea from the Digital Livestock Lab explains how high-throughput computing is used in the field of animal and dairy sciences.

Gaylen Fronk Headshot

Harnessing HTC-enabled precision mental health to capture the complexity of smoking cessation

Collaborating with CHTC research computing facilitation staff, UW-Madison researcher Gaylen Fronk is using HTC to improve cigarette cessation treatments by accounting for the complex differences among patients.

Satellite image collage graphic

Protecting ecosystems with HTC

Researchers at the USGS are using HTC to pinpoint potential invasive species for the United States.

Ariadna looking over bats in a case

80,000 jobs, 40 billion base pairs, and 20 bats –– all in 4 weeks

An evolutionary biologist at the AMNH used HTC services provided by the OSG to unlock a genomic basis for convergent evolution in bats.

Newspaper Spread

Centuries of newspapers are now easily searchable thanks to HTCSS

BAnQ’s digital collections team recently used HTCSS to tackle their largest computational endeavor yet –– completing text recognition on all newspapers in their digital archives.

Hero Image for Morgridge Article Courtesy of Morgridge

Resilience: How COVID-19 challenged the scientific world

In the face of the pandemic, scientists needed to adapt. This article by the Morgridge Institute for Research provides a thoughtful look into how individuals and organizations, including the CHTC, have pivoted in these challenging times.

Image of Chemistry instrument

Scaling virtual screening to ultra-large virtual chemical libraries

Kicking off the OSG User School Showcase, Spencer Ericksen, a researcher at the University of Wisconsin-Madison’s Carbone Cancer Center, described how high throughput computing (HTC) has made his work in early-stage drug discovery infinitely more scalable.

OSG Virtual School 2021 Logo

Transforming research with high throughput computing

During the OSG Virtual School Showcase, three different researchers shared how high throughput computing has made lasting impacts on their work.

Brain Model

Using HTC for a simulation study on cross-validation for model evaluation in psychological science

During the OSG School Showcase, Hannah Moshontz, a postdoctoral fellow at UW-Madison’s Department of Psychology, described her experience of using high throughput computing (HTC) for the very first time, when taking on an entirely new project within the field of psychology.

Proton-proton collision

Antimatter: Using HTC to study very rare processes

Anirvan Shukla, a User School participant in 2016, spoke at this year’s Showcase about how high throughput computing has transformed his research of antimatter in the last five years.

Campus Cyberinfrastructure (CC*) Awardees Contribute Over 349 Million Core Hours in Last 12 Months

Campus Cyberinfrastructure Award Recipients Power the OSG and contributed over 349 million core hours to researchers using distributed high throughput computing (dHTC).

Nebraska standing at graduation

OSG fuels a student-developed computing platform to advance RNA nanomachines

How undergraduates at the University of Nebraska-Lincoln developed a science gateway that enables researchers to build RNA nanomachines for therapeutic, engineering, and basic science applications.

Graph showing upward trend of OSG core usage

OSPool Usage Hits Daily Record

Researchers utilizing the OSPool are racking up record-breaking numbers. On June 8, the OSPool, which provides computing resources to researchers across the country, went over 1.1 million core hours –– a daily record number. To put this in perspective, one million core hours is equivalent to using 42 thousand cores in just one day. That is close to half the size of some large supercomputing centers. In short, an increasing number of researchers are utilizing the OSG to carry out an incredible amount of computing.

How to Transfer 460 Terabytes? A File Transfer Case Study

When Greg Daues at the National Center for Supercomputing Applications (NCSA) needed to transfer 460 Terabytes of NCSA files from the National Institute of Nuclear and Particle Physics (IN2P3) in Lyon, France to Urbana, Illinois, for a project they were working with FNAL, CC-IN2P3 and the Rubin Data Production team, he turned to the HTCondor High Throughput system, not to run computationally intensive jobs, as many do, but to manage the hundreds of thousands of I/O bound transfers.

Register Now for the February 8-9 Campus Workshop

Save the date and register now for another Campus Workshop on distributed high-throughput computing (dHTC) February 8-9 offered by the Parternship to Advance Throughput Computing (PATh).

Submit Locally, Run Globally

The PATh project offers technologies and services that enable researchers to harness through a single interface, and from the comfort of their “home directory”, computing capacity offered by a global and diverse collection of resources.

High Throughput Computing Powers Covid Genetic Sequencing

MADISON - David O’Connor, professor at the UW School of Medicine and Public Health, reports that recent advances in genetic sequencing of viruses makes it possible to track the spread of SARS-CoV-2 throughout communities in Wisconsin.

National Science Foundation establishes a partnership to advance throughput computing

MADISON — Recognizing the University of Wisconsin-Madison’s leadership role in research computing, the National Science Foundation announced this month that the Madison campus will be home to a five-year, $22.5 million initiative to advance high-throughput computing.

High Throughput Computing in Support of Science

The high throughput computing capabilities provided by HTCondor and the OSG Consortium’s Fabric of Services have a rich history of advancing all domains of research. From detecting gravitational waves caused by ancient black hole collisions, to hunting viral variants of COVID-19 –– browse the collection of articles below to discover just what’s possible with high throughput computing.