2023 European HTCondor Workshop May 23, 2023
We are very pleased to announce that the 2023 European HTCondor Workshop will be held from Tuesday 19th September to Friday 22nd September, at IJCLab in Orsay, France.
News Articles
Construction Commences on CHTC's Future Home in New CDIS Building April 27, 2023
On April 25th, UW-Madison broke ground on the new School of Computer, Data & Information Sciences and CHTC’s new home.
OSPool As a Tool for Advancing Research in Computational Chemistry April 25, 2023
Assistant Professor Eric Jonas uses OSG resources to understand the structure of molecules based on their measurements and derived properties.
Get To Know Student Communications Specialist Hannah Cheren April 24, 2023
During her two year tenure with the Morgridge Institute for Research - Research Computing lab, Hannah Cheren made significant science writing contributions and along the way changed the direction of her life.
The CHTC Philosophy of High Throughput Computing – A Talk by Greg Thain April 24, 2023
HTCondor Core Developer Greg Thain spoke to UW faculty and researchers about research computing and the missions and goals of the Center for High Throughput Computing (CHTC).
Distributed Computing at the African School of Physics 2022 Workshop April 24, 2023
Over 50 students chose to participate in a distributed computing workshop from the 7th biennial African School of Physics (ASP) 2022 at Nelson Mandela University in Gqeberha, South Africa.
Google Quantum Computing Utilizing HTCondor March 01, 2023
Google’s launch of a Quantum Virtual Machine emulates the experience and results of programming one of Google’s quantum computers, managed by an HTCondor system running in Google Cloud.
Get To Know Todd Tannenbaum January 23, 2023
Staff profile of the HTCSS Software Lead, Todd Tannenbaum.
Empowering Computational Materials Science Research using HTC January 20, 2023
Ajay Annamareddy, a research scientist at the University of Wisconsin-Madison, describes how he utilizes high-throughput computing in computational materials science.
CHTC Leads High Throughput Computing Demonstrations January 20, 2023
Students and researchers acquire high-throughput computing knowhow from CHTC led demonstrations.
OSPool's Growing Number of Cores Reaching New Levels December 19, 2022
Campuses contributing to the capacity of the OSPool led to record breaking number of cores this December, 2022. On December 9th, the OSPool, which provides computing resources to researchers across the country, crossed the 70,000 cores line –– for the very first time.
OSG User School 2022 Researchers Present Inspirational Lightning Talks December 19, 2022
The OSG User School student lightning talks showcased their research, inspiring all the event participants.
CHTC Facilitation Innovations for Research Computing December 14, 2022
After adding Research Computing Facilitators in 2013-2014, CHTC has expanded its reach to support researchers in all disciplines interested in using large-scale computing to support their research through the shared computing capacity offered by the CHTC.
High-throughput computing: Fostering data science without limits December 06, 2022
The Center for High-Throughput Computing (CHTC), a joint partnership of UW-Madison School of Computer, Data & Information Sciences and the Morgridge Institute, sees this onslaught of data and says: Bring it on.
UW–Madison's Icecube Neutrino Observatory Wins HPCwire Award November 16, 2022
The UW-Madison Center for High Throughput Computing’s (CHTC) collaboration with the San Diego Supercomputer Center on the IceCube Neutrino Observatory received recognition with the HPCwire 2022 Readers’ Choice Award for Best Use of High Performance Computing (HPC) in the Cloud (Use Case).
Over 240,000 CHTC Jobs Hit Record Daily Capacity Consumption November 09, 2022
The Center for High Throughput (CHTC) users continue to be hard at work smashing records with high throughput computational workloads. On October 20th, more than 240,000 jobs completed that day, reporting a total consumption of more than 710,000 core hours. This is equivalent to the capacity of 30,000 cores running non-stop for 24 hours.
PATh Extends Access to Diverse Set of High Throughout Computing Research Programs November 03, 2022
UCSD announces the new PATh Facility and discusses its impact on science.
Solving for the future: Investment, new coalition levels up research computing infrastructure at UW–Madison September 27, 2022
Summary of Corissa Runde’s article from the UW-Madison Department of Information Technology website.
NIAID/ACE students attend this year’s OSG User School 2022 September 09, 2022
This past July, the OSG User School 2022 welcomed students from across the globe to learn how to use high-throughput computing (HTC) in their scientific research. This year five students from Makerere University in Uganda and the University Of Sciences, Techniques, and Technologies of Bamako in Mali, Africa, participated as a part of The U.S. National Institute of Allergy and Infectious Diseases (NIAID) and the African Centers for Excellence in Bioinformatics and Data-Intensive Science (ACE) partnership program.
OSG User School Concludes July 29, 2022
After a week of participating in the OSG User School 60+ students are being released to use impact research across the globe. In this one week event, students learn to run large-scale computing workloads at their campus or using the national-scale OSPool provided by the OSG Consortium.
LIGO's Search for Gravitational Waves Signals Using HTCondor July 21, 2022
Cody Messick, a Postdoc at the Massachusetts Institute of Technology (MIT) working for the LIGO lab, describes LIGO’s use of HTCondor to search for new gravitational wave sources.
Retirements and New Beginnings: The Transition to Tokens July 21, 2022
May 1, 2022 officially marked the retirement of OSG 3.5, GridFTP, and GSI dependencies. OSG 3.6, up and running since February of 2021, is prepared for usage and took its place, relying on WebDAV and bearer tokens.
The Future of Radio Astronomy Using High Throughput Computing July 12, 2022
Eric Wilcots, UW-Madison dean of the College of Letters & Science and the Mary C. Jacoby Professor of Astronomy, dazzles the HTCondor Week 2022 audience.
Expediting Nuclear Forensics and Security Using High Throughput Computing July 06, 2022
Arrielle C. Opotowsky, a 2021 Ph.D. graduate from the University of Wisconsin-Madison’s Department of Engineering Physics, describes how she utilized high throughput computing to expedite nuclear forensics investigations.
Testing GPU/ML Framework Compatibility July 06, 2022
Justin Hiemstra, a Machine Learning Application Specialist for CHTC’s GPU Lab, discusses the testing suite developed to test CHTC’s support for GPU and ML framework compatibility.
UW Statistics Course using HTC July 06, 2022
For the first time, UW Statistics undergraduates could participate in a course teaching high throughput computing (HTC). John Gillett, lecturer of Statistics at the University of Wisconsin-Madison, designed and taught the course with the support of the Center for High Throughput Computing (CHTC).
Using HTC and HPC Applications to Track the Dispersal of Spruce Budworm Moths July 06, 2022
Matthew Garcia, a Postdoctoral Research Associate in the Department of Forest & Wildlife Ecology at the University of Wisconsin–Madison, discusses how he used the HTCondor Software Suite to combine HTC and HPC capacity to perform simulations that modeled the dispersal of budworm moths.
Using high throughput computing to investigate the role of neural oscillations in visual working memory July 06, 2022
Jacqueline M. Fulvio, lab manager and research scientist for the Postle Lab at the University of Wisconsin-Madison, explains how she used the HTCondor Software Suite to investigate neural oscillations in visual working memory.
OSPool Hits Record Number of Jobs June 02, 2022
The OSPool processed over 2.6 million jobs during the week of April 14th - 17th this year and ran over half a million jobs on two separate days that week.
Introducing the PATh Facility: A Unique Distributed High Throughput Computing Service June 01, 2022
Researchers can now request credits on the PATh Facility, the PATh project’s new service intended for distributed high throughput computing workflows supporting NSF science.
The role of HTC in advancing population genetics research June 01, 2022
Postdoctoral researcher Parul Johri uses OSG services, the HTCondor Software Suite, and the population genetics simulation program SLiM to investigate historical patterns of genetic variation.
A Long-Awaited Reunion: HTCondor Week 2022 in Photos June 01, 2022
HTCondor Week 2022 featured over 40 exciting talks, tutorials, and research spotlights focused on the HTCondor Software Suite (HTCSS). Sixty-three attendees reunited in Madison, Wisconsin for the long-awaited in-person meeting, and 111 followed the action virtually on Zoom.
HTCondor Week 2022 Concludes May 27, 2022
Thank you to all in-person and virtual participants in HTCondor Week 2022. Over the course of the event we had over 40 talks spanning tutorials, applications and science domains using HTCSS. We hope to see you next year!
High-throughput computing as an enabler of black hole science May 12, 2022
The stunning new image of a supermassive black hole in the center of the Milky Way was created by eight telescopes, 300 international astronomers and more than 5 million computational tasks. This Morgridge Institute article describes how the Wisconsin-based Open Science Pool helped make sense of it all.
NIAID/ACE - OSG collaboration leads to a successful virtual training session May 02, 2022
The U.S. National Institute of Allergy and Infectious Diseases (NIAID) and the African Centers for Excellence in Bioinformatics and Data-Intensive Science (ACE) partnered with the OSG Consortium to host a virtual high throughput computing training session for graduate students from Makerere University and the University Of Sciences, Techniques, and Technologies of Bamako (USTTB).
Expanding, uniting, and enhancing CLAS12 computing with OSG’s fabric of services May 02, 2022
A mutually beneficial partnership between Jefferson Lab and the OSG Consortium at both the organizational and individual levels has delivered a prolific impact for the CLAS12 Experiment.
Learning and adapting with OSG: Investigating the strong nuclear force April 25, 2022
David Swanson Memorial Award winner, Connor Natzke’s journey with the OSG Consortium began in 2019 as a student of the OSG User School. Today, nearly three years later, Natzke has executed 600,000 simulations with the help of OSG staff and prior OSG programming. These simulations, each of them submitted as a job, logged over 135,000 core hours provided by the Open Science Pool (OSPool). Natzke’s history with the OSG Consortium reflects a pattern of learning, adapting, and improving that translates to the acceleration and expansion of scientific discovery.
Connor Natzke awarded David Swanson Memorial Award April 11, 2022
Connor Natzke was awarded the 2022 David Swanson Memorial Award at the March OSG All-Hands Meeting. The memorial was established to honor our late colleage David Swanson who contributed to campus research across the country.
Celebrating a dynamic OSG All-Hands Meeting 2022 April 11, 2022
In March, 251 OSG users, resource providers, and staff convened virtually for the OSG All-Hands Meeting 2022. This article provides a brief summary of the talks and discussions that took place, and includes links to the video recordings of all talks.
Machine Learning and Image Analyses for Livestock Data February 22, 2022
In this presentation from HTCondor Week 2021, Joao Dorea from the Digital Livestock Lab explains how high-throughput computing is used in the field of animal and dairy sciences.
Harnessing HTC-enabled precision mental health to capture the complexity of smoking cessation December 16, 2021
Collaborating with CHTC research computing facilitation staff, UW-Madison researcher Gaylen Fronk is using HTC to improve cigarette cessation treatments by accounting for the complex differences among patients.
Protecting ecosystems with HTC November 09, 2021
Researchers at the USGS are using HTC to pinpoint potential invasive species for the United States.
80,000 jobs, 40 billion base pairs, and 20 bats –– all in 4 weeks October 26, 2021
An evolutionary biologist at the AMNH used HTC services provided by the OSG to unlock a genomic basis for convergent evolution in bats.
Centuries of newspapers are now easily searchable thanks to HTCSS October 26, 2021
BAnQ’s digital collections team recently used HTCSS to tackle their largest computational endeavor yet –– completing text recognition on all newspapers in their digital archives.
Resilience: How COVID-19 challenged the scientific world September 23, 2021
In the face of the pandemic, scientists needed to adapt. This article by the Morgridge Institute for Research provides a thoughtful look into how individuals and organizations, including the CHTC, have pivoted in these challenging times.
Scaling virtual screening to ultra-large virtual chemical libraries August 19, 2021
Kicking off the OSG User School Showcase, Spencer Ericksen, a researcher at the University of Wisconsin-Madison’s Carbone Cancer Center, described how high throughput computing (HTC) has made his work in early-stage drug discovery infinitely more scalable.
Transforming research with high throughput computing August 19, 2021
During the OSG Virtual School Showcase, three different researchers shared how high throughput computing has made lasting impacts on their work.
Using HTC for a simulation study on cross-validation for model evaluation in psychological science August 19, 2021
During the OSG School Showcase, Hannah Moshontz, a postdoctoral fellow at UW-Madison’s Department of Psychology, described her experience of using high throughput computing (HTC) for the very first time, when taking on an entirely new project within the field of psychology.
Antimatter: Using HTC to study very rare processes August 19, 2021
Anirvan Shukla, a User School participant in 2016, spoke at this year’s Showcase about how high throughput computing has transformed his research of antimatter in the last five years.
Campus Cyberinfrastructure (CC*) Awardees Contribute Over 349 Million Core Hours in Last 12 Months August 12, 2021
Campus Cyberinfrastructure Award Recipients Power the OSG and contributed over 349 million core hours to researchers using distributed high throughput computing (dHTC).
OSG fuels a student-developed computing platform to advance RNA nanomachines August 10, 2021
How undergraduates at the University of Nebraska-Lincoln developed a science gateway that enables researchers to build RNA nanomachines for therapeutic, engineering, and basic science applications.
OSPool Usage Hits Daily Record June 10, 2021
Researchers utilizing the OSPool are racking up record-breaking numbers. On June 8, the OSPool, which provides computing resources to researchers across the country, went over 1.1 million core hours –– a daily record number. To put this in perspective, one million core hours is equivalent to using 42 thousand cores in just one day. That is close to half the size of some large supercomputing centers. In short, an increasing number of researchers are utilizing the OSG to carry out an incredible amount of computing.
How to Transfer 460 Terabytes? A File Transfer Case Study January 15, 2021
When Greg Daues at the National Center for Supercomputing Applications (NCSA) needed to transfer 460 Terabytes of NCSA files from the National Institute of Nuclear and Particle Physics (IN2P3) in Lyon, France to Urbana, Illinois, for a project they were working with FNAL, CC-IN2P3 and the Rubin Data Production team, he turned to the HTCondor High Throughput system, not to run computationally intensive jobs, as many do, but to manage the hundreds of thousands of I/O bound transfers.
Register Now for the February 8-9 Campus Workshop December 18, 2020
Save the date and register now for another Campus Workshop on distributed high-throughput computing (dHTC) February 8-9 offered by the Parternship to Advance Throughput Computing (PATh).
Submit Locally, Run Globally December 07, 2020
The PATh project offers technologies and services that enable researchers to harness through a single interface, and from the comfort of their “home directory”, computing capacity offered by a global and diverse collection of resources.
High Throughput Computing Powers Covid Genetic Sequencing November 18, 2020
MADISON - David O’Connor, professor at the UW School of Medicine and Public Health, reports that recent advances in genetic sequencing of viruses makes it possible to track the spread of SARS-CoV-2 throughout communities in Wisconsin.
National Science Foundation establishes a partnership to advance throughput computing October 10, 2020
MADISON — Recognizing the University of Wisconsin-Madison’s leadership role in research computing, the National Science Foundation announced this month that the Madison campus will be home to a five-year, $22.5 million initiative to advance high-throughput computing.
High Throughput Computing in Support of Science
The high throughput computing capabilities provided by HTCondor and the OSG Consortium’s Fabric of Services have a rich history of advancing all domains of research. From detecting gravitational waves caused by ancient black hole collisions, to hunting viral variants of COVID-19 –– browse the collection of articles below to discover just what’s possible with high throughput computing.
