Supercomputer Helps Protect Earth From Space Storms


Toth helped develop today’s preeminent space weather prediction model, which is used for operational forecasting by the National Oceanic and Atmospheric Administration (NOAA). On February 3, 2021, NOAA began using the Geospace Model Version 2.0, which is part of the University of Michigan’s Space Weather Modeling Framework, to predict geomagnetic disturbances.

“We’re constantly improving our models,” Toth said. The new model replaces version 1.5 which has been in operations since November 2017. “The main change in version 2 was the refinement of the numerical grid in the magnetosphere, several improvements in the algorithms, and a recalibration of the empirical parameters.”

The Geospace Model is based on a global representation of Earth’s Geospace environment that includes magnetohydrodynamics — the properties and behavior of electrically conducting fluids like plasma interacting with magnetic fields, which plays a key role in the dynamics of space weather.

The Geospace model predicts magnetic disturbances on the ground resulting from geospace interactions with solar wind. Such magnetic disturbances induce a geoelectric field that can damage large-scale electrical conductors, such as the power grid.

Short-term advanced warning from the model provides forecasters and power grid operators with situational awareness about harmful currents and allows time to mitigate the problem and maintain the integrity of the electric power grid, NOAA announced at the time of the launch.

As advanced as the Geospace Model is, it provides only about 30 minutes of advanced warning. Toth’s team is one of several groups working to increase lead time to one to three days. Doing so means understanding how activity on the surface of the Sun leads to events that can impact the Earth.

“We’re currently using data from a satellite measuring plasma parameters one million miles away from the Earth,” Toth explained. Researchers hope to start from the Sun, using remote observation of the Sun’s surface — in particular, coronal mass ejections that produce flares that are visible in X-rays and UV light. “That happens early on the Sun. From that point, we can run a model and predict the arrival time and impact of magnetic events.”

Improving the lead time of space weather forecasts requires new methods and algorithms that can compute far faster than those used today and can be deployed efficiently on high performance computers. Toth uses the Frontera supercomputer at the Texas Advanced Computing Center — the fastest academic system in the world and the 10th most powerful overall — to develop and test these new methods.

“I consider myself really good at developing new algorithms,” Toth said. “I apply these to space physics, but many of the algorithms I develop are more general and not restricted to one application.”

A key algorithmic improvement made by Toth involved finding a novel way to combine the kinetic and fluid aspects of plasmas in one simulation model. “People tried it before and failed. But we made it work. We go a million times faster than brute-force simulations by inventing smart approximations and algorithms,” Toth said.

The new algorithm dynamically adapts the location covered by the kinetic model based on the simulation results. The model identifies the regions of interests and places the kinetic model and the computational resources to focus on them. This can result in a 10 to 100 time speed up for space weather models.

As part of the NSF SWQU project, Toth and his team has been working on making the Space Weather Modeling Framework run efficiently on future supercomputers that rely heavily on graphical processing units (GPUs). As a first goal, they set out to port the Geospace model to GPUs using the NVIDIA Fortran compiler with OpenACC directives.

They recently managed to run the full Geospace model faster than real-time on a single GPU. They used TACC’s GPU-enabled Longhorn machine to reach this milestone. To run the model with the same speed on traditional supercomputer requires at least 100 CPU cores.

“It took a whole year of code development to make this happen, Toth said. “The goal is to run an ensemble of simulations fast and efficiently to provide a probabilistic space weather forecast.”

This type of probabilistic forecasting is important for another aspect of Toth’s research: localizing predictions in terms of the impact on the surface of Earth.

“Should we worry in Michigan or only in Canada? What is the maximum induced current particular transformers will experience? How long will generators need to be shut off? To do this accurately, you need a model you believe in,” he said. “Whatever we predict, there’s always some uncertainty. We want to give predictions with precise probabilities, similar to terrestrial weather forecasts.”

Toth and his team run their code in parallel on thousands of cores on Frontera for each simulation. They plan to run thousands of simulations over the coming years to see how model parameters affect the results to find the best model parameters and to be able to attach probabilities to simulation results.

“Without Frontera, I don’t think we could do this research,” Toth said. “When you put together smart people and big computers, great things can happen.”

More news

Related News