Abstract
For the first time, an automatically triggered, between-pulse fusion science analysis code was run on-demand at a remotely located supercomputer at Argonne Leadership Computing Facility (ALCF, Lemont, Illinois) in support of in-process experiments being performed at DIII-D (San Diego, California). This represents a new paradigm for combining geographically distant experimental and high-performance computing facilities to provide enhanced data analysis that is quickly available to researchers. Enhanced analysis improves the understanding of the current pulse, translating into a more efficient use of experimental resources and quality of the resultant science. The analysis code used here, called SURFMN, calculates the magnetic structure of the plasma using Fourier transform. Increasing the number of Fourier components provides a more accurate determination of the stochastic boundary layer near the plasma edge by better resolving magnetic islands, but requires 26 min to complete using local DIII-D resources, putting it well outside the useful time range for between-pulse analysis. These islands relate to confinement and edge-localized mode suppression, and may be controlled by adjusting coil currents for the next pulse. ALCF has ensured on-demand execution of SURFMN by providing a reserved queue, a specialized service that launches the code after receiving an automatic trigger, and network access from the worker nodes for data transfer. Runs are executed on 252 cores of ALCF’s Cooley cluster and the data are available locally at DIII-D within 3 min of triggering. The original SURFMN design limits additional improvements with more cores; however, our work shows a path forward where codes that benefit from thousands of processors can run between pulses.
Acknowledgments
We would like to thank the organizers of the 2nd IAEA Technical Meeting on Fusion Data Processing, Validation, and Analysis for their hard work putting the conference together. We would also like to thank S. Flanagan for all of his assistance with MDSplus. This material is based upon work supported by the U.S. Department of Energy (DOE), Office of Science, Office of Fusion Energy Sciences, using the DIII-D National Fusion Facility, a DOE Office of Science User Facility, under awards DE-FC02-04ER54698 and DE-FG02-05ER54809. DIII-D data shown in this paper can be obtained in digital format by following the links at https://fusion.gat.com/global/D3D_DMP. This research used resources of the ALCF, which is a DOE Office of Science User Facility supported under contract DE-AC02-06CH11357.
Notes
a MPI official website: http://mpi-forum.org.
b MDSplus is a set of software tools for data acquisition and storage and a methodology for management of complex scientific data; http://www.mdsplus.org/index.php/Introduction.
c COBALT is a job scheduler that manages a queue of requested analysis jobs on the ALCF’s resources; https://www.alcf.anl.gov/cobalt-scheduler.