XSEDE16 has ended
Back To Schedule
Wednesday, July 20 • 4:30pm - 5:00pm
TECH: A web interface for XALT log data analysis

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

XALT is a job-monitoring tool to collect accurate, detailed, and continuous job level and link-time data on all MPI jobs running on the computing cluster. Due to its usefulness and complementariness to existing logs and databases, XALT has been deployed on Stampede at Texas Advanced Computing Center and other high performance computing resources around the world. The data collected by XALT can be extremely valuable to help resource providers understanding resources usages and identify patterns and insights for future improvements. However, the volume of data collected by XALT grows quickly over time on large system and presents challenges for access and analysis. In this paper, we describe development of a prototype tool for analyze and visualize XALT data. The application utilizes Spark for processing the large volume of log data and Shiny for visualizing the results over the web. The application provides an easy to use interface for users to conveniently share and communicate executable usage and patterns without prerequisite knowledge on big data technology.

Wednesday July 20, 2016 4:30pm - 5:00pm EDT
Sevilla InterContinental Miami