XSEDE16 has ended
Back To Schedule
Tuesday, July 19 • 11:00am - 11:30am
TECH: User Managed Virtual Clusters in Comet

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Hardware virtualization has been gaining a significant share of computing timein the last years. Using virtual machines (VMs) for parallel computing is anattractive option for many users. A VM gives users a freedom of choosing anoperating system, software stack and security policies, leaving the physicalhardware, OS management, and billing to physical cluster administrators. Thewell-known solutions for cloud computing, both commercial (Amazon Cloud, GoogleCloud, Yahoo Cloud, etc.) and open-source (OpenStack, Eucalyptus) provideplatforms for running a single VM or a group of VMs. With all the benefits,there are also some drawbacks, which include reduced performance when runningcode inside of a VM, increased complexity of cluster management, as well as theneed to learn new tools and protocols to manage the clusters.
At SDSC, we have created a novel framework and infrastructure by providing virtualHPC clusters to projects using the NSF sponsored Comet supercomputer.Managing virtual clusters on Comet is similar to managing a bare-metal cluster in terms of processes and tools that are employed. This is beneficial becausesuch processes and tools are familiar to cluster administrators. Unlikeplatforms like AWS, Comet's virtualization capability supportsinstalling VMs from ISOs (i.e., a CD-ROM or DVD image) or via an isolatedmanagement VLAN (PXE). At the same time, we're helping projects take advantageof VMs by providing an enhanced client tool for interaction with our managementsystem called Cloudmesh client. Cloudmesh client can also be used to managevirtual machines on OpenStack, AWS, and Azure.

Tuesday July 19, 2016 11:00am - 11:30am EDT
Sevilla InterContinental Miami