Operating system issues and HiPerGator - University of Florida

Operating system issues and HiPerGator - University of Florida

Operating system issues and HiPerGator Erik Deumens Director Research Computing Information Technology University of Florida Contents UF infrastructure for data and computing Operating system issues

Base OS: Linux and Windows Virtual machines - KVM Scheduler Security, authentication, authorization Applications management Storage Restricted data Portals Web services

UF Information Technology mission Provide high- Data Center Opened Jan 2013 Florida Lambda Rail

per second 2015 100 Gigabit Internet2 2013 100 Gigabit per second in

HiPerGator supercomputer cores in 2013 16,000 Expansion 50,000 cores in 2016 Base OS

RedHat Enterprise Linux 6 1,900 nodes strongly interconnected OS consistency is crucial -> Automation configuration and change Foreman Puppet Virtual machines KVM Some projects and applications require Windows OS Some projects require kernel modifications

-> Virtual machines New this summer Run VMs using KVM libvirt with RHEL as host Like applications Run next to native RHEL applications for HPC and HTC UF Apps for Research: ready to go cloud apps Scheduler Moab -> Slurm

Login nodes Interactive nodes GUI nodes Work nodes Run jobs batch Scheduler matches available nodes expected times Requested resources: nr cores, RAM core configuration

Nr core per node shared RAM Nr nodes distributed RAM interconnect causes delays Security, authentication, authorization GatorLink identity UF policy Shibboleth authentication

Authorization by LDAP server UID GID Group membership Application management Many applications Avoid every having their own copy Manage with module Set path and other environment variables

We provide Latest version Current stable version Last version So that people do not have to upgrade at the same time Storage

High performance Parallel Random access from many nodes and cores 21,000 processes now 51,000 soon when expansion is in full use Lustre file system Hierarchical infrastructure Move files by policy to slower and cheaper disks Integrate SSDs for fast portion

Restricted data Whole new world Guarantee confidentiality to be compliant with Federal State Regulations and laws on special data ePHI electronic Protected Health Information (HIPAA) Export control ITAR/EAR

General new rule 2016 Controlled Unclassified Information (CUI) Portals & web services Researcher projects now need live data as result Accessible from web

Through the portal With some form of authentication Users can run programs, algorithms, databases On HiPerGator Users can upload their data

Compare with available data Run published algorithms on it Without having to install the published software first To use it and verify the inventors claims Questions?

Recently Viewed Presentations

  • Intraoral Radiographs - Yola

    Intraoral Radiographs - Yola

    Instead, a bisecting angle technique is used resulting in a 20-50 degree angulation of the x-ray beam to the film plane, depending on which tooth is radiographed Rules for Successful Positioning The closer the object being radiographed is to the...
  • vadas  kokybinius tyrimus Kas tai yra Imties formavimas

    vadas kokybinius tyrimus Kas tai yra Imties formavimas

    Thus the charting process involves a considerable amount of abstraction and synthesis Mapping and interpretation—using the charts to define concepts, map the range and nature of phenomena, create typologies and find associations between themes with a view to providing explanations...
  • Introduction Characteristics of USB Introduction System Model Characteristics

    Introduction Characteristics of USB Introduction System Model Characteristics

    USB System Model What needs to be done Platform Issues Conceptual Issues Timeline USB Monitoring David Harding Characteristics of USB (1.1 specification) Up to 127 devices on one Bus Hierarchical structure with hubs Up to 12Mbps bandwidth (greater in 2.0)...
  • Using Tables, Charts, and Diagrams

    Using Tables, Charts, and Diagrams

    from the chart, click cell . A1, and then drag the arrow in the lower-right corner of cell . D5. to the left. Release it when cells . A1:C5. are surrounded by a heavy blue border. In the PowerPoint window,...
  • 2-nd International Conference on Oxide and Non-Oxide Materials

    2-nd International Conference on Oxide and Non-Oxide Materials

    University of chemical technology and metallurgy Abstract 2-nd International Conference on Oxide and Non-Oxide Materials for Optoelectronics Our study concerns about these two glassy systems, (GeTe5)100-xInx and (GeSe5)100-xInx, which contain different chalcogen elements.
  • ATSSA Update AASHTO Standing Committee on Highway Traffic

    ATSSA Update AASHTO Standing Committee on Highway Traffic

    Work Zone Safety App. Quickly. determine both minimum device spacing & minimum # of devices needed for merging, shifting, shoulder, or flagger operations. Calculate. the number of devices you need. Customize. your results to incorporate local standards.
  • Measuring the Benefits of the Advanced Technology Program

    Measuring the Benefits of the Advanced Technology Program

    Measure Against Mission Timeline: What We Measure When Evaluation Tools Business Reporting System Regular, systematic electronic surveys supplemented by telephone surveys Composite Performance Rating System Individual project/participant analysis and mini-case studies Portfolio-wide analysis In ...
  • The Peril and Promise of the Internet Within Mormonism

    The Peril and Promise of the Internet Within Mormonism

    The Peril and Promise of the Internet Within Mormonism ... Joseph Smith Superman) Social software Myspace and facebook Warnings against it ELGG 10 Interesting Dynamics Google Search Blogging Podcasting Video The growth MySpace & Facebook Podcast Reach Mormons and Masons...