SMBL and Blast Joe Rinkovsky Unix Systems Support Group Indiana University Introduction
IU has around 2000 Windows PCs in public Student Technology Centers Condor is used to harvest unused cycles Simple Message Brokering Library(SMBL) used for parallelizing applications on Windows Web portal for user interaction Project History
[email protected] Was used as initial test of Condor SMBL was created to address the lack of a general purpose parallel library on Windows that could tolerate sporadically available systems FastDNAml was ported to SMBL Web portal created Other apps ported to SMBL(MEME,BLAST) System Architecture
Condor server running on Linux BLAST databases served via Samba on a second Linux machine Apache/MySQL/PHP web portal Windows clients What is SMBL?
Simple Message Brokering Library Open Source(http://smbl.sf.net) Uses master / worker model Process and Port Manager(PPM) manages SMBL servers and master processes Number of master /foreman processes is different for each application
SMBL workers contact the SMBL master to get work SMBL server terminates workers when they are no longer needed Condor and SMBL
Condor is used as the scheduling and delivery system for SMBL workers SMBL workers contact the SMBL server when they start running to begin receiving work. SMBL server seperates the work to be into smaller pieces depending on the number of workers Work is redistributed if a worker is lost SMBL server terminates workers when there is no work left Applications using SMBL
FastDNAml Generates phylogenic trees from molecular data MEME Detects patterns in nucleotide and protein sequences NCBI BLAST(blastall) Query molecular sequences against sequence databases The Challenges of porting BLAST to SMBL
BLAST relies on the availability of large database files Files too large for efficient delivery via Condor Local copies of databases on pool machines would be difficult to manage Sharing DB files via Samba is the best solution Samba was moved to a seperate server to increase perfomance
The Challenges of porting BLAST to SMBL(cont.) BLAST jobs take more time to complete than FastDNAml and MEME Dissapearing
worker problem Pool machines would end up in CLAIMED/IDLE state Size of our Condor pool made the problem hard to track Only jobs taking more than 30 minutes were affected Problem was determined to be state table sessions timing out on the machine room firewall. Machines were removed from firewall and switched to host-based iptables firewall.
Web portal Apache/MySQL/PHP based Jobs are submitted via portal ONLY Condor submit files are dynamically generated based on user input
Status of jobs can be checked using the portal Results retrieved from the portal Questions?
Chain of Productions and Channels of Distribution. We will look at: Revision of Chain of Production. Samples of Chain of Production. Primary/Secondary/Tertiary Activities
The dispatcher states the patient is female and out of the vehicle. Upon your arrival, you can see the vehicle overturned in the median and a group gathered around what appears to be your patient. A State trooper meets with...
NFHS Volleyball Rules Changes 2012-13. Rule 4-2-2 new NOTE: ... It has become increasingly difficult to discern the libero's legality when playing the ball when he/she cannot be easily identified apart from the teammates due to multi-colored uniform tops. ......
Three factors determine stability of joints to prevent dislocations: Shape of articularsurface (minor role) Shallow surfaces less stable than ball-and-socket. Ligament number and location (limited role) The more ligaments, the stronger the joint. Muscletone keeps tendons taut as they cross...
Cells classified by what "turns them on" receptive field properties of cells M cells a) project to Magnocellular layers of LGN b) dominant in DORSAL/WHERE stream c) also go to SC d) fast conducting, colorblind, low acuity P cells a)...
Suspension of work/stop work notices. Standard form 30, block 13D applies. Cite the appropriate contract clause as authority. Unilateral Modifications Cont. Bilateral/ Supplemental Mods. Commercial Modification (Continued) IAW 52.212-4 (c) Changes. "Changes in the terms and conditions of this ...
Download Presentation
Ready to download the document? Go ahead and hit continue!
