Multi-infrastructure workflow execution for medical simulation in the Virtual Imaging Platform

Rafael FERREIRA DA SILVA, Sorina CAMARASU-POP, Baptiste GRENIER, Vanessa HAMAR, David MANSET, Johan MONTAGNAT, Jérôme REVILLARD, Javier ROJAS BALDERRAMA, Andrei TSAREGORODTSEV, Tristan GLATARD

 

This paper presents the architecture of the Virtual Imaging Platform supporting the execution of medical image simulation workflows on multiple computing infrastructures. The system relies on the MOTEUR engine for workflow execution and on the DIRAC pilot-job system for workload management. The jGASW code wrapper is extended to describe applications running on multiple infrastructures and a DIRAC cluster agent that can securely involve personal cluster resources with no administrator intervention is proposed. Grid data management is complemented with local storage used as a failover in case of file transfer errors. Between November 2010 and April 2011 the platform was used by 10 users to run 484 workflow instances representing 10.8 CPU years. Tests show that a small personal cluster can significantly contribute to a simulation running on EGI and that the improved data manager can decrease the job failure rate from 7.7% to 1.5%.

 

Proceedings of the HealthGrid 2011 Conference, Bristol, England. 2011

 

http://www.creatis.insa-lyon.fr/site/en/publications/FERR-11