AMIGA : Wf4Ever - Preservation of scientific workflows

One of the current challenges in Astronomy is the efficient exploitation of the huge volume of data currently available. This efficiency is needed in

One of the current challenges in Astronomy is the efficient exploitation of the huge volume of data currently available. This efficiency is needed in order to ensure the prompt return of the big investments made in terms of facilities to obtain those data, something that clearly the traditional methods of analysis are not currently achieving. This is the reason why scientific workflows are becoming a need in Astronomy. The systematic capture of the scientific process into a digital Research Object (RO) enables researchers to create, re-use, and share the full methodology and agents of an experiment. The RO is a container of the lifecycle of an experiment, linking data, services and tools for their analysis, producing executable papers which go well beyond the pdf. This disruptive methodology reduces effort duplication and ensures repeatability of the discovery process, which finally leads to a complete change of paradigm in the way research is performed. Since December 2010, the AMIGA group is a participant in a EU FP7 funded project - Wf4Ever: Advanced Workflow Preservation Technologies for Enhanced Science - in order to contribute to the development of standards and models for the preservation of scientific workflows. Main goals Allow the methodology to be preserved and become re-usable by others. Increase the efficiency of the collaborative process in Astronomy. Contribute to the repeatability of the experiments, independently of their knowledge level. Ensure the reproducibility of the results, independently of the local working environment. Ease learning process for young researchers with organized and documented methodologies. Enable multiarchive/multifacility VO web-services-based workflows. Actions Develop models and ontologies for the semantic characterization of processesand integrate them into the VO. Creation of three representative Astronomy workflows. Handling of large data tables of physically interconnected parameters. Extractions of sources from digital surveys. Kinematical modeling of galaxies. Provide preservation of the Research Object to allow for re-use, sharing, repeatability, etc. of astronomy digital experiments. Upgrade of Taverna workflow managment tool to integrate VO services. Foster the use of collaborative web communities (MyExperiment) for publication, sharing, rating, etc. of ROs. Ellaboration of Research Object/Workflows for training. Astronomy is a collaborative science, but it has also become highly specialized, as many other disciplines. Scientific workflows will enable astronomers to greatly benefit from each other’s highly specialized know-how, they constitute a way to push Astronomy to share and publish not only results and data, but also processes and methodologies. Astronomers must hence be encouraged to document their methodology in a clear, concise and modular universal language. Golden Exemplar for a 3D Kinematical Modelling VO web-services-based scientific workflow At the start of this project most of the required individual infrastructures are either in place, or being developed with the goal of the interoperability of both data and methods through the Virtual Observatory initiative, although essentially no scientific workflows exist in Astronomy. Our first step step is to build a representative set of Golden Exemplars, and subsequently assemble all of the involved pieces through preserved scientific workflows. Participants Intelligent Software Components iSOCO University of Manchester Universidad Politécnica de Madrid Poznan Supercomputing and Networking Center Oxford e-Research Centre Instituto de Astrofísica de Andalucía - CSIC Leiden University Medical Centrer Publications Workflow-Centric Research Objects: A First Class Citizen in the Scholarly Discourse K. Belhajjame, O. Corcho, D. Garijo, J. Zhao, P. Missier, D. R. Newman, R. Palma, S. Bechhofer, E. Garcia Cuesta, J. M. Gomez-Perez, G. Klyne, K. Page, M. Roos, J. E. Ruiz, S. Soiland-Reyes, L. Verdes-Montenegro, D. De Roure and C. Goble. 2012. Proceedings of theSecond International Conference on the Future of Scholarly Communication and Scientific Publishing Sepublica2012. Scientific Workflows in Astronomy A. Schaaff, L. Verdes-Montenegro, J. E. Ruiz, J. D. Santander-Vela. 2012.Proceedings of the XXI ADASS Conference. Astronomical Society of the Pacific Conference Series. Towards the Preservation of Scientific Workflows David De Roure, Khalid Belhajjam, Paolo Missier, José Manuel Gómez-Pérez, Raúl Palma,José Enrique Ruiz, Kristina Hettne, Marco Roos, Graham Klyne and Carole Goble. 2011.iPRES2011 ConferencePapers Contributions. Presentations in Conferences --- These activities are funded under the EU 7th Framework Programme in the area of Digital Libraries and Digital Preservation. (ICT-2009.4.1) Project reference: 270192
 

Wf4Ever - Preservation of scientific workflows

One of the current challenges in Astronomy is the efficient exploitation of the huge volume of data currently available. This efficiency is needed in order to ensure the prompt return of the big investments made in terms of facilities to obtain those data, something that clearly the traditional methods of analysis are not currently achieving. This is the reason why scientific workflows are becoming a need in Astronomy.

The systematic capture of the scientific process into a digital Research Object (RO) enables researchers to create, re-use, and share the full methodology and agents of an experiment. The RO is a container of the lifecycle of an experiment, linking data, services and tools for their analysis, producing executable papers which go well beyond the pdf. This disruptive methodology reduces effort duplication and ensures repeatability of the discovery process, which finally leads to a complete change of paradigm in the way research is performed. 

Since December 2010, the AMIGA group is a participant in a EU FP7 funded project - Wf4Ever: Advanced Workflow Preservation Technologies for Enhanced Science - in order to contribute to the development of standards and models for the preservation of scientific workflows.

Main goals

  • Allow the methodology to be preserved and become re-usable by others.
  • Increase the efficiency of the collaborative process in Astronomy.
  • Contribute to the repeatability of the experiments, independently of their knowledge level.
  • Ensure the reproducibility of the results, independently of the local working environment.
  • Ease learning process for young researchers with organized and documented methodologies.
  • Enable multiarchive/multifacility VO web-services-based workflows.

Actions

  • Develop models and ontologies for the semantic characterization of processes and integrate them into the VO.
  • Creation of three representative Astronomy workflows.
    • Handling of large data tables of physically interconnected parameters.
    • Extractions of sources from digital surveys.
    • Kinematical modeling of galaxies.
  • Provide preservation of the Research Object to allow for re-use, sharing, repeatability, etc. of astronomy digital experiments.
  • Upgrade of Taverna workflow managment tool to integrate VO services.
  • Foster the use of collaborative web communities (MyExperiment) for publication, sharing, rating, etc. of ROs.
  • Ellaboration of Research Object/Workflows for training.
     

Astronomy is a collaborative science, but it has also become highly specialized, as many other disciplines. Scientific workflows will enable astronomers to greatly benefit from each other’s highly specialized know-how, they constitute a way to push Astronomy to share and publish not only results and data, but also processes and methodologies. Astronomers must hence be encouraged to document their methodology in a clear, concise and modular universal language.

Golden Exemplar for a 3D Kinematical Modelling VO web-services-based scientific workflow

At the start of this project most of the required individual infrastructures are either in place, or being developed with the goal of the interoperability of both data and methods through the Virtual Observatory initiative, although essentially no scientific workflows exist in Astronomy. Our first step step is to build a representative set of Golden Exemplars, and subsequently assemble all of the involved pieces through preserved scientific workflows.

Participants

Publications

  • PDF File Workflow-Centric Research Objects: A First Class Citizen in the Scholarly Discourse
    K. Belhajjame, O. Corcho, D. Garijo, J. Zhao, P. Missier, D. R. Newman, R. Palma, S. Bechhofer, E. Garcia Cuesta, J. M. Gomez-Perez, G. Klyne, K. Page, M. Roos, J. E. Ruiz, S. Soiland-Reyes, L. Verdes-Montenegro, D. De Roure and C. Goble.
    2012. Proceedings of the Second International Conference on the Future of Scholarly Communication and Scientific Publishing Sepublica2012.
  • PDF File Scientific Workflows in Astronomy
    A. Schaaff, L. Verdes-Montenegro, J. E. Ruiz, J. D. Santander-Vela.
    2012.  Proceedings of the XXI ADASS Conference. Astronomical Society of the Pacific Conference Series.
  • PDF File Towards the Preservation of Scientific Workflows
    David De Roure, Khalid Belhajjam, Paolo Missier, José Manuel Gómez-Pérez, Raúl Palma, José Enrique Ruiz, Kristina Hettne, Marco Roos, Graham Klyne and Carole Goble.
    2011. iPRES2011 Conference Papers Contributions.

Presentations in Conferences

---

These activities are funded under the EU 7th Framework Programme in the area of Digital Libraries and Digital Preservation. (ICT-2009.4.1) Project reference: 270192