Skip to content
Wongiseng edited this page Oct 10, 2013 · 40 revisions

#DuckTape

Overview

DuckTape is a platform to string together experiments from existing code base. It is designed for any of the following situations:

  • You have a simple piece of code that you want to try out with different inputs (a parameter sweep)
  • You have several interconnected pieces of code
  • You have an experimental workflow with different pieces of code in different programming languages (* main support currently on Java domain*)
  • You have a piece of code that tests the limits of your computer. You'd like to do a parameter sweep on a cluster, without rewriting everything (under development)

Features

The DuckTape platform allows you to take your code and with a few simple annotations, run it in a controlled environment. With the DuckTape you get:

  • Complete separation of you code and your running parameters
  • HTML Reports that offer quick insight into the result of a run
  • Automatic provenance information generated based on PROV-O
  • Command line programs can be used as modules for unsupported languages
  • Support for modules in Java, (Python, Matlab under development)
  • Scale your experiments from your laptop to a cluster with minimal effort (under development)

Usage

The following steps are required to use DuckTape:

  • Install DuckTape by obtaining our latest build of Ducktape from our Maven Repositories
  • Compose workflow by creating a Yaml file containing the parameters you'd like to run with.
  • Run the workflow using : mvn exec:java -Dexec.mainClass=org.data2semantics.platform.run.Run

Quick Start provides short description on how to immediately start using DuckTape, for running example workflow that we provide.

Example Workflows gives you example of workflow.

##Detailed Documentation

More documentation is provided here

Status

The DuckTape is currently in development. A proof of concept is capable of running basic workflows. We expect to be releasing alpha level code at the end of 2013.

Clone this wiki locally