Skip to content
Wongiseng edited this page Oct 9, 2013 · 40 revisions

#DuckTape

DuckTape is a platform to string together experiments from existing code base. It is designed for any of the following situations:

  • You have a simple piece of code that you want to try out with different inputs (a parameter sweep)
  • You have several interconnected pieces of code
  • You have an experimental workflow with different pieces of code in different programming languages
  • You have a piece of code that tests the limits of your computer. You'd like to do a parameter sweep on a cluster, without rewriting everything

Features

(All these features are still in development)

The D2S platform allows you to take your code and with a few simple annotations, run it in a controlled environment. With the D2S Platform you get:

  • Complete separation of you code and your running parameters
  • Scale your experiments from your laptop to a cluster with minimal effort
  • HTML Reports that offer quick insight into the result of a run
  • Automatic provenance information generated
  • Support for modules in Java, python, matlab
  • Command line programs can be used as modules for unsupported languages

Status

The DuckTape is currently in development. A proof of concept is capable of running basic workflows. We expect to be releasing alpha level code at the end of 2013.

Usage

See the Bla for more detailed instructions.

To use the DuckTape, you must (currently) perform the following steps:

  • Use latest build of Ducktape by from our Maven
  • Annotate your code to let the platform know which functions, classes and field to use
  • Create a yaml file containing the parameters you'd like to run with.
  • Run the platform using : mvn exec:java -Dexec.mainClass=org.data2semantics.platform.run.Run

Quick Start

[Documentation] (wiki/DuckTape-Documentation)

Clone this wiki locally