-
Notifications
You must be signed in to change notification settings - Fork 4
Home
Wongiseng edited this page Oct 9, 2013
·
40 revisions
#DuckTape
DuckTape is a platform to string together experiments from existing code base. It is designed for any of the following situations:
- You have a simple piece of code that you want to try out with different inputs (a parameter sweep)
- You have several interconnected pieces of code
- You have an experimental workflow with different pieces of code in different programming languages
- You have a piece of code that tests the limits of your computer. You'd like to do a parameter sweep on a cluster, without rewriting everything
(All these features are still in development)
The D2S platform allows you to take your code and with a few simple annotations, run it in a controlled environment. With the D2S Platform you get:
- Complete separation of you code and your running parameters
- Scale your experiments from your laptop to a cluster with minimal effort
- HTML Reports that offer quick insight into the result of a run
- Automatic provenance information generated
- Support for modules in Java, python, matlab
- Command line programs can be used as modules for unsupported languages
The DuckTape is currently in development. A proof of concept is capable of running basic workflows. We expect to be releasing alpha level code at the end of 2013.
See the Quick Start for more detailed instructions.
To use the DuckTape, you must (currently) perform the following steps:
- Use latest build of Ducktape by from our Maven
- Annotate your code to let the platform know which functions, classes and field to use
- Create a yaml file containing the parameters you'd like to run with.
- Run the platform using :
mvn exec:java -Dexec.mainClass=org.data2semantics.platform.run.Run
#[More Documentation] (wiki/DuckTape-Documentation)