v1.7.0

• Added a MultiProblem class for Multitask Learning. Thanks @urvashik !

• Added decoding option to pass through the features dictionary to predictions. Thanks @rsepassi !

• Enabled MLEngine path to use Cloud TPUs. Thanks @rsepassi !

• Added a simple One-Hot Symbol modality. Thanks @mbz !

• Added Cleverhans integration. Thanks @aidangomez !

• Problem definitions added for:

  • Allen Brain Atlas problems. Thanks @cwbeitel !
  • LSUN Bedrooms dataset.
  • Added various NLP datasets. Thanks @urvashik !
    • MSR Paraphrase Corpus,
    • Quora Question Pairs,
    • Stanford Sentiment Treebank,
    • Question Answering NLI classification problems,
    • Recognizing Textual Entailment,
    • Corpus of Linguistic Acceptability,
    • Winograd NLI.
  • Added a data generator for WSJ parsing.

• Model additions:

  • Implemented Targeted Dropout for Posthoc Pruning. Thanks @aidangomez !
  • Added self attention to VQA attention model.
  • Added fast block parallel transformer model
  • Implemented auxiliary losses from Stochastic Activation Pruning for Robust Adversarial Defense. Thanks @alexyku !
  • Added probability based scheduled sampling for SV2P problem. Thanks @mbz !
  • Reimplementated Autoencoder and Eval. Thanks @piotrmilos !
  • Relative memory efficient unmasked self-attention.

• Notable bug fixes:

  • bug with data_gen in style transfer problem Thanks @tlatkowski !
  • wmt_enfr dataset should not use vocabulary based on "small" dataset. Thanks @nshazeer !

• Many more fixes, tests and work on Model based RL, Transfomer, Video and other models and problems.