Stochastic Frank Wolfe library for TensorFlow and PyTorch

Deep Neural Network Training with Frank-Wolfe (arXiv:2010.07243)

Authors: Sebastian Pokutta, Christoph Spiegel, Max Zimmer

• arxiv.org/abs/2010.07243
• Colab Notebook for visualization of constraints (TensorFlow)
• Colab Notebook for sparseness during training (TensorFlow)
• Colab Notebook for comparing stochastic Frank–Wolfe methods (TensorFlow)
• Colab Notebook for large network training (PyTorch)

Projection-Free Adaptive Gradients for Large-Scale Optimization (arXiv:2009.14114)

Authors: Cyrille W. Combettes, Christoph Spiegel, Sebastian Pokutta

• arxiv.org/abs/2009.14114
• Colab Notebook for convex objectives (not using this repository)
• Colab Notebook for non-convex objectives (TensorFlow)