Torched and Fried Documentation

Torched and Fried (torchfry) is a software package that implements kernel approximation algorithms Fastfood (Le, Sarlos, Smola, 2013) and Random Kitchen Sink (Rahimi, Recht, 2007) as custom PyTorch layers for use in different networks.

Our motivation for implementing the Fastfood algorithm with PyTorch is to create an easy to use package that makes kernel methods scalable to high-dimensional datasets through efficient random feature layers like that in Deep Fried Convnets (Yang, Moczulski, Demil, et al., 2014). Through testing, we have found training times of Fastfood networks to be faster than Random Kitchen Sink networks. The improvement is about 20% decrease in time. The parameter count of Fastfood networks is much lower than those for Random Kitchen Sink networks, all while retaining the same image classification performance.