https://hoffman.ai/tags/ml/ Recent content in ml on Max Hoffman Hugo -- gohugo.io en Fri, 05 Jun 2020 10:51:04 -0700 https://hoffman.ai/posts/lambda-mr/ Fri, 05 Jun 2020 10:51:04 -0700 https://hoffman.ai/posts/lambda-mr/ What problems to Spark and Map Reduce solve? Was Spark the next generation of MapReduce? Do they solve the same problem? Is Spark quick and failure-prone, while MapReduce is slow and reliable? To play devil’s advocate, I think MapReduce was the right abstraction for the wrong problem. https://hoffman.ai/posts/smaker/ Sat, 25 May 2019 15:28:52 -0700 https://hoffman.ai/posts/smaker/ Smaker Workflow Helper Motivation My second project at Factual involved re-evaluating our team’s workflow automation software. The existing system used Drake to run our pre-processing, training and evalutation scripts. Drake introduces many pain-points in the process of writing and maintaining workflows, but I was more concerned with the lack of certain features that I considered important for our use cases: https://hoffman.ai/posts/wave/wave/ Tue, 08 Jan 2019 14:52:05 -0600 https://hoffman.ai/posts/wave/wave/ I spent some time working with graph recurrent neural networks at WashU. One of the key motivations of the project was to design a system that played to a graph’s strengths, rather reusing models designed for different applications. As a lab engineer, I did not own any of the science, so I did not spend the bulk of my time trying to understand the literature or design careful experiements. https://hoffman.ai/posts/tflon/ Sun, 30 Sep 2018 06:55:06 -0500 https://hoffman.ai/posts/tflon/ The Swamidass lab I am researching with has a tooling framework called Tflon. Matthew Mattlock, who wrote most of Tflon, first described the project as his attempt to provide tooling that shared Keras’s ease of use, but allowed for the full flexibiliy of Tensorflow.