Finlay Thompson - Cloud-Haskell to Build a Continuous-Integration Platform for Reproducible Research

Finlay Thompson's talk at Compose :: Conference in Melbourne, 2016.

Using Cloud-Haskell to Build a Continuous-Integration Platform for Reproducible Research

--
Cloud Haskell is a collection of libraries that have brought Erlang style networking patterns to the Haskell language. The libraries bring together the best of Haskell’s strong typing, with an opinionated approach to building distributed applications. I will provide an experience report on how we have used Cloud Haskell, and Haskell in general, to build a continuous integration platform to support the rest of our data science work. The project has been successful in our organisation, and is starting to be used by other partner organisations. I believe that Haskell has helped development by making it easy to refactor, while also being extremely reliable in production. Cloud Haskell has allowed us to scale up to hundreds of compute nodes, and tens of thousands of computations in parallel, without changing any code.

Haskell is now an essential tool at Dragonfly Data Science. I will also discuss our experience with building up Haskell skills across our team, and across a range of projects.

Dragonfly is a data science team that combines research science and software development experience. We are committed to realising the benefits of using reproducible methods for all our work, for ourselves, our clients, and the general community.
--

http://www.composeconference.org/2016...