-
Notifications
You must be signed in to change notification settings - Fork 0
/
index.Rmd
95 lines (54 loc) · 9.27 KB
/
index.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
---
title: "Data Science in Julia for Hackers"
author: "Lambdaclass"
date: "`r Sys.Date()`"
site: bookdown::bookdown_site
documentclass: book
bibliography: [book.bib, packages.bib]
biblio-style: apalike
link-citations: yes
description: "Data Science in Julia for Hackers"
---
# Introduction {.unnumbered}
## Open source {.unnumbered}
This book is currently in a beta version.
We are looking forward to getting feedback and criticism:
- Submit a GitHub issue [**here**](https://github.com/unbalancedparentheses/data_science_in_julia_for_hackers/issues).
- Mail us to [**martina.cantaro\@lambdaclass.com**](mailto:martina.cantaro@lambdaclass.com){.email}
Thank you!
There are 2 ways in which you can read this book: 1. In our web page <https://datasciencejuliahackers.com/> 1. If you prefer a dynamic version of the book, you can download the repo in [GitHub](https://github.com/unbalancedparentheses/data_science_in_julia_for_hackers) and run the .jl files in a Pluto notebook
*The pdf version of the book will be available in a few weeks*
## Prologue {.unnumbered}
This book is written by Federico Carrone, Herman Obst Demaestri and Mariano Nicolini.
Thanks to Martina Cantaro, Camilo Plata, Manuel Puebla, Lucas Raúl Fernandez Piana, Osvaldo Martin, Iñaki Garay and Mariana Vinyolas.
------------------------------------------------------------------------
> *We have a habit in writing articles published in scientific journals to make the work as finished as possible, to cover up all the tracks, to not worry about the blind alleys or describe how you had the wrong idea first, and so on* - **Richard Feynman**
> *Only that what's open can be true. Full transparency is best for me and you* - **OpenBSD**
One of the first things to note about this book is that it is not an academic textbook. The authors of this book are not academics but a multidisciplinary team of passionate, amateur practitioners from different backgrounds, namely Engineering, Computer Science, Physics and Economy, that found a common ground to write this book, and that day by day keep reading, learning and applying new approaches, technologies and ways of thinking. This book lies somewhere in between a methodological recipe and a theoretical intensive textbook. What we want to deliver is a mathematical and computational methodology to face concrete Data Science problems, that is, applying theory and science to real-world problems involving data. The relationship between theory and practice is complex. Considering them as a whole can take us much farther. These pages may offer the theorist a way to think about problematic situations in a more down to earth manner, and to the practitioner, stimulation to go beyond the mere application of programming libraries and tools.
As the name of the book states, this is a book for Hackers. The term can have opposite connotations, depending on who is pronouncing it and to whom it refers to. In media and pop culture, it is associated with cyber-criminals, people that use computers and technology with malicious intent. In the cyber-security domain, hackers are, as stated in the final chapter of *Hacking: The Art of Exploitation* by Jon Erickson, "...just people with innovative spirits and an in-depth knowledge of technology". But the definition we like the most is borrowed from [The Jargon File's](http://www.catb.org/jargon/html/index.html) glossary, written by Eric S. Raymond, \> "A person who delights in having an intimate understanding of the internal workings of a system, computers and computer networks in particular."
It is in this sense that this book is meant for hackers: it will lead you down a road with a results-driven perspective, slowly growing intuition about the inner workings of many problems involving data and what they all have in common, with an emphasis on application. The name of the book is also inspired by the great [Bayesian Methods for Hackers](http://camdavidsonpilon.github.io/Probabilistic-Programming-and-Bayesian-Methods-for-Hackers/), which had a big influence on the topics and the approach of this book.
The situations presented in the book are diverse, reflecting the broad spectrum of application of Data Science. The solutions, however, don't try to be beautiful or perfect. We know the path to resolving real-life problems is muddy, that sometimes you might feel lost and that your ideas may change as you try to find the solution, but we encourage to embrace these coarse features and accept the sharp corners in this learning-through-solving journey. Suggestions, criticism and feedback are very appreciated, this book is alive and will evolve as a consequence of its environment's response.
Although this book isn't intended to have obscure, overly technical or academic definitions that may put the reader off, people with a little programming knowledge, a basic understanding of Calculus and some modelling intuition will get the most out of these pages. Familiarity with a high-level language like Python, taking derivatives and some function analysis should be enough for the reader to follow through with the book. All chapters include the code for the reader to play, explore and implement the solutions on their own. Moreover, links to notebooks with the worked solutions are available.
Why Data Science in Julia? There are several reasons why Julia is great language for Data Science. Julia code is readable, specially in regards to math-related computations. Julia is designed for math from the ground up, and considering the great amounts of math involved in Data Science, this makes it a very convenient programming language to work with. Another interesting aspect of Julia is its syncretism. This is due to its historical background: it was developed by a team of scientists who wanted a tool to address problems they typically encountered while doing research. Often, scientists are faced with complicated situations that need to integrate various tools and find an equilibrium point among many requirements, like learning to program in a new language and to efficiently use the equipment and hardware available. Julia is the perfect tool for these needs, suited for implementing high-level solutions than can be tested easily and quickly in an interactive manner, and allowing to write highly performant code in a simple way when needed, all in the same language. Moreover, features like multiple-dispatch and simple syntax, allow for great composability between packages as well as scalability, making the task of writing software much more user friendly and maintainable.
## Table of contents {.unnumbered}
### Part I: Data Science and Julia {.unnumbered}
- [First chapter](https://datasciencejuliahackers.com/01_science_technology_and_epistemology.jl.html): Science, technology, models and epistemology.
- [Second chapter](https://datasciencejuliahackers.com/02_julia_intro.jl.html): Introduction to the Julia programming language, showing examples of code and some first steps.
### Part II: Bayesian Statistics {.unnumbered}
- [Third chapter](https://datasciencejuliahackers.com/03_probability_intro.jl.html): An introduction to probability, probability distributions and Bayes' interpretation.
- [Fourth chapter](https://datasciencejuliahackers.com/04_naive_bayes.jl.html): Using a Naive-Bayes approach we construct a simple spam email filter.
- [Fifth chapter](https://datasciencejuliahackers.com/05_prob_prog_intro.jl.html): An introduction to Probabilistic Programming and some simple examples using the Turing.jl package.
- [Sixth chapter](https://datasciencejuliahackers.com/06_gravity.jl.html): We estimate the gravity of Mars to compute the escape velocity, throwing stones and taking very simple measurements from it.
- [Seventh chapter](https://datasciencejuliahackers.com/07_football_simulation.jl.html): We use a hierarchical bayesian model to estimate latent variables that describe Premier League´s football teams.
- [Eighth chapter](https://datasciencejuliahackers.com/08_basketball_shots.jl.html): We analyze how the scoring probability is affected by some variables, such as the distance from the hoop and the angle of shooting.
- [Ninth chapter](https://datasciencejuliahackers.com/09_optimal_pricing.jl.html): We solve a problem of optimal pricing optimization using a bayesian point of view.
### Part III: Machine Learning {.unnumbered}
- Work in progress
### Part IV: Deep Learning {.unnumbered}
- [Tenth chapter](https://datasciencejuliahackers.com/10_bees_vs_wasps.jl.html): Overview of Machine Learning and implementation of a simple convolutional neural network that is able to discriminate between pictures of bees and wasps.
### Part V: Scientific Machine Learning {.unnumbered}
- [Eleventh chapter](https://datasciencejuliahackers.com/11_ultima_online.jl.html): We explain the Ultima Online Catastrophe using differential equations to build a population dynamics model.
- [Twelfth chapter](https://datasciencejuliahackers.com/12_ultima_continued.jl.html): A continuation of the Ultima Online Catastrophe, introducing the Universal Differential Equations to recover missing parts of scientific models.
### Part VI: Time Series and Forecasting {.unnumbered}
- [Thirteenth chapter](https://datasciencejuliahackers.com/13_time_series.jl.html): We lay the foundations for time series analysis, focusing on the exponential smoothing method.