text_mining/Acquire.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Acquire the Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Sources of Data\n",
    "\n",
    "We want to understand what are the important trends in Machine Learning at the moment. So we want to get a list of articles about Machine Learning that people are talking about. We can do that from many sources, but we decided to pick three sources to do that.\n",
    "\n",
    "1. [Reddit.com - Machine Learning](https://www.reddit.com/r/MachineLearning/) - Reddit is a user generated discussion forum where recent articles and topics on Maching Learning are discussed by the community.\n",
    "\n",
    "2. [Data Tau](http://www.datatau.com/)- Data Tau is the hacker news for machine learning. Users post articles about latest trends in data science and machine learning and can have discussion arount it.\n",
    "\n",
    "3. [Twitter #machinelearning](https://twitter.com/search?q=%23machinelearning&src=typd) - We can also look at Twitter with #machinelearning tags to find the latest articles and post about machine learning that are being discussed in the social media.\n",
    "\n",
    "\n",
    "## Working with Data Tau\n",
    "\n",
    "Let us start with Data Tau site and scrape the data to acquire it.\n",
    "\n",
    "![](img/datatau.png)\n",
    "\n",
    "We will want to scrape the title and date for each of the article in this page"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "import requests\n",
    "from bs4 import BeautifulSoup \n",
    "import re\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "base_url = 'http://www.datatau.com'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Understand the HTML Structure"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "#Let us use request to get the url\n",
    "dataTau = requests.get(base_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<Response [200]>"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check if the page has been scraped - we should see Response 200\n",
    "dataTau"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "dataTau = open('dataTau.html', 'rb').read()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "b'<html><head><link rel=\"stylesheet\" type=\"text/css\" href=\"news.css\">\\n<link rel=\"shortcut icon\" href=\"http://www.iconj.com/ico/d/x/dxo02ap56v.ico\">\\n<script>\\nfunction byId(id) {\\n  return document.getElementById(id);\\n}\\n\\nfunction vote(node) {\\n  var v = node.id.split(/_/);   // {\\'up\\', \\'123\\'}\\n  var item = v[1]; \\n\\n  // adjust score\\n  var score = byId(\\'score_\\' + item);\\n  var newscore = parseInt(score.innerHTML) + (v[0] == \\'up\\' ? 1 : -1);\\n  score.innerHTML = newscore + (newscore == 1 ? \\' point\\' : \\' points\\');\\n\\n  // hide arrows\\n  byId(\\'up_\\'   + item).style.visibility = \\'hidden\\';\\n  byId(\\'down_\\' + item).style.visibility = \\'hidden\\';\\n\\n  // ping server\\n  var ping = new Image();\\n  ping.src = node.href;\\n\\n  return false; // cancel browser nav\\n} </script><script>\\n\\n  (function(i,s,o,g,r,a,m){i[\\'GoogleAnalyticsObject\\']=r;i[r]=i[r]||function(){\\n  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),\\n  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)\\n  })(window,document,\\'script\\',\\'//www.google-analytics.com/analytics.js\\',\\'ga\\');\\n\\n  ga(\\'create\\', \\'UA-46326769-1\\', \\'datatau.com\\');\\n  ga(\\'send\\', \\'pageview\\');\\n\\n</script><title>DataTau</title></head><body><center><table border=0 cellpadding=0 cellspacing=0 width=\"85%\" bgcolor=#f6f6ef><tr><td bgcolor=#00b4b4><table border=0 cellpadding=0 cellspacing=0 width=\"100%\" style=\"padding:2px\"><tr><td style=\"width:18px;padding-right:4px\"><a href=\"http://www.datatau.com\"><img src=\"arc.png\" width=18 height=18 style=\"border:1px #b4b400 solid;\"></img></a></td><td style=\"line-height:12pt; height:10px;\"><span class=\"pagetop\"><b><a href=\"news\">DataTau</a></b><img src=\"s.gif\" height=1 width=10><a href=\"newest\">new</a> | <a href=\"newcomments\">comments</a> | <a href=\"leaders\">leaders</a> | <a href=\"submit\">submit</a></span></td><td style=\"text-align:right;padding-right:4px;\"><span class=\"pagetop\"><a href=\"/x?fnid=fDLzOSbeCa\">login</a></span></td></tr></table></td></tr><tr style=\"height:10px\"></tr><tr><td><table border=0 cellpadding=0 cellspacing=0><tr><td align=right valign=top class=\"title\">1.</td><td><center><a id=nil href=\"vote?for=11989&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11989></span></center></td><td class=\"title\"><a href=\"https://www.springboard.com/blog/eat-rate-love-an-exploration-of-r-yelp-and-the-search-for-good-indian-food/\" rel=\"nofollow\">An Exploration of R, Yelp, and the Search for Good Indian Food</a><span class=\"comhead\"> (springboard.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11989>5 points</span> by <a href=\"user?id=Rogerh91\">Rogerh91</a> 4 hours ago  | <a href=\"item?id=11989\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">2.</td><td><center><a id=nil href=\"vote?for=11986&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11986></span></center></td><td class=\"title\"><a href=\"http://blog.insightdatalabs.com/spark-pipelines-elegant-yet-powerful/\" rel=\"nofollow\">Spark Pipelines: Elegant Yet Powerful</a><span class=\"comhead\"> (insightdatalabs.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11986>3 points</span> by <a href=\"user?id=aouyang1\">aouyang1</a> 7 hours ago  | <a href=\"item?id=11986\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">3.</td><td><center><a id=nil href=\"vote?for=11973&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11973></span></center></td><td class=\"title\"><a href=\"https://www.youtube.com/watch?v=KeJINHjyzOU\">Deep Advances in Generative Modeling</a><span class=\"comhead\"> (youtube.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11973>7 points</span> by <a href=\"user?id=gwulfs\">gwulfs</a> 13 hours ago  | <a href=\"item?id=11973\">1 comment</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">4.</td><td><center><a id=nil href=\"vote?for=11980&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11980></span></center></td><td class=\"title\"><a href=\"http://www.buzzfeed.com/westleyargentum/stuff-vcs-say#.lk1wooEBL\" rel=\"nofollow\">Shit VCs Say</a><span class=\"comhead\"> (buzzfeed.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11980>3 points</span> by <a href=\"user?id=Argentum01\">Argentum01</a> 8 hours ago  | <a href=\"item?id=11980\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">5.</td><td><center><a id=nil href=\"vote?for=11967&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11967></span></center></td><td class=\"title\"><a href=\"http://sebastianraschka.com/blog/2015/why-python.html\" rel=\"nofollow\">Python, Machine Learning, and Language Wars</a><span class=\"comhead\"> (sebastianraschka.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11967>4 points</span> by <a href=\"user?id=pmigdal\">pmigdal</a> 15 hours ago  | <a href=\"item?id=11967\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">6.</td><td><center><a id=nil href=\"vote?for=11975&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11975></span></center></td><td class=\"title\"><a href=\"https://iamtrask.github.io/2015/07/12/basic-python-network/\" rel=\"nofollow\">A Neural Network in 11 lines of Python </a><span class=\"comhead\"> (github.io) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11975>3 points</span> by <a href=\"user?id=dekhtiar\">dekhtiar</a> 13 hours ago  | <a href=\"item?id=11975\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">7.</td><td><center><a id=nil href=\"vote?for=11955&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11955></span></center></td><td class=\"title\"><a href=\"http://setosa.io/ev/markov-chains/\">Markov Chains Explained Visually</a><span class=\"comhead\"> (setosa.io) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11955>13 points</span> by <a href=\"user?id=zeroviscosity\">zeroviscosity</a> 1 day ago  | <a href=\"item?id=11955\">1 comment</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">8.</td><td><center><a id=nil href=\"vote?for=11952&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11952></span></center></td><td class=\"title\"><a href=\"https://github.com/dodger487/dplython\">Dplython: Dplyr for Python</a><span class=\"comhead\"> (github.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11952>13 points</span> by <a href=\"user?id=thenaturalist\">thenaturalist</a> 1 day ago  | <a href=\"item?id=11952\">3 comments</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">9.</td><td><center><a id=nil href=\"vote?for=11940&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11940></span></center></td><td class=\"title\"><a href=\"http://research.google.com/pubs/pub41854.html\">Inferring causal impact using Bayesian structural time-series models</a><span class=\"comhead\"> (google.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11940>8 points</span> by <a href=\"user?id=Homunculiheaded\">Homunculiheaded</a> 1 day ago  | <a href=\"item?id=11940\">1 comment</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">10.</td><td><center><a id=nil href=\"vote?for=11948&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11948></span></center></td><td class=\"title\"><a href=\"http://tech.marksblogg.com/billion-nyc-taxi-rides-spark-emr.html\" rel=\"nofollow\">A Billion Taxi Rides on Amazon EMR running Spark</a><span class=\"comhead\"> (marksblogg.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11948>5 points</span> by <a href=\"user?id=marklit\">marklit</a> 1 day ago  | <a href=\"item?id=11948\">1 comment</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">11.</td><td><center><a id=nil href=\"vote?for=11946&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11946></span></center></td><td class=\"title\"><a href=\"http://trendct.org/2016/03/18/tutorial-web-scraping-and-mapping-breweries-with-import-io-and-r/\" rel=\"nofollow\">Tutorial: Web scraping and mapping breweries with import.io and R</a><span class=\"comhead\"> (trendct.org) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11946>4 points</span> by <a href=\"user?id=jasdumas\">jasdumas</a> 1 day ago  | <a href=\"item?id=11946\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">12.</td><td><center><a id=nil href=\"vote?for=11939&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11939></span></center></td><td class=\"title\"><a href=\"http://yanirseroussi.com/2016/03/20/the-rise-of-greedy-robots/\" rel=\"nofollow\">The rise of greedy robots</a><span class=\"comhead\"> (yanirseroussi.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11939>4 points</span> by <a href=\"user?id=yanir\">yanir</a> 2 days ago  | <a href=\"item?id=11939\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">13.</td><td><center><a id=nil href=\"vote?for=11905&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11905></span></center></td><td class=\"title\"><a href=\"https://github.com/jmportilla/Python-for-Algorithms--Data-Structures--and-Interviews\">Python for Data Structures, Algorithms, and Interviews</a><span class=\"comhead\"> (github.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11905>18 points</span> by <a href=\"user?id=kokoubaby\">kokoubaby</a> 4 days ago  | <a href=\"item?id=11905\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">14.</td><td><center><a id=nil href=\"vote?for=11956&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11956></span></center></td><td class=\"title\"><a href=\"http://techblog.netflix.com/2016/03/extracting-image-metadata-at-scale.html\" rel=\"nofollow\">Extracting image metadata at scale</a><span class=\"comhead\"> (netflix.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11956>2 points</span> by <a href=\"user?id=zachwill\">zachwill</a> 1 day ago  | <a href=\"item?id=11956\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">15.</td><td><center><a id=nil href=\"vote?for=11909&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11909></span></center></td><td class=\"title\"><a href=\"http://blog.datalifebalance.com/lift-charts-a-data-scientists-secret-weapon/\">Lift charts - A data scientist\\'s secret weapon</a><span class=\"comhead\"> (datalifebalance.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11909>14 points</span> by <a href=\"user?id=datenheini\">datenheini</a> 4 days ago  | <a href=\"item?id=11909\">2 comments</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">16.</td><td><center><a id=nil href=\"vote?for=11934&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11934></span></center></td><td class=\"title\"><a href=\"http://swanintelligence.com/how-to-become-a-machine-learning-expert-in-one-simple-step.html\" rel=\"nofollow\">How To Become A Machine Learning Expert In One Simple Step</a><span class=\"comhead\"> (swanintelligence.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11934>4 points</span> by <a href=\"user?id=swanint\">swanint</a> 2 days ago  | <a href=\"item?id=11934\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">17.</td><td><center><a id=nil href=\"vote?for=11910&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11910></span></center></td><td class=\"title\"><a href=\"http://multithreaded.stitchfix.com/blog/2016/03/16/engineers-shouldnt-write-etl/\">Engineers Shouldn\\xe2\\x80\\x99t Write ETL: High Functioning Data Science Departments</a><span class=\"comhead\"> (stitchfix.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11910>10 points</span> by <a href=\"user?id=legel\">legel</a> 4 days ago  | <a href=\"item?id=11910\">3 comments</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">18.</td><td><center><a id=nil href=\"vote?for=11937&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11937></span></center></td><td class=\"title\"><a href=\"http://www.willmcginnis.com/2016/03/15/simple-estimation-hierarchical-events-petersburg/\" rel=\"nofollow\">Simple estimation of hierarchical events with petersburg</a><span class=\"comhead\"> (willmcginnis.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11937>3 points</span> by <a href=\"user?id=wdm0006\">wdm0006</a> 2 days ago  | <a href=\"item?id=11937\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">19.</td><td><center><a id=nil href=\"vote?for=11938&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11938></span></center></td><td class=\"title\"><a href=\"item?id=11938\">Data Science Side Project</a></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11938>6 points</span> by <a href=\"user?id=yashpatel5400\">yashpatel5400</a> 2 days ago  | <a href=\"item?id=11938\">8 comments</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">20.</td><td><center><a id=nil href=\"vote?for=11920&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11920></span></center></td><td class=\"title\"><a href=\"http://multithreaded.stitchfix.com/blog/2016/02/04/computer-vision-state-of-the-art/\">Unsupervised Computer Vision: The Current State of the Art</a><span class=\"comhead\"> (stitchfix.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11920>6 points</span> by <a href=\"user?id=carlosfaham\">carlosfaham</a> 3 days ago  | <a href=\"item?id=11920\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">21.</td><td><center><a id=nil href=\"vote?for=11882&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11882></span></center></td><td class=\"title\"><a href=\"https://drive.google.com/file/d/0BxGB59WxQI5oTXpQd09jbVpvalE/view\">Data Engineering at Slack: Twelve Mistakes I\\'ve Made In My First Three Months</a><span class=\"comhead\"> (google.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11882>14 points</span> by <a href=\"user?id=gwulfs\">gwulfs</a> 6 days ago  | <a href=\"item?id=11882\">2 comments</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">22.</td><td><center><a id=nil href=\"vote?for=11931&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11931></span></center></td><td class=\"title\"><a href=\"http://www.randalolson.com/2016/03/11/what-data-visualization-tools-do-rdataisbeautiful-oc-creators-use/\" rel=\"nofollow\">What data visualization tools do /r/DataIsBeautiful OC creators use?</a><span class=\"comhead\"> (randalolson.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11931>3 points</span> by <a href=\"user?id=pmigdal\">pmigdal</a> 2 days ago  | <a href=\"item?id=11931\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">23.</td><td><center><a id=nil href=\"vote?for=11917&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11917></span></center></td><td class=\"title\"><a href=\"https://nikolaygrozev.wordpress.com/2015/07/01/reshaping-in-pandas-pivot-pivot-table-stack-and-unstack-explained-with-pictures/\">Reshaping in Pandas</a><span class=\"comhead\"> (nikolaygrozev.wordpress.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11917>6 points</span> by <a href=\"user?id=carlosgg\">carlosgg</a> 4 days ago  | <a href=\"item?id=11917\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">24.</td><td><center><a id=nil href=\"vote?for=11923&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11923></span></center></td><td class=\"title\"><a href=\"http://blackboxchallenge.com/eng\" rel=\"nofollow\">An unusual interactive machine learning challenge</a><span class=\"comhead\"> (blackboxchallenge.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11923>4 points</span> by <a href=\"user?id=gglumov\">gglumov</a> 3 days ago  | <a href=\"item?id=11923\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">25.</td><td><center><a id=nil href=\"vote?for=11922&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11922></span></center></td><td class=\"title\"><a href=\"http://blog.datumbox.com/datumbox-machine-learning-framework-0-7-0-released/\" rel=\"nofollow\">Datumbox Machine Learning Framework 0.7.0 Released</a><span class=\"comhead\"> (datumbox.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11922>4 points</span> by <a href=\"user?id=datumbox\">datumbox</a> 3 days ago  | <a href=\"item?id=11922\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">26.</td><td><center><a id=nil href=\"vote?for=11865&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11865></span></center></td><td class=\"title\"><a href=\"http://p.migdal.pl/2016/03/15/data-science-intro-for-math-phys-background.html\">Data science intro for math/phys background</a><span class=\"comhead\"> (p.migdal.pl) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11865>14 points</span> by <a href=\"user?id=pmigdal\">pmigdal</a> 7 days ago  | <a href=\"item?id=11865\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">27.</td><td><center><a id=nil href=\"vote?for=11837&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11837></span></center></td><td class=\"title\"><a href=\"http://lumiverse.io/series/neural-networks-demystified\">Neural Networks demystified</a><span class=\"comhead\"> (lumiverse.io) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11837>16 points</span> by <a href=\"user?id=elyase\">elyase</a> 8 days ago  | <a href=\"item?id=11837\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">28.</td><td><center><a id=nil href=\"vote?for=11880&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11880></span></center></td><td class=\"title\"><a href=\"http://insighthealthdata.com/blog/HealthyBeats/\">What machines can learn from Apple Watch: detecting undiagnosed heart condition</a><span class=\"comhead\"> (insighthealthdata.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11880>9 points</span> by <a href=\"user?id=koukouhappy\">koukouhappy</a> 6 days ago  | <a href=\"item?id=11880\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">29.</td><td><center><a id=nil href=\"vote?for=11862&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11862></span></center></td><td class=\"title\"><a href=\"http://blog.dominodatalab.com/open-source-winning-against-proprietary-data-science-vendors/\">Data Science Tools: The Biggest Winners and Losers</a><span class=\"comhead\"> (dominodatalab.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11862>12 points</span> by <a href=\"user?id=AnnaOnTheWeb\">AnnaOnTheWeb</a> 7 days ago  | <a href=\"item?id=11862\">discuss</a></td></tr><tr style=\"height:5px\"></tr><tr><td align=right valign=top class=\"title\">30.</td><td><center><a id=nil href=\"vote?for=11868&dir=up&whence=%6e%65%77%73\"><img src=\"grayarrow.gif\" border=0 vspace=3 hspace=2></a><span id=down_11868></span></center></td><td class=\"title\"><a href=\"https://medium.com/@thomasrorystone/10-years-of-open-source-machine-learning-64bb6fb18eb2#.vp3r4try5\">10 Years of Open Source Machine Learning</a><span class=\"comhead\"> (medium.com) </span></td></tr><tr><td colspan=2></td><td class=\"subtext\"><span id=score_11868>9 points</span> by <a href=\"user?id=tstonez\">tstonez</a> 6 days ago  | <a href=\"item?id=11868\">1 comment</a></td></tr><tr style=\"height:5px\"></tr><tr style=\"height:10px\"></tr><tr><td colspan=2></td><td class=\"title\"><a href=\"/x?fnid=CSS821ucAs\" rel=\"nofollow\">More</a></td></tr></table></td></tr><tr><td><img src=\"s.gif\" height=10 width=0><table width=\"100%\" cellspacing=0 cellpadding=1><tr><td bgcolor=#00b4b4></td></tr></table><br>\\n<center></center></td></tr></table></center><center><a href=\"http://www.datatau.com/rss\">RSS\\n</a><a href=\"http://www.datatau.com/item?id=1\">| Announcements\\n</a></center></body></html>'"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Let us see the text content of the page\n",
    "dataTau"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Start the beautifulsoup library and create a soup!\n",
    "soup = BeautifulSoup(dataTau,'html.parser')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<html>\n",
      " <head>\n",
      "  <link href=\"news.css\" rel=\"stylesheet\" type=\"text/css\">\n",
      "   <link href=\"http://www.iconj.com/ico/d/x/dxo02ap56v.ico\" rel=\"shortcut icon\">\n",
      "    <script>\n",
      "     function byId(id) {\n",
      "  return document.getElementById(id);\n",
      "}\n",
      "\n",
      "function vote(node) {\n",
      "  var v = node.id.split(/_/);   // {'up', '123'}\n",
      "  var item = v[1]; \n",
      "\n",
      "  // adjust score\n",
      "  var score = byId('score_' + item);\n",
      "  var newscore = parseInt(score.innerHTML) + (v[0] == 'up' ? 1 : -1);\n",
      "  score.innerHTML = newscore + (newscore == 1 ? ' point' : ' points');\n",
      "\n",
      "  // hide arrows\n",
      "  byId('up_'   + item).style.visibility = 'hidden';\n",
      "  byId('down_' + item).style.visibility = 'hidden';\n",
      "\n",
      "  // ping server\n",
      "  var ping = new Image();\n",
      "  ping.src = node.href;\n",
      "\n",
      "  return false; // cancel browser nav\n",
      "}\n",
      "    </script>\n",
      "    <script>\n",
      "     (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){\n",
      "  (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),\n",
      "  m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)\n",
      "  })(window,document,'script','//www.google-analytics.com/analytics.js','ga');\n",
      "\n",
      "  ga('create', 'UA-46326769-1', 'datatau.com');\n",
      "  ga('send', 'pageview');\n",
      "    </script>\n",
      "    <title>\n",
      "     DataTau\n",
      "    </title>\n",
      "   </link>\n",
      "  </link>\n",
      " </head>\n",
      " <body>\n",
      "  <center>\n",
      "   <table bgcolor=\"#f6f6ef\" border=\"0\" cellpadding=\"0\" cellspacing=\"0\" width=\"85%\">\n",
      "    <tr>\n",
      "     <td bgcolor=\"#00b4b4\">\n",
      "      <table border=\"0\" cellpadding=\"0\" cellspacing=\"0\" style=\"padding:2px\" width=\"100%\">\n",
      "       <tr>\n",
      "        <td style=\"width:18px;padding-right:4px\">\n",
      "         <a href=\"http://www.datatau.com\">\n",
      "          <img height=\"18\" src=\"arc.png\" style=\"border:1px #b4b400 solid;\" width=\"18\"/>\n",
      "         </a>\n",
      "        </td>\n",
      "        <td style=\"line-height:12pt; height:10px;\">\n",
      "         <span class=\"pagetop\">\n",
      "          <b>\n",
      "           <a href=\"news\">\n",
      "            DataTau\n",
      "           </a>\n",
      "          </b>\n",
      "          <img height=\"1\" src=\"s.gif\" width=\"10\">\n",
      "           <a href=\"newest\">\n",
      "            new\n",
      "           </a>\n",
      "           |\n",
      "           <a href=\"newcomments\">\n",
      "            comments\n",
      "           </a>\n",
      "           |\n",
      "           <a href=\"leaders\">\n",
      "            leaders\n",
      "           </a>\n",
      "           |\n",
      "           <a href=\"submit\">\n",
      "            submit\n",
      "           </a>\n",
      "          </img>\n",
      "         </span>\n",
      "        </td>\n",
      "        <td style=\"text-align:right;padding-right:4px;\">\n",
      "         <span class=\"pagetop\">\n",
      "          <a href=\"/x?fnid=fDLzOSbeCa\">\n",
      "           login\n",
      "          </a>\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "      </table>\n",
      "     </td>\n",
      "    </tr>\n",
      "    <tr style=\"height:10px\">\n",
      "    </tr>\n",
      "    <tr>\n",
      "     <td>\n",
      "      <table border=\"0\" cellpadding=\"0\" cellspacing=\"0\">\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         1.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11989&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11989\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://www.springboard.com/blog/eat-rate-love-an-exploration-of-r-yelp-and-the-search-for-good-indian-food/\" rel=\"nofollow\">\n",
      "          An Exploration of R, Yelp, and the Search for Good Indian Food\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (springboard.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11989\">\n",
      "          5 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=Rogerh91\">\n",
      "          Rogerh91\n",
      "         </a>\n",
      "         4 hours ago  |\n",
      "         <a href=\"item?id=11989\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         2.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11986&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11986\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://blog.insightdatalabs.com/spark-pipelines-elegant-yet-powerful/\" rel=\"nofollow\">\n",
      "          Spark Pipelines: Elegant Yet Powerful\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (insightdatalabs.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11986\">\n",
      "          3 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=aouyang1\">\n",
      "          aouyang1\n",
      "         </a>\n",
      "         7 hours ago  |\n",
      "         <a href=\"item?id=11986\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         3.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11973&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11973\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://www.youtube.com/watch?v=KeJINHjyzOU\">\n",
      "          Deep Advances in Generative Modeling\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (youtube.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11973\">\n",
      "          7 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=gwulfs\">\n",
      "          gwulfs\n",
      "         </a>\n",
      "         13 hours ago  |\n",
      "         <a href=\"item?id=11973\">\n",
      "          1 comment\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         4.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11980&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11980\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://www.buzzfeed.com/westleyargentum/stuff-vcs-say#.lk1wooEBL\" rel=\"nofollow\">\n",
      "          Shit VCs Say\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (buzzfeed.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11980\">\n",
      "          3 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=Argentum01\">\n",
      "          Argentum01\n",
      "         </a>\n",
      "         8 hours ago  |\n",
      "         <a href=\"item?id=11980\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         5.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11967&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11967\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://sebastianraschka.com/blog/2015/why-python.html\" rel=\"nofollow\">\n",
      "          Python, Machine Learning, and Language Wars\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (sebastianraschka.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11967\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=pmigdal\">\n",
      "          pmigdal\n",
      "         </a>\n",
      "         15 hours ago  |\n",
      "         <a href=\"item?id=11967\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         6.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11975&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11975\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://iamtrask.github.io/2015/07/12/basic-python-network/\" rel=\"nofollow\">\n",
      "          A Neural Network in 11 lines of Python\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (github.io)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11975\">\n",
      "          3 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=dekhtiar\">\n",
      "          dekhtiar\n",
      "         </a>\n",
      "         13 hours ago  |\n",
      "         <a href=\"item?id=11975\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         7.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11955&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11955\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://setosa.io/ev/markov-chains/\">\n",
      "          Markov Chains Explained Visually\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (setosa.io)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11955\">\n",
      "          13 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=zeroviscosity\">\n",
      "          zeroviscosity\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11955\">\n",
      "          1 comment\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         8.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11952&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11952\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://github.com/dodger487/dplython\">\n",
      "          Dplython: Dplyr for Python\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (github.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11952\">\n",
      "          13 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=thenaturalist\">\n",
      "          thenaturalist\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11952\">\n",
      "          3 comments\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         9.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11940&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11940\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://research.google.com/pubs/pub41854.html\">\n",
      "          Inferring causal impact using Bayesian structural time-series models\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (google.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11940\">\n",
      "          8 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=Homunculiheaded\">\n",
      "          Homunculiheaded\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11940\">\n",
      "          1 comment\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         10.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11948&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11948\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://tech.marksblogg.com/billion-nyc-taxi-rides-spark-emr.html\" rel=\"nofollow\">\n",
      "          A Billion Taxi Rides on Amazon EMR running Spark\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (marksblogg.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11948\">\n",
      "          5 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=marklit\">\n",
      "          marklit\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11948\">\n",
      "          1 comment\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         11.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11946&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11946\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://trendct.org/2016/03/18/tutorial-web-scraping-and-mapping-breweries-with-import-io-and-r/\" rel=\"nofollow\">\n",
      "          Tutorial: Web scraping and mapping breweries with import.io and R\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (trendct.org)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11946\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=jasdumas\">\n",
      "          jasdumas\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11946\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         12.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11939&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11939\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://yanirseroussi.com/2016/03/20/the-rise-of-greedy-robots/\" rel=\"nofollow\">\n",
      "          The rise of greedy robots\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (yanirseroussi.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11939\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=yanir\">\n",
      "          yanir\n",
      "         </a>\n",
      "         2 days ago  |\n",
      "         <a href=\"item?id=11939\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         13.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11905&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11905\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://github.com/jmportilla/Python-for-Algorithms--Data-Structures--and-Interviews\">\n",
      "          Python for Data Structures, Algorithms, and Interviews\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (github.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11905\">\n",
      "          18 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=kokoubaby\">\n",
      "          kokoubaby\n",
      "         </a>\n",
      "         4 days ago  |\n",
      "         <a href=\"item?id=11905\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         14.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11956&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11956\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://techblog.netflix.com/2016/03/extracting-image-metadata-at-scale.html\" rel=\"nofollow\">\n",
      "          Extracting image metadata at scale\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (netflix.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11956\">\n",
      "          2 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=zachwill\">\n",
      "          zachwill\n",
      "         </a>\n",
      "         1 day ago  |\n",
      "         <a href=\"item?id=11956\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         15.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11909&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11909\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://blog.datalifebalance.com/lift-charts-a-data-scientists-secret-weapon/\">\n",
      "          Lift charts - A data scientist's secret weapon\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (datalifebalance.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11909\">\n",
      "          14 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=datenheini\">\n",
      "          datenheini\n",
      "         </a>\n",
      "         4 days ago  |\n",
      "         <a href=\"item?id=11909\">\n",
      "          2 comments\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         16.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11934&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11934\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://swanintelligence.com/how-to-become-a-machine-learning-expert-in-one-simple-step.html\" rel=\"nofollow\">\n",
      "          How To Become A Machine Learning Expert In One Simple Step\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (swanintelligence.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11934\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=swanint\">\n",
      "          swanint\n",
      "         </a>\n",
      "         2 days ago  |\n",
      "         <a href=\"item?id=11934\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         17.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11910&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11910\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://multithreaded.stitchfix.com/blog/2016/03/16/engineers-shouldnt-write-etl/\">\n",
      "          Engineers Shouldn’t Write ETL: High Functioning Data Science Departments\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (stitchfix.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11910\">\n",
      "          10 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=legel\">\n",
      "          legel\n",
      "         </a>\n",
      "         4 days ago  |\n",
      "         <a href=\"item?id=11910\">\n",
      "          3 comments\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         18.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11937&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11937\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://www.willmcginnis.com/2016/03/15/simple-estimation-hierarchical-events-petersburg/\" rel=\"nofollow\">\n",
      "          Simple estimation of hierarchical events with petersburg\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (willmcginnis.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11937\">\n",
      "          3 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=wdm0006\">\n",
      "          wdm0006\n",
      "         </a>\n",
      "         2 days ago  |\n",
      "         <a href=\"item?id=11937\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         19.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11938&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11938\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"item?id=11938\">\n",
      "          Data Science Side Project\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11938\">\n",
      "          6 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=yashpatel5400\">\n",
      "          yashpatel5400\n",
      "         </a>\n",
      "         2 days ago  |\n",
      "         <a href=\"item?id=11938\">\n",
      "          8 comments\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         20.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11920&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11920\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://multithreaded.stitchfix.com/blog/2016/02/04/computer-vision-state-of-the-art/\">\n",
      "          Unsupervised Computer Vision: The Current State of the Art\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (stitchfix.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11920\">\n",
      "          6 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=carlosfaham\">\n",
      "          carlosfaham\n",
      "         </a>\n",
      "         3 days ago  |\n",
      "         <a href=\"item?id=11920\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         21.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11882&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11882\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://drive.google.com/file/d/0BxGB59WxQI5oTXpQd09jbVpvalE/view\">\n",
      "          Data Engineering at Slack: Twelve Mistakes I've Made In My First Three Months\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (google.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11882\">\n",
      "          14 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=gwulfs\">\n",
      "          gwulfs\n",
      "         </a>\n",
      "         6 days ago  |\n",
      "         <a href=\"item?id=11882\">\n",
      "          2 comments\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         22.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11931&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11931\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://www.randalolson.com/2016/03/11/what-data-visualization-tools-do-rdataisbeautiful-oc-creators-use/\" rel=\"nofollow\">\n",
      "          What data visualization tools do /r/DataIsBeautiful OC creators use?\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (randalolson.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11931\">\n",
      "          3 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=pmigdal\">\n",
      "          pmigdal\n",
      "         </a>\n",
      "         2 days ago  |\n",
      "         <a href=\"item?id=11931\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         23.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11917&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11917\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://nikolaygrozev.wordpress.com/2015/07/01/reshaping-in-pandas-pivot-pivot-table-stack-and-unstack-explained-with-pictures/\">\n",
      "          Reshaping in Pandas\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (nikolaygrozev.wordpress.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11917\">\n",
      "          6 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=carlosgg\">\n",
      "          carlosgg\n",
      "         </a>\n",
      "         4 days ago  |\n",
      "         <a href=\"item?id=11917\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         24.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11923&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11923\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://blackboxchallenge.com/eng\" rel=\"nofollow\">\n",
      "          An unusual interactive machine learning challenge\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (blackboxchallenge.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11923\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=gglumov\">\n",
      "          gglumov\n",
      "         </a>\n",
      "         3 days ago  |\n",
      "         <a href=\"item?id=11923\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         25.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11922&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11922\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://blog.datumbox.com/datumbox-machine-learning-framework-0-7-0-released/\" rel=\"nofollow\">\n",
      "          Datumbox Machine Learning Framework 0.7.0 Released\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (datumbox.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11922\">\n",
      "          4 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=datumbox\">\n",
      "          datumbox\n",
      "         </a>\n",
      "         3 days ago  |\n",
      "         <a href=\"item?id=11922\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         26.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11865&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11865\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://p.migdal.pl/2016/03/15/data-science-intro-for-math-phys-background.html\">\n",
      "          Data science intro for math/phys background\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (p.migdal.pl)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11865\">\n",
      "          14 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=pmigdal\">\n",
      "          pmigdal\n",
      "         </a>\n",
      "         7 days ago  |\n",
      "         <a href=\"item?id=11865\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         27.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11837&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11837\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://lumiverse.io/series/neural-networks-demystified\">\n",
      "          Neural Networks demystified\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (lumiverse.io)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11837\">\n",
      "          16 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=elyase\">\n",
      "          elyase\n",
      "         </a>\n",
      "         8 days ago  |\n",
      "         <a href=\"item?id=11837\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         28.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11880&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11880\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://insighthealthdata.com/blog/HealthyBeats/\">\n",
      "          What machines can learn from Apple Watch: detecting undiagnosed heart condition\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (insighthealthdata.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11880\">\n",
      "          9 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=koukouhappy\">\n",
      "          koukouhappy\n",
      "         </a>\n",
      "         6 days ago  |\n",
      "         <a href=\"item?id=11880\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         29.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11862&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11862\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"http://blog.dominodatalab.com/open-source-winning-against-proprietary-data-science-vendors/\">\n",
      "          Data Science Tools: The Biggest Winners and Losers\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (dominodatalab.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11862\">\n",
      "          12 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=AnnaOnTheWeb\">\n",
      "          AnnaOnTheWeb\n",
      "         </a>\n",
      "         7 days ago  |\n",
      "         <a href=\"item?id=11862\">\n",
      "          discuss\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td align=\"right\" class=\"title\" valign=\"top\">\n",
      "         30.\n",
      "        </td>\n",
      "        <td>\n",
      "         <center>\n",
      "          <a href=\"vote?for=11868&amp;dir=up&amp;whence=%6e%65%77%73\" id=\"nil\">\n",
      "           <img border=\"0\" hspace=\"2\" src=\"grayarrow.gif\" vspace=\"3\"/>\n",
      "          </a>\n",
      "          <span id=\"down_11868\">\n",
      "          </span>\n",
      "         </center>\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"https://medium.com/@thomasrorystone/10-years-of-open-source-machine-learning-64bb6fb18eb2#.vp3r4try5\">\n",
      "          10 Years of Open Source Machine Learning\n",
      "         </a>\n",
      "         <span class=\"comhead\">\n",
      "          (medium.com)\n",
      "         </span>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"subtext\">\n",
      "         <span id=\"score_11868\">\n",
      "          9 points\n",
      "         </span>\n",
      "         by\n",
      "         <a href=\"user?id=tstonez\">\n",
      "          tstonez\n",
      "         </a>\n",
      "         6 days ago  |\n",
      "         <a href=\"item?id=11868\">\n",
      "          1 comment\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "       <tr style=\"height:5px\">\n",
      "       </tr>\n",
      "       <tr style=\"height:10px\">\n",
      "       </tr>\n",
      "       <tr>\n",
      "        <td colspan=\"2\">\n",
      "        </td>\n",
      "        <td class=\"title\">\n",
      "         <a href=\"/x?fnid=CSS821ucAs\" rel=\"nofollow\">\n",
      "          More\n",
      "         </a>\n",
      "        </td>\n",
      "       </tr>\n",
      "      </table>\n",
      "     </td>\n",
      "    </tr>\n",
      "    <tr>\n",
      "     <td>\n",
      "      <img height=\"10\" src=\"s.gif\" width=\"0\">\n",
      "       <table cellpadding=\"1\" cellspacing=\"0\" width=\"100%\">\n",
      "        <tr>\n",
      "         <td bgcolor=\"#00b4b4\">\n",
      "         </td>\n",
      "        </tr>\n",
      "       </table>\n",
      "       <br>\n",
      "        <center>\n",
      "        </center>\n",
      "       </br>\n",
      "      </img>\n",
      "     </td>\n",
      "    </tr>\n",
      "   </table>\n",
      "  </center>\n",
      "  <center>\n",
      "   <a href=\"http://www.datatau.com/rss\">\n",
      "    RSS\n",
      "   </a>\n",
      "   <a href=\"http://www.datatau.com/item?id=1\">\n",
      "    | Announcements\n",
      "   </a>\n",
      "  </center>\n",
      " </body>\n",
      "</html>\n"
     ]
    }
   ],
   "source": [
    "# See the pretty form HTML - Not so pretty though!\n",
    "print (soup.prettify())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get the title in each page\n",
    "\n",
    "We have 30 articles on each page. Let us see if we can get the html tag and attribute to get this data\n",
    "\n",
    "Let us see which html tag we need the '`td .title`'\n",
    "\n",
    "![](img/title.png)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "title_class = soup.select('td .title')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "61"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(title_class)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We are getting double the number -> Let us see why by examining the first two elements in the list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<td align=\"right\" class=\"title\" valign=\"top\">1.</td>,\n",
       " <td class=\"title\"><a href=\"https://www.springboard.com/blog/eat-rate-love-an-exploration-of-r-yelp-and-the-search-for-good-indian-food/\" rel=\"nofollow\">An Exploration of R, Yelp, and the Search for Good Indian Food</a><span class=\"comhead\"> (springboard.com) </span></td>]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[0:2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<td class=\"title\"><a href=\"/x?fnid=CSS821ucAs\" rel=\"nofollow\">More</a></td>"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[-1]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Aha - We are getting both the number and the title name. We need to be even more specific and pick only the one with `<a>`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "title_class = soup.select('td .title a')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "31"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(title_class)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Why do we get 31 and not 30 articles... Lets check"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<a href=\"https://www.springboard.com/blog/eat-rate-love-an-exploration-of-r-yelp-and-the-search-for-good-indian-food/\" rel=\"nofollow\">An Exploration of R, Yelp, and the Search for Good Indian Food</a>"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'An Exploration of R, Yelp, and the Search for Good Indian Food'"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[0].get_text()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<a href=\"/x?fnid=CSS821ucAs\" rel=\"nofollow\">More</a>"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[-1]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Ok... so the last link is the link to the \"More\" - which is the next page. That is good. We can use it to get the link to the next url to scrape\n",
    "\n",
    "**NOTE: Taking care of the edge cases**\n",
    "\n",
    "When we run this on multiple pages, we find that sometimes there are more than one `<a>` link in the title. To take of this we re-write the selection criterion to only pick the first `<a>` link in the title only"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "title_class = soup.select('td .title > a:nth-of-type(1)')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'An Exploration of R, Yelp, and the Search for Good Indian Food'"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "title_class[0].get_text()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Get the date for each title\n",
    "\n",
    "To get the date for each title, we need html tag and class - '`td .subtext`'\n",
    "\n",
    "![](img/date.png)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "date_class = soup.select('.subtext')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "30"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(date_class)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<td class=\"subtext\"><span id=\"score_11989\">5 points</span> by <a href=\"user?id=Rogerh91\">Rogerh91</a> 4 hours ago  | <a href=\"item?id=11989\">discuss</a></td>"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "date_class[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'5 points by Rogerh91 4 hours ago  | discuss'"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "date_class[0].get_text()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Automate the Scraping Process\n",
    "\n",
    "We now write a function which starts with first page, gets all the title and date string and puts it in to a dataframe and then moves to the next page."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "title    0\n",
       "date     0\n",
       "dtype: int64"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Let us create an empty dataframe to store the data\n",
    "df = pd.DataFrame(columns=['title','date'])\n",
    "df.count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def get_data_from_tau(url):\n",
    "    print(url)\n",
    "    dataTau = requests.get(url)\n",
    "    soup = BeautifulSoup(dataTau.content,'html.parser')\n",
    "    title_class = soup.select('td .title > a:nth-of-type(1)')\n",
    "    date_class = soup.select('.subtext')\n",
    "    print(len(title_class),len(date_class))\n",
    "    for i in range(len(title_class)-1):\n",
    "        df.loc[df.shape[0]] = [title_class[i].get_text(),date_class[i].get_text()]\n",
    "    print('updated df with data')\n",
    "    return title_class[len(title_class) - 1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "http://www.datatau.com\n",
      "31 30\n",
      "updated df with data\n",
      "http://www.datatau.com/x?fnid=aFffLhBQyN\n",
      "31 30\n",
      "updated df with data\n",
      "http://www.datatau.com/x?fnid=0urLeo7gjV\n",
      "31 30\n",
      "updated df with data\n",
      "http://www.datatau.com/x?fnid=uMJcXgJIJs\n",
      "31 30\n",
      "updated df with data\n",
      "http://www.datatau.com/x?fnid=qyftRfLQ6D\n",
      "31 30\n",
      "updated df with data\n",
      "http://www.datatau.com/x?fnid=VcML5GXJiJ\n",
      "31 30\n",
      "updated df with data\n"
     ]
    }
   ],
   "source": [
    "url = base_url\n",
    "for i in range(0,6):\n",
    "    more_url = get_data_from_tau(url)\n",
    "    url = base_url+more_url['href']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(180, 2)"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>title</th>\n",
       "      <th>date</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>An Exploration of R, Yelp, and the Search for ...</td>\n",
       "      <td>5 points by Rogerh91 6 hours ago  | discuss</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Deep Advances in Generative Modeling</td>\n",
       "      <td>7 points by gwulfs 15 hours ago  | 1 comment</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Spark Pipelines: Elegant Yet Powerful</td>\n",
       "      <td>3 points by aouyang1 9 hours ago  | discuss</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Shit VCs Say</td>\n",
       "      <td>3 points by Argentum01 10 hours ago  | discuss</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Python, Machine Learning, and Language Wars</td>\n",
       "      <td>4 points by pmigdal 17 hours ago  | discuss</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                               title  \\\n",
       "0  An Exploration of R, Yelp, and the Search for ...   \n",
       "1               Deep Advances in Generative Modeling   \n",
       "2              Spark Pipelines: Elegant Yet Powerful   \n",
       "3                                       Shit VCs Say   \n",
       "4        Python, Machine Learning, and Language Wars   \n",
       "\n",
       "                                             date  \n",
       "0     5 points by Rogerh91 6 hours ago  | discuss  \n",
       "1    7 points by gwulfs 15 hours ago  | 1 comment  \n",
       "2     3 points by aouyang1 9 hours ago  | discuss  \n",
       "3  3 points by Argentum01 10 hours ago  | discuss  \n",
       "4     4 points by pmigdal 17 hours ago  | discuss  "
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "df.to_csv('data_tau.csv', encoding = \"utf8\", index = False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}