Td-06-Speakers.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Getting the Pages that List Speakers\n",
    "\n",
    "After some rooting around on the TED website, examining the Speakers home page, it looks like there are 86 pages that list TED speakers, with URLS like this: `https://www.ted.com/speakers?page=1`. My plan is to:\n",
    "\n",
    "1. create a list of pages in a text file, \n",
    "2. download the 86 pages, \n",
    "3. parse the speakers out,\n",
    "4. create a second list of pages with the `ted.com/speakers/speaker_name\" format`\n",
    "5. download all those pages\n",
    "6. parse them into a CSV for KK.\n",
    "\n",
    "Oh, I hope this works."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "There's going to be a lot of files created in this process, so it's important to remember where I am:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'/Users/c00253218/Code/tedtalks/data'"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "% pwd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "# As always, the collected imports for this notebook are at the top:\n",
    "\n",
    "import re, csv, os\n",
    "from bs4 import BeautifulSoup"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 1: Create a list of pages"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://www.ted.com/speakers?page=1\n",
      "https://www.ted.com/speakers?page=2\n",
      "https://www.ted.com/speakers?page=3\n",
      "https://www.ted.com/speakers?page=4\n"
     ]
    }
   ],
   "source": [
    "# This is just proof of concept. I actually used range(1,87) to get\n",
    "# the list I needed and pasted it into a text document.\n",
    "for i in range(1,5):\n",
    "    print(\"https://www.ted.com/speakers?page=\" + str(i))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 2: Download the pages\n",
    "\n",
    "Okay, the text file is `speaker_index_pages.txt` in the data/speakers/directory. I used the following to download all 86 speaker pages to the indices directory:\n",
    "\n",
    "    wget -w 2 -i ../speaker_index_pages.txt\n",
    "\n",
    "Then, being lazy and not wanting to figure out how to parse all the files into one list (see below), I simply concatenated all the files into one, with the plan to use `BeautifulSoup` to run through it.\n",
    "\n",
    "    cat indices/* > speakers_all_pages.txt\n",
    "\n",
    "### Step 3: Parse the Speaker URLs Out of the Pages\n",
    "\n",
    "Inside the HTML, each speaker's profile can be found in the following line:\n",
    "\n",
    "    <a class=\"results__result media media--sm-v m4\" href=\"/speakers/ellen_t_hoen\">\n",
    "\n",
    "So we need the `href` attribute for the `results__result` class."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "with open('./speakers/speakers_all_pages.txt', 'r') as myfile:\n",
    "    data = myfile.read()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "the_soup = BeautifulSoup(data, \"lxml\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "bs4.BeautifulSoup"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(the_soup)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<a class=\"results__result media media--sm-v m4\" href=\"/speakers/ellen_t_hoen\">\n",
      "<div class=\"media__image media__image--thumb\">\n",
      "<span class=\"thumb thumb--square\"><span class=\"thumb__sizer\"><span class=\"thumb__tugger\"><img alt=\"\" class=\" thumb__image\" play=\"false\" src=\"https://pi.tedcdn.com/r/pe.tedcdn.com/images/ted/bcd3208945bf8b311418b64f917b1f38e84a24e8_800x600.jpg?h=191&amp;w=254\"/><span class=\"thumb__aligner\"></span></span></span></span>\n",
      "</div>\n",
      "<div class=\"media__message\">\n",
      "<h4 class=\"h7 m5\">\n",
      "Ellen<br/>'t Hoen</h4>\n",
      "<p class=\"p4\">\n",
      "<strong>Medicine law expert</strong>\n",
      "</p>\n",
      "</div>\n",
      "</a>\n"
     ]
    }
   ],
   "source": [
    "speaker_suffix = the_soup.find('a', {'class':'results__result media media--sm-v m4'})\n",
    "print(speaker_suffix)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'str'> /speakers/ellen_t_hoen\n"
     ]
    }
   ],
   "source": [
    "speaker_suffix = the_soup.find('a', {'class':'results__result'})['href']\n",
    "print(type(speaker_suffix), speaker_suffix)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "30"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "speaker_suffixes = the_soup.findAll('a', {'class':'results__result media media--sm-v m4'})\n",
    "len(speaker_suffixes)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Why is this only returning 30 items? Using search in a plain text editor (Atom) on the same files above, there are 2572 occurrences of **`results__result`**.\n",
    "\n",
    "```python\n",
    "# Archived code that was meant to generate URLs from the soup above\n",
    "suffixes = [i.attrs[\"href\"] for i in speaker_suffixes]\n",
    "urls = [str(\"https://www.ted.com\"+suffix) for suffix in suffixes]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Using regex to get the speaker suffix\n",
    "\n",
    "Okay, I'm still not sure what's going on with the truncated input above, but what I am going to try to do below is read the file in as a string and then use regex to grab the speaker suffixes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2572"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "suffixes = re.findall(r'/speakers/(.*?)\\'>', data)\n",
    "len(suffixes)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "urls = [str(\"https://www.ted.com/speakers/\"+suffix) for suffix in suffixes]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['https://www.ted.com/speakers/ellen_t_hoen',\n",
       " 'https://www.ted.com/speakers/sandra_aamodt',\n",
       " 'https://www.ted.com/speakers/trevor_aaronson',\n",
       " 'https://www.ted.com/speakers/chris_abani',\n",
       " 'https://www.ted.com/speakers/yassmin_abdel_magied']"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "urls[0:5]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Create a second list with the speaker suffixes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "with open('./speakers/speaker_urls.txt', 'w') as f:\n",
    "    for item in urls:\n",
    "        f.write(\"%s\\n\" % item)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Step 5** was done using **`wget`**: \n",
    "\n",
    "```bash\n",
    "wget -w 2 -i ../speaker_urls.txt\n",
    "```\n",
    "\n",
    "And here's the eventual report:\n",
    "\n",
    "```\n",
    "FINISHED --2018-11-15 22:05:00--\n",
    "Total wall clock time: 2h 0m 43s\n",
    "Downloaded: 2569 files, 91M in 7.0s (13.1 MB/s)\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Step 6: Parse the speaker profiles"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "/Users/c00253218/Code/tedtalks/data/speakers\n"
     ]
    }
   ],
   "source": [
    "% cd speakers"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[1m\u001b[34mindices\u001b[m\u001b[m/                  speaker_urls.txt          speakers_raw.csv\r\n",
      "\u001b[1m\u001b[34mprofiles\u001b[m\u001b[m/                 speakers_all_pages.txt\r\n",
      "speaker_index_pages.txt   speakers_gender_test.csv\r\n"
     ]
    }
   ],
   "source": [
    "% ls"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here's the HTML where things are found:\n",
    "\n",
    "* **Name**: `<meta name=\"author\" content=\"Aala El-Khani\" />` or `<h1 class=\"h2 profile-header__name\">`\n",
    "* **Occupation**: `<div class=\"p2 profile-header__summary\">`\n",
    "* **Intro**: `<div class=\"profile-intro\">`\n",
    "* **Profile**: `<div class=\"section section--minor\">`\n",
    "\n",
    "These are all converted into **`BS4`** searches below. (Fingers crossed that these work.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "def parsethis(soup):\n",
    "    if (soup.find('h1', {'class' : 'h2 profile-header__name'})) is not None:\n",
    "        name = soup.find('h1', {'class' : 'h2 profile-header__name'}).text.strip('\\n')\n",
    "        occupation = soup.find('div', {'class' : 'p2 profile-header__summary'}).text.strip('\\n')\n",
    "        intro = soup.find('div', {'class' : 'profile-intro'}).text.strip('\\n')\n",
    "        profile = soup.find('div', {'class' : 'section section--minor'}).text.strip('\\n')\n",
    "        return name, occupation, intro, profile\n",
    "    else:\n",
    "        return 'undetected','undetected','undetected','undetected'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "def to_csv(pth, out):\n",
    "    # open file to write to.\n",
    "    with open(out, \"w\") as out:\n",
    "        # create csv.writer\n",
    "        wr = csv.writer(out)\n",
    "        # write headers\n",
    "        wr.writerow([\"name\", \"occupation\", \"introduction\", \"profile\"])\n",
    "        # get all our html files\n",
    "        for html in os.listdir(pth):\n",
    "            with open(os.path.join(pth, html)) as f:\n",
    "                print(html) # prints off name as it goes?\n",
    "                # parse the file and write the data to a row.\n",
    "                wr.writerow(parsethis(BeautifulSoup(f, \"html\")))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gary_haugen\n",
      "rabbi_lord_jonathan_sacks\n",
      "joe_kowan\n",
      "allan_adams\n",
      "peter_tyack\n",
      "heather_brooke\n",
      "reed_hastings\n",
      "oscar_schwartz\n",
      "marwa_al_sabouni\n",
      "steven_addis\n",
      "nizar_ibrahim\n",
      "ian_bremmer\n",
      "lisa_harouni\n",
      "shashi_tharoor\n",
      "sergey_brin\n",
      "candy_chang\n",
      "susan_solomon\n",
      "jk_rowling\n",
      "diane_kelly\n",
      "thelma_golden\n",
      "john_kasaona\n",
      "lee_smolin\n",
      "elon_musk\n",
      "yossi_vardi\n",
      "david_logan\n",
      "christiane_amanpour\n",
      "ndidi_nwuneli\n",
      "jonas_gahr_store\n",
      "larry_brilliant\n",
      "zaria_forman\n",
      "marc_abrahams\n",
      "adam_driver\n",
      "halla_tomasdottir\n",
      "sarah_donnelly\n",
      "courtney_e_martin\n",
      "joshua_klein\n",
      "john_gable\n",
      "john_la_grou\n",
      "christine_sun_kim\n",
      "deborah_gordon\n",
      "bart_knols\n",
      "einstein_the_parrot\n",
      "mike_degruy\n",
      "peter_gabriel\n",
      "jill_heinerth\n",
      "haas_hahn\n",
      "benjamin_wallace\n",
      "ethan_zuckerman\n",
      "marco_tempest\n",
      "pam_warhurst\n",
      "neri_oxman\n",
      "cynthia_kenyon\n",
      "chimamanda_ngozi_adichie\n",
      "jonathan_marks\n",
      "hannah_brencher\n",
      "birke_baehr\n",
      "abraham_verghese\n",
      "katie_hinde\n",
      "sheila_patek\n",
      "nirmalya_kumar\n",
      "raj_panjabi\n",
      "kate_stafford\n",
      "lauren_sallan\n",
      "sian_leah_beilock\n",
      "jimmy_lin\n",
      "elizabeth_lindsey\n",
      "manwar_ali\n",
      "peter_fankhauser\n",
      "sue_desmond_hellman\n",
      "anindya_kundu\n",
      "jack_choi\n",
      "stuart_duncan\n",
      "peter_molyneux\n",
      "damon_davis\n",
      "ingrid_betancourt\n",
      "lidia_yuknavitch\n",
      "molly_stevens\n",
      "patrick_awuah\n",
      "keith_schacht\n",
      "jason_mccue\n",
      "diane_wolk_rogers\n",
      "evgeny_morozov\n",
      "damon_horowitz\n",
      "adrianne_haslet_davis\n",
      "simon_anholt\n",
      "sendhil_mullainathan\n",
      "roger_mcnamee\n",
      "rose_goslinga\n",
      "joshua_foer\n",
      "stephanie_busari\n",
      "mitchell_besser\n",
      "christiana_figueres\n",
      "rei\n",
      "nic_marks\n",
      "donald_hoffman\n",
      "james_watson\n",
      "chris_bangle\n",
      "edwidge_danticat\n",
      "krista_donaldson\n",
      "luke_syson\n",
      "rives\n",
      "ramsey_musallam\n",
      "bryan_stevenson\n",
      "michael_archer\n",
      "michael_green_spi\n",
      "sam_kass\n",
      "sangu_delle\n",
      "janet_iwasa\n",
      "stanley_mcchrystal\n",
      "cathy_o_neil\n",
      "kate_darling\n",
      "linda_hill\n",
      "fred_jansen\n",
      "they_might_be_giants\n",
      "trevor_timm\n",
      "alexis_ohanian\n",
      "elif_shafak\n",
      "ric_elias\n",
      "carol_dweck\n",
      "graham_hawkes\n",
      "amy_tan\n",
      "alex_wissner_gross\n",
      "supasorn_suwajanakorn\n",
      "kayla_briet\n",
      "william_mcdonough\n",
      "laura_l_dunn\n",
      "vikram_sharma\n",
      "sydney_chaffee\n",
      "casey_gerald\n",
      "jinha_lee\n",
      "norman_lear\n",
      "dread_scott\n",
      "ruth_chang\n",
      "kristin_poinar\n",
      "eric_haseltine\n",
      "pavan_sukhdev\n",
      "bjorn_lomborg\n",
      "arvind_gupta\n",
      "bill_bernat\n",
      "drew_philp\n",
      "alice_goffman\n",
      "yuval_noah_harari\n",
      "navi_radjou\n",
      "stefana_broadbent\n",
      "jessica_shortall\n",
      "dennis_hong\n",
      "marlene_zuk\n",
      "christian_benimana\n",
      "greg_gage\n",
      "dave_eggers\n",
      "michael_tilson_thomas\n",
      "cesar_harada\n",
      "joe_derisi\n",
      "dale_dougherty\n",
      "saki_mafundikwa\n",
      "julia_galef\n",
      "ray_zahab\n",
      "ameenah_gurib_fakim\n",
      "paula_hammond\n",
      "phil_plait\n",
      "anab_jain\n",
      "kirsty_duncan\n",
      "alberto_cairo\n",
      "curtis_wall_street_carroll\n",
      "steven_johnson\n",
      "elizabeth_cawein\n",
      "sandra_aamodt\n",
      "beau_lotto\n",
      "lakshmi_pratury\n",
      "peter_doolittle\n",
      "omar_ahmad\n",
      "dalia_mogahed\n",
      "shih_chieh_huang\n",
      "amber_case\n",
      "neil_turok\n",
      "danny_hillis\n",
      "harsha_bhogle\n",
      "abigail_washburn\n",
      "chris_nowinski\n",
      "david_mackay\n",
      "beeban_kidron\n",
      "michael_mcdaniel\n",
      "gayle_tzemach_lemmon\n",
      "jason_clay\n",
      "melissa_marshall\n",
      "dolly_chugh\n",
      "andreas_raptopoulos\n",
      "isabel_allende\n",
      "jon_bowers\n",
      "ivan_oransky\n",
      "philip_zimbardo\n",
      "tara_houska\n",
      "jim_flynn\n",
      "ernest_madu\n",
      "levon_biss\n",
      "antonio_donato_nobre\n",
      "shah_rukh_khan\n",
      "kirk_sorensen\n",
      "cameron_herold\n",
      "e_o_wilson\n",
      "tabetha_boyajian\n",
      "victoria_pratt\n",
      "elora_hardy\n",
      "mick_cornett\n",
      "deandrea_salvador\n",
      "daniel_reisel\n",
      "tal_golesworthy\n",
      "jason_pontin\n",
      "benoit_mandelbrot\n",
      "robert_full\n",
      "munir_virani\n",
      "denis_dutton\n",
      "paul_snelgrove\n",
      "linus_torvalds\n",
      "beth_malone\n",
      "ross_lovegrove\n",
      "doris_kearns_goodwin\n",
      "gail_reed\n",
      "reshma_saujani\n",
      "mike_gil\n",
      "nadine_burke_harris_1\n",
      "leslie_dodson\n",
      "jennifer_healey\n",
      "daniel_kraft\n",
      "stefano_mancuso\n",
      "steve_howard\n",
      "nadia_lopez\n",
      "pamela_meyer\n",
      "harald_haas\n",
      "sugata_mitra\n",
      "robert_legato\n",
      "richard_baraniuk\n",
      "david_mccandless\n",
      "charity_tilleman_dick\n",
      "jeremy_kasdin\n",
      "loretta_napoleoni\n",
      "jill_cornell_tarter\n",
      "morgan_o_neill\n",
      "huang_yi\n",
      "colin_stokes\n",
      "harish_manwani\n",
      "jia_jiang\n",
      "peter_weinstock\n",
      "rainer_strack\n",
      "sunni_brown\n",
      "matthew_childs\n",
      "stefan_larsson\n",
      "mary_lou_jepsen\n",
      "amy_lockwood\n",
      "jon_ronson\n",
      "imogen_heap\n",
      "prosanta_chakrabarty\n",
      "ash_beckham\n",
      "andrew_blum\n",
      "inge_missmahl\n",
      "joel_levine\n",
      "sarah_bergbreiter\n",
      "giles_duley\n",
      "cesar_kuriyama\n",
      "frances_larson\n",
      "tom_hulme\n",
      "ethel\n",
      "vinay_venkatraman\n",
      "gary_liu\n",
      "nikki_clifton\n",
      "rob_forbes\n",
      "j_j_abrams\n",
      "james_b_glattfelder\n",
      "bobby_mcferrin\n",
      "rory_stewart\n",
      "kaustav_dey\n",
      "sam_martin\n",
      "daniel_goleman\n",
      "christoph_niemann\n",
      "ziauddin_yousafzai\n",
      "t_morgan_dixon\n",
      "walter_hood\n",
      "rodrigo_y_gabriela\n",
      "bastian_schaefer\n",
      "jeffrey_kluger\n",
      "deborah_rhodes\n",
      "ben_kacyra\n",
      "latif_nasser\n",
      "susan_shaw\n",
      "jaime_lerner\n",
      "christen_reighter\n",
      "carlos_bautista\n",
      "david_epstein\n",
      "angela_lee_duckworth\n",
      "tiq_milan\n",
      "kelly_richmond_pope\n",
      "karen_j_meech\n",
      "ani_liu\n",
      "abigail_marsh\n",
      "elizabeth_streb\n",
      "kandace_sumner\n",
      "sinead_burke\n",
      "sherwin_nuland\n",
      "carin_bondar\n",
      "robert_neuwirth\n",
      "winona_guo\n",
      "karen_armstrong\n",
      "chris_anderson_wired\n",
      "nathaniel_kahn\n",
      "emma_marris\n",
      "jose_andres\n",
      "shereen_el_feki\n",
      "nina_tandon\n",
      "kare_anderson\n",
      "lian_pin_koh\n",
      "johan_rockstrom\n",
      "matilda_ho\n",
      "andrew_solomon\n",
      "stefon_harris\n",
      "nikki_webber_allen\n",
      "hannah_buerckstuemmer\n",
      "shawn_achor\n",
      "andrew_pelling\n",
      "roger_stein\n",
      "margaret_mitchell\n",
      "plankton_chronicles_project\n",
      "siddhartha_roy\n",
      "chuck_nice\n",
      "marc_kushner\n",
      "alexander_betts\n",
      "juliana_rotich\n",
      "todd_humphreys\n",
      "david_chalmers\n",
      "john_walker\n",
      "ryan_lobo\n",
      "jd_vance\n",
      "lili_haydn\n",
      "peter_eigen\n",
      "kenneth_shinozuka\n",
      "alejandro_aravena\n",
      "henry_evans\n",
      "chika_ezeanya_esiobu\n",
      "sheikha_al_mayassa\n",
      "luis_von_ahn\n",
      "emmanuel_jal\n",
      "esther_duflo\n",
      "john_doerr\n",
      "peter_diamandis\n",
      "knut_haanaes\n",
      "jaron_lanier\n",
      "leymah_gbowee\n",
      "van_jones\n",
      "ben_saunders\n",
      "arunachalam_muruganantham\n",
      "wade_davis\n",
      "pat_mitchell\n",
      "janet_echelman\n",
      "aomawa_shields\n",
      "saul_griffith\n",
      "tom_rielly\n",
      "david_brenner\n",
      "richard_dawkins\n",
      "sofi_tukker\n",
      "jimmy_carter\n",
      "meklit_hadero\n",
      "sebastian_bortnik\n",
      "chris_urmson\n",
      "ben_roche\n",
      "jane_poynter\n",
      "itay_talgam\n",
      "alanna_shaikh\n",
      "anna_deavere_smith\n",
      "lesley_hazleton\n",
      "seth_shostak\n",
      "emma_teeling\n",
      "yuyu_rau\n",
      "david_kwong\n",
      "antonio_guterres\n",
      "christopher_deam\n",
      "mark_bezos\n",
      "jesse_j_perez\n",
      "drew_curtis\n",
      "andrew_dent\n",
      "rachel_sussman\n",
      "burt_rutan\n",
      "andrew_fitzgerald\n",
      "todd_kuiken\n",
      "wendy_chung\n",
      "brenda_laurel\n",
      "carrie_nugent\n",
      "franco_sacchi\n",
      "margaret_wertheim\n",
      "pilobolus\n",
      "jay_silver\n",
      "helder_guimaraes\n",
      "diebedo_francis_kere\n",
      "hans_rosling\n",
      "fred_krupp\n",
      "boaz_almog\n",
      "shameem_akhtar_mari\n",
      "justin_davidson\n",
      "dan_phillips\n",
      "dayo_ogunyemi\n",
      "chris_sheldrick\n",
      "scott_dinsmore\n",
      "bernie_kraus\n",
      "martina_flor\n",
      "alessandro_acquisti\n",
      "jill_bolte_taylor\n",
      "billie_jean_king\n",
      "shree_bose\n",
      "cynthia_erivo\n",
      "kelli_anderson\n",
      "benedetta_berti\n",
      "jody_williams\n",
      "mckenna_pope\n",
      "chris_domas\n",
      "kevin_stone\n",
      "hendrik\n",
      "cat_laine\n",
      "sasha_dichter\n",
      "william_ury\n",
      "dixon_chibanda\n",
      "brian_little\n",
      "aditi_shankardass\n",
      "bruno_torturra\n",
      "lucy_mcrae\n",
      "niki_okuk\n",
      "fiorenzo_omenetto\n",
      "drew_dudley\n",
      "angela_patton\n",
      "billy_graham\n",
      "steve_keil\n",
      "caroline_phillips\n",
      "greg_asner\n",
      "chris_anderson_ted\n",
      "boniface_mwangi\n",
      "mary_roach\n",
      "sharmeen_obaid_chinoy\n",
      "dan_gilbert\n",
      "stephen_hawking\n",
      "jen_wilcox\n",
      "thomas_hellum\n",
      "patsy_rodenburg\n",
      "gregoire_courtine\n",
      "giorgia_lupi\n",
      "bryn_freedman\n",
      "michael_metcalfe\n",
      "leslie_morgan_steiner\n",
      "suzana_herculano_houzel\n",
      "mark_tyndall\n",
      "devdutt_pattanaik\n",
      "james_beacham\n",
      "kavita_ramdas\n",
      "stephen_lawler\n",
      "juno_mac\n",
      "yasheng_huang\n",
      "christopher_mcdougall\n",
      "jeff_bezos\n",
      "camille_seaman\n",
      "mei_lin_neo\n",
      "jill_shargaa\n",
      "lisa_dyson\n",
      "fields_wicker_miurin\n",
      "lemon_andersen\n",
      "michael_specter\n",
      "michael_nielsen\n",
      "suheir_hammad\n",
      "sylvia_earle\n",
      "shlomo_benartzi\n",
      "tony_porter\n",
      "daniel_susskind\n",
      "ronny_edry\n",
      "poppy_crum\n",
      "sara_seager\n",
      "evelyn_glennie\n",
      "dk_osseo_asare\n",
      "canku_one_star\n",
      "mary_bassett\n",
      "scilla_elworthy\n",
      "mark_bittman\n",
      "gerard_ryle\n",
      "rebecca_saxe\n",
      "sajay_samuel\n",
      "joe_madiath\n",
      "a_balasubramaniam\n",
      "nagin_cox\n",
      "aala_el_khani\n",
      "ian_dunbar\n",
      "scott_williams\n",
      "erin_marie_saltman\n",
      "david_griffin\n",
      "naoko_ishii\n",
      "gwynne_shotwell\n",
      "frances_frei\n",
      "monica_araya\n",
      "barat_ali_batoor\n",
      "joshua_silver\n",
      "mallika_sarabhai\n",
      "thomas_goetz\n",
      "adam_sadowsky\n",
      "bob_inglis\n",
      "roy_gould\n",
      "dylan_marron\n",
      "natalie_macmaster\n",
      "annette_heuser\n",
      "martin_reeves\n",
      "rodrigo_canales\n",
      "steven_wise\n",
      "alastair_parvin\n",
      "colin_robertson\n",
      "daniel_barasch\n",
      "ben_goldacre\n",
      "george_papandreou\n",
      "jeff_hawkins\n",
      "nana_vasconcelos\n",
      "liu_bolin\n",
      "euvin_naidoo\n",
      "charles_fleischer\n",
      "shaka_senghor\n",
      "katie_bouman\n",
      "jeff_hancock\n",
      "dan_bricklin\n",
      "raspyni_brothers\n",
      "dan_meyer\n",
      "blaise_aguera_y_arcas\n",
      "ken_kamler\n",
      "kate_marvel\n",
      "dan_bell\n",
      "roman_mars\n",
      "aparna_rao\n",
      "paul_moller\n",
      "rebeca_hwang\n",
      "ryan_holladay\n",
      "robin_steinberg\n",
      "armando_azua_bustos\n",
      "sam_harris\n",
      "joe_sabia\n",
      "tito_deler\n",
      "david_gallo\n",
      "jor_el\n",
      "steven_pinker\n",
      "mark_shaw\n",
      "pattie_maes\n",
      "david_anderson\n",
      "alan_eustace\n",
      "black_label_movement\n",
      "romulus_whitaker\n",
      "nate_silver\n",
      "auke_ijspeert\n",
      "fei_fei_li\n",
      "marcel_dicke\n",
      "paul_lewis\n",
      "anushka_naiknaware\n",
      "sharon_brous\n",
      "kevin_breel\n",
      "yann_dall_aglio\n",
      "bahia_shehab\n",
      "oskar_eustis\n",
      "andrew_youn\n",
      "michael_botticelli\n",
      "marcus_byrne\n",
      "michele_l_sullivan\n",
      "britta_riley\n",
      "jon_mooallem\n",
      "colin_grant\n",
      "jenna_mccarthy\n",
      "lauran_arledge\n",
      "simon_lewis\n",
      "michael_moschen\n",
      "jamila_raqib\n",
      "jim_simons\n",
      "freeman_dyson\n",
      "olu_fe_mi_ta_i_wo\n",
      "rory_bremner\n",
      "erik_johannson\n",
      "ivan_krastev\n",
      "frans_de_waal\n",
      "riccardo_sabatini\n",
      "derek_paravicini\n",
      "david_damberger\n",
      "penelope_jagessar_chaffer\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "kevin_njabo\n",
      "ola_rosling\n",
      "sebastian_deterding\n",
      "richard_branson\n",
      "isaac_lidsky\n",
      "ines_hercovich\n",
      "miriam_zoila_perez\n",
      "maurizio_seracini\n",
      "max_tegmark\n",
      "sandrine_thuret\n",
      "soyapi_mumba\n",
      "robin_ince\n",
      "boyd_varty\n",
      "ben_ambridge\n",
      "sheryl_wudunn\n",
      "katherine_kuchenbecker\n",
      "michael_pemberton\n",
      "sarah_murray\n",
      "bel_pesce\n",
      "chris_hadfield\n",
      "andrew_mwenda\n",
      "amy_webb\n",
      "david_kelley\n",
      "david_keith\n",
      "marina_abramovic\n",
      "anant_agarwal\n",
      "emily_oster\n",
      "bhu_srinivasan\n",
      "paul_knoepfler\n",
      "robert_ballard\n",
      "sophie_andrews\n",
      "bruce_feiler\n",
      "angelo_vermeulen\n",
      "elise_legrow\n",
      "dan_goldstein\n",
      "vilayanur_ramachandran\n",
      "nick_bostrom\n",
      "ilona_stengel\n",
      "mary_maker\n",
      "ibeyi\n",
      "alyssa_monks\n",
      "ajit_narayanan\n",
      "alexis_charpentier\n",
      "james_patten\n",
      "hugh_herr\n",
      "paul_debevec\n",
      "sanford_biggers\n",
      "justin_hall_tipping\n",
      "daan_roosegaarde\n",
      "iain_mcgilchrist\n",
      "olafur_eliasson\n",
      "vincent_moon\n",
      "garry_kasparov\n",
      "kiran_sethi\n",
      "sheila_nirenberg\n",
      "rachel_botsman\n",
      "jose_antonio_abreu\n",
      "jim_yong_kim\n",
      "philip_evans\n",
      "ismael_nazario\n",
      "chris_burkard\n",
      "latoya_ruby_frazier\n",
      "alex_steffen\n",
      "shimon_schocken\n",
      "amanda_palmer\n",
      "peter_haas\n",
      "soka_moses\n",
      "janine_shepherd\n",
      "matthieu_ricard\n",
      "per_espen_stoknes\n",
      "didier_sornette\n",
      "angel_hsu\n",
      "alaa_murabit\n",
      "kate_orff\n",
      "taiye_selasi\n",
      "seema_bansal\n",
      "ji_hae_park\n",
      "cosmin_mihaiu\n",
      "suki_kim\n",
      "eames_demetrios\n",
      "megan_kamerick\n",
      "noy_thrupkaew\n",
      "michael_murphy\n",
      "jorge_ramos\n",
      "jean_paul_mari\n",
      "greg_stone\n",
      "john_hodgman\n",
      "paul_kemp_robertson\n",
      "jenni_chang_and_lisa_dazols\n",
      "vincent_cochetel\n",
      "carol_f_cohen\n",
      "luma_mufleh\n",
      "uri_alon\n",
      "hector_garcia\n",
      "tanya_menon\n",
      "jonathan_tepperman\n",
      "jason_b_rosenthal\n",
      "bonnie_bassler\n",
      "dina_katabi\n",
      "pierre_thiam\n",
      "al_gore\n",
      "rebecca_mackinnon\n",
      "stefan_sagmeister\n",
      "robin_hanson\n",
      "mwende_freequency_katwiwa\n",
      "johnny_lee\n",
      "jennifer_8_lee\n",
      "deborah_willis\n",
      "ben_cort\n",
      "rodrigo_bijou\n",
      "bertrand_piccard\n",
      "adam_de_la_zerda\n",
      "robert_palmer\n",
      "zak_ebrahim\n",
      "theo_jansen\n",
      "angela_belcher\n",
      "tammy_lally\n",
      "steve_truglia\n",
      "michelle_obama\n",
      "conrad_wolfram\n",
      "torsten_reil\n",
      "john_underkoffler\n",
      "emily_pilloton\n",
      "sunni_patterson\n",
      "david_casarett\n",
      "reed_kroloff\n",
      "augie_picado\n",
      "johanna_blakley\n",
      "bandi_mbubi\n",
      "matthew_brookshire\n",
      "paul_greenberg\n",
      "tara_winkler\n",
      "nnedi_okorafor\n",
      "carl_schoonover\n",
      "patrick_chappatte\n",
      "homaro_cantu\n",
      "rainn_wilson\n",
      "ian_firth\n",
      "antonio_damasio\n",
      "caleb_chung\n",
      "astro_teller\n",
      "jocelyne_bloch\n",
      "monika_bulaj\n",
      "russ_altman\n",
      "cynthia_breazeal\n",
      "claron_mcfadden\n",
      "victor_rios\n",
      "liza_donnelly\n",
      "denise_herzing\n",
      "olivier_scalabre\n",
      "nighat_dad\n",
      "abby_dobson\n",
      "michael_bodekaer\n",
      "mark_applebaum\n",
      "danielle_de_niese\n",
      "anthony_goldbloom\n",
      "catherine_mohr\n",
      "david_bolinsky\n",
      "david_deutsch\n",
      "r_a_mashelkar\n",
      "drew_berry\n",
      "michael_green\n",
      "jim_hemerling\n",
      "stacey_baker\n",
      "charles_elachi\n",
      "curtis_wong\n",
      "thandiswa_mazwai\n",
      "marlon_peterson\n",
      "nonny_de_la_pena\n",
      "g_t_bynum\n",
      "kk_raghava\n",
      "touria_el_glaoui\n",
      "kyra_gaunt\n",
      "keith_chen\n",
      "betta_lemme\n",
      "chieko_asakawa\n",
      "harry_baker\n",
      "adam_ockelford\n",
      "chris_emdin\n",
      "jakob_trollback\n",
      "mohamed_hijri\n",
      "alison_gopnik\n",
      "frederick_balagadde\n",
      "devita_davison\n",
      "tim_harford\n",
      "vik_muniz\n",
      "bill_clinton\n",
      "alan_siegel\n",
      "tobacco_brown\n",
      "allison_hunt\n",
      "robert_wright\n",
      "henry_markram\n",
      "adam_davidson\n",
      "carmen_agra_deedy\n",
      "michael_rubinstein\n",
      "stephen_coleman\n",
      "danielle_wood\n",
      "roger_ebert\n",
      "sharon_terry\n",
      "sunitha_krishnan\n",
      "tim_ferriss\n",
      "kelli_jean_drinkwater\n",
      "quixotic\n",
      "mehdi_ordikhani_seyedlar\n",
      "gavin_pretor_pinney\n",
      "matt_goldman\n",
      "melinda_french_gates\n",
      "michael_pollan\n",
      "mariano_sigman\n",
      "yasmin_green\n",
      "vy_higginsen_s_gospel_choir_of_harlem\n",
      "jonathan_harris\n",
      "jake_wood\n",
      "lerato_mokobe\n",
      "rishi_manchanda\n",
      "suzie_sheehy\n",
      "jean_baptiste_michel\n",
      "eduardo_saenz_de_cabezon\n",
      "c_k_williams\n",
      "michael_shermer\n",
      "rufus_griscom_alisa_volkam\n",
      "bruce_bueno_de_mesquita\n",
      "eleanor_longden\n",
      "dyan_denapoli\n",
      "jennifer_kahn\n",
      "theaster_gates\n",
      "tania_douglas\n",
      "tracie_keesee\n",
      "ravin_agrawal\n",
      "nina_jablonski\n",
      "kirk_citron\n",
      "john_searle\n",
      "paul_maccready\n",
      "paula_johnson\n",
      "tim_birkhead\n",
      "javed_akhtar\n",
      "rana_el_kaliouby\n",
      "caleb_barlow\n",
      "jp_rangaswami\n",
      "sonaar_luthra\n",
      "eric_sanderson\n",
      "michael_hendryx\n",
      "robin_murphy\n",
      "susan_etlinger\n",
      "billy_collins\n",
      "robert_j_gordon\n",
      "elizabeth_gilbert\n",
      "brewster_kahle\n",
      "peggy_orenstein\n",
      "jedidah_isler\n",
      "maurice_conti\n",
      "arthur_ganson\n",
      "karima_bennoune\n",
      "jr\n",
      "marc_koska\n",
      "lloyd_pendleton\n",
      "hannah_fry\n",
      "liv_boeree\n",
      "sebastian_seung\n",
      "carne_ross\n",
      "janet_stovall\n",
      "read_montague\n",
      "dan_pacholke\n",
      "paul_bloom\n",
      "ricardo_semler\n",
      "maysoon_zayid\n",
      "rebecca_brachman\n",
      "robin_nagle\n",
      "rob_dunbar\n",
      "david_katz\n",
      "alisa_miller\n",
      "alix_generous\n",
      "niels_van_namen\n",
      "tristram_wyatt\n",
      "simone_george\n",
      "boghuma_kabisen_titanji\n",
      "don_tapscott\n",
      "neil_gershenfeld\n",
      "trevor_aaronson\n",
      "daniel_tammet\n",
      "noah_feldman\n",
      "charles_moore\n",
      "qi_zhang\n",
      "sergei_lupashin\n",
      "jill_farrant\n",
      "yoav_medan\n",
      "nancy_duarte\n",
      "edi_rama\n",
      "salil_dudani\n",
      "naomi_oreskes\n",
      "neil_harbisson\n",
      "susan_colantuono\n",
      "chip_conley\n",
      "randall_munroe\n",
      "malcolm_london\n",
      "peter_attia\n",
      "neha_narula\n",
      "ed_ulbrich\n",
      "matthias_muellenbeck\n",
      "mayor_eduardo_paes\n",
      "emily_esfahani_smith\n",
      "christian_rodriguez\n",
      "caroline_harper\n",
      "karoliina_korppoo\n",
      "amy_edmondson\n",
      "misha_glenny\n",
      "jeff_smith\n",
      "martin_ford\n",
      "moshe_safdie\n",
      "elizabeth_murchison\n",
      "matt_johnson\n",
      "larry_lessig\n",
      "don_levy\n",
      "margaret_stewart\n",
      "rita_f_pierson\n",
      "regina_hartley\n",
      "bill_doyle\n",
      "chris_gerdes\n",
      "suzanne_talhouk\n",
      "roselinde_torres\n",
      "melissa_walker\n",
      "john_hockenberry\n",
      "seth_berkley\n",
      "dao_nguyen\n",
      "julia_sweeney\n",
      "bruno_maisonnier\n",
      "grace_kim\n",
      "naif_al_mutawa\n",
      "holly_morris\n",
      "washington_wachira\n",
      "jim_toomey\n",
      "nora_atkinson\n",
      "olga_yurkova\n",
      "xavier_de_kestelier\n",
      "stuart_brown\n",
      "bruce_schneier\n",
      "a_j_jacobs\n",
      "ken_goldberg\n",
      "robert_waldinger\n",
      "kate_adams\n",
      "erik_brynjolfsson\n",
      "david_pizarro\n",
      "marco_annunziata\n",
      "scott_rickard\n",
      "miguel_nicolelis\n",
      "caroline_casey\n",
      "el_seed\n",
      "pranav_mistry\n",
      "marc_goodman\n",
      "alan_smith\n",
      "scott_fraser\n",
      "shigeru_ban\n",
      "yoruba_richen\n",
      "ludwick_marishane\n",
      "martin_jacques\n",
      "manal_al_sharif\n",
      "josh_luber\n",
      "valarie_kaur\n",
      "sue_klebold\n",
      "clint_smith\n",
      "eben_bayer\n",
      "iqbal_quadir\n",
      "paul_hessburg\n",
      "donald_sadoway\n",
      "gayle_king\n",
      "abha_dawesar\n",
      "trevor_copp\n",
      "anas_aremeyaw_anas\n",
      "francis_de_los_reyes\n",
      "jen_brea\n",
      "vikram_patel\n",
      "karen_lloyd\n",
      "brene_brown\n",
      "deborah_lipstadt\n",
      "zubaida_bai\n",
      "mia_birdsong\n",
      "pratik_shah\n",
      "lisa_kristine\n",
      "natalie_panek\n",
      "john_amory\n",
      "cheryl_hayashi\n",
      "sitawa_wafula\n",
      "virginia_postrel\n",
      "neil_burgess\n",
      "john_delaney\n",
      "paola_antonelli\n",
      "jeff_fox\n",
      "james_a_white_sr\n",
      "sally_kohn\n",
      "krista_tippett\n",
      "mike_kinney\n",
      "audrey_choi\n",
      "john_francis\n",
      "larry_burns\n",
      "melinda_epler\n",
      "luvvie_ajayi\n",
      "steve_jobs\n",
      "ivan_coyote\n",
      "fabien_cousteau\n",
      "yann_arthus_bertrand\n",
      "janna_levin\n",
      "shaffi_mather\n",
      "maz_jobrani\n",
      "eric_x_li\n",
      "bob_mankoff\n",
      "joe_gebbia\n",
      "alain_de_botton\n",
      "mohamed_ali\n",
      "deb_roy\n",
      "rhiannon_giddens\n",
      "dave_meslin\n",
      "laura_robinson\n",
      "vijay_kumar\n",
      "kwabena_boahen\n",
      "shilo_shiv_suleman\n",
      "henry_lin\n",
      "patrisse_cullors\n",
      "steve_mccarroll\n",
      "jose_miguel_sokoloff\n",
      "richard_wilkinson\n",
      "avi_reichental\n",
      "bill_stone\n",
      "helen_gillett\n",
      "timothy_prestero\n",
      "sandi_toksvig\n",
      "marisa_fick_jordan\n",
      "mechai_viravaidya\n",
      "eric_lewis\n",
      "jackie_tabick\n",
      "lucien_engelen\n",
      "shivani_siroya\n",
      "marian_bantjes\n",
      "morgan_spurlock\n",
      "julie_taymor\n",
      "rupal_patel\n",
      "michael_merzenich\n",
      "anil_ananthaswamy\n",
      "philip_k_howard\n",
      "frederic_kaplan\n",
      "shyam_sankar\n",
      "rob_knight\n",
      "sophal_ear\n",
      "jane_goodall\n",
      "erin_mckean\n",
      "stew\n",
      "elise_roy\n",
      "howard_stevenson\n",
      "alison_killing\n",
      "aubrey_de_grey\n",
      "vivek_maru\n",
      "elizabeth_lesser\n",
      "willard_wigan\n",
      "mark_forsyth\n",
      "heather_barnett_1\n",
      "marvin_minsky\n",
      "brian_cox\n",
      "mark_raymond\n",
      "benjamin_zander\n",
      "nabila_alibhai\n",
      "dennis_vanengelsdorp\n",
      "lara_setrakian\n",
      "ali_carr_chellman\n",
      "frans_lanting\n",
      "nick_veasey\n",
      "janine_di_giovanni\n",
      "nellie_mckay\n",
      "toni_griffin\n",
      "dame_stephanie_steve_shirley\n",
      "tim_brown\n",
      "natalie_jeremijenko\n",
      "kevin_slavin\n",
      "joel_selanikio\n",
      "chance_coughenour\n",
      "kate_hartman\n",
      "joann_kuchera_morin\n",
      "simona_francese\n",
      "raul_midon\n",
      "ben_dunlap\n",
      "hank_willis_thomas\n",
      "garrett_lisi\n",
      "joseph_lassiter\n",
      "kang_lee\n",
      "rick_falkvinge\n",
      "elyn_saks\n",
      "kaitlyn_sadtler\n",
      "mena_trott\n",
      "siamak_hariri\n",
      "hod_lipson\n",
      "zachariah_mampilly\n",
      "edsel_salvana\n",
      "brett_hennig\n",
      "george_smoot\n",
      "bjarke_ingels\n",
      "chetana_gala_sinha\n",
      "morgana_bailey\n",
      "vint_cerf\n",
      "renny_gleeson\n",
      "jeremy_howard\n",
      "joshua_roman\n",
      "john_graham_cumming\n",
      "susan_pinker\n",
      "mihaly_csikszentmihalyi\n",
      "yelle\n",
      "giada_gerboni\n",
      "yanis_varoufakis\n",
      "toma_s_saraceno\n",
      "karim_abouelnaga\n",
      "mathias_jud\n",
      "richard_st_john\n",
      "chee_pearlman\n",
      "david_burkus\n",
      "paula_scher\n",
      "silk_road_ensemble\n",
      "shane_koyczan\n",
      "julie_lythcott_haims\n",
      "yasin_kakande\n",
      "yves_rossy\n",
      "dan_knights\n",
      "rebecca_newberger_goldstein\n",
      "eve_ensler\n",
      "tim_berners_lee\n",
      "emily_levine\n",
      "joshua_prince_ramus\n",
      "bob_woodward\n",
      "dan_barber\n",
      "tom_chatfield\n",
      "carl_safina\n",
      "sasa_vucinic\n",
      "francesco_sauro\n",
      "ed_gavagan\n",
      "david_lang\n",
      "abe_davis\n",
      "jinsop_lee\n",
      "johann_hari\n",
      "james_howard_kunstler\n",
      "raymond_tang\n",
      "jim_fallon\n",
      "laolu_senbanjo\n",
      "tom_uglow\n",
      "alexa_meade\n",
      "james_bridle\n",
      "pico_iyer\n",
      "erica_frenkel\n",
      "topher_white\n",
      "jun_wang\n",
      "meaghan_ramsey\n",
      "phil_hansen\n",
      "arthur_benjamin\n",
      "ghada_wali\n",
      "elliot_krane\n",
      "joshua_walters\n",
      "tom_zimmerman\n",
      "clemantine_wamariya\n",
      "rachelle_garniez\n",
      "jane_fonda_1\n",
      "adong_judith\n",
      "siyanda_mohutsiwa\n",
      "margrethe_vestager\n",
      "daniel_wolpert\n",
      "niall_ferguson\n",
      "xavier_vilalta\n",
      "rich_benjamin\n",
      "thordis_elva\n",
      "gabriel_barcia_colombo\n",
      "vittorio_loreto\n",
      "ryan_merkley\n",
      "yassmin_abdel_magied\n",
      "joe_landolina\n",
      "elizabeth_white\n",
      "scott_galloway\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "maya_penn_1\n",
      "sisonke_msimang\n",
      "barbara_block\n",
      "mohamad_jabara\n",
      "tiffany_watt_smith\n",
      "glen_henry\n",
      "david_eagleman\n",
      "john_lloyd\n",
      "helen_czerski\n",
      "jason_shen\n",
      "dawn_wacek\n",
      "wendy_woods\n",
      "ilona_szabo_de_carvalho\n",
      "the_teresa_carreno_youth_orchestra\n",
      "stella_young\n",
      "catherine_bracy\n",
      "danielle_feinberg\n",
      "zachary_r_wood\n",
      "peter_ouko\n",
      "paul_tudor_jones_ii\n",
      "janine_benyus\n",
      "emilie_wapnick\n",
      "david_agus\n",
      "chris_milk\n",
      "dianna_cohen\n",
      "samantha_nutt\n",
      "steve_silberman\n",
      "eddi_reader\n",
      "harry_cliff\n",
      "jane_mcgonigal\n",
      "sirena_huang\n",
      "thomas_insel\n",
      "tshering_tobgay\n",
      "oren_yakobovich\n",
      "clifford_stoll\n",
      "dimitar_sasselov\n",
      "mark_ronson\n",
      "ari_wallach\n",
      "kristen_marhaver\n",
      "maryn_mckenna\n",
      "aaron_huey\n",
      "ramanan_laxminarayan\n",
      "sue_austin\n",
      "ramona_pierson\n",
      "leah_chase\n",
      "mac_barnett\n",
      "sheena_iyengar\n",
      "tony_wyss_coray\n",
      "dave_debronkart\n",
      "the_soul_rebels\n",
      "natalie_merchant\n",
      "markus_fischer\n",
      "bunker_roy\n",
      "john_cary\n",
      "suzanne_simard\n",
      "sean_carroll\n",
      "nilay_kulkarni\n",
      "david_grady\n",
      "sandra_fisher_martins\n",
      "joseph_redmon\n",
      "antony_gormley\n",
      "mick_mountz\n",
      "will_macaskill\n",
      "mitch_resnick\n",
      "phil_borges\n",
      "fredy_peccerelli\n",
      "alex_honnold\n",
      "michael_pawlyn\n",
      "george_tulevski\n",
      "evan_williams\n",
      "gregory_petsko\n",
      "colin_camerer\n",
      "swami_dayananda_saraswati\n",
      "lana_mazahreh\n",
      "john_mcwhorter\n",
      "nicholas_negroponte\n",
      "david_s_rose\n",
      "matt_weinstein\n",
      "malcolm_gladwell\n",
      "shaolan_hsueh\n",
      "rick_smolan\n",
      "dr_amel_karboul\n",
      "dan_pallotta\n",
      "caitria_o_neill\n",
      "dave_isay\n",
      "ngozi_okonjo_iweala\n",
      "siphumeze_khundayi\n",
      "david_whyte\n",
      "gary_vaynerchuk\n",
      "beverly_dereck_joubert\n",
      "laura_galante\n",
      "david_camarillo\n",
      "shonda_rhimes\n",
      "charles_limb\n",
      "jamila_lyiscott\n",
      "thomas_heatherwick\n",
      "lil_buck\n",
      "jamais_cascio\n",
      "nicholas_christakis\n",
      "susan_lim\n",
      "nadine_hachach_haram\n",
      "chip_colwell\n",
      "radhika_nagpal\n",
      "thom_mayne\n",
      "sebastian_wernicke\n",
      "steven_schwaitzberg\n",
      "leonard_susskind\n",
      "tim_urban\n",
      "lux_narayan\n",
      "michelle_borkin\n",
      "kakenya_ntaiya\n",
      "anjan_sundaram\n",
      "tapiwa_chiwewe\n",
      "thandie_newton\n",
      "dan_dennett\n",
      "christoph_adami\n",
      "neil_pasricha\n",
      "amy_o_toole\n",
      "wanuri_kahiu\n",
      "kirby_ferguson\n",
      "alex_tabarrok\n",
      "daniel_kish\n",
      "viktor_e_frankl\n",
      "danit_peleg\n",
      "tiffany_kagure_mugo\n",
      "jay_bradner\n",
      "eduardo_briceno\n",
      "sofia_jawed_wessel\n",
      "susan_david\n",
      "sam_richards\n",
      "amit_kalra\n",
      "annie_lennox\n",
      "sir_ken_robinson\n",
      "george_whitesides\n",
      "kate_stone\n",
      "tamas_kocsis\n",
      "anjali_tripathi\n",
      "liz_ogbu\n",
      "mark_pagel\n",
      "jane_chen\n",
      "sophie_hunger\n",
      "tasos_frantzolas\n",
      "derek_sivers\n",
      "jay_walker\n",
      "hadi_eldebek\n",
      "martin_villeneuve\n",
      "elaine_morgan\n",
      "yvette_alberdingk_thijm\n",
      "paul_stamets\n",
      "katlego_kolanyane_kesupile\n",
      "eric_topol\n",
      "amishi_jha\n",
      "adam_savage\n",
      "pawan_sinha\n",
      "xu_liu\n",
      "sangeeta_bhatia\n",
      "leo_igwe\n",
      "anne_curzan\n",
      "br_david_steindl_rast\n",
      "kevin_bales\n",
      "ray_anderson\n",
      "jason_yang\n",
      "jared_diamond\n",
      "romina_libster\n",
      "emily_parsons_lord\n",
      "jonathan_rossiter\n",
      "dambisa_moyo\n",
      "nathalie_cabrol\n",
      "myriam_sidibe\n",
      "gabe_zichermann\n",
      "roger_antonsen\n",
      "robert_hammond\n",
      "triona_mcgrath\n",
      "paul_zak\n",
      "hyeonseo_lee\n",
      "michael_stevens\n",
      "paul_nicklen\n",
      "simon_sinek\n",
      "dee_boersma\n",
      "esther_perel\n",
      "hillel_cooperman\n",
      "talithia_williams\n",
      "sanjay_dastoor\n",
      "teresa_njoroge\n",
      "fredros_okumu\n",
      "kimberley_motley\n",
      "murray_gell_mann\n",
      "annmarie_thomas\n",
      "seth_godin\n",
      "carrie_poppy\n",
      "mellody_hobson\n",
      "bill_gross\n",
      "garth_lenz\n",
      "matthew_o_reilly\n",
      "laura_snyder\n",
      "ben_katchor\n",
      "paul_pholeros\n",
      "ar_rahman\n",
      "james_lyne\n",
      "nilofer_merchant\n",
      "alejandro_sanchez_alvarado\n",
      "james_cameron\n",
      "lisa_bu\n",
      "karen_bass\n",
      "ory_okolloh\n",
      "willie_smits\n",
      "improv_everywhere\n",
      "janette_sadik_khan\n",
      "aspen_baker\n",
      "evan_grant\n",
      "markham_nolan\n",
      "anielle_reid\n",
      "elizabeth_lev\n",
      "nicholas_perony\n",
      "andy_puddicombe\n",
      "eva_vertes\n",
      "nick_hanauer\n",
      "wolfgang_kessling\n",
      "nate_garvis\n",
      "joseph_ravenell\n",
      "julia_bacha\n",
      "william_kamkwamba\n",
      "lucy_kalanithi\n",
      "richard_pyle\n",
      "dave_brain\n",
      "adam_grant\n",
      "karen_tse\n",
      "penny_chisholm\n",
      "sxip_shirey\n",
      "pearl_arredondo\n",
      "lz_granderson\n",
      "nancy_frates\n",
      "cary_fowler\n",
      "lemn_sissay\n",
      "wes_moore\n",
      "c_noel_bairey_merz\n",
      "david_titley\n",
      "barry_schwartz\n",
      "liz_coleman\n",
      "bart_weetjens\n",
      "lxd\n",
      "mariana_mazzucato\n",
      "carter_emmart\n",
      "becky_blanton\n",
      "david_cage\n",
      "petter_johansson\n",
      "ge_wang\n",
      "meera_vijayann\n",
      "amy_adele_hasinoff\n",
      "tony_fadell\n",
      "christina_wallace\n",
      "brian_greene\n",
      "floyd_romesberg\n",
      "jon_nguyen\n",
      "gautam_bhan\n",
      "natsai_audrey_chieza\n",
      "jarreth_merz\n",
      "haley_van_dyck\n",
      "bassam_tariq\n",
      "henrietta_fore\n",
      "julian_assange\n",
      "david_korins\n",
      "gregory_heyworth\n",
      "sir_martin_rees\n",
      "peter_norvig\n",
      "jonathan_zittrain\n",
      "sauti_sol\n",
      "prumsodun_ok\n",
      "david_sengeh\n",
      "geena_rocero\n",
      "surya_mattu\n",
      "jennifer_granick\n",
      "katherine_fulton\n",
      "mark_roth\n",
      "rob_hopkins\n",
      "patricia_medici\n",
      "anders_fjellberg\n",
      "raymond_wang\n",
      "erez_lieberman_aiden\n",
      "jonas_eliasson\n",
      "monica_byrne\n",
      "anil_seth\n",
      "guy_philippe_goldstein\n",
      "jackson_bird\n",
      "linda_liukas\n",
      "isabel_wilkerson\n",
      "tony_robbins\n",
      "jonathan_drori\n",
      "iain_hutchison\n",
      "richard_weller\n",
      "teddy_cruz\n",
      "jamie_heywood\n",
      "bill_t_jones\n",
      "jaap_de_roode\n",
      "mark_plotkin\n",
      "uldus_bakhtiozina\n",
      "jennifer_pluznick\n",
      "charles_anderson\n",
      "paul_root_wolpe\n",
      "scott_kim\n",
      "sara_dewitt\n",
      "andrea_ghez\n",
      "gus_casely_hayford\n",
      "peter_reinhart\n",
      "timothy_ihrig\n",
      "faith_jegede\n",
      "lucy_marcil\n",
      "barbara_natterson_horowitz\n",
      "sam_rodriques\n",
      "robert_lang\n",
      "tania_luna\n",
      "susan_robinson\n",
      "kevin_jones\n",
      "simon_berrow\n",
      "anna_heringer\n",
      "matt_ridley\n",
      "sleepy_man_banjo_boys\n",
      "liz_hajek\n",
      "ruby_wax\n",
      "su_kahumbu\n",
      "mick_ebeling\n",
      "sebastiao_salgado\n",
      "ziyah_gafic\n",
      "onyx_ashanti\n",
      "john_gerzema\n",
      "kamal_meattle\n",
      "jeremy_jackson\n",
      "david_r_williams\n",
      "travis_kalanick\n",
      "patricia_kuhl\n",
      "tyler_cowen\n",
      "hilary_cottam\n",
      "david_gruber\n",
      "josette_sheeran\n",
      "woody_norris\n",
      "elizabeth_loftus\n",
      "erika_gregory\n",
      "meg_jay\n",
      "leslie_chang\n",
      "kevin_surace\n",
      "luhan_yang\n",
      "duarte_geraldino\n",
      "anupam_mishra\n",
      "andy_hobsbawm\n",
      "alicia_garza\n",
      "jacob_collier\n",
      "aakash_odedra\n",
      "james_hansen\n",
      "alan_kay\n",
      "mennat_el_ghalid\n",
      "guillaume_nery\n",
      "rory_sutherland\n",
      "keith_barry\n",
      "kola_masha\n",
      "cleo_wade\n",
      "rebecca_kleinberger\n",
      "thomas_suarez\n",
      "susan_blackmore\n",
      "guy_winch\n",
      "david_merrill\n",
      "graham_allison\n",
      "rogier_van_der_heide\n",
      "gian_giudice\n",
      "louise_fresco\n",
      "theo_e_j_wilson\n",
      "ellen_gustafson\n",
      "eve_abrams\n",
      "damian_palin\n",
      "siddharthan_chandran\n",
      "ike_ude\n",
      "miranda_wang_and_jenny_yao\n",
      "jim_al_khalili\n",
      "timothy_bartik\n",
      "russell_foster\n",
      "brittney_cooper\n",
      "frank_warren\n",
      "allan_jones\n",
      "simone_bianco\n",
      "ples_felix\n",
      "john_koenig\n",
      "tavi_gevinson\n",
      "ashwini_anburajan\n",
      "ian_goldin\n",
      "renzo_piano\n",
      "nikolai_begg\n",
      "darieth_chisolm_1\n",
      "tom_thum\n",
      "rose_george\n",
      "raffaello_d_andrea\n",
      "christopher_bell\n",
      "angelica_dass\n",
      "beatrice_coron\n",
      "kelly_mcgonigal\n",
      "deepika_kurup\n",
      "stuart_russell\n",
      "handspring_puppet_company\n",
      "peter_ward\n",
      "nathalie_miebach\n",
      "essam_daod\n",
      "kathy_hull\n",
      "paul_rothemund\n",
      "kaki_king\n",
      "jeanne_gang\n",
      "ellen_macarthur\n",
      "aditi_gupta\n",
      "keren_elezari\n",
      "jon_gosier\n",
      "alexander_wagner\n",
      "rick_guidotti_s\n",
      "douglas_adams\n",
      "tommy_mccall\n",
      "david_holt\n",
      "kary_mullis\n",
      "geert_chatrou\n",
      "anote_tong\n",
      "paul_ewald\n",
      "christina_warinner\n",
      "giulia_enders\n",
      "samuel_cohen\n",
      "glenn_greenwald\n",
      "max_little\n",
      "maria_bezaitis\n",
      "paul_romer\n",
      "carl_honore\n",
      "herbie_hancock\n",
      "marc_pachter\n",
      "dan_ariely\n",
      "jorge_drexler\n",
      "michel_laberge\n",
      "vishaan_chakrabarti\n",
      "james_burchfield\n",
      "shirin_neshat\n",
      "susan_emmett\n",
      "susan_savage_rumbaugh\n",
      "stephen_wilkes\n",
      "negin_farsad\n",
      "beardyman\n",
      "stephen_webb\n",
      "ueli_gegenschatz\n",
      "bob_stein\n",
      "wadah_khanfar\n",
      "freeman_hrabowski\n",
      "nandan_nilekani\n",
      "jonathan_klein\n",
      "colin_powell\n",
      "dustin_schroeder\n",
      "imam_feisal_abdul_rauf\n",
      "enrique_penalosa\n",
      "milton_glaser\n",
      "andrew_bird\n",
      "robyn_stein_deluca\n",
      "asher_hasan\n",
      "hector_ruiz\n",
      "jamil_abu_wardeh\n",
      "mike_velings\n",
      "andras_forgacs\n",
      "wendy_freedman\n",
      "mikko_hypponen\n",
      "lalitesh_katragadda\n",
      "miwa_matreyek\n",
      "luca_turin\n",
      "michael_kimmel\n",
      "shimon_steinberg\n",
      "faith_osier\n",
      "eva_zeisel\n",
      "ed_boyden\n",
      "matthew_white\n",
      "deanna_van_buren\n",
      "matthew_williams\n",
      "michael_lynch\n",
      "jeremy_rifkin\n",
      "leah_buechley\n",
      "michel_dugon\n",
      "al_vernacchio\n",
      "chris_mcknett\n",
      "pankaj_ghemawat\n",
      "adora_svitak\n",
      "ami_klin\n",
      "david_carson\n",
      "anna_rosling_ronnlund\n",
      "margaret_heffernan\n",
      "carolyn_bertozzi\n",
      "pamelia_kurstin\n",
      "achenyo_idachaba\n",
      "vanessa_ruiz\n",
      "molly_winter\n",
      "andres_lozano\n",
      "hubertus_knabe\n",
      "taylor_mali\n",
      "james_green\n",
      "aaron_koblin\n",
      "jessica_ladd\n",
      "john_hardy\n",
      "daphne_koller\n",
      "sarah_kay\n",
      "steve_boyes\n",
      "eddy_cartaya\n",
      "david_birch\n",
      "mitchell_joachim\n",
      "mileha_soneji\n",
      "steve_jurvetson\n",
      "michael_hansmeyer\n",
      "kevin_briggs\n",
      "norman_spack\n",
      "elizabeth_wayne\n",
      "marla_spivak\n",
      "stephen_cave\n",
      "adam_garone\n",
      "jennifer_lin\n",
      "ellen_dunham_jones\n",
      "jen_pahlka\n",
      "rodin_lyasoff\n",
      "amit_sood\n",
      "ashley_judd\n",
      "daniel_pauly\n",
      "gene_yang\n",
      "steve_ramirez\n",
      "vicki_arroyo\n",
      "aaron_o_connell\n",
      "emily_nagoski\n",
      "michael_norton\n",
      "david_cameron\n",
      "julian_baggini\n",
      "dan_cobley\n",
      "ramesh_raskar\n",
      "dr_dean_ornish\n",
      "malika_whitley\n",
      "dan_gartenberg\n",
      "suzanne_barakat\n",
      "michael_anti\n",
      "kashmir_hill\n",
      "eric_berlow\n",
      "miru_kim\n",
      "terry_moore\n",
      "kathryn_schulz\n",
      "dan_berkenstock\n",
      "mark_z_jacobson\n",
      "michael_bierut\n",
      "arthur_brooks\n",
      "adam_galinsky\n",
      "daniel_engber\n",
      "roxane_gay\n",
      "the_lady_lifers\n",
      "ronald_sullivan\n",
      "kamau_gachigi\n",
      "marcus_du_sautoy\n",
      "david_lee\n",
      "daniel_levitin\n",
      "john_green\n",
      "jeff_iliff\n",
      "roberto_and_francesca_d_angelo\n",
      "melissa_fleming\n",
      "zach_kaplan\n",
      "mark_kendall\n",
      "stephen_friend\n",
      "danny_dorling\n",
      "magatte_wade\n",
      "jill_sobule\n",
      "simone_giertz\n",
      "manoush_zomorodi\n",
      "daniel_pink\n",
      "edward_tenner\n",
      "jimmy_nelson\n",
      "mara_mintzer\n",
      "tim_leberecht\n",
      "karen_t_walker\n",
      "thomas_dolby\n",
      "wendy_suzuki\n",
      "heather_lanier\n",
      "ozlem_cekic\n",
      "ron_gutman\n",
      "alan_russell\n",
      "rachel_pike\n",
      "irina_kareva\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "cyndi_stivers\n",
      "r_luke_dubois\n",
      "philippa_neave\n",
      "amos_winter\n",
      "regina_dugan\n",
      "jennifer_doudna\n",
      "howard_rheingold\n",
      "sara_menker\n",
      "tan_le\n",
      "quyen_nguyen\n",
      "azim_n_khamisa\n",
      "julia_shaw\n",
      "lera_boroditsky\n",
      "shea_hembrey\n",
      "toby_eccles\n",
      "erik_schlangen\n",
      "scott_mccloud\n",
      "edith_widder\n",
      "anjan_chatterjee\n",
      "ann_morgan\n",
      "rutger_bregman\n",
      "noah_wilson_rich\n",
      "chris_abani\n",
      "liz_diller\n",
      "nancy_lublin\n",
      "yochai_benkler\n",
      "james_balog\n",
      "gary_flake\n",
      "robert_sapolsky\n",
      "arianna_huffington\n",
      "philip_rosedale\n",
      "carolyn_steel\n",
      "annie_murphy_paul\n",
      "bobby_ghosh\n",
      "eric_whitacre\n",
      "david_rockwell\n",
      "steven_strogatz\n",
      "helen_pearson\n",
      "kim_gorgens\n",
      "nadia_al_sakkaf\n",
      "heather_knight\n",
      "ethan_nadelmann\n",
      "tina_seelig\n",
      "stephen_deberry\n",
      "caleb_harper\n",
      "doris_kim_sung\n",
      "craig_venter\n",
      "anne_lamott\n",
      "geraldine_hamilton\n",
      "michael_rain\n",
      "casey_brown\n",
      "kimberle_crenshaw\n",
      "susan_cain\n",
      "mae_jemison\n",
      "ray_dalio\n",
      "celeste_headlee\n",
      "teresa_bajan\n",
      "io_tillett_wright\n",
      "mina_bissell\n",
      "hasan_elahi\n",
      "joy_sun\n",
      "sakena_yacoobi\n",
      "ursus_wehrli\n",
      "dan_buettner\n",
      "isaac_mizrahi\n",
      "brian_dettmer\n",
      "cheyenne_cochrane\n",
      "rajiv_maheswaran\n",
      "jose_bowen\n",
      "ole_scheeren\n",
      "madeleine_albright\n",
      "kristie_overstreet\n",
      "karina_galperin\n",
      "rokia_traore\n",
      "massimo_banzi\n",
      "jorge_soto\n",
      "carina_morillo\n",
      "bill_strickland\n",
      "jimmy_wales\n",
      "benjamin_grant\n",
      "monica_lewinsky\n",
      "daniele_quercia\n",
      "rachel_armstrong\n",
      "niels_diffrient\n",
      "laurie_santos\n",
      "jeff_skoll\n",
      "katrina_spade\n",
      "paul_rucker\n",
      "dawn_landes\n",
      "sara_ramirez\n",
      "ernesto_sirolli\n",
      "gero_miesenboeck\n",
      "caroline_paul\n",
      "amy_green\n",
      "rola_hallam\n",
      "ted_halstead\n",
      "lindsay_malloy\n",
      "mandy_len_catron\n",
      "martin_seligman\n",
      "jennifer_granholm\n",
      "hetain_patel\n",
      "rachel_wurzman\n",
      "anika_paulson\n",
      "sophie_scott\n",
      "david_macaulay\n",
      "eric_dyer\n",
      "paul_tasner\n",
      "temple_grandin\n",
      "thomas_piketty\n",
      "hanna_rosin\n",
      "paul_gilding\n",
      "robert_fischell\n",
      "jeremy_gilley\n",
      "alan_lightman\n",
      "judy_macdonald_johnston\n",
      "will_wright\n",
      "khalida_brohi\n",
      "zeresenay_alemseged\n",
      "bronwyn_king\n",
      "bruce_aylward\n",
      "debra_jarvis\n",
      "david_rothkopf\n",
      "sting\n",
      "ron_finley\n",
      "georgette_mulheir\n",
      "kristina_gjerde\n",
      "will_potter\n",
      "sherry_turkle\n",
      "salvatore_iaconesi\n",
      "molly_crockett\n",
      "avi_rubin\n",
      "naturally_7\n",
      "gary_greenberg\n",
      "geoffrey_canada\n",
      "catherine_crump\n",
      "joan_blades\n",
      "jae_rhim_lee\n",
      "aziz_abu_sarah\n",
      "jeff_han\n",
      "mac_stone\n",
      "nalini_nadkarni\n",
      "amanda_bennett\n",
      "srdja_popovic\n",
      "stewart_brand\n",
      "don_norman\n",
      "lisa_margonelli\n",
      "majora_carter\n",
      "mike_rowe\n",
      "jackie_savitz\n",
      "teitur\n",
      "robin_sanders\n",
      "carvens_lissaint\n",
      "ingrid_fetell_lee\n",
      "tania_simoncelli\n",
      "steven_cowley\n",
      "jennifer_murphy\n",
      "eleni_gabre_madhin\n",
      "kiran_bedhi\n",
      "jason_decaires_taylor\n",
      "david_christian\n",
      "chetan_bhatt\n",
      "allan_savory\n",
      "jason_fried\n",
      "alyson_mcgregor\n",
      "natalie_warne\n",
      "samantha_power\n",
      "paul_collier\n",
      "philippe_starck\n",
      "david_binder\n",
      "baba_shiv\n",
      "richard_j_berry\n",
      "nancy_n_rabalais\n",
      "beth_noveck\n",
      "tim_kruger\n",
      "lisa_feldman_barrett\n",
      "patience_mthunzi\n",
      "david_autor\n",
      "pete_alcorn\n",
      "gary_wolf\n",
      "safwat_saleem\n",
      "judith_heumann\n",
      "amory_lovins\n",
      "wael_ghonim\n",
      "jamie_bartlett\n",
      "jackson_katz\n",
      "christopher_soghoian\n",
      "francis_collins\n",
      "klaus_stadlmann\n",
      "leana_wen\n",
      "kevin_allocca\n",
      "brian_goldman\n",
      "tom_wujec\n",
      "bruno_bowden\n",
      "alec_soth\n",
      "patricia_ryan\n",
      "parag_khanna\n",
      "ashton_applewhite\n",
      "laura_schulz\n",
      "david_baron\n",
      "carolyn_porco\n",
      "james_nachtwey\n",
      "andrew_connolly\n",
      "michelle_knox\n",
      "rev_tom_honey\n",
      "anil_gupta\n",
      "tom_griffiths\n",
      "stephen_petranek\n",
      "sebastian_thrun\n",
      "trita_parsi\n",
      "david_perry\n",
      "caroline_weaver\n",
      "chade_meng_tan\n",
      "p_w_singer\n",
      "laura_trice\n",
      "spencer_wells\n",
      "leticia_gasca\n",
      "kevin_kelly\n",
      "nina_fedoroff\n",
      "charmian_gooch\n",
      "reggie_watts\n",
      "george_monbiot\n",
      "jeremy_heimans\n",
      "ayah_bdeir\n",
      "diana_nyad\n",
      "luke_sital_singh\n",
      "wanis_kabbaj\n",
      "david_hanson\n",
      "laurel_braitman\n",
      "meron_gribetz\n",
      "patricia_burchat\n",
      "joey_alexander\n",
      "yves_behar\n",
      "lisa_genova\n",
      "keith_bellows\n",
      "george_ayittey\n",
      "ashraf_ghani\n",
      "paul_conneally\n",
      "nora_york\n",
      "may_el_khalil\n",
      "honor_harger\n",
      "peter_singer\n",
      "eman_mohammed\n",
      "adam_spencer\n",
      "jherek_bischoff\n",
      "mona_chalabi\n",
      "edward_burtynsky\n",
      "james_forbes\n",
      "sebastian_junger\n",
      "anders_ynnerman\n",
      "alice_bows_larkin\n",
      "yves_morieux\n",
      "megan_washington\n",
      "diana_laufenberg\n",
      "priya_vulchi\n",
      "george_steinmetz\n",
      "ben_cameron\n",
      "amanda_burden\n",
      "sheryl_sandberg\n",
      "angela_wang\n",
      "arik_hartmann\n",
      "christopher_ategeka\n",
      "sebastian_kraves\n",
      "rev_jeffrey_brown\n",
      "joe_smith\n",
      "eric_liu\n",
      "kristen_ashburn\n",
      "christopher_ryan\n",
      "iyad_rahwan\n",
      "marco_alvera\n",
      "emtithal_mahmoud\n",
      "sarah_parcak\n",
      "stuart_firestein\n",
      "anjali_kumar\n",
      "jakob_magolan\n",
      "aaswath_raman\n",
      "diane_benscoter\n",
      "erricka_bridgeford\n",
      "gever_tulley\n",
      "eythor_bender\n",
      "lb_hannahs\n",
      "thomas_p_campbell\n",
      "erica_stone\n",
      "todd_scott\n",
      "alex_edmans\n",
      "ione_wells\n",
      "jonathan_foley\n",
      "gretchen_carlson\n",
      "william_li\n",
      "rebecca_onie\n",
      "auret_van_heerden\n",
      "wayne_mcgregor\n",
      "sergey_brin_and_larry_page\n",
      "robert_gupta\n",
      "sarah_corbett\n",
      "fadi_chehade\n",
      "steven_levitt\n",
      "jude_kelly\n",
      "tracy_chevalier\n",
      "elizabeth_nyamayaro\n",
      "jessi_arrington\n",
      "franklin_leonard\n",
      "robert_hakiza\n",
      "tali_sharot\n",
      "peter_hirshberg\n",
      "robert_muggah\n",
      "grady_booch\n",
      "noriko_arai\n",
      "scott_summit\n",
      "stacey_kramer\n",
      "chip_kidd\n",
      "lauren_zalaznick\n",
      "kenichi_ebina\n",
      "daphne_bavelier\n",
      "paul_bennett\n",
      "mary_norris\n",
      "bill_davenhall\n",
      "veerle_provoost\n",
      "natasha_hurley_walker\n",
      "benjamin_barber\n",
      "dan_ellsey\n",
      "william_black\n",
      "finn_myrstad\n",
      "kasiva_mutua\n",
      "bran_ferren\n",
      "tal_danino\n",
      "joy_buolamwini\n",
      "francoise_mouly\n",
      "tom_shannon\n",
      "mindy_scheier\n",
      "manu_prakash\n",
      "leyla_acaroglu\n",
      "roz_savage\n",
      "alex_kipman\n",
      "a_tribe_called_red\n",
      "jake_barton\n",
      "andrew_mcafee\n",
      "david_hoffman\n",
      "rosie_king\n",
      "opal_tometi\n",
      "zainab_salbi\n",
      "dustin_yellin_1\n",
      "pia_mancini\n",
      "shai_agassi\n",
      "aziza_chaouni\n",
      "fabian_hemmert\n",
      "anna_rothschild\n",
      "chris_jordan\n",
      "irwin_redlener\n",
      "ariel_garten\n",
      "sayu_bhojwani\n",
      "golan_levin\n",
      "wanda_diaz_merced\n",
      "caitlin_quattromani\n",
      "siddhartha_mukherjee\n",
      "ben_wellington\n",
      "richard_seymour\n",
      "jason_webb\n",
      "neil_macgregor\n",
      "robin_chase\n",
      "euna_lee\n",
      "gonzalo_vilarino\n",
      "rajesh_rao\n",
      "fahad_al_attiya\n",
      "sarah_gray\n",
      "travis_rieder\n",
      "charles_robertson\n",
      "george_dyson\n",
      "laura_indolfi\n",
      "david_r_dow\n",
      "isadora_kosofsky\n",
      "sarah_lewis\n",
      "anthony_atala\n",
      "chris_bliss\n",
      "olutimehin_adegbeye\n",
      "daniel_libeskind\n",
      "tim_jackson\n",
      "sean_follmer\n",
      "nancy_kanwisher\n",
      "zahra_langhi\n",
      "chelsea_shields\n",
      "michael_shellenberger\n",
      "matthew_mills_and_tamara_roukaerts\n",
      "frank_gehry\n",
      "george_takei\n",
      "paul_piff\n",
      "tom_stranger\n",
      "malte_spitz\n",
      "oded_shoseyov\n",
      "chris_kluwe\n",
      "suzanne_lee\n",
      "anthony_appiah\n",
      "tristram_stuart\n",
      "james_surowiecki\n",
      "shimpei_takahashi\n",
      "mustafa_akyol\n",
      "clayton_cameron\n",
      "michael_porter\n",
      "robin_morgan\n",
      "keller_rinaudo\n",
      "so_percussion\n",
      "adam_ostrow\n",
      "seyi_oyesola\n",
      "edward_snowden\n",
      "naomi_shah\n",
      "daniel_suarez\n",
      "apollo_robbins\n",
      "dena_simmons\n",
      "judson_brewer\n",
      "greg_lynn\n",
      "lorrie_faith_cranor\n",
      "ellen_jorgensen\n",
      "jamie_drummond\n",
      "anthony_d_romero\n",
      "maya_beiser\n",
      "peter_donnelly\n",
      "diana_reiss\n",
      "esta_soler\n",
      "musimbi_kanyoro\n",
      "eric_mead\n",
      "kent_larson\n",
      "aimee_mullins\n",
      "john_wilbanks\n",
      "kate_raworth\n",
      "pardis_sabeti\n",
      "raphael_arar\n",
      "guy_hoffman\n",
      "kevin_rudd\n",
      "diane_j_savino\n",
      "qudus_onikeku\n",
      "randy_pausch\n",
      "david_blaine\n",
      "dong_woo_jang\n",
      "ann_cooper\n",
      "chris_downey\n",
      "alexandra_sacks\n",
      "jack_horner\n",
      "eric_giler\n",
      "yang_lan\n",
      "bill_gates\n",
      "lisa_nip\n",
      "david_puttnam\n",
      "gary_slutkin\n",
      "young_ha_kim\n",
      "john_hunter\n",
      "amy_purdy\n",
      "vishal_vaid\n",
      "keith_nolan\n",
      "tamara_roukaerts\n",
      "zeynep_tufekci\n",
      "jacqueline_novogratz\n",
      "barry_schuler\n",
      "thomas_thwaites\n",
      "iwan_baan\n",
      "bettina_warburg\n",
      "bono\n",
      "alice_rawsthorn\n",
      "cedric_villani\n",
      "kitra_cahana\n",
      "tristan_harris\n",
      "sue_jaye_johnson\n",
      "roger_doiron\n",
      "david_brooks\n",
      "jeff_speck\n",
      "genevieve_von_petzinger\n",
      "helen_fisher\n",
      "ron_mccallum\n",
      "robert_swan\n",
      "fawn_qiu\n",
      "aleph_molinari\n",
      "malcolm_mclaren\n",
      "penelope_boston\n",
      "magda_sayeg\n",
      "sethembile_msezane\n",
      "lauren_pharr\n",
      "jesse_schell\n",
      "geoffrey_west\n",
      "hugh_evans\n",
      "kelli_swazey\n",
      "dilip_ratha\n",
      "joi_ito\n",
      "david_byrne\n",
      "john_legend\n",
      "andreas_ekstrom\n",
      "tom_gruber\n",
      "bill_joy\n",
      "jeff_kirschner\n",
      "bill_ford\n",
      "margaret_bourdeaux\n",
      "melissa_garren\n",
      "anne_milgram\n",
      "julian_treasure\n",
      "daniel_kahneman\n",
      "martin_pistorius\n",
      "sarah_jones\n",
      "ralph_langner\n",
      "nick_sears_1\n",
      "newton_aduaka\n",
      "asali_devan_ecclesiastes\n",
      "jonathan_haidt\n",
      "aicha_el_wafi_phyllis_rodriguez\n",
      "british_paraorchestra\n",
      "jessica_green\n",
      "natasha_tsakos\n",
      "lord_nicholas_stern\n",
      "nicole_paris\n",
      "al_seckel\n",
      "lennart_green\n",
      "christine_porath\n",
      "andrew_bastawrous\n",
      "robert_lee_hotz\n",
      "svante_paabo\n",
      "naomi_mcdougall_jones\n",
      "noreena_hertz\n",
      "burcin_mutlu_pakdil\n",
      "louie_schwartzberg\n",
      "enric_sala\n",
      "dean_kamen\n",
      "gaston_acurio\n",
      "anand_varma\n",
      "stephen_burt\n",
      "reuben_margolin\n",
      "marc_raibert\n",
      "niti_bhan\n",
      "hadyn_parry\n",
      "ellen_stokken_dahl\n",
      "rodney_mullen\n",
      "melati_and_isabel_wijsen\n",
      "marily_oppezzo\n",
      "tamekia_mizladi_smith\n",
      "gary_lauder\n",
      "nigel_marsh\n",
      "verna_myers\n",
      "matt_kenyon\n",
      "lauren_hodge\n",
      "anne_madden\n",
      "stephen_palumbi\n",
      "eli_pariser\n",
      "erik_hersman\n",
      "kio_stark\n",
      "tod_machover\n",
      "christien_meindertsma\n",
      "bilal_bomani\n",
      "maajid_nawaz\n",
      "amy_cuddy\n",
      "laura_vanderkam\n",
      "joseph_desimone\n",
      "rodney_brooks\n",
      "nina_dolvik_brochmann\n",
      "gordon_brown\n",
      "tyrone_hayes\n",
      "thomas_barnett\n",
      "taylor_wilson\n",
      "richard_resnick\n",
      "memory_banda\n",
      "vusi_mahlasela\n",
      "anastasia_taylor_lind\n",
      "eli_beer\n",
      "maira_kalman\n",
      "mallory_soldner\n",
      "dan_gross\n",
      "richard_browning\n",
      "eric_hirshberg\n",
      "gregory_stock\n",
      "peter_van_uhm\n",
      "alvin_irby\n",
      "ok_go\n",
      "somi_kakoma\n",
      "richard_turere\n",
      "christopher_moot_poole\n",
      "michael_sandel\n",
      "seth_priebatsch\n",
      "severine_autesserre\n",
      "rick_ledgett\n",
      "andres_ruzo\n",
      "michael_dickinson\n",
      "ron_eglash\n",
      "wingham_rowan\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "joshua_smith\n",
      "black\n",
      "sanjay_pradhan\n",
      "marc_bamuthi_joseph\n",
      "michael_biddle\n",
      "arthur_potts_dawson\n",
      "dr_hawa_abdi_dr_deqo_mohamed\n",
      "jennifer_golbeck\n",
      "alice_dreger\n",
      "rocio_lorenzo\n",
      "skylar_tibbits\n",
      "joseph_kim\n",
      "hamish_jolly\n",
      "graham_hill\n",
      "jared_ficklin\n",
      "john_maeda\n",
      "aris_venetikidis\n",
      "jonathan_trent\n",
      "jessica_pryce\n",
      "andy_yen\n",
      "thomas_peschak\n",
      "stephen_ritz\n",
      "stefan_wolff\n",
      "richard_feynman\n",
      "his_holiness_the_17th_karmapa\n",
      "caitlin_doughty\n",
      "joan_halifax\n",
      "khadija_gbla\n",
      "will_noel\n",
      "camille_brown\n",
      "gary_kovacs\n",
      "sean_gourley\n",
      "robb_willer\n",
      "michael_pritchard\n",
      "clay_shirky\n",
      "harvey_fineberg\n",
      "ed_yong\n",
      "adam_grosser\n",
      "john_bohannon\n",
      "peter_calthorpe\n",
      "charles_hazlewood\n",
      "rob_harmon\n",
      "jehane_noujaim\n",
      "vinay_shandal\n",
      "adam_foss\n",
      "joshua_prager\n",
      "daniel_schnitzer\n",
      "shukla_bose\n",
      "tracee_ellis_ross\n",
      "mike_matas\n",
      "wendy_troxel\n",
      "preston_reed\n",
      "richard_sears\n",
      "eric_berridge\n",
      "anand_agarawala\n",
      "charles_c_mann\n",
      "will_marshall\n",
      "jessica_jackley\n",
      "jd_schramm\n",
      "david_pogue\n",
      "jessa_gamble\n",
      "tasso_azevedo\n",
      "taryn_simon\n",
      "serena_williams\n",
      "alastair_gray\n",
      "becci_manson\n",
      "chera_kowalski\n",
      "hasini_jayatilaka\n",
      "pope_francis\n",
      "kai_fu_lee\n",
      "rufus_cappadocia\n",
      "daffodil_hudson\n",
      "salman_khan\n",
      "david_bismark\n",
      "gabriela_gonzalez\n",
      "cindy_gallop\n",
      "andrew_stanton\n",
      "t_boone_pickens\n",
      "todd_coleman\n",
      "chrystia_freeland\n",
      "renata_salecl\n",
      "dave_troy\n",
      "mundano\n",
      "jack_conte\n",
      "melvin_russell\n",
      "marcin_jakubowski\n",
      "james_stavridis\n",
      "halima_aden\n",
      "brian_skerry\n",
      "martine_rothblatt\n",
      "christopher_decharms\n",
      "wale_oyejide\n",
      "cameron_sinclair\n",
      "laura_boushnak\n",
      "norman_foster\n",
      "amar_inamdar\n",
      "jan_chipchase\n",
      "stephen_wolfram\n",
      "charlie_todd\n",
      "titus_kaphar\n",
      "moshe_szyf\n",
      "leila_takayama\n",
      "kid_president\n",
      "joachim_de_posada\n",
      "fred_swaniker\n",
      "ameera_ahmad\n",
      "minda_dentler\n",
      "jack_andraka\n",
      "richard_preston\n",
      "sara_lewis\n",
      "jarrett_j_krosoczka\n",
      "isabel_behncke_izquierdo\n",
      "jennifer_senior\n",
      "parul_sehgal_1\n",
      "uri_hasson\n",
      "mikhail_zygar\n",
      "carolyn_jones\n",
      "paolo_cardini\n",
      "sivamani\n",
      "lee_cronin\n",
      "lily_tomlin\n",
      "jon_boogz\n",
      "joseph_pine\n",
      "cameron_russell\n",
      "matt_cutts\n",
      "jer_thorp\n",
      "ray_kurzweil\n",
      "lucianne_walkowicz\n",
      "tierney_thys\n",
      "jim_holt\n",
      "andreas_schleicker\n",
      "sarah_jayne_blakemore\n",
      "del_harvey\n",
      "joseph_nye\n",
      "david_miliband\n",
      "nancy_etcoff\n",
      "amy_smith\n",
      "jon_bergmann\n",
      "ken_jennings\n",
      "atul_gawande_1\n",
      "nathan_wolfe\n",
      "adam_alter\n",
      "magnus_larsson\n",
      "cristina_domenech\n",
      "rick_warren\n",
      "juan_enriquez\n",
      "corneille_ewango\n",
      "ellen_t_hoen\n",
      "lewis_pugh\n",
      "mark_pollock\n",
      "toby_shapshak\n",
      "felix_dennis\n",
      "anna_mracek_dietrichs\n",
      "jeremy_forbes\n",
      "ravilla_thulasiraj\n",
      "jacek_utko\n",
      "garik_israelian\n",
      "james_randi\n",
      "nathan_myhrvold\n",
      "jamie_oliver\n",
      "juliana_machado_ferreira\n",
      "ryan_gravel\n",
      "louise_leakey\n",
      "paddy_ashdown\n",
      "matt_russo\n",
      "joseph_lekuton\n",
      "thomas_pogge\n",
      "elizabeth_pisani\n",
      "david_sedlak\n",
      "dan_cohen\n",
      "shekhar_kapur\n",
      "christian_picciolini\n",
      "elizabeth_blackburn\n",
      "ashton_cofer\n",
      "jok_church\n",
      "bj_miller\n",
      "keolu_fox\n",
      "ahn_trio\n",
      "inara_george\n",
      "deeyah_khan\n",
      "ananda_shankar_jayant\n",
      "morley\n",
      "paul_sereno\n",
      "mathieu_lehanneur\n",
      "larry_smith\n",
      "kim_katrin_milan\n",
      "deborah_scranton\n",
      "megan_phelps_roper\n",
      "eric_dishman\n",
      "rob_reid\n",
      "felice_belle\n",
      "ze_frank\n",
      "daria_van_den_bercken\n",
      "catarina_mota\n",
      "kenneth_cukier\n",
      "shubhendu_sharma\n",
      "brenda_brathwaite\n",
      "dorothy_roberts\n",
      "kailash_satyarthi\n",
      "geoff_mulgan\n",
      "kees_moeliker\n",
      "anand_giridharadas\n",
      "leila_hoteit\n",
      "chinaka_hodge\n",
      "gavin_schmidt\n",
      "charity_wayua\n",
      "siegfried_woldhek\n",
      "kym_worthy\n",
      "caroline_lavelle\n",
      "martin_hanczyc\n",
      "manuel_lima\n",
      "alessandra_orofino\n",
      "justin_baldoni\n",
      "james_geary\n",
      "philippe_petit\n",
      "carlo_ratti\n",
      "gill_hicks\n",
      "tricia_wang\n",
      "afra_raymond\n",
      "alison_jackson\n",
      "anne_marie_slaughter\n",
      "bob_thurman\n",
      "takaharu_tezuka\n",
      "srikumar_rao\n",
      "john_wooden\n",
      "shai_reshef\n",
      "stacy_smith\n",
      "franz_freudenthal\n",
      "peter_van_manen\n",
      "soraya_chemaly\n",
      "ian_ritchie\n",
      "joel_burns\n",
      "shabana_basij_rasikh\n",
      "bruce_mccall\n",
      "asha_de_vos\n",
      "jackson_brown\n",
      "peter_saul\n",
      "oliver_sacks\n",
      "jonathan_eisen\n",
      "kartick_satyanarayan\n",
      "cynthia_schneider\n",
      "laura_carstensen\n",
      "linda_cliatt_wayman\n",
      "heribert_watzke\n",
      "eddie_obeng\n",
      "pierre_barreau\n",
      "onora_o_neill\n",
      "james_veitch\n",
      "joel_jackson\n",
      "lisa_gansky\n",
      "barton_seaver\n",
      "julio_gil\n",
      "emily_balcetis\n",
      "usman_riaz\n",
      "fabian_oefner\n",
      "alex_laskey\n",
      "dan_gibson\n",
      "julie_burstein\n",
      "kenneth_lacovara\n",
      "alexander_tsiaras\n",
      "matthew_carter\n",
      "naomi_klein\n",
      "sarah_kaminsky\n",
      "mary_robinson\n",
      "sonia_shah\n",
      "heidi_m_sosik\n",
      "pamela_ronald\n",
      "mark_kelly_and_gabby_giffords\n",
      "matt_killingsworth\n",
      "miho_janvier\n",
      "charles_leadbeater\n"
     ]
    }
   ],
   "source": [
    "# This is the ACTION:\n",
    "to_csv(\"./profiles/\",\"speakers2.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(134, 4)\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>occupation</th>\n",
       "      <th>introduction</th>\n",
       "      <th>profile</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Gary Haugen</td>\n",
       "      <td>Human rights attorney</td>\n",
       "      <td>As founder of International Justice Mission, G...</td>\n",
       "      <td>While a member of the 1994 United Nations te...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Rabbi Lord Jonathan Sacks</td>\n",
       "      <td>Religious leader</td>\n",
       "      <td>In a world violently polarized by extremists, ...</td>\n",
       "      <td>Rabbi Lord Sacks is one of Judaism's spiritua...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Joe Kowan</td>\n",
       "      <td>Musician and graphic designer</td>\n",
       "      <td>By day he's a graphic designer, and by night J...</td>\n",
       "      <td>Joe Kowan is a Boston-based musician and grap...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Allan Adams</td>\n",
       "      <td>Theoretical physicist</td>\n",
       "      <td>Allan Adams is a theoretical physicist working...</td>\n",
       "      <td>Allan Adams is a theoretical physicist workin...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Peter Tyack</td>\n",
       "      <td>Behavioral ecologist</td>\n",
       "      <td>Peter Tyack studies the social behavior and ac...</td>\n",
       "      <td>Peter Tyack, a senior scientist in biology at...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                        name                     occupation  \\\n",
       "0                Gary Haugen          Human rights attorney   \n",
       "1  Rabbi Lord Jonathan Sacks               Religious leader   \n",
       "2                  Joe Kowan  Musician and graphic designer   \n",
       "3                Allan Adams          Theoretical physicist   \n",
       "4                Peter Tyack           Behavioral ecologist   \n",
       "\n",
       "                                        introduction  \\\n",
       "0  As founder of International Justice Mission, G...   \n",
       "1  In a world violently polarized by extremists, ...   \n",
       "2  By day he's a graphic designer, and by night J...   \n",
       "3  Allan Adams is a theoretical physicist working...   \n",
       "4  Peter Tyack studies the social behavior and ac...   \n",
       "\n",
       "                                             profile  \n",
       "0    While a member of the 1994 United Nations te...  \n",
       "1   Rabbi Lord Sacks is one of Judaism's spiritua...  \n",
       "2   Joe Kowan is a Boston-based musician and grap...  \n",
       "3   Allan Adams is a theoretical physicist workin...  \n",
       "4   Peter Tyack, a senior scientist in biology at...  "
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "\n",
    "df = pd.read_csv('speakers.csv')\n",
    "print(df.shape)\n",
    "\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "with open(out, \"w\") as out:\n",
    "    # create csv.writer\n",
    "    wr = csv.writer(out)\n",
    "    # write headers\n",
    "    wr.writerow([\"name\", \"occupation\", \"introduction\", \"profile\"])\n",
    "    # get all our html files\n",
    "    for html in os.listdir(pth):\n",
    "        with open(os.path.join(pth, html)) as f:\n",
    "            # print(html) # prints off name as it goes?\n",
    "            # parse the file and write the data to a row.\n",
    "            wr.writerow(parse(BeautifulSoup(f, \"lxml\")))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Problem with Eric Haseltine\n",
    "\n",
    "We have one speaker who's page kept throwing an error in the `parsethis` function and for which we wrote the `else: return undetected` code. His name is Eric Haseltine, and we turned the TED website upside down and shook it, hard, and it looks like he's been removed from the website: his speaker page sends you to a recommendations page.\n",
    "\n",
    "Let's load the big CSV, `tedtalks2018` and see if we can find the row for his talk(s) to see if we need to create a line in the speakers CSV for him."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(2656, 12)\n"
     ]
    }
   ],
   "source": [
    "import pandas as pd\n",
    "\n",
    "df = pd.read_csv('tedtalks2018.csv')\n",
    "print(df.shape)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>occupation</th>\n",
       "      <th>introduction</th>\n",
       "      <th>profile</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Gary Haugen</td>\n",
       "      <td>Human rights attorney</td>\n",
       "      <td>As founder of International Justice Mission, G...</td>\n",
       "      <td>While a member of the 1994 United Nations te...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Rabbi Lord Jonathan Sacks</td>\n",
       "      <td>Religious leader</td>\n",
       "      <td>In a world violently polarized by extremists, ...</td>\n",
       "      <td>Rabbi Lord Sacks is one of Judaism's spiritua...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Joe Kowan</td>\n",
       "      <td>Musician and graphic designer</td>\n",
       "      <td>By day he's a graphic designer, and by night J...</td>\n",
       "      <td>Joe Kowan is a Boston-based musician and grap...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Allan Adams</td>\n",
       "      <td>Theoretical physicist</td>\n",
       "      <td>Allan Adams is a theoretical physicist working...</td>\n",
       "      <td>Allan Adams is a theoretical physicist workin...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Peter Tyack</td>\n",
       "      <td>Behavioral ecologist</td>\n",
       "      <td>Peter Tyack studies the social behavior and ac...</td>\n",
       "      <td>Peter Tyack, a senior scientist in biology at...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                        name                     occupation  \\\n",
       "0                Gary Haugen          Human rights attorney   \n",
       "1  Rabbi Lord Jonathan Sacks               Religious leader   \n",
       "2                  Joe Kowan  Musician and graphic designer   \n",
       "3                Allan Adams          Theoretical physicist   \n",
       "4                Peter Tyack           Behavioral ecologist   \n",
       "\n",
       "                                        introduction  \\\n",
       "0  As founder of International Justice Mission, G...   \n",
       "1  In a world violently polarized by extremists, ...   \n",
       "2  By day he's a graphic designer, and by night J...   \n",
       "3  Allan Adams is a theoretical physicist working...   \n",
       "4  Peter Tyack studies the social behavior and ac...   \n",
       "\n",
       "                                             profile  \n",
       "0    While a member of the 1994 United Nations te...  \n",
       "1   Rabbi Lord Sacks is one of Judaism's spiritua...  \n",
       "2   Joe Kowan is a Boston-based musician and grap...  \n",
       "3   Allan Adams is a theoretical physicist workin...  \n",
       "4   Peter Tyack, a senior scientist in biology at...  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>occupation</th>\n",
       "      <th>introduction</th>\n",
       "      <th>profile</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: [name, occupation, introduction, profile]\n",
       "Index: []"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.loc[df['name'] == \"Eric\"]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "He has been removed: his name appearing in our system is entirely a function of his name still appearing in TED's speaker list. We hand-edited the `speakers2.csv` file to remove the line with `undetected` in it."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}