Lectures/Lecture_2/w4111-L2-s2019-ModelRelational-V2.2.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<b><center>\n",
    "<span style=\"font-size: 24pt; line-height: 1.2\">\n",
    "COMS W4111: Introduction to Databases\n",
    "</span>\n",
    "</center></b>\n",
    "<p>\n",
    "<i><center>\n",
    "<span style=\"font-size: 20pt; line-height: 1.2\">\n",
    "Lecture 2: Begin Working with Data Modeling, the Relational Model and SQL<br>(V 2.2)\n",
    "</span>\n",
    "</center></i>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Questions?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Today's Topics\n",
    "\n",
    "1. Environment: Spend some time configuring environments and discussing what is happening:\n",
    "    - Jupyter (iPython) Notebook\n",
    "    - URLs, database connections, database management system servers\n",
    "    - PyCharm environments\n",
    "<br><br>\n",
    "2. Core database concepts and examples.\n",
    "<br><br>\n",
    "3. The relational model and SQL:\n",
    "    1. Overview and concepts.\n",
    "    2. SQL operations: ```SELECT, INSERT, UPDATE, DELETE.```\n",
    "    3. Introduction to keys.\n",
    "    4. Discussion of HW1.\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Set Up Environment\n",
    "\n",
    "## Setup"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The sql extension is already loaded. To reload it, use:\n",
      "  %reload_ext sql\n",
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    }
   ],
   "source": [
    "%load_ext sql\n",
    "%sql mysql+pymysql://dbuser:dbuserdbuser@localhost/lahman2019raw\n",
    "%sql select * from people where playerid='willite01'\n",
    "\n",
    "import pymysql\n",
    "default_cnx = pymysql.connect(host='localhost',\n",
    "                             user='dbuser',\n",
    "                             password='dbuserdbuser',\n",
    "                             db='lahman2019raw',\n",
    "                             charset='utf8mb4',\n",
    "                             cursorclass=pymysql.cursors.DictCursor)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- To run the examples that use %sql, you will have to install an extension to your iPython/Jupyter notebooks.\n",
    "\n",
    "\n",
    "- The extension and installation instruction are at: https://pypi.org/project/ipython-sql/\n",
    "\n",
    "\n",
    "- You can come to office hours (CAs, mine) if you need help.\n",
    "\n",
    "| <img src=\"../../images/install_wizard.jpg\"> |\n",
    "| :---: |\n",
    "| __Installation Wizard__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Explanation\n",
    "\n",
    "- Three interesting and illuminating program statements.\n",
    "\n",
    "```\n",
    "%load_ext sql\n",
    "%sql mysql+pymysql://dbuser:dbuser@localhost/lahman2017\n",
    "%sql select * from people where playerid='willite01'\n",
    "```\n",
    "<br><br>\n",
    "\n",
    "| <img src=\"../../images/what-is-this-sorcery.jpg\" > |\n",
    "| :---: |\n",
    "| __Some Sorcery__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### iPython/Jupyter Notebook Architecture\n",
    "\n",
    "| <img src=\"../../images/notebook_components.png\" > |\n",
    "| :---: |\n",
    "| [iPython Notebook Architecture](https://jupyter.readthedocs.io/en/latest/architecture/how_jupyter_ipython_work.html) |\n",
    "\n",
    "\n",
    "- There are several good explanations of interactive Python, iPython notebooks, etc:\n",
    "    - https://jupyter.readthedocs.io/en/latest/architecture/how_jupyter_ipython_work.html\n",
    "    - https://ipython-books.github.io/chapter-3-mastering-the-jupyter-notebook/\n",
    "    \n",
    "    \n",
    "- You do not need to understand this material for the course.\n",
    "\n",
    "\n",
    "- In lectures, I am using Jupyter notebooks.\n",
    "    - There is an ecosystem of plug-ins and extensions that add features to the base notebook capabilities.\n",
    "    - The ```%sql magic function``` is one of the extensions. \n",
    "    \n",
    "    \n",
    "- \"IPython will treat any line whose first character is a % as a special call to a ‘magic’ function. These allow you to control the behavior of IPython itself, plus a lot of system-type features. They are all prefixed with a % character, but parameters are given without parentheses or quote.\" (https://ipython.readthedocs.io/en/stable/interactive/reference.html#magic)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "%magic"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- ```%load_ext sql``` is calling the magic function ```load_extension.``` This\n",
    "    - Loads the extension module\n",
    "    - The ```%sql``` magic function.\n",
    "  \n",
    "  \n",
    "- This is all FYI. The [iPython](https://ipython.readthedocs.io/en/stable/config/custommagics.html?highlight=magic) documentation explains how to implement Magics.     "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Databases and Connections\n",
    "\n",
    "- What about ```%sql mysql+pymysql://dbuser:dbuser@localhost/lahman2017```?\n",
    "\n",
    "| <img src=\"../../images/db-connection.jpg\"> |\n",
    "| :---: |\n",
    "| __Database Server and Connection__ |\n",
    "\n",
    "\n",
    "- There are typically two processes (running programs) in a database application.\n",
    "    - The database server, which processes database commands.\n",
    "    - The client application that sends commands to and receives responses from the database server.\n",
    "    \n",
    "    \n",
    "- The magic statement defines a database connection.\n",
    "\n",
    "\n",
    "\"A Database connection is facility in computer science that allows client software to talk to database server software, whether on the same machine or not. A connection is required to send commands and receive answers, usually in the form of a result set.\n",
    "\n",
    "Connections are a key concept in data-centric programming. Since some DBMS engines require considerable time to connect connection pooling was invented to improve performance. No command can be performed against a database without an \"open and available\" connection to it.\n",
    "\n",
    "Connections are built by supplying an underlying driver or provider with a connection string, which is a way of addressing a specific database or server and instance as well as user authentication credentials (for example, Server=sql_box;Database=Common;User ID=uid;Pwd=password;). Once a connection has been built it can be opened and closed at will, and properties (such as the command time-out length, or transaction, if one exists) can be set. The Connection String is composed of a set of key/value pairs as dictated by the data access interface and data provider being used.\" (https://en.wikipedia.org/wiki/Database_connection)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Modifying the diagram above to add the DB server\n",
    "\n",
    "| <img src=\"../../images/notebook_and_db.jpeg\"> |\n",
    "| :---: |\n",
    "| __Notebook and DB__"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Again, this is just FYI.\n",
    "    - Understanding that there are connections, how to create them, ... is important and you will write code that uses connections.\n",
    "    - We will not cover the details of connections."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### URLs\n",
    "\n",
    "- A little more about ```mysql+pymysql://dbuser:dbuser@localhost/lahman2017```\n",
    "\n",
    "\n",
    "- The connection specification above is a URL.\n",
    "\n",
    "\n",
    "- \"A Uniform Resource Locator (URL), colloquially termed a web address, is a reference to a web resource that specifies its location on a computer network and a mechanism for retrieving it. A URL is a specific type of Uniform Resource Identifier (URI), although many people use the two terms interchangeably. URLs occur most commonly to reference web pages (http), but are also used for file transfer (ftp), email (mailto), database access (JDBC), and many other applications.\" (https://en.wikipedia.org/wiki/URL)\n",
    "\n",
    "\n",
    "- A URL has the format\n",
    "\n",
    "\n",
    "```URI = scheme:[//authority]path[?query][#fragment]```\n",
    "\n",
    "\n",
    "- The components are:\n",
    "    1. Scheme: Information about the protocol, connector library, ...\n",
    "    2. Authority: Usually ```userid:password```.\n",
    "    3. Path: File system like folder path to the resource.\n",
    "    4. We will cover query string later.\n",
    "    5. Fragment: A location or subset of the resource, e.g. a section with heading.\n",
    "    \n",
    "    \n",
    "- We have seen how we connect to MySQL from Python using ```PyMySQL``` library.\n",
    "\n",
    "```default_cnx = pymysql.connect(host='localhost',\n",
    "                             user='dbuser',\n",
    "                             password='dbuser',\n",
    "                             db='lahman2017',\n",
    "                             charset='utf8mb4',\n",
    "                             cursorclass=pymysql.cursors.DictCursor)```\n",
    "\n",
    "\n",
    "\n",
    "- Some connector libraries support a single connection string of the form:\n",
    "\n",
    "\n",
    "```jdbc:mysql://someuserid:somepassword@www.myurl.com:3306```\n",
    "\n",
    "\n",
    "- Other databases have similar concepts, for example CouchDB.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The Command\n",
    "\n",
    "- And, ```%sql select * from people where playerid='willite01'``` simply runs a [Structured Query Language (SQL)](https://en.wikipedia.org/wiki/SQL) statement.\n",
    "\n",
    "\n",
    "- The optional (recommended) text book _Ramakrishnan and Gehrke,_ chapter 5 discusses SQL.\n",
    "\n",
    "\n",
    "- SQL is the main topic in this and the next few lectures."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### URL, Connection Summary\n",
    "\n",
    "- A database management system:\n",
    "    - Is a software program executing on a \"server\" in the network.The data in a database.\n",
    "    - Stores the data in the database on the file system, usually in special files on a \"disk.\"\n",
    "    \n",
    "    \n",
    "- Applications, including tools like MySQL Workbench, connect to the database management system:\n",
    "    - Over a network.\n",
    "    - Specifying some form of URL that defines:\n",
    "        - The network address of the server (host, port).\n",
    "        - The protocol to use.\n",
    "        - The specific database among the many that the DBMS controls.\n",
    "        - Authentication and authorization information.\n",
    "    - Send commands in a DBMS specific language to the server.\n",
    "\n",
    "| <img src=\"../../images/two-three-tier.jpeg\"> |\n",
    "| :---: |\n",
    "| __Database Architectures__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- We have seen an example of (a) using Jupyter Notebooks."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The relevant people are: \n",
      " [\n",
      "  {\n",
      "    \"playerID\": \"willite01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Ted\",\n",
      "    \"birthCity\": \"San Diego\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthYear\": \"1918\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"willitr01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Trevor\",\n",
      "    \"birthCity\": \"San Diego\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthYear\": \"1992\"\n",
      "  }\n",
      "]\n"
     ]
    }
   ],
   "source": [
    "import json\n",
    "cool_cnx = pymysql.connect(host='localhost',\n",
    "                             user='dbuser',\n",
    "                             password='dbuserdbuser',\n",
    "                             db='lahman2019raw',\n",
    "                             charset='utf8mb4',\n",
    "                             cursorclass=pymysql.cursors.DictCursor)\n",
    "\n",
    "sql = \"select playerID, nameLast, nameFirst, birthCity, birthState, birthYear from People where birthCity='San Diego' \" + \\\n",
    "    \"and nameLast='Williams'\"\n",
    "cur = cool_cnx.cursor()\n",
    "res = cur.execute(sql)\n",
    "people_info = cur.fetchall()\n",
    "print(\"The relevant people are: \\n\", json.dumps(people_info, indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Other database have similar concepts, for example [CouchDB](http://couchdb.apache.org/)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| <img src=\"../../images/couchdb_arch.png\" width=\"800px\"> |\n",
    "| :---: |\n",
    "| [CouchDB Architecture](https://www.researchgate.net/figure/Simple-Architecture-of-Apache-CouchDB-database-Storage-Engine-It-is-B-tree-based-and-the_fig1_265062016) |"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Result =  {\n",
      "  \"docs\": [\n",
      "    {\n",
      "      \"_id\": \"2570e0b648805195a380643653006e66\",\n",
      "      \"_rev\": \"1-b2d6f5b544ea86d95522f3af40d0e2c5\",\n",
      "      \"last_name\": \"Ferguson\",\n",
      "      \"email\": \"dff9@columbia.edu\"\n",
      "    }\n",
      "  ],\n",
      "  \"bookmark\": \"g1AAAABweJzLYWBgYMpgSmHgKy5JLCrJTq2MT8lPzkzJBYorGJmaG6QaJJmZWFgYmBpamiYaWxiYmRibmRobGJilmpmB9HHA9BGlIwsAJ70bdw\",\n",
      "  \"warning\": \"no matching index found, create an index to optimize query time\"\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "import requests\n",
    "body = {\n",
    "    \"selector\": {\n",
    "        \"last_name\": {\"$eq\": \"Ferguson\"}\n",
    "    },\n",
    "    \"fields\": [\"_id\", \"_rev\", \"last_name\", \"email\"]\n",
    "}\n",
    "url = \"http://127.0.0.1:5984/w4111f19/_find\"\n",
    "headers = {\"content-type\": \"application/json\"}\n",
    "result = requests.post(url, json=body, headers=headers)\n",
    "print(\"Result = \", json.dumps(result.json(), indent=2))\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- We will do a Web simple application, specifically a REST API, the implements the three-tier model. This will be homework 2.\n",
    "\n",
    "\n",
    "- There is a very basic HTML UI to give a feel for how the application works end-to-end. The primary focus is an application that accesses data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"900\"\n",
       "            height=\"650\"\n",
       "            src=\"http://127.0.0.1:5000/static/W4111/index.html\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.IFrame at 0x202557051d0>"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import IFrame  \n",
    "IFrame('http://127.0.0.1:5000/static/W4111/index.html', width=900, height=650)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- In the three tier application model:\n",
    "    1. The client (browser, another application, ...) executes code that calls an application programming interface function (API) that the server implements.\n",
    "        - This is similar to any function/method call you learned in programming, but ...\n",
    "        - Occurs between two programs communicating over a network.\n",
    "        - The most common technology is [REST](https://en.wikipedia.org/wiki/Representational_state_transfer).\n",
    "    2. The server application implements business logic in code. This is logical that complements and is beyond what the application can express in the database DML and DDL.\n",
    "    3. The database stores the data and executes queries, integrity constraints, etc."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Answer = \n",
      " {\n",
      "  \"data\": [\n",
      "    {\n",
      "      \"playerID\": {\n",
      "        \"value\": \"willite01\",\n",
      "        \"link\": {\n",
      "          \"rel\": \"people\",\n",
      "          \"href\": \"/api/people/willite01\"\n",
      "        }\n",
      "      },\n",
      "      \"nameLast\": \"Williams\",\n",
      "      \"nameFirst\": \"Ted\",\n",
      "      \"birthCity\": \"San Diego\",\n",
      "      \"birthYear\": \"1918\"\n",
      "    },\n",
      "    {\n",
      "      \"playerID\": {\n",
      "        \"value\": \"willitr01\",\n",
      "        \"link\": {\n",
      "          \"rel\": \"people\",\n",
      "          \"href\": \"/api/people/willitr01\"\n",
      "        }\n",
      "      },\n",
      "      \"nameLast\": \"Williams\",\n",
      "      \"nameFirst\": \"Trevor\",\n",
      "      \"birthCity\": \"San Diego\",\n",
      "      \"birthYear\": \"1992\"\n",
      "    }\n",
      "  ],\n",
      "  \"links\": [\n",
      "    {\n",
      "      \"rel\": \"current\",\n",
      "      \"href\": \"http://127.0.0.1:5000/api/lahman2019raw/people?nameLast=Williams&birthCity=San+Diego&fields=playerID%2CnameLast%2CnameFirst%2CbirthCity%2CbirthYear\"\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "import requests\n",
    "import json\n",
    "\n",
    "url = \"http://127.0.0.1:5000/api/lahman2019raw/people\"\n",
    "\n",
    "query_params = {\"nameLast\": \"Williams\", \"birthCity\": \"San Diego\", \"fields\": \"playerID,nameLast,nameFirst,birthCity,birthYear\"}\n",
    "\n",
    "result = requests.get(url=url, params=query_params)\n",
    "answer = result.json()\n",
    "\n",
    "print(\"Answer = \\n\", json.dumps(answer, indent=2))\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| <img src=\"../../images/new_book_ch1_21.jpg\" width=\"900px\"> |\n",
    "| :---: |\n",
    "| __Database Applications__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Some examples of application logic:\n",
    "    - Complex computations using the data.\n",
    "    - Coordinating integrity of data between multiple different databases and database models.\n",
    "    - Complex input parameter verification."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## PyCharm (Python) Environment\n",
    "\n",
    "### Concept\n",
    "\n",
    "- A core concept in Python, and by extension PyCharm and any Python tool, is a virtual environment.\n",
    "\n",
    "\n",
    "\"'What Is a Virtual Environment?'\"<br><br>\n",
    "At its core, the main purpose of Python virtual environments is to create an isolated environment for Python projects. This means that each project can have its own dependencies, regardless of what dependencies every other project has.\" (https://realpython.com/python-virtual-environments-a-primer/)\n",
    "\n",
    "- [From the Python documentation:](https://docs.python.org/3/tutorial/venv.html)\n",
    "\n",
    "\"Python applications will often use packages and modules that don’t come as part of the standard library. Applications will sometimes need a specific version of a library, because the application may require that a particular bug has been fixed or the application may be written using an obsolete version of the library’s interface.\n",
    "\n",
    "This means it may not be possible for one Python installation to meet the requirements of every application. If application A needs version 1.0 of a particular module but application B needs version 2.0, then the requirements are in conflict and installing either version 1.0 or 2.0 will leave one application unable to run.\n",
    "\n",
    "The solution for this problem is to create a virtual environment, a self-contained directory tree that contains a Python installation for a particular version of Python, plus a number of additional packages.\n",
    "\n",
    "Different applications can then use different virtual environments. To resolve the earlier example of conflicting requirements, application A can have its own virtual environment with version 1.0 installed while application B has another virtual environment with version 2.0. If application B requires a library be upgraded to version 3.0, this will not affect application A’s environment.\"\n",
    "\n",
    "\n",
    "- Other programming languages have similar concepts:\n",
    "    - Java Classpath (https://en.wikipedia.org/wiki/Classpath_(Java))\n",
    "    - JavaScript/NodeJS has the [Node Module Path](https://nodejs.org/api/modules.html)\n",
    "    \n",
    "    \n",
    "- There are two applications with environments that I will use in this course.\n",
    "    - Ananconda\n",
    "    - PyCharm\n",
    "    \n",
    "### PyCharm Demo\n",
    "\n",
    "- Demo environments, creating environments, installing packages.\n",
    "\n",
    "\n",
    "### Anaconda\n",
    "\n",
    "- Demonstrate terminal environment in Jupyter.\n",
    "\n",
    "\n",
    "- Demonstrate Conda command prompt."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Common Database Concepts\n",
    "\n",
    "## The Concepts\n",
    "\n",
    "- Almost all database engines and models have the concepts of\n",
    "    - Objects that are some form of array of (name, value) pairs.\n",
    "    - Sets of similar or related objects.\n",
    "    - Four basic (CRUD) operations on a set\n",
    "        - CREATE a new object and add to a set.\n",
    "        - RETRIEVE an object in a set based on a criteria.\n",
    "        - UPDATE an object in a set, e.g. change the data in the object.\n",
    "        - DELETE an object from a set, specifying the object(s) by some criteria.\n",
    "        \n",
    "        \n",
    "- In the file systems/CSV model:\n",
    "    - A set is a file, e.g. People.csv.\n",
    "    - Each object is a row in the file.\n",
    "    - The header row gives the names of each column.\n",
    "    - The CRUD processing involves writing a program that reads the file, changes the two-dimensional array and writing the file.\n",
    "        - CREATE: Append a row and save the file.\n",
    "        - RETRIEVE: Scan the table and apply some kind of IF statement.\n",
    "        - UPDATE: Change a row in the two dimensional array.\n",
    "        - DELETE: Remove a row from the array.\n",
    "        \n",
    "\n",
    "- In the \"pure\" relational model\n",
    "    - A set is a _relation_.\n",
    "    - An object is a _row_ or _tuple_.\n",
    "    - The operation for _retrieve_ is $\\sigma$.\n",
    "    - There is no support for CREATE, UPDATE or DELETE.\n",
    "    - There is an _algebra_ and language for producing a new relation from existing relations that you can use to \"sort of\" implement INSERT, DELETE, UPDATE.\n",
    "    \n",
    "    \n",
    "- In SQL,\n",
    "    - A set is a _table_.\n",
    "    - An object is a _row_ or _tuple_.\n",
    "    - INSERT is the create operation.\n",
    "    - UPDATE is the delete operation.\n",
    "    - DELETE is the delete operation.\n",
    "    - SELECT is the statement that realizes the relational _algebra_.\n",
    "    \n",
    "    \n",
    "- In [Representational state transfer](https://en.wikipedia.org/wiki/Representational_state_transfer) REST.\n",
    "    - A set is a _resource_ that is a collection of _resources._\n",
    "    - An object is a resource.\n",
    "    - CREATE is HTTP POST\n",
    "    - RETRIEVE is HTTP GET\n",
    "    - UPDATE is HTTP PUT (or PATCH)\n",
    "    - DELETE is HTTP DELETE.\n",
    "    \n",
    "    \n",
    "- [Redis](https://redis.io/): I am tempted to say, \"Don't ask!\"\n",
    "    - The basic concept is that Redis stores pairs of (key, value).\n",
    "    - Key is just a string\n",
    "    - Value can be:\n",
    "        - String\n",
    "        - List\n",
    "        - Hash\n",
    "        - Set\n",
    "        - Sorted Set\n",
    "    - The CRUD commands depend on the data type for a value.\n",
    "    \n",
    "    \n",
    "- In [CouchDB](http://couchdb.apache.org/): I am tempted to say, \"No. Seriously, do not ask! Please!\"\n",
    "    - CouchDB is basically a REST/HTTP accessible document database.\n",
    "    - The CRUD operations are the same as for basic REST, but ...\n",
    "    - There is much more powerful support for running commands, e.g. ```_find.```\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Examples\n",
    "\n",
    "### SQL\n",
    "\n",
    "- ```RETRIEVE``` is ```SELECT```\n",
    "\n",
    "\n",
    "- The basic syntax is:\n",
    "```\n",
    "SELECT column1, column2, ...\n",
    "FROM table_name\n",
    "WHERE condition;\n",
    "```\n",
    "\n",
    "- ```table_name``` is the table/relation representing a set of entities.\n",
    "\n",
    "\n",
    "- ```column1, column2, ...``` is the list of fields/properties you want from each entity.\n",
    "\n",
    "\n",
    "- ```WHERE condition``` is like an ```IF``` statement in a programming language. The operation only returns the entities for which the condition is true."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "11 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>playerID</th>\n",
       "        <th>nameLast</th>\n",
       "        <th>nameFirst</th>\n",
       "        <th>birthYear</th>\n",
       "        <th>birthState</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibe01</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Bernie</td>\n",
       "        <td>1948</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willido02</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Don</td>\n",
       "        <td>1935</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williji03</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Jimy</td>\n",
       "        <td>1943</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willike02</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Ken</td>\n",
       "        <td>1964</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima04</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Matt</td>\n",
       "        <td>1965</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willimi02</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Mitch</td>\n",
       "        <td>1964</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williri02</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Rinaldo</td>\n",
       "        <td>1893</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williri03</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Rick</td>\n",
       "        <td>1952</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willish01</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Shad</td>\n",
       "        <td>1971</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willite01</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Ted</td>\n",
       "        <td>1918</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willitr01</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Trevor</td>\n",
       "        <td>1992</td>\n",
       "        <td>CA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('willibe01', 'Williams', 'Bernie', '1948', 'CA'),\n",
       " ('willido02', 'Williams', 'Don', '1935', 'CA'),\n",
       " ('williji03', 'Williams', 'Jimy', '1943', 'CA'),\n",
       " ('willike02', 'Williams', 'Ken', '1964', 'CA'),\n",
       " ('willima04', 'Williams', 'Matt', '1965', 'CA'),\n",
       " ('willimi02', 'Williams', 'Mitch', '1964', 'CA'),\n",
       " ('williri02', 'Williams', 'Rinaldo', '1893', 'CA'),\n",
       " ('williri03', 'Williams', 'Rick', '1952', 'CA'),\n",
       " ('willish01', 'Williams', 'Shad', '1971', 'CA'),\n",
       " ('willite01', 'Williams', 'Ted', '1918', 'CA'),\n",
       " ('willitr01', 'Williams', 'Trevor', '1992', 'CA')]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "    select playerID, nameLast, nameFirst, birthYear, birthState \n",
    "    from lahman2019raw.people where nameLast='Williams' and birthState='CA'\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Remember, we set up a connection. So, the \"location\" in the \"web\" of the entity is ```localhost:3038``` which resolve to my laptop. \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### REST\n",
    "\n",
    "- SQL is very powerful and there is a widely implement [standard.](https://en.wikipedia.org/wiki/ISO/IEC_9075)\n",
    "\n",
    "\n",
    "- REST is less a standard and more a set of conventions or informal agreements.\n",
    "\n",
    "\n",
    "- Different endpoints interpret the conventions differently. You typically have to read documentation for each endpoint to figure it all out.\n",
    "\n",
    "\n",
    "- For HW2, we will implement a REST endpoint on top of the Lahman 2019 database.\n",
    "\n",
    "\n",
    "- A sample query would be:\n",
    "```\n",
    "http://127.0.0.1:5000/api/lahman2019raw/people?nameLast=Williams&birthState=CA&fields=playerID,nameLast,nameFirst,birthYear,birthState\n",
    "```\n",
    "\n",
    "- A sample of using my solution to HW2 is:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    " %load_ext restmagic"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{\n",
       "  \"data\": [\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willibe01\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willibe01\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Bernie\",\n",
       "      \"birthYear\": \"1948\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willido02\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willido02\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Don\",\n",
       "      \"birthYear\": \"1935\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"williji03\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/williji03\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Jimy\",\n",
       "      \"birthYear\": \"1943\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willike02\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willike02\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Ken\",\n",
       "      \"birthYear\": \"1964\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willima04\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willima04\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Matt\",\n",
       "      \"birthYear\": \"1965\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willimi02\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willimi02\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Mitch\",\n",
       "      \"birthYear\": \"1964\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"williri02\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/williri02\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Rinaldo\",\n",
       "      \"birthYear\": \"1893\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"williri03\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/williri03\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Rick\",\n",
       "      \"birthYear\": \"1952\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willish01\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willish01\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Shad\",\n",
       "      \"birthYear\": \"1971\",\n",
       "      \"birthState\": \"CA\"\n",
       "    },\n",
       "    {\n",
       "      \"playerID\": {\n",
       "        \"value\": \"willite01\",\n",
       "        \"link\": {\n",
       "          \"rel\": \"people\",\n",
       "          \"href\": \"/api/people/willite01\"\n",
       "        }\n",
       "      },\n",
       "      \"nameLast\": \"Williams\",\n",
       "      \"nameFirst\": \"Ted\",\n",
       "      \"birthYear\": \"1918\",\n",
       "      \"birthState\": \"CA\"\n",
       "    }\n",
       "  ],\n",
       "  \"links\": [\n",
       "    {\n",
       "      \"rel\": \"current\",\n",
       "      \"href\": \"http://127.0.0.1:5000/api/lahman2019raw/people?nameLast=Williams&birthState=CA&fields=playerID,nameLast,nameFirst,birthYear,birthState\"\n",
       "    },\n",
       "    {\n",
       "      \"rel\": \"next\",\n",
       "      \"href\": \"http://127.0.0.1:5000/api/lahman2019raw/people?nameLast=Williams&birthState=CA&fields=playerID,nameLast,nameFirst,birthYear,birthState&offset=10&limit=10\"\n",
       "    }\n",
       "  ]\n",
       "}"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "<Response [200]>"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%rest GET http://127.0.0.1:5000/api/lahman2019raw/people?nameLast=Williams&birthState=CA&fields=playerID,nameLast,nameFirst,birthYear,birthState"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Comments:\n",
    "    - 127.0.0.1 is just another way to say ```localhost.```\n",
    "    - ```/api``` is a convention or pattern that means \"I am calling an API, not asking for a web page.\n",
    "    - ```/lahman2019/people``` is a convention for identifying the database and table.\n",
    "    - ```fields=...``` is a convention for identifying the properties that you want.\n",
    "    - ```?x=y&z=m``` is a simplified query expressions similar to ```WHERE ...```\n",
    "    \n",
    "    \n",
    "- We will understand more when we move onto HW2. The important point is thinking about the web as a kind of database.\n",
    "\n",
    "\n",
    "- __Note:__ Demo the UI\n",
    "\n",
    "\n",
    "<hr style=\"height:1px;\">\n",
    "\n",
    "| <img src=\"../../images/hw2_intro.jpeg\"> |\n",
    "| :---: |\n",
    "| __HW2 Concept__ |\n",
    "\n",
    "<hr style=\"height:1px;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Files/CSVs\n",
    "\n",
    "- There is not standard. HW1 defines a convention, and then maps to RDB or CSV files.\n",
    "\n",
    "\n",
    "- To learn about database concepts, we are implementing a DB like think on top of CSV files.\n",
    "\n",
    "\n",
    "- We implement the same concept on top of RDB to compare implementations.\n",
    "\n",
    "\n",
    "- We could do the same pattern on top of all of our various databases, but there is not a lot of learning value."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Load my solution implementation into the Notebook's path.\n",
    "import sys\n",
    "sys.path.append(\"C:\\\\Users\\\\dferguso\\\\ansys_one_drive\\\\Columbia\\\\Projects\\\\W4111\\\\HW1Impl\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "from src.CSVDataTable import CSVDataTable"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Where is the \"DB\" holding my \"tables\"?\n",
    "_default_directory = \\\n",
    "        \"C:\\\\Users\\\\dferguso\\\\ansys_one_drive\\\\Columbia\\Projects\\\\W4111\\\\HW1Impl\\\\Data\" + \\\n",
    "            \"\\\\baseballdatabank-2019.2\\\\core\\\\\" "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# I want to connect to a \"table\"\n",
    "connect_info = {\n",
    "    \"directory\": _default_directory,\n",
    "    \"file_name\": 'People.csv'\n",
    "}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Create a data table to wrap the file.\n",
    "t = CSVDataTable(table_name=\"People\", key_columns=['playerID'],connect_info=connect_info)                     "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Load the file into memory.\n",
    "t.load()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "template = {\"birthState\": \"CA\", \"nameLast\": \"Williams\"}\n",
    "field_list = ['playerID', 'nameLast', 'nameFirst', 'birthYear', 'birthState']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "result = t.find_by_template(template, field_list, None, None, None)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'src.DerivedDataTable.DerivedDataTable'>: name = FBT:People\n",
      "connect_info = None\n",
      "Key columns = None\n",
      "No. of rows = 11\n",
      "{'playerID': 'willibe01', 'nameLast': 'Williams', 'nameFirst': 'Bernie', 'birthYear': '1948', 'birthState': 'CA'}\n",
      "{'playerID': 'willido02', 'nameLast': 'Williams', 'nameFirst': 'Don', 'birthYear': '1935', 'birthState': 'CA'}\n",
      "{'playerID': 'williji03', 'nameLast': 'Williams', 'nameFirst': 'Jimy', 'birthYear': '1943', 'birthState': 'CA'}\n",
      "{'playerID': 'willike02', 'nameLast': 'Williams', 'nameFirst': 'Ken', 'birthYear': '1964', 'birthState': 'CA'}\n",
      "{'playerID': 'willima04', 'nameLast': 'Williams', 'nameFirst': 'Matt', 'birthYear': '1965', 'birthState': 'CA'}\n"
     ]
    }
   ],
   "source": [
    "print(result)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Redis, CouchDB\n",
    "\n",
    "__I said, 'Don't ask.\"__\n",
    "\n",
    "\n",
    "- These are complex discussions and I want to move onto the relational model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# The Relational Model $-$ I\n",
    "\n",
    "## Overview\n",
    "\n",
    "References: Ramakrishnan and Gehrke, section 3.1\n",
    "\n",
    "There are two perspectives on the relational model:\n",
    "1. Formal language and algebra.\n",
    "2. A standard implementation language, Structure Query Language [(SQL)](https://en.wikipedia.org/wiki/SQL)\n",
    "\n",
    "\n",
    "The relational model and SQL language (and most DB engines) have two sub-languages/models:\n",
    "1. Data definition\n",
    "2. Data manipulation\n",
    "    \n",
    "    \n",
    "MySQL and other database engines also have an API/language for administration and security.\n",
    "\n",
    "<hr style=\"height:1px;\">\n",
    "\n",
    "| <img src=\"../../images/db_engine_apis.jpeg\"> |\n",
    "| :---: |\n",
    "| __DB Engine Interfaces__ |\n",
    "\n",
    "<hr style=\"height:1px;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "\n",
    "| <img src=\"../../images/Slide03.jpg\"> |\n",
    "| :---: |\n",
    "| __Relational Model__ |\n",
    "\n",
    "<hr>\n",
    "\n",
    "| <img src=\"../../images/Slide04.jpg\"> |\n",
    "| :---: |\n",
    "| __Relational Model__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Defining Data\n",
    "\n",
    "### Relational Model\n",
    "\n",
    "- _Relational Schema_ defines and provides metadata describing what is/can be in \"the file\" (called a _relation_), e.g.<br>\n",
    "\n",
    "\n",
    "\\begin{equation}\n",
    "Employees(\\overline{employeeNumber}:integer, \\ lastName:string, \\ firstName:string, \\ extension:string, \\ email:string, \\ officeCode:integer, \\ reportsTo:integer, \\ jobTitle: string)\n",
    "\\end{equation}\n",
    "\n",
    "\n",
    "- The formal relational model is imprecise about allowed types for fields/columns. The types must be elementary (atomic) types, e.g. integer, string, char, ...\n",
    "\n",
    "\n",
    "- The $\\overline{overline}$ indicates the _key columns,_ which we will cover later.\n",
    "\n",
    "\n",
    "- A _Relational Instance_ is a \"table\" of data that conforms to a relation schema, e.g.<br><br>\n",
    "\n",
    "\n",
    "| <img src=\"../../images/employee_relation.jpeg\" width=\"900px%\"> |\n",
    "| :---: |\n",
    "| __Employee Relational Instance__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### SQL\n",
    "\n",
    "- Structured Query Language (SQL) is a well-defined programming language that realizes a superset of the relation model.\n",
    "\n",
    "\n",
    "- There are two sub-languages\n",
    "    1. Data Definition Language (DDL) corresponds to relational schema.\n",
    "    2. Data Manipulation Language corresponds to relational algebra (covered later).\n",
    "    \n",
    "\n",
    "- Data Definition Statements (DDL) statements are how you create/modify tables in SQL.\n",
    "\n",
    "\n",
    "- Defining a table in SQL uses the create statement. The statement for creating the ```People``` table to hold data from ```Lahman2019's``` CSV file ```people.csv``` is: \n",
    "\n",
    "```\n",
    "\n",
    "CREATE TABLE `people` (\n",
    "  `playerID` text,\n",
    "  `birthYear` text,\n",
    "  `birthMonth` text,\n",
    "  `birthDay` text,\n",
    "  `birthCountry` text,\n",
    "  `birthState` text,\n",
    "  `birthCity` text,\n",
    "  `deathYear` text,\n",
    "  `deathMonth` text,\n",
    "  `deathDay` text,\n",
    "  `deathCountry` text,\n",
    "  `deathState` text,\n",
    "  `deathCity` text,\n",
    "  `nameFirst` text,\n",
    "  `nameLast` text,\n",
    "  `nameGiven` text,\n",
    "  `weight` text,\n",
    "  `height` text,\n",
    "  `bats` text,\n",
    "  `throws` text,\n",
    "  `debut` text,\n",
    "  `finalGame` text,\n",
    "  `retroID` text,\n",
    "  `bbrefID` text\n",
    ") ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci;\n",
    "\n",
    "\n",
    "\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- The back, single quotes are a sometimes useful/sometimes annoying aspect of MySQL's implementation of the SQL standard.\n",
    "    - Anything in between single back quotes is a _schema element._\n",
    "    - Allows attributes and table names of the form \\`My Table\\` \\`My-Table\\` and makes clear that \\`My-Table\\` is a schema element and not an attempt to subtract the variable `Table` from the variable `My` \n",
    "\n",
    "\n",
    "- SQL has a superset of the relational model's schema definition capability. An improved table definition could be\n",
    "        \n",
    "        \n",
    "- There are some design or best practice issues with this table, which we will discuss later.\n",
    "        \n",
    "        \n",
    "- The SQL DML\n",
    "    - Has many other operations/statements.\n",
    "        - DROP\n",
    "        - ALTER\n",
    "    - Operates on more than just a table's attributes, e.g.\n",
    "        - Constraints\n",
    "        - Triggers\n",
    "        - Indexes\n",
    "\n",
    "\n",
    "- We will go into DML and defining data in much more detail."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Manipulating and Processing Information\n",
    "\n",
    "### Computer Languages\n",
    "\n",
    "- A [declarative language's](https://en.wikipedia.org/wiki/Declarative_programming) programs describe their desired results without explicitly listing commands or steps that must be performed\n",
    "\n",
    "\n",
    "- An [imperative language](https://en.wikipedia.org/wiki/Imperative_programming) program consists of commands for the computer to perform. Imperative programming focuses on describing how a program operates.\n",
    "\n",
    "\n",
    "- The most distinguishing feature is that declarative languages do not have control-flow constructs, e.g.\n",
    "    - ```if {...} else {...}```\n",
    "    - ```for (...) {...}```\n",
    "\n",
    "\n",
    "- The relation model, SQL and many DB languages are (primarily) [declarative languages.](https://en.wikipedia.org/wiki/Declarative_programming)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Algebraic Query Language\n",
    "\n",
    "Reference: Ramkrishan and Gherke, section 2.4.\n",
    "\n",
    "Both the abstract relational model/theory and SQL are __algebras__.\n",
    "\n",
    "#### Algebra\n",
    "\n",
    "\"... abstract algebra (occasionally called modern algebra) is the study of algebraic structures.\" (https://en.wikipedia.org/wiki/Abstract_algebra) \n",
    "\n",
    "\"In mathematics, and more specifically in abstract algebra, an algebraic structure is a set (called carrier set or underlying set) with one or more operations defined on it that satisfies a list of axioms.\" (https://en.wikipedia.org/wiki/Algebraic_structure)\n",
    "\n",
    "__Group is an Example__ (http://mathworld.wolfram.com/Group.html)\n",
    "\n",
    "\"A group G is a finite or infinite set of elements together with a binary operation (called the group operation) that together satisfy the four fundamental properties of closure, associativity, the identity property, and the inverse property. The operation with respect to which a group is defined is often called the \"group operation,\" and a set is said to be a group \"under\" this operation. Elements A, B, C, ... with binary operation between A and B denoted AB form a group if\n",
    "\n",
    "1. Closure: If A and B are two elements in G, then the product AB is also in G.\n",
    "<br><br>\n",
    "2. Associativity: The defined multiplication is associative, i.e., for all A,B,C in G, (AB)C=A(BC).\n",
    "<br><br>\n",
    "3. Identity: There is an identity element I (a.k.a. 1, E, or e) such that IA=AI=A for every element A in G.\n",
    "<br><br>\n",
    "4. Inverse: There must be an inverse (a.k.a. reciprocal) of each element. Therefore, for each element A of G, the set contains an element B=A<sup>-1</sup> such that <br>AA<sup>-1</sup>=A<sup>-1</sup>A=I."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Why a Special Query Language? Why a Formal Language? Why an Algebra\n",
    "\n",
    "- Computing has a formal mathemetical model.\n",
    "\n",
    "\n",
    "- Programming languages derive from the model and have their own formal definition.\n",
    "\n",
    "\n",
    "- Almost every time someone publishes a new language, my reaction is, \"What? Why another language? Can't we just pick one, use it and get it right?\"\n",
    "\n",
    "\n",
    "- Relational algebra is less powerful and expressive than Java, C, ... and other programming languages.\n",
    "\n",
    "\n",
    "- __The simplicity and constrained capabilities is actually one of the core of the value,__ enabling\n",
    "    - Vastly simplified programming and supporting tools that yields increased productivity.\n",
    "    - Development of algorithms that process the data definitions and query statements to automatically produce optimal execution plans, which are better than what a programmer can directly code.\n",
    "    \n",
    "    \n",
    "- We will see these benefits in coming lectures.\n",
    "\n",
    "\n",
    "_Simple Tool Example_ that enables \"citizen programmers\" to maniuplate data.\n",
    "\n",
    "| <img src=\"../../images/ss_1.jpeg\"> |\n",
    "| :---: |\n",
    "| __Data Processing and Cleansing Tools__ |\n",
    "\n",
    "<br><br>\n",
    "_Simple Tool Example_ for enabling business professionals to analyze and report on data.\n",
    "\n",
    "| <img src=\"../../images/quicksight.jpeg\" width=\"85%\"> |\n",
    "| :---: |\n",
    "| [QuickSight](https://aws.amazon.com/quicksight/) Analysis Tool |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Relational Algebra\n",
    "\n",
    "- There are two notations or representations of the algebra:\n",
    "    - The original, formal theory.\n",
    "    - SQL\n",
    "    \n",
    "#### Original, Formal Relational Notation\n",
    "\n",
    "Ramakrishnan and Gehrke, section 4.2\n",
    "\n",
    "\n",
    "- The \"set\" in the relational algebra is the set of _relations_.\n",
    "\n",
    "\n",
    "- The operations are:\n",
    "    - Common set operations:\n",
    "        - Union: $\\cup$\n",
    "        - Intersection: $\\cap$\n",
    "        - Difference: $-$\n",
    "    - Projection: $\\pi$\n",
    "    - Selection: $\\sigma$\n",
    "    - Cartesian Product: $\\times$\n",
    "    - Join: $\\bowtie$\n",
    "    - Rename/Alias\n",
    "    \n",
    "\n",
    "- The formal notation does not support create, update or delete of tuples/rows in a relation. You could emulate the operations by\n",
    "    - Defining new relations containing the created, updated or delete tuples.\n",
    "    - Using $\\cup$, $\\cap$, $-$ on the original relation and created/deleted/updated tuple relation.\n",
    "    \n",
    "    \n",
    "- This is an algebra $\\Rightarrow$ that $R_1\\ OP\\ R_2 \\rightarrow R_3 ,$ where $R_1 , R_2 , $ and $R_3$ are relations ( aka tables). Relationa algebra is closed. Algebra statements operate on relations and produce relations.\n",
    "    \n",
    "    \n",
    "#### SQL Notation\n",
    "\n",
    "Ramakrishnan and Gehrke, sections 5.1, 5.2\n",
    "\n",
    "- The \"set\" in the relational algebra is the catalog of _tables_.\n",
    "\n",
    "\n",
    "- The operations are:\n",
    "    - Common set operations:\n",
    "        - Union: UNION\n",
    "        - Intersection: INTERSECT\n",
    "        - Difference: EXCEPT\n",
    "    - Selection, Projection, Cartesian Product, Rename/Alias and Join are clauses within a SELECT statement.\n",
    "    \n",
    "    ```SELECT <project clause> FROM <table> [JOIN <table> [ON <join condition]] WHERE <select condition>```\n",
    "    \n",
    "    \n",
    "- SQL supports additional operations, e.g\n",
    "    - GROUP BY\n",
    "    - ORDER BY\n",
    "    \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Selection and Projection\n",
    "\n",
    "#### Relational Model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- <span style=\"color: red;\">Projection</span> produces a new relation that\n",
    "    - Has the same rows as the original table\n",
    "    - But only containing the requested columns/fields\n",
    "    \n",
    "    \n",
    "- <span style=\"color: red;\">Selection</span> produces a new relation that\n",
    "    - Has the same columns as the original relation\n",
    "    - But only contains rows with column values matching a predicate.\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Selection\n",
    "\n",
    "- The selection operator is $\\sigma$\n",
    "\n",
    "\n",
    "- The selection predicate operators are: $\\lt, \\gt, =, \\ne, \\ge, \\le$\n",
    "\n",
    "\n",
    "- $\\sigma(Players)$ selects all of the rows/tuples in the player relation.\n",
    "\n",
    "\n",
    "- The predicate/condition is a \"subscript,\" e.g.\n",
    "    - $\\sigma$<sub>playerID=napolmi01</sub>$(Players)$ selects all players with _playerID=napolmi01_\n",
    "    - $\\sigma$<sub>((nameLast=Williams)$\\land(throws=L))\\lor(birthYear\\ne1914)$</sub>$(Players)$ selects all players with\n",
    "        - Last name williams who threw lefthanded\n",
    "        - Birth year not equal to 1914\n",
    "        \n",
    "        \n",
    "- This notation is a little clunky. You can think of the selection predicate being similar to what goes in an _if()_ statement if you were looping through an array testing for a match.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "###### Projection\n",
    "\n",
    "- The projection operator is $\\pi$\n",
    "\n",
    "\n",
    "- The requested columns are subscripts on the operator, e.g. $\\pi$<sub>$nameLast,nameFirst,throws$</sub>$(Players)$ returns a table\n",
    "    - Containing the $nameLast, nameFirst, throws$ column values, in that order\n",
    "    - For all tuples in the $Players$ table."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### An Algebra\n",
    "\n",
    "- Because the relational model is an algebra, composition is possible.\n",
    "\n",
    "\n",
    "- Like algebras, there are instances where composition supports _commutativity,_ _associativity,_ _distribution_ and other algebra rules. \n",
    "\n",
    "\n",
    "- For example, $\\pi$ and $\\sigma$ are commutative.\n",
    "\\begin{equation}\n",
    "\\pi_{nameLast,nameFirst,birthYear}(\\sigma_{birthYear=1960}(Players)) = \\sigma_{birthYear=1960}(\\pi_{nameLast,nameFirst,birthYear}(Players))\n",
    "\\end{equation}\n",
    "\n",
    "\n",
    "- The fact that some algebra rules apply will become important in query optimization later in the course."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### SQL\n",
    "\n",
    "- The core syntax of the SQL SELECT statement is\n",
    "```\n",
    "SELECT [DISTINCT] column-list\n",
    "    FROM table-list\n",
    "    WHERE qualification\n",
    "```\n",
    "\n",
    "- All RDB products implement the core syntax but with extensions.\n",
    "\n",
    "\n",
    "- The MYSQL syntax is\n",
    "\n",
    "```\n",
    "SELECT\n",
    "    [ALL | DISTINCT | DISTINCTROW ]\n",
    "      [HIGH_PRIORITY]\n",
    "      [STRAIGHT_JOIN]\n",
    "      [SQL_SMALL_RESULT] [SQL_BIG_RESULT] [SQL_BUFFER_RESULT]\n",
    "      SQL_NO_CACHE [SQL_CALC_FOUND_ROWS]\n",
    "    select_expr [, select_expr ...]\n",
    "    [FROM table_references\n",
    "      [PARTITION partition_list]\n",
    "    [WHERE where_condition]\n",
    "    [GROUP BY {col_name | expr | position}, ... [WITH ROLLUP]]\n",
    "    [HAVING where_condition]\n",
    "    [WINDOW window_name AS (window_spec)\n",
    "        [, window_name AS (window_spec)] ...]\n",
    "    [ORDER BY {col_name | expr | position}\n",
    "      [ASC | DESC], ... [WITH ROLLUP]]\n",
    "    [LIMIT {[offset,] row_count | row_count OFFSET offset}]\n",
    "    [INTO OUTFILE 'file_name'\n",
    "        [CHARACTER SET charset_name]\n",
    "        export_options\n",
    "      | INTO DUMPFILE 'file_name'\n",
    "      | INTO var_name [, var_name]]\n",
    "    [FOR {UPDATE | SHARE} [OF tbl_name [, tbl_name] ...] [NOWAIT | SKIP LOCKED] \n",
    "      | LOCK IN SHARE MODE]]\n",
    "```\n",
    "\n",
    "\n",
    "- __Examples are the easiest way to master the syntax and behavior.__\n",
    "\n",
    "\n",
    "- A reminder of the ```Lahman2017.People``` table.\n",
    "\n",
    "```\n",
    "CREATE TABLE `people` (\n",
    "  `playerID` varchar(12) NOT NULL,\n",
    "  `birthYear` char(4) DEFAULT NULL,\n",
    "  `birthMonth` char(2) DEFAULT NULL,\n",
    "  `birthDay` char(2) DEFAULT NULL,\n",
    "  `birthCountry` varchar(64) DEFAULT NULL,\n",
    "  `birthState` varchar(32) DEFAULT NULL,\n",
    "  `birthCity` varchar(64) DEFAULT NULL,\n",
    "  `deathYear` char(4) DEFAULT NULL,\n",
    "  `deathMonth` char(2) DEFAULT NULL,\n",
    "  `deathDay` char(2) DEFAULT NULL,\n",
    "  `deathCountry` varchar(64) DEFAULT NULL,\n",
    "  `deathState` varchar(32) DEFAULT NULL,\n",
    "  `deathCity` varchar(64) DEFAULT NULL,\n",
    "  `nameFirst` varchar(64) NOT NULL,\n",
    "  `nameLast` varchar(64) NOT NULL,\n",
    "  `nameGiven` varchar(128) DEFAULT NULL,\n",
    "  `weight` char(3) DEFAULT NULL,\n",
    "  `height` char(3) DEFAULT NULL,\n",
    "  `bats` char(1) DEFAULT NULL,\n",
    "  `throws` char(1) DEFAULT NULL,\n",
    "  `debut` varchar(16) DEFAULT NULL,\n",
    "  `finalGame` varchar(16) DEFAULT NULL,\n",
    "  `retroID` varchar(12) DEFAULT NULL,\n",
    "  `bbrefID` varchar(12) DEFAULT NULL,\n",
    "  PRIMARY KEY (`playerID`)\n",
    ") ENGINE=InnoDB DEFAULT CHARSET=utf8;\n",
    "```\n",
    "\n",
    "- __NOTE:__ All of the single back quotes are:\n",
    "    - MySQL specific\n",
    "    - Optional in most cases, and only required if a table or column name has a space or some other icky character, e.g. ``` `First Name` ```, ```First-Name```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<u>Select all People with last name 'Williams'</u>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "80 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>playerID</th>\n",
       "        <th>birthYear</th>\n",
       "        <th>birthMonth</th>\n",
       "        <th>birthDay</th>\n",
       "        <th>birthCountry</th>\n",
       "        <th>birthState</th>\n",
       "        <th>birthCity</th>\n",
       "        <th>deathYear</th>\n",
       "        <th>deathMonth</th>\n",
       "        <th>deathDay</th>\n",
       "        <th>deathCountry</th>\n",
       "        <th>deathState</th>\n",
       "        <th>deathCity</th>\n",
       "        <th>nameFirst</th>\n",
       "        <th>nameLast</th>\n",
       "        <th>nameGiven</th>\n",
       "        <th>weight</th>\n",
       "        <th>height</th>\n",
       "        <th>bats</th>\n",
       "        <th>throws</th>\n",
       "        <th>debut</th>\n",
       "        <th>finalGame</th>\n",
       "        <th>retroID</th>\n",
       "        <th>bbrefID</th>\n",
       "        <th>DOD</th>\n",
       "        <th>DOB</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williac01</td>\n",
       "        <td>1917</td>\n",
       "        <td>3</td>\n",
       "        <td>18</td>\n",
       "        <td>USA</td>\n",
       "        <td>NJ</td>\n",
       "        <td>Montclair</td>\n",
       "        <td>1999</td>\n",
       "        <td>9</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>FL</td>\n",
       "        <td>Fort Myers</td>\n",
       "        <td>Ace</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Robert Fulton</td>\n",
       "        <td>174</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>L</td>\n",
       "        <td>1940-07-15</td>\n",
       "        <td>1946-04-22</td>\n",
       "        <td>willa103</td>\n",
       "        <td>williac01</td>\n",
       "        <td>1999-09-16</td>\n",
       "        <td>1917-03-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willial02</td>\n",
       "        <td>1914</td>\n",
       "        <td>5</td>\n",
       "        <td>11</td>\n",
       "        <td>USA</td>\n",
       "        <td>AL</td>\n",
       "        <td>Valhermosa Springs</td>\n",
       "        <td>1969</td>\n",
       "        <td>7</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Groves</td>\n",
       "        <td>Al</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Almon Edward</td>\n",
       "        <td>200</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1937-04-19</td>\n",
       "        <td>1938-09-04</td>\n",
       "        <td>willa101</td>\n",
       "        <td>willial02</td>\n",
       "        <td>1969-07-19</td>\n",
       "        <td>1914-05-11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willial03</td>\n",
       "        <td>1954</td>\n",
       "        <td>5</td>\n",
       "        <td>6</td>\n",
       "        <td>Nicaragua</td>\n",
       "        <td>Atlantico Sur</td>\n",
       "        <td>Pearl Lagoon</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Albert</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Albert Hamilton</td>\n",
       "        <td>190</td>\n",
       "        <td>76</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1980-05-07</td>\n",
       "        <td>1984-09-26</td>\n",
       "        <td>willa001</td>\n",
       "        <td>willial03</td>\n",
       "        <td>None</td>\n",
       "        <td>1954-05-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williar01</td>\n",
       "        <td>1877</td>\n",
       "        <td>8</td>\n",
       "        <td>24</td>\n",
       "        <td>USA</td>\n",
       "        <td>MA</td>\n",
       "        <td>Somerville</td>\n",
       "        <td>1941</td>\n",
       "        <td>5</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Arlington</td>\n",
       "        <td>Art</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Arthur Frank</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1902-05-07</td>\n",
       "        <td>1902-09-01</td>\n",
       "        <td>willa104</td>\n",
       "        <td>williar01</td>\n",
       "        <td>1941-05-16</td>\n",
       "        <td>1877-08-24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibe01</td>\n",
       "        <td>1948</td>\n",
       "        <td>10</td>\n",
       "        <td>8</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Alameda</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Bernie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Bernard</td>\n",
       "        <td>175</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1970-09-07</td>\n",
       "        <td>1974-05-12</td>\n",
       "        <td>willb105</td>\n",
       "        <td>willibe01</td>\n",
       "        <td>None</td>\n",
       "        <td>1948-10-08</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibe02</td>\n",
       "        <td>1968</td>\n",
       "        <td>9</td>\n",
       "        <td>13</td>\n",
       "        <td>P.R.</td>\n",
       "        <td></td>\n",
       "        <td>San Juan</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Bernie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Bernabe</td>\n",
       "        <td>180</td>\n",
       "        <td>74</td>\n",
       "        <td>B</td>\n",
       "        <td>R</td>\n",
       "        <td>1991-07-07</td>\n",
       "        <td>2006-10-01</td>\n",
       "        <td>willb002</td>\n",
       "        <td>willibe02</td>\n",
       "        <td>None</td>\n",
       "        <td>1968-09-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibi01</td>\n",
       "        <td>1938</td>\n",
       "        <td>6</td>\n",
       "        <td>15</td>\n",
       "        <td>USA</td>\n",
       "        <td>AL</td>\n",
       "        <td>Whistler</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Billy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Billy Leo</td>\n",
       "        <td>175</td>\n",
       "        <td>73</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1959-08-06</td>\n",
       "        <td>1976-10-02</td>\n",
       "        <td>willb104</td>\n",
       "        <td>willibi01</td>\n",
       "        <td>None</td>\n",
       "        <td>1938-06-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibi02</td>\n",
       "        <td>1932</td>\n",
       "        <td>6</td>\n",
       "        <td>13</td>\n",
       "        <td>USA</td>\n",
       "        <td>SC</td>\n",
       "        <td>Newberry</td>\n",
       "        <td>2013</td>\n",
       "        <td>6</td>\n",
       "        <td>11</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Berkeley</td>\n",
       "        <td>Billy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>William</td>\n",
       "        <td>195</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1969-08-15</td>\n",
       "        <td>1969-08-20</td>\n",
       "        <td>willb102</td>\n",
       "        <td>willibi02</td>\n",
       "        <td>2013-06-11</td>\n",
       "        <td>1932-06-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibo01</td>\n",
       "        <td>1884</td>\n",
       "        <td>4</td>\n",
       "        <td>27</td>\n",
       "        <td>USA</td>\n",
       "        <td>OH</td>\n",
       "        <td>Monday</td>\n",
       "        <td>1962</td>\n",
       "        <td>8</td>\n",
       "        <td>6</td>\n",
       "        <td>USA</td>\n",
       "        <td>OH</td>\n",
       "        <td>Nelsonville</td>\n",
       "        <td>Bob</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Robert Elias</td>\n",
       "        <td>190</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1911-07-03</td>\n",
       "        <td>1913-09-30</td>\n",
       "        <td>willb103</td>\n",
       "        <td>willibo01</td>\n",
       "        <td>1962-08-06</td>\n",
       "        <td>1884-04-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willibr01</td>\n",
       "        <td>1969</td>\n",
       "        <td>2</td>\n",
       "        <td>15</td>\n",
       "        <td>USA</td>\n",
       "        <td>SC</td>\n",
       "        <td>Lancaster</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Brian</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Brian O&#x27;Neal</td>\n",
       "        <td>205</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1991-09-16</td>\n",
       "        <td>2000-07-05</td>\n",
       "        <td>willb001</td>\n",
       "        <td>willibr01</td>\n",
       "        <td>None</td>\n",
       "        <td>1969-02-15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willich01</td>\n",
       "        <td>1947</td>\n",
       "        <td>10</td>\n",
       "        <td>11</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>Flushing</td>\n",
       "        <td>2015</td>\n",
       "        <td>1</td>\n",
       "        <td>27</td>\n",
       "        <td>USA</td>\n",
       "        <td>FL</td>\n",
       "        <td>Port Orange</td>\n",
       "        <td>Charlie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Charles Prosek</td>\n",
       "        <td>200</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1971-04-23</td>\n",
       "        <td>1978-09-11</td>\n",
       "        <td>willc101</td>\n",
       "        <td>willich01</td>\n",
       "        <td>2015-01-27</td>\n",
       "        <td>1947-10-11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willicy01</td>\n",
       "        <td>1887</td>\n",
       "        <td>12</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>IN</td>\n",
       "        <td>Wadena</td>\n",
       "        <td>1974</td>\n",
       "        <td>4</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>WI</td>\n",
       "        <td>Eagle River</td>\n",
       "        <td>Cy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Fred</td>\n",
       "        <td>180</td>\n",
       "        <td>74</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1912-07-18</td>\n",
       "        <td>1930-09-22</td>\n",
       "        <td>willc103</td>\n",
       "        <td>willicy01</td>\n",
       "        <td>1974-04-23</td>\n",
       "        <td>1887-12-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida01</td>\n",
       "        <td>1855</td>\n",
       "        <td>10</td>\n",
       "        <td>6</td>\n",
       "        <td>USA</td>\n",
       "        <td>KY</td>\n",
       "        <td>Ludlow</td>\n",
       "        <td>1939</td>\n",
       "        <td>10</td>\n",
       "        <td>22</td>\n",
       "        <td>USA</td>\n",
       "        <td>KY</td>\n",
       "        <td>Covington</td>\n",
       "        <td>Dale</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Elisha Alphonso</td>\n",
       "        <td>175</td>\n",
       "        <td>69</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1876-08-12</td>\n",
       "        <td>1876-09-09</td>\n",
       "        <td>willd106</td>\n",
       "        <td>willida01</td>\n",
       "        <td>1939-10-22</td>\n",
       "        <td>1855-10-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida02</td>\n",
       "        <td>1881</td>\n",
       "        <td>2</td>\n",
       "        <td>7</td>\n",
       "        <td>USA</td>\n",
       "        <td>PA</td>\n",
       "        <td>Scranton</td>\n",
       "        <td>1918</td>\n",
       "        <td>4</td>\n",
       "        <td>25</td>\n",
       "        <td>USA</td>\n",
       "        <td>AR</td>\n",
       "        <td>Hot Springs</td>\n",
       "        <td>Dave</td>\n",
       "        <td>Williams</td>\n",
       "        <td>David Owen</td>\n",
       "        <td>167</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>L</td>\n",
       "        <td>1902-07-02</td>\n",
       "        <td>1902-08-03</td>\n",
       "        <td>willd103</td>\n",
       "        <td>willida02</td>\n",
       "        <td>1918-04-25</td>\n",
       "        <td>1881-02-07</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida03</td>\n",
       "        <td>1927</td>\n",
       "        <td>11</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Dallas</td>\n",
       "        <td>2009</td>\n",
       "        <td>8</td>\n",
       "        <td>17</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Farmers Branch</td>\n",
       "        <td>Davey</td>\n",
       "        <td>Williams</td>\n",
       "        <td>David Carlous</td>\n",
       "        <td>160</td>\n",
       "        <td>70</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1949-09-16</td>\n",
       "        <td>1955-07-31</td>\n",
       "        <td>willd102</td>\n",
       "        <td>willida03</td>\n",
       "        <td>2009-08-17</td>\n",
       "        <td>1927-11-02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida05</td>\n",
       "        <td>1958</td>\n",
       "        <td>2</td>\n",
       "        <td>28</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>Brooklyn</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Dallas</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Dallas McKinley</td>\n",
       "        <td>165</td>\n",
       "        <td>71</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1981-09-19</td>\n",
       "        <td>1983-10-02</td>\n",
       "        <td>willd101</td>\n",
       "        <td>willida05</td>\n",
       "        <td>None</td>\n",
       "        <td>1958-02-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida06</td>\n",
       "        <td>1963</td>\n",
       "        <td>3</td>\n",
       "        <td>20</td>\n",
       "        <td>USA</td>\n",
       "        <td>WV</td>\n",
       "        <td>Weirton</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Dana</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Dana Lamont</td>\n",
       "        <td>170</td>\n",
       "        <td>70</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1989-06-19</td>\n",
       "        <td>1989-07-02</td>\n",
       "        <td>willd001</td>\n",
       "        <td>willida06</td>\n",
       "        <td>None</td>\n",
       "        <td>1963-03-20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willida07</td>\n",
       "        <td>1979</td>\n",
       "        <td>3</td>\n",
       "        <td>12</td>\n",
       "        <td>USA</td>\n",
       "        <td>AK</td>\n",
       "        <td>Anchorage</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>David</td>\n",
       "        <td>Williams</td>\n",
       "        <td>David Aaron</td>\n",
       "        <td>215</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>2001-06-06</td>\n",
       "        <td>2007-09-24</td>\n",
       "        <td>willd002</td>\n",
       "        <td>willida07</td>\n",
       "        <td>None</td>\n",
       "        <td>1979-03-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willide01</td>\n",
       "        <td>1896</td>\n",
       "        <td>12</td>\n",
       "        <td>13</td>\n",
       "        <td>USA</td>\n",
       "        <td>OR</td>\n",
       "        <td>Portland</td>\n",
       "        <td>1929</td>\n",
       "        <td>3</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>San Clemente</td>\n",
       "        <td>Denny</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Evon Daniel</td>\n",
       "        <td>150</td>\n",
       "        <td>68</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1921-04-15</td>\n",
       "        <td>1928-07-18</td>\n",
       "        <td>willd105</td>\n",
       "        <td>willide01</td>\n",
       "        <td>1929-03-23</td>\n",
       "        <td>1896-12-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willide02</td>\n",
       "        <td>1916</td>\n",
       "        <td>2</td>\n",
       "        <td>5</td>\n",
       "        <td>USA</td>\n",
       "        <td>NC</td>\n",
       "        <td>Durham</td>\n",
       "        <td>2000</td>\n",
       "        <td>3</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>ND</td>\n",
       "        <td>Williston</td>\n",
       "        <td>Dewey</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Dewey Edgar</td>\n",
       "        <td>160</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1944-06-28</td>\n",
       "        <td>1948-09-26</td>\n",
       "        <td>willd109</td>\n",
       "        <td>willide02</td>\n",
       "        <td>2000-03-19</td>\n",
       "        <td>1916-02-05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willidi01</td>\n",
       "        <td>1910</td>\n",
       "        <td>1</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>AR</td>\n",
       "        <td>Greenbrier</td>\n",
       "        <td>1992</td>\n",
       "        <td>4</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>AR</td>\n",
       "        <td>Searcy</td>\n",
       "        <td>Dib</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Edwin Dibrell</td>\n",
       "        <td>175</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1930-04-27</td>\n",
       "        <td>1935-09-29</td>\n",
       "        <td>willd107</td>\n",
       "        <td>willidi01</td>\n",
       "        <td>1992-04-02</td>\n",
       "        <td>1910-01-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willidi02</td>\n",
       "        <td>1929</td>\n",
       "        <td>5</td>\n",
       "        <td>7</td>\n",
       "        <td>USA</td>\n",
       "        <td>MO</td>\n",
       "        <td>St. Louis</td>\n",
       "        <td>2011</td>\n",
       "        <td>7</td>\n",
       "        <td>7</td>\n",
       "        <td>USA</td>\n",
       "        <td>NV</td>\n",
       "        <td>Las Vegas</td>\n",
       "        <td>Dick</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Richard Hirschfeld</td>\n",
       "        <td>190</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1951-06-10</td>\n",
       "        <td>1964-10-01</td>\n",
       "        <td>willd104</td>\n",
       "        <td>willidi02</td>\n",
       "        <td>2011-07-07</td>\n",
       "        <td>1929-05-07</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willido01</td>\n",
       "        <td>1931</td>\n",
       "        <td>9</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Floyd</td>\n",
       "        <td>2011</td>\n",
       "        <td>10</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Floyd</td>\n",
       "        <td>Don</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Don Fred</td>\n",
       "        <td>180</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1958-09-12</td>\n",
       "        <td>1962-08-23</td>\n",
       "        <td>willd108</td>\n",
       "        <td>willido01</td>\n",
       "        <td>2011-10-16</td>\n",
       "        <td>1931-09-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willido02</td>\n",
       "        <td>1935</td>\n",
       "        <td>9</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Los Angeles</td>\n",
       "        <td>1991</td>\n",
       "        <td>12</td>\n",
       "        <td>20</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>La Jolla</td>\n",
       "        <td>Don</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Donald Reid</td>\n",
       "        <td>218</td>\n",
       "        <td>77</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1963-08-04</td>\n",
       "        <td>1963-08-17</td>\n",
       "        <td>willd110</td>\n",
       "        <td>willido02</td>\n",
       "        <td>1991-12-20</td>\n",
       "        <td>1935-09-02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williea01</td>\n",
       "        <td>1903</td>\n",
       "        <td>1</td>\n",
       "        <td>27</td>\n",
       "        <td>USA</td>\n",
       "        <td>TN</td>\n",
       "        <td>Cumberland Gap</td>\n",
       "        <td>1958</td>\n",
       "        <td>3</td>\n",
       "        <td>10</td>\n",
       "        <td>USA</td>\n",
       "        <td>TN</td>\n",
       "        <td>Knoxville</td>\n",
       "        <td>Earl</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Earl Baxter</td>\n",
       "        <td>185</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1928-05-27</td>\n",
       "        <td>1928-06-02</td>\n",
       "        <td>wille102</td>\n",
       "        <td>williea01</td>\n",
       "        <td>1958-03-10</td>\n",
       "        <td>1903-01-27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williea02</td>\n",
       "        <td>1948</td>\n",
       "        <td>7</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>NJ</td>\n",
       "        <td>Newark</td>\n",
       "        <td>2013</td>\n",
       "        <td>1</td>\n",
       "        <td>28</td>\n",
       "        <td>USA</td>\n",
       "        <td>NJ</td>\n",
       "        <td>Somerset</td>\n",
       "        <td>Earl</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Earl Craig</td>\n",
       "        <td>215</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1970-09-13</td>\n",
       "        <td>1977-09-25</td>\n",
       "        <td>wille101</td>\n",
       "        <td>williea02</td>\n",
       "        <td>2013-01-28</td>\n",
       "        <td>1948-07-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willied01</td>\n",
       "        <td>1964</td>\n",
       "        <td>11</td>\n",
       "        <td>1</td>\n",
       "        <td>USA</td>\n",
       "        <td>LA</td>\n",
       "        <td>Shreveport</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Eddie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Edward Laquan</td>\n",
       "        <td>175</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1986-04-18</td>\n",
       "        <td>1998-05-27</td>\n",
       "        <td>wille001</td>\n",
       "        <td>willied01</td>\n",
       "        <td>None</td>\n",
       "        <td>1964-11-01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willifr01</td>\n",
       "        <td>1958</td>\n",
       "        <td>2</td>\n",
       "        <td>13</td>\n",
       "        <td>USA</td>\n",
       "        <td>WA</td>\n",
       "        <td>Seattle</td>\n",
       "        <td>2009</td>\n",
       "        <td>1</td>\n",
       "        <td>9</td>\n",
       "        <td>CAN</td>\n",
       "        <td>BC</td>\n",
       "        <td>Victoria</td>\n",
       "        <td>Frank</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Frank Lee</td>\n",
       "        <td>180</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1984-04-05</td>\n",
       "        <td>1989-09-27</td>\n",
       "        <td>willf001</td>\n",
       "        <td>willifr01</td>\n",
       "        <td>2009-01-09</td>\n",
       "        <td>1958-02-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willige01</td>\n",
       "        <td>1939</td>\n",
       "        <td>10</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>MI</td>\n",
       "        <td>Detroit</td>\n",
       "        <td>2009</td>\n",
       "        <td>5</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>MI</td>\n",
       "        <td>Detroit</td>\n",
       "        <td>George</td>\n",
       "        <td>Williams</td>\n",
       "        <td>George</td>\n",
       "        <td>165</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1961-07-16</td>\n",
       "        <td>1964-07-05</td>\n",
       "        <td>willg101</td>\n",
       "        <td>willige01</td>\n",
       "        <td>2009-05-14</td>\n",
       "        <td>1939-10-23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willige02</td>\n",
       "        <td>1966</td>\n",
       "        <td>8</td>\n",
       "        <td>10</td>\n",
       "        <td>USA</td>\n",
       "        <td>LA</td>\n",
       "        <td>New Orleans</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Gerald</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Gerald Floyd</td>\n",
       "        <td>190</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1992-09-15</td>\n",
       "        <td>2005-10-02</td>\n",
       "        <td>willg001</td>\n",
       "        <td>willige02</td>\n",
       "        <td>None</td>\n",
       "        <td>1966-08-10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willige03</td>\n",
       "        <td>1969</td>\n",
       "        <td>4</td>\n",
       "        <td>22</td>\n",
       "        <td>USA</td>\n",
       "        <td>WI</td>\n",
       "        <td>La Crosse</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>George</td>\n",
       "        <td>Williams</td>\n",
       "        <td>George Erik</td>\n",
       "        <td>190</td>\n",
       "        <td>70</td>\n",
       "        <td>B</td>\n",
       "        <td>R</td>\n",
       "        <td>1995-07-14</td>\n",
       "        <td>2000-09-13</td>\n",
       "        <td>willg002</td>\n",
       "        <td>willige03</td>\n",
       "        <td>None</td>\n",
       "        <td>1969-04-22</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willigl01</td>\n",
       "        <td>1977</td>\n",
       "        <td>7</td>\n",
       "        <td>18</td>\n",
       "        <td>Australia</td>\n",
       "        <td>New South Wales</td>\n",
       "        <td>Gosford</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Glenn</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Glenn David</td>\n",
       "        <td>195</td>\n",
       "        <td>74</td>\n",
       "        <td>B</td>\n",
       "        <td>R</td>\n",
       "        <td>2005-06-07</td>\n",
       "        <td>2005-06-28</td>\n",
       "        <td>willg003</td>\n",
       "        <td>willigl01</td>\n",
       "        <td>None</td>\n",
       "        <td>1977-07-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willigu01</td>\n",
       "        <td>1870</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>New York</td>\n",
       "        <td>1890</td>\n",
       "        <td>10</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>New York</td>\n",
       "        <td>Gus</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Augustine H.</td>\n",
       "        <td>170</td>\n",
       "        <td>71</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>1890-04-18</td>\n",
       "        <td>1890-04-22</td>\n",
       "        <td>willg102</td>\n",
       "        <td>willigu01</td>\n",
       "        <td>1890-10-14</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willigu02</td>\n",
       "        <td>1888</td>\n",
       "        <td>5</td>\n",
       "        <td>7</td>\n",
       "        <td>USA</td>\n",
       "        <td>NE</td>\n",
       "        <td>Omaha</td>\n",
       "        <td>1964</td>\n",
       "        <td>4</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>IL</td>\n",
       "        <td>Sterling</td>\n",
       "        <td>Gus</td>\n",
       "        <td>Williams</td>\n",
       "        <td>August Joseph</td>\n",
       "        <td>185</td>\n",
       "        <td>72</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1911-04-12</td>\n",
       "        <td>1915-06-18</td>\n",
       "        <td>willg103</td>\n",
       "        <td>willigu02</td>\n",
       "        <td>1964-04-16</td>\n",
       "        <td>1888-05-07</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williha01</td>\n",
       "        <td>1890</td>\n",
       "        <td>6</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>NE</td>\n",
       "        <td>Omaha</td>\n",
       "        <td>1963</td>\n",
       "        <td>12</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Huntington Park</td>\n",
       "        <td>Harry</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Harry Peter</td>\n",
       "        <td>200</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1913-08-07</td>\n",
       "        <td>1914-06-30</td>\n",
       "        <td>willh103</td>\n",
       "        <td>williha01</td>\n",
       "        <td>1963-12-21</td>\n",
       "        <td>1890-06-23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willija01</td>\n",
       "        <td>1986</td>\n",
       "        <td>5</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>OK</td>\n",
       "        <td>Tulsa</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Jackson</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Jackson Thomas</td>\n",
       "        <td>200</td>\n",
       "        <td>70</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>2014-08-27</td>\n",
       "        <td>2015-10-04</td>\n",
       "        <td>willj005</td>\n",
       "        <td>willija01</td>\n",
       "        <td>None</td>\n",
       "        <td>1986-05-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willije01</td>\n",
       "        <td>1972</td>\n",
       "        <td>6</td>\n",
       "        <td>6</td>\n",
       "        <td>Australia</td>\n",
       "        <td>Capital Territory</td>\n",
       "        <td>Canberra</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Jeff</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Jeffrey F.</td>\n",
       "        <td>185</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>L</td>\n",
       "        <td>1999-09-12</td>\n",
       "        <td>2002-09-28</td>\n",
       "        <td>willj002</td>\n",
       "        <td>willije02</td>\n",
       "        <td>None</td>\n",
       "        <td>1972-06-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willije02</td>\n",
       "        <td>1981</td>\n",
       "        <td>12</td>\n",
       "        <td>4</td>\n",
       "        <td>USA</td>\n",
       "        <td>HI</td>\n",
       "        <td>Honolulu</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Jerome</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Jerome Lee</td>\n",
       "        <td>260</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>2003-04-26</td>\n",
       "        <td>2016-09-26</td>\n",
       "        <td>willj003</td>\n",
       "        <td>willije01</td>\n",
       "        <td>None</td>\n",
       "        <td>1981-12-04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williji01</td>\n",
       "        <td>1876</td>\n",
       "        <td>12</td>\n",
       "        <td>20</td>\n",
       "        <td>USA</td>\n",
       "        <td>MO</td>\n",
       "        <td>St. Louis</td>\n",
       "        <td>1965</td>\n",
       "        <td>1</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>FL</td>\n",
       "        <td>St. Petersburg</td>\n",
       "        <td>Jimmy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>James Thomas</td>\n",
       "        <td>175</td>\n",
       "        <td>69</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1899-04-15</td>\n",
       "        <td>1909-10-03</td>\n",
       "        <td>willj106</td>\n",
       "        <td>williji01</td>\n",
       "        <td>1965-01-16</td>\n",
       "        <td>1876-12-20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williji03</td>\n",
       "        <td>1943</td>\n",
       "        <td>10</td>\n",
       "        <td>4</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Santa Maria</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Jimy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>James Francis</td>\n",
       "        <td>170</td>\n",
       "        <td>70</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1966-04-26</td>\n",
       "        <td>1967-09-21</td>\n",
       "        <td>willj107</td>\n",
       "        <td>williji03</td>\n",
       "        <td>None</td>\n",
       "        <td>1943-10-04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williji04</td>\n",
       "        <td>1947</td>\n",
       "        <td>4</td>\n",
       "        <td>29</td>\n",
       "        <td>USA</td>\n",
       "        <td>LA</td>\n",
       "        <td>Zachary</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Jim</td>\n",
       "        <td>Williams</td>\n",
       "        <td>James Alfred</td>\n",
       "        <td>190</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1969-09-08</td>\n",
       "        <td>1970-09-30</td>\n",
       "        <td>willj108</td>\n",
       "        <td>williji04</td>\n",
       "        <td>None</td>\n",
       "        <td>1947-04-29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williji99</td>\n",
       "        <td>1847</td>\n",
       "        <td>1</td>\n",
       "        <td>4</td>\n",
       "        <td>USA</td>\n",
       "        <td>OH</td>\n",
       "        <td>Catawba</td>\n",
       "        <td>1918</td>\n",
       "        <td>10</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>Westbury</td>\n",
       "        <td>Jimmy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>James Andrew</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>willj801</td>\n",
       "        <td>williji99</td>\n",
       "        <td>1918-10-23</td>\n",
       "        <td>1847-01-04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willijo02</td>\n",
       "        <td>1889</td>\n",
       "        <td>7</td>\n",
       "        <td>16</td>\n",
       "        <td>USA</td>\n",
       "        <td>HI</td>\n",
       "        <td>Honolulu</td>\n",
       "        <td>1963</td>\n",
       "        <td>9</td>\n",
       "        <td>8</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Long Beach</td>\n",
       "        <td>Johnnie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>John Brodie</td>\n",
       "        <td>180</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1914-04-21</td>\n",
       "        <td>1914-08-19</td>\n",
       "        <td>willj101</td>\n",
       "        <td>willijo02</td>\n",
       "        <td>1963-09-08</td>\n",
       "        <td>1889-07-16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willijo99</td>\n",
       "        <td>1885</td>\n",
       "        <td>4</td>\n",
       "        <td>6</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Seguin</td>\n",
       "        <td>1951</td>\n",
       "        <td>2</td>\n",
       "        <td>25</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>New York</td>\n",
       "        <td>Smokey Joe</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Joseph</td>\n",
       "        <td>190</td>\n",
       "        <td>76</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>willijo99</td>\n",
       "        <td>1951-02-25</td>\n",
       "        <td>1885-04-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willike01</td>\n",
       "        <td>1890</td>\n",
       "        <td>6</td>\n",
       "        <td>28</td>\n",
       "        <td>USA</td>\n",
       "        <td>OR</td>\n",
       "        <td>Grants Pass</td>\n",
       "        <td>1959</td>\n",
       "        <td>1</td>\n",
       "        <td>22</td>\n",
       "        <td>USA</td>\n",
       "        <td>OR</td>\n",
       "        <td>Grants Pass</td>\n",
       "        <td>Ken</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Kenneth Roy</td>\n",
       "        <td>170</td>\n",
       "        <td>72</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1915-07-14</td>\n",
       "        <td>1929-08-10</td>\n",
       "        <td>willk101</td>\n",
       "        <td>willike01</td>\n",
       "        <td>1959-01-22</td>\n",
       "        <td>1890-06-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willike02</td>\n",
       "        <td>1964</td>\n",
       "        <td>4</td>\n",
       "        <td>6</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Berkeley</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Ken</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Kenneth Royal</td>\n",
       "        <td>187</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1986-09-02</td>\n",
       "        <td>1991-10-04</td>\n",
       "        <td>willk001</td>\n",
       "        <td>willike02</td>\n",
       "        <td>None</td>\n",
       "        <td>1964-04-06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willike03</td>\n",
       "        <td>1972</td>\n",
       "        <td>4</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>PA</td>\n",
       "        <td>Bedford</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Keith</td>\n",
       "        <td>Williams</td>\n",
       "        <td>David Keith</td>\n",
       "        <td>190</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1996-06-07</td>\n",
       "        <td>1996-06-23</td>\n",
       "        <td>willk002</td>\n",
       "        <td>willike03</td>\n",
       "        <td>None</td>\n",
       "        <td>1972-04-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willile01</td>\n",
       "        <td>1893</td>\n",
       "        <td>3</td>\n",
       "        <td>9</td>\n",
       "        <td>USA</td>\n",
       "        <td>MO</td>\n",
       "        <td>Aurora</td>\n",
       "        <td>1959</td>\n",
       "        <td>11</td>\n",
       "        <td>4</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Laguna Beach</td>\n",
       "        <td>Lefty</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Claude Preston</td>\n",
       "        <td>160</td>\n",
       "        <td>69</td>\n",
       "        <td>R</td>\n",
       "        <td>L</td>\n",
       "        <td>1913-09-17</td>\n",
       "        <td>1920-09-25</td>\n",
       "        <td>willl104</td>\n",
       "        <td>willile01</td>\n",
       "        <td>1959-11-04</td>\n",
       "        <td>1893-03-09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willile03</td>\n",
       "        <td>1905</td>\n",
       "        <td>12</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>GA</td>\n",
       "        <td>Macon</td>\n",
       "        <td>1984</td>\n",
       "        <td>11</td>\n",
       "        <td>20</td>\n",
       "        <td>USA</td>\n",
       "        <td>GA</td>\n",
       "        <td>Atlanta</td>\n",
       "        <td>Leon</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Leon Theo</td>\n",
       "        <td>154</td>\n",
       "        <td>70</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1926-05-26</td>\n",
       "        <td>1926-09-06</td>\n",
       "        <td>willl101</td>\n",
       "        <td>willile03</td>\n",
       "        <td>1984-11-20</td>\n",
       "        <td>1905-12-02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima01</td>\n",
       "        <td>1893</td>\n",
       "        <td>2</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>NC</td>\n",
       "        <td>Faison</td>\n",
       "        <td>1935</td>\n",
       "        <td>2</td>\n",
       "        <td>22</td>\n",
       "        <td>USA</td>\n",
       "        <td>AZ</td>\n",
       "        <td>Tucson</td>\n",
       "        <td>Marsh</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Marshall McDiarmid</td>\n",
       "        <td>180</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1916-07-07</td>\n",
       "        <td>1916-08-25</td>\n",
       "        <td>willm104</td>\n",
       "        <td>willima01</td>\n",
       "        <td>1935-02-22</td>\n",
       "        <td>1893-02-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima02</td>\n",
       "        <td>1953</td>\n",
       "        <td>7</td>\n",
       "        <td>28</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>Elmira</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Mark</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Mark Westley</td>\n",
       "        <td>180</td>\n",
       "        <td>72</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1977-05-20</td>\n",
       "        <td>1977-05-22</td>\n",
       "        <td>willm105</td>\n",
       "        <td>willima02</td>\n",
       "        <td>None</td>\n",
       "        <td>1953-07-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima03</td>\n",
       "        <td>1959</td>\n",
       "        <td>7</td>\n",
       "        <td>25</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Houston</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Matt</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Matthew Evan</td>\n",
       "        <td>200</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1983-08-02</td>\n",
       "        <td>1985-10-05</td>\n",
       "        <td>willm001</td>\n",
       "        <td>willima03</td>\n",
       "        <td>None</td>\n",
       "        <td>1959-07-25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima04</td>\n",
       "        <td>1965</td>\n",
       "        <td>11</td>\n",
       "        <td>28</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Bishop</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Matt</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Matthew Derrick</td>\n",
       "        <td>205</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1987-04-11</td>\n",
       "        <td>2003-05-31</td>\n",
       "        <td>willm003</td>\n",
       "        <td>willima04</td>\n",
       "        <td>None</td>\n",
       "        <td>1965-11-28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima06</td>\n",
       "        <td>1971</td>\n",
       "        <td>4</td>\n",
       "        <td>12</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Virginia Beach</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Matt</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Matt Taylor</td>\n",
       "        <td>185</td>\n",
       "        <td>72</td>\n",
       "        <td>B</td>\n",
       "        <td>L</td>\n",
       "        <td>2000-04-05</td>\n",
       "        <td>2000-04-29</td>\n",
       "        <td>willm006</td>\n",
       "        <td>willima09</td>\n",
       "        <td>None</td>\n",
       "        <td>1971-04-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willima07</td>\n",
       "        <td>1991</td>\n",
       "        <td>8</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>RI</td>\n",
       "        <td>Pawtucket</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Mason</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Mason</td>\n",
       "        <td>195</td>\n",
       "        <td>73</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>2015-06-12</td>\n",
       "        <td>2017-06-25</td>\n",
       "        <td>willm007</td>\n",
       "        <td>willima10</td>\n",
       "        <td>None</td>\n",
       "        <td>1991-08-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willimi02</td>\n",
       "        <td>1964</td>\n",
       "        <td>11</td>\n",
       "        <td>17</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Santa Ana</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Mitch</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Mitchell Steven</td>\n",
       "        <td>180</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>1986-04-09</td>\n",
       "        <td>1997-05-10</td>\n",
       "        <td>willm002</td>\n",
       "        <td>willimi02</td>\n",
       "        <td>None</td>\n",
       "        <td>1964-11-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willimi03</td>\n",
       "        <td>1968</td>\n",
       "        <td>7</td>\n",
       "        <td>29</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Radford</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Mike</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Michael Darren</td>\n",
       "        <td>190</td>\n",
       "        <td>74</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1992-06-30</td>\n",
       "        <td>2003-09-28</td>\n",
       "        <td>willm005</td>\n",
       "        <td>willimi03</td>\n",
       "        <td>None</td>\n",
       "        <td>1968-07-29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willimu01</td>\n",
       "        <td>1892</td>\n",
       "        <td>7</td>\n",
       "        <td>31</td>\n",
       "        <td>USA</td>\n",
       "        <td>AR</td>\n",
       "        <td>Ozark</td>\n",
       "        <td>1962</td>\n",
       "        <td>3</td>\n",
       "        <td>30</td>\n",
       "        <td>USA</td>\n",
       "        <td>AR</td>\n",
       "        <td>Fayetteville</td>\n",
       "        <td>Mutt</td>\n",
       "        <td>Williams</td>\n",
       "        <td>David Carter</td>\n",
       "        <td>195</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1913-10-04</td>\n",
       "        <td>1914-10-01</td>\n",
       "        <td>willm103</td>\n",
       "        <td>willimu01</td>\n",
       "        <td>1962-03-30</td>\n",
       "        <td>1892-07-31</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willini01</td>\n",
       "        <td>1993</td>\n",
       "        <td>9</td>\n",
       "        <td>8</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Galveston</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Nick</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Billy Nicholas</td>\n",
       "        <td>195</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>2017-06-30</td>\n",
       "        <td>2017-10-01</td>\n",
       "        <td>willn001</td>\n",
       "        <td>willini01</td>\n",
       "        <td>None</td>\n",
       "        <td>1993-09-08</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williot01</td>\n",
       "        <td>1877</td>\n",
       "        <td>11</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>NJ</td>\n",
       "        <td>Newark</td>\n",
       "        <td>1937</td>\n",
       "        <td>3</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>NE</td>\n",
       "        <td>Omaha</td>\n",
       "        <td>Otto</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Otto George</td>\n",
       "        <td>165</td>\n",
       "        <td>68</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1902-10-05</td>\n",
       "        <td>1906-06-09</td>\n",
       "        <td>willo101</td>\n",
       "        <td>williot01</td>\n",
       "        <td>1937-03-19</td>\n",
       "        <td>1877-11-02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willipa01</td>\n",
       "        <td>1913</td>\n",
       "        <td>7</td>\n",
       "        <td>17</td>\n",
       "        <td>USA</td>\n",
       "        <td>MS</td>\n",
       "        <td>Meridian</td>\n",
       "        <td>1993</td>\n",
       "        <td>11</td>\n",
       "        <td>2</td>\n",
       "        <td>USA</td>\n",
       "        <td>MS</td>\n",
       "        <td>Meridian</td>\n",
       "        <td>Papa</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Fred</td>\n",
       "        <td>200</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1945-04-19</td>\n",
       "        <td>1945-07-08</td>\n",
       "        <td>willp102</td>\n",
       "        <td>willipa01</td>\n",
       "        <td>1993-11-02</td>\n",
       "        <td>1913-07-17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willipo01</td>\n",
       "        <td>1874</td>\n",
       "        <td>5</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>ME</td>\n",
       "        <td>Bowdoinham</td>\n",
       "        <td>1959</td>\n",
       "        <td>8</td>\n",
       "        <td>4</td>\n",
       "        <td>USA</td>\n",
       "        <td>ME</td>\n",
       "        <td>Topsham</td>\n",
       "        <td>Pop</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Walter Merrill</td>\n",
       "        <td>190</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>L</td>\n",
       "        <td>1898-09-14</td>\n",
       "        <td>1903-09-15</td>\n",
       "        <td>willp101</td>\n",
       "        <td>willipo01</td>\n",
       "        <td>1959-08-04</td>\n",
       "        <td>1874-05-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willira01</td>\n",
       "        <td>1975</td>\n",
       "        <td>9</td>\n",
       "        <td>18</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Harlingen</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Randy</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Randall Duane</td>\n",
       "        <td>200</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>L</td>\n",
       "        <td>2004-09-11</td>\n",
       "        <td>2011-08-05</td>\n",
       "        <td>willr003</td>\n",
       "        <td>willira01</td>\n",
       "        <td>None</td>\n",
       "        <td>1975-09-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willire01</td>\n",
       "        <td>1960</td>\n",
       "        <td>8</td>\n",
       "        <td>29</td>\n",
       "        <td>USA</td>\n",
       "        <td>TN</td>\n",
       "        <td>Memphis</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Reggie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Reginald Dewayne</td>\n",
       "        <td>185</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1985-09-02</td>\n",
       "        <td>1988-10-02</td>\n",
       "        <td>willr001</td>\n",
       "        <td>willire01</td>\n",
       "        <td>None</td>\n",
       "        <td>1960-08-29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willire02</td>\n",
       "        <td>1966</td>\n",
       "        <td>5</td>\n",
       "        <td>5</td>\n",
       "        <td>USA</td>\n",
       "        <td>SC</td>\n",
       "        <td>Laurens</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Reggie</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Reginald Bernard</td>\n",
       "        <td>180</td>\n",
       "        <td>73</td>\n",
       "        <td>B</td>\n",
       "        <td>R</td>\n",
       "        <td>1992-09-08</td>\n",
       "        <td>1999-07-25</td>\n",
       "        <td>willr002</td>\n",
       "        <td>willire02</td>\n",
       "        <td>None</td>\n",
       "        <td>1966-05-05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williri01</td>\n",
       "        <td>1882</td>\n",
       "        <td>1</td>\n",
       "        <td>31</td>\n",
       "        <td>USA</td>\n",
       "        <td>IL</td>\n",
       "        <td>Carthage</td>\n",
       "        <td>1933</td>\n",
       "        <td>7</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>IA</td>\n",
       "        <td>Keokuk</td>\n",
       "        <td>Rip</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Alva Mitchell</td>\n",
       "        <td>187</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1911-04-12</td>\n",
       "        <td>1918-06-09</td>\n",
       "        <td>willr104</td>\n",
       "        <td>williri01</td>\n",
       "        <td>1933-07-23</td>\n",
       "        <td>1882-01-31</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williri02</td>\n",
       "        <td>1893</td>\n",
       "        <td>12</td>\n",
       "        <td>18</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Santa Cruz</td>\n",
       "        <td>1966</td>\n",
       "        <td>4</td>\n",
       "        <td>24</td>\n",
       "        <td>USA</td>\n",
       "        <td>AZ</td>\n",
       "        <td>Cottonwood</td>\n",
       "        <td>Rinaldo</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Rinaldo Louis</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1914-10-08</td>\n",
       "        <td>1914-10-10</td>\n",
       "        <td>willr103</td>\n",
       "        <td>williri02</td>\n",
       "        <td>1966-04-24</td>\n",
       "        <td>1893-12-18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williri03</td>\n",
       "        <td>1952</td>\n",
       "        <td>11</td>\n",
       "        <td>9</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Merced</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Rick</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Richard Allen</td>\n",
       "        <td>180</td>\n",
       "        <td>73</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1978-06-12</td>\n",
       "        <td>1979-09-26</td>\n",
       "        <td>willr101</td>\n",
       "        <td>williri03</td>\n",
       "        <td>None</td>\n",
       "        <td>1952-11-09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willish01</td>\n",
       "        <td>1971</td>\n",
       "        <td>3</td>\n",
       "        <td>10</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>Fresno</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Shad</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Shad Clayton</td>\n",
       "        <td>185</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1996-05-18</td>\n",
       "        <td>1997-07-22</td>\n",
       "        <td>wills001</td>\n",
       "        <td>willish01</td>\n",
       "        <td>None</td>\n",
       "        <td>1971-03-10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willist01</td>\n",
       "        <td>1892</td>\n",
       "        <td>1</td>\n",
       "        <td>31</td>\n",
       "        <td>USA</td>\n",
       "        <td>MT</td>\n",
       "        <td>Cascade</td>\n",
       "        <td>1979</td>\n",
       "        <td>6</td>\n",
       "        <td>29</td>\n",
       "        <td>USA</td>\n",
       "        <td>MN</td>\n",
       "        <td>Deer River</td>\n",
       "        <td>Steamboat</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Rees Gephardt</td>\n",
       "        <td>170</td>\n",
       "        <td>71</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1914-07-12</td>\n",
       "        <td>1916-10-01</td>\n",
       "        <td>wills101</td>\n",
       "        <td>willist01</td>\n",
       "        <td>1979-06-29</td>\n",
       "        <td>1892-01-31</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willist02</td>\n",
       "        <td>1936</td>\n",
       "        <td>9</td>\n",
       "        <td>14</td>\n",
       "        <td>USA</td>\n",
       "        <td>NH</td>\n",
       "        <td>Enfield</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Stan</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Stanley Wilson</td>\n",
       "        <td>230</td>\n",
       "        <td>77</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1958-05-17</td>\n",
       "        <td>1972-08-01</td>\n",
       "        <td>wills102</td>\n",
       "        <td>willist02</td>\n",
       "        <td>None</td>\n",
       "        <td>1936-09-14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willita01</td>\n",
       "        <td>1991</td>\n",
       "        <td>7</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>WA</td>\n",
       "        <td>Vancouver</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Taylor</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Taylor Grant</td>\n",
       "        <td>195</td>\n",
       "        <td>71</td>\n",
       "        <td>B</td>\n",
       "        <td>R</td>\n",
       "        <td>2017-09-06</td>\n",
       "        <td>2017-10-01</td>\n",
       "        <td>willt003</td>\n",
       "        <td>willita01</td>\n",
       "        <td>None</td>\n",
       "        <td>1991-07-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willite01</td>\n",
       "        <td>1918</td>\n",
       "        <td>8</td>\n",
       "        <td>30</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>San Diego</td>\n",
       "        <td>2002</td>\n",
       "        <td>7</td>\n",
       "        <td>5</td>\n",
       "        <td>USA</td>\n",
       "        <td>FL</td>\n",
       "        <td>Inverness</td>\n",
       "        <td>Ted</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Theodore Samuel</td>\n",
       "        <td>205</td>\n",
       "        <td>75</td>\n",
       "        <td>L</td>\n",
       "        <td>R</td>\n",
       "        <td>1939-04-20</td>\n",
       "        <td>1960-09-28</td>\n",
       "        <td>willt103</td>\n",
       "        <td>willite01</td>\n",
       "        <td>2002-07-05</td>\n",
       "        <td>1918-08-30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willito01</td>\n",
       "        <td>1870</td>\n",
       "        <td>8</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>OH</td>\n",
       "        <td>Minersville</td>\n",
       "        <td>1940</td>\n",
       "        <td>7</td>\n",
       "        <td>27</td>\n",
       "        <td>USA</td>\n",
       "        <td>OH</td>\n",
       "        <td>Columbus</td>\n",
       "        <td>Tom</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Thomas C.</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>1892-05-01</td>\n",
       "        <td>1893-09-14</td>\n",
       "        <td>willt101</td>\n",
       "        <td>willito01</td>\n",
       "        <td>1940-07-27</td>\n",
       "        <td>1870-08-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willito02</td>\n",
       "        <td>1971</td>\n",
       "        <td>2</td>\n",
       "        <td>13</td>\n",
       "        <td>USA</td>\n",
       "        <td>NY</td>\n",
       "        <td>Syracuse</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Todd</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Todd Michael</td>\n",
       "        <td>185</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1995-04-29</td>\n",
       "        <td>2007-06-15</td>\n",
       "        <td>willt001</td>\n",
       "        <td>willito02</td>\n",
       "        <td>None</td>\n",
       "        <td>1971-02-13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>willitr01</td>\n",
       "        <td>1992</td>\n",
       "        <td>4</td>\n",
       "        <td>25</td>\n",
       "        <td>USA</td>\n",
       "        <td>CA</td>\n",
       "        <td>San Diego</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Trevor</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Trevor Anthony</td>\n",
       "        <td>230</td>\n",
       "        <td>75</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>2016-09-07</td>\n",
       "        <td>2017-09-26</td>\n",
       "        <td>willt002</td>\n",
       "        <td>willitr01</td>\n",
       "        <td>None</td>\n",
       "        <td>1992-04-25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williwa01</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>PA</td>\n",
       "        <td>Philadelphia</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Wash</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Washington J.</td>\n",
       "        <td>180</td>\n",
       "        <td>71</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>1884-08-05</td>\n",
       "        <td>1885-06-08</td>\n",
       "        <td>willw102</td>\n",
       "        <td>williwa01</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williwa02</td>\n",
       "        <td>1943</td>\n",
       "        <td>12</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Brownwood</td>\n",
       "        <td>2016</td>\n",
       "        <td>1</td>\n",
       "        <td>23</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Abilene</td>\n",
       "        <td>Walt</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Walter Allen</td>\n",
       "        <td>165</td>\n",
       "        <td>66</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1964-04-21</td>\n",
       "        <td>1975-09-22</td>\n",
       "        <td>willw103</td>\n",
       "        <td>williwa02</td>\n",
       "        <td>2016-01-23</td>\n",
       "        <td>1943-12-19</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williwo01</td>\n",
       "        <td>1912</td>\n",
       "        <td>8</td>\n",
       "        <td>21</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Pamplin</td>\n",
       "        <td>1995</td>\n",
       "        <td>2</td>\n",
       "        <td>24</td>\n",
       "        <td>USA</td>\n",
       "        <td>VA</td>\n",
       "        <td>Appomattox</td>\n",
       "        <td>Woody</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Woodrow Wilson</td>\n",
       "        <td>175</td>\n",
       "        <td>71</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1938-09-05</td>\n",
       "        <td>1945-09-30</td>\n",
       "        <td>willw101</td>\n",
       "        <td>williwo01</td>\n",
       "        <td>1995-02-24</td>\n",
       "        <td>1912-08-21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>williwo02</td>\n",
       "        <td>1966</td>\n",
       "        <td>8</td>\n",
       "        <td>19</td>\n",
       "        <td>USA</td>\n",
       "        <td>TX</td>\n",
       "        <td>Houston</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "        <td>Woody</td>\n",
       "        <td>Williams</td>\n",
       "        <td>Gregory Scott</td>\n",
       "        <td>180</td>\n",
       "        <td>72</td>\n",
       "        <td>R</td>\n",
       "        <td>R</td>\n",
       "        <td>1993-05-14</td>\n",
       "        <td>2007-09-22</td>\n",
       "        <td>willw001</td>\n",
       "        <td>williwo02</td>\n",
       "        <td>None</td>\n",
       "        <td>1966-08-19</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('williac01', 1917, 3, 18, 'USA', 'NJ', 'Montclair', 1999, 9, 16, 'USA', 'FL', 'Fort Myers', 'Ace', 'Williams', 'Robert Fulton', '174', '74', 'R', 'L', '1940-07-15', '1946-04-22', 'willa103', 'williac01', datetime.date(1999, 9, 16), datetime.date(1917, 3, 18)),\n",
       " ('willial02', 1914, 5, 11, 'USA', 'AL', 'Valhermosa Springs', 1969, 7, 19, 'USA', 'TX', 'Groves', 'Al', 'Williams', 'Almon Edward', '200', '75', 'R', 'R', '1937-04-19', '1938-09-04', 'willa101', 'willial02', datetime.date(1969, 7, 19), datetime.date(1914, 5, 11)),\n",
       " ('willial03', 1954, 5, 6, 'Nicaragua', 'Atlantico Sur', 'Pearl Lagoon', None, None, None, '', '', '', 'Albert', 'Williams', 'Albert Hamilton', '190', '76', 'R', 'R', '1980-05-07', '1984-09-26', 'willa001', 'willial03', None, datetime.date(1954, 5, 6)),\n",
       " ('williar01', 1877, 8, 24, 'USA', 'MA', 'Somerville', 1941, 5, 16, 'USA', 'VA', 'Arlington', 'Art', 'Williams', 'Arthur Frank', '', '', 'L', 'R', '1902-05-07', '1902-09-01', 'willa104', 'williar01', datetime.date(1941, 5, 16), datetime.date(1877, 8, 24)),\n",
       " ('willibe01', 1948, 10, 8, 'USA', 'CA', 'Alameda', None, None, None, '', '', '', 'Bernie', 'Williams', 'Bernard', '175', '73', 'R', 'R', '1970-09-07', '1974-05-12', 'willb105', 'willibe01', None, datetime.date(1948, 10, 8)),\n",
       " ('willibe02', 1968, 9, 13, 'P.R.', '', 'San Juan', None, None, None, '', '', '', 'Bernie', 'Williams', 'Bernabe', '180', '74', 'B', 'R', '1991-07-07', '2006-10-01', 'willb002', 'willibe02', None, datetime.date(1968, 9, 13)),\n",
       " ('willibi01', 1938, 6, 15, 'USA', 'AL', 'Whistler', None, None, None, '', '', '', 'Billy', 'Williams', 'Billy Leo', '175', '73', 'L', 'R', '1959-08-06', '1976-10-02', 'willb104', 'willibi01', None, datetime.date(1938, 6, 15)),\n",
       " ('willibi02', 1932, 6, 13, 'USA', 'SC', 'Newberry', 2013, 6, 11, 'USA', 'CA', 'Berkeley', 'Billy', 'Williams', 'William', '195', '75', 'L', 'R', '1969-08-15', '1969-08-20', 'willb102', 'willibi02', datetime.date(2013, 6, 11), datetime.date(1932, 6, 13)),\n",
       " ('willibo01', 1884, 4, 27, 'USA', 'OH', 'Monday', 1962, 8, 6, 'USA', 'OH', 'Nelsonville', 'Bob', 'Williams', 'Robert Elias', '190', '72', 'R', 'R', '1911-07-03', '1913-09-30', 'willb103', 'willibo01', datetime.date(1962, 8, 6), datetime.date(1884, 4, 27)),\n",
       " ('willibr01', 1969, 2, 15, 'USA', 'SC', 'Lancaster', None, None, None, '', '', '', 'Brian', 'Williams', \"Brian O'Neal\", '205', '75', 'R', 'R', '1991-09-16', '2000-07-05', 'willb001', 'willibr01', None, datetime.date(1969, 2, 15)),\n",
       " ('willich01', 1947, 10, 11, 'USA', 'NY', 'Flushing', 2015, 1, 27, 'USA', 'FL', 'Port Orange', 'Charlie', 'Williams', 'Charles Prosek', '200', '74', 'R', 'R', '1971-04-23', '1978-09-11', 'willc101', 'willich01', datetime.date(2015, 1, 27), datetime.date(1947, 10, 11)),\n",
       " ('willicy01', 1887, 12, 21, 'USA', 'IN', 'Wadena', 1974, 4, 23, 'USA', 'WI', 'Eagle River', 'Cy', 'Williams', 'Fred', '180', '74', 'L', 'L', '1912-07-18', '1930-09-22', 'willc103', 'willicy01', datetime.date(1974, 4, 23), datetime.date(1887, 12, 21)),\n",
       " ('willida01', 1855, 10, 6, 'USA', 'KY', 'Ludlow', 1939, 10, 22, 'USA', 'KY', 'Covington', 'Dale', 'Williams', 'Elisha Alphonso', '175', '69', 'R', 'R', '1876-08-12', '1876-09-09', 'willd106', 'willida01', datetime.date(1939, 10, 22), datetime.date(1855, 10, 6)),\n",
       " ('willida02', 1881, 2, 7, 'USA', 'PA', 'Scranton', 1918, 4, 25, 'USA', 'AR', 'Hot Springs', 'Dave', 'Williams', 'David Owen', '167', '71', 'R', 'L', '1902-07-02', '1902-08-03', 'willd103', 'willida02', datetime.date(1918, 4, 25), datetime.date(1881, 2, 7)),\n",
       " ('willida03', 1927, 11, 2, 'USA', 'TX', 'Dallas', 2009, 8, 17, 'USA', 'TX', 'Farmers Branch', 'Davey', 'Williams', 'David Carlous', '160', '70', 'R', 'R', '1949-09-16', '1955-07-31', 'willd102', 'willida03', datetime.date(2009, 8, 17), datetime.date(1927, 11, 2)),\n",
       " ('willida05', 1958, 2, 28, 'USA', 'NY', 'Brooklyn', None, None, None, '', '', '', 'Dallas', 'Williams', 'Dallas McKinley', '165', '71', 'L', 'L', '1981-09-19', '1983-10-02', 'willd101', 'willida05', None, datetime.date(1958, 2, 28)),\n",
       " ('willida06', 1963, 3, 20, 'USA', 'WV', 'Weirton', None, None, None, '', '', '', 'Dana', 'Williams', 'Dana Lamont', '170', '70', 'R', 'R', '1989-06-19', '1989-07-02', 'willd001', 'willida06', None, datetime.date(1963, 3, 20)),\n",
       " ('willida07', 1979, 3, 12, 'USA', 'AK', 'Anchorage', None, None, None, '', '', '', 'David', 'Williams', 'David Aaron', '215', '75', 'L', 'L', '2001-06-06', '2007-09-24', 'willd002', 'willida07', None, datetime.date(1979, 3, 12)),\n",
       " ('willide01', 1896, 12, 13, 'USA', 'OR', 'Portland', 1929, 3, 23, 'USA', 'CA', 'San Clemente', 'Denny', 'Williams', 'Evon Daniel', '150', '68', 'L', 'R', '1921-04-15', '1928-07-18', 'willd105', 'willide01', datetime.date(1929, 3, 23), datetime.date(1896, 12, 13)),\n",
       " ('willide02', 1916, 2, 5, 'USA', 'NC', 'Durham', 2000, 3, 19, 'USA', 'ND', 'Williston', 'Dewey', 'Williams', 'Dewey Edgar', '160', '72', 'R', 'R', '1944-06-28', '1948-09-26', 'willd109', 'willide02', datetime.date(2000, 3, 19), datetime.date(1916, 2, 5)),\n",
       " ('willidi01', 1910, 1, 19, 'USA', 'AR', 'Greenbrier', 1992, 4, 2, 'USA', 'AR', 'Searcy', 'Dib', 'Williams', 'Edwin Dibrell', '175', '71', 'R', 'R', '1930-04-27', '1935-09-29', 'willd107', 'willidi01', datetime.date(1992, 4, 2), datetime.date(1910, 1, 19)),\n",
       " ('willidi02', 1929, 5, 7, 'USA', 'MO', 'St. Louis', 2011, 7, 7, 'USA', 'NV', 'Las Vegas', 'Dick', 'Williams', 'Richard Hirschfeld', '190', '72', 'R', 'R', '1951-06-10', '1964-10-01', 'willd104', 'willidi02', datetime.date(2011, 7, 7), datetime.date(1929, 5, 7)),\n",
       " ('willido01', 1931, 9, 14, 'USA', 'VA', 'Floyd', 2011, 10, 16, 'USA', 'VA', 'Floyd', 'Don', 'Williams', 'Don Fred', '180', '74', 'R', 'R', '1958-09-12', '1962-08-23', 'willd108', 'willido01', datetime.date(2011, 10, 16), datetime.date(1931, 9, 14)),\n",
       " ('willido02', 1935, 9, 2, 'USA', 'CA', 'Los Angeles', 1991, 12, 20, 'USA', 'CA', 'La Jolla', 'Don', 'Williams', 'Donald Reid', '218', '77', 'R', 'R', '1963-08-04', '1963-08-17', 'willd110', 'willido02', datetime.date(1991, 12, 20), datetime.date(1935, 9, 2)),\n",
       " ('williea01', 1903, 1, 27, 'USA', 'TN', 'Cumberland Gap', 1958, 3, 10, 'USA', 'TN', 'Knoxville', 'Earl', 'Williams', 'Earl Baxter', '185', '72', 'R', 'R', '1928-05-27', '1928-06-02', 'wille102', 'williea01', datetime.date(1958, 3, 10), datetime.date(1903, 1, 27)),\n",
       " ('williea02', 1948, 7, 14, 'USA', 'NJ', 'Newark', 2013, 1, 28, 'USA', 'NJ', 'Somerset', 'Earl', 'Williams', 'Earl Craig', '215', '75', 'R', 'R', '1970-09-13', '1977-09-25', 'wille101', 'williea02', datetime.date(2013, 1, 28), datetime.date(1948, 7, 14)),\n",
       " ('willied01', 1964, 11, 1, 'USA', 'LA', 'Shreveport', None, None, None, '', '', '', 'Eddie', 'Williams', 'Edward Laquan', '175', '72', 'R', 'R', '1986-04-18', '1998-05-27', 'wille001', 'willied01', None, datetime.date(1964, 11, 1)),\n",
       " ('willifr01', 1958, 2, 13, 'USA', 'WA', 'Seattle', 2009, 1, 9, 'CAN', 'BC', 'Victoria', 'Frank', 'Williams', 'Frank Lee', '180', '73', 'R', 'R', '1984-04-05', '1989-09-27', 'willf001', 'willifr01', datetime.date(2009, 1, 9), datetime.date(1958, 2, 13)),\n",
       " ('willige01', 1939, 10, 23, 'USA', 'MI', 'Detroit', 2009, 5, 14, 'USA', 'MI', 'Detroit', 'George', 'Williams', 'George', '165', '71', 'R', 'R', '1961-07-16', '1964-07-05', 'willg101', 'willige01', datetime.date(2009, 5, 14), datetime.date(1939, 10, 23)),\n",
       " ('willige02', 1966, 8, 10, 'USA', 'LA', 'New Orleans', None, None, None, '', '', '', 'Gerald', 'Williams', 'Gerald Floyd', '190', '74', 'R', 'R', '1992-09-15', '2005-10-02', 'willg001', 'willige02', None, datetime.date(1966, 8, 10)),\n",
       " ('willige03', 1969, 4, 22, 'USA', 'WI', 'La Crosse', None, None, None, '', '', '', 'George', 'Williams', 'George Erik', '190', '70', 'B', 'R', '1995-07-14', '2000-09-13', 'willg002', 'willige03', None, datetime.date(1969, 4, 22)),\n",
       " ('willigl01', 1977, 7, 18, 'Australia', 'New South Wales', 'Gosford', None, None, None, '', '', '', 'Glenn', 'Williams', 'Glenn David', '195', '74', 'B', 'R', '2005-06-07', '2005-06-28', 'willg003', 'willigl01', None, datetime.date(1977, 7, 18)),\n",
       " ('willigu01', 1870, None, None, 'USA', 'NY', 'New York', 1890, 10, 14, 'USA', 'NY', 'New York', 'Gus', 'Williams', 'Augustine H.', '170', '71', '', '', '1890-04-18', '1890-04-22', 'willg102', 'willigu01', datetime.date(1890, 10, 14), None),\n",
       " ('willigu02', 1888, 5, 7, 'USA', 'NE', 'Omaha', 1964, 4, 16, 'USA', 'IL', 'Sterling', 'Gus', 'Williams', 'August Joseph', '185', '72', 'L', 'L', '1911-04-12', '1915-06-18', 'willg103', 'willigu02', datetime.date(1964, 4, 16), datetime.date(1888, 5, 7)),\n",
       " ('williha01', 1890, 6, 23, 'USA', 'NE', 'Omaha', 1963, 12, 21, 'USA', 'CA', 'Huntington Park', 'Harry', 'Williams', 'Harry Peter', '200', '73', 'R', 'R', '1913-08-07', '1914-06-30', 'willh103', 'williha01', datetime.date(1963, 12, 21), datetime.date(1890, 6, 23)),\n",
       " ('willija01', 1986, 5, 14, 'USA', 'OK', 'Tulsa', None, None, None, '', '', '', 'Jackson', 'Williams', 'Jackson Thomas', '200', '70', 'R', 'R', '2014-08-27', '2015-10-04', 'willj005', 'willija01', None, datetime.date(1986, 5, 14)),\n",
       " ('willije01', 1972, 6, 6, 'Australia', 'Capital Territory', 'Canberra', None, None, None, '', '', '', 'Jeff', 'Williams', 'Jeffrey F.', '185', '72', 'R', 'L', '1999-09-12', '2002-09-28', 'willj002', 'willije02', None, datetime.date(1972, 6, 6)),\n",
       " ('willije02', 1981, 12, 4, 'USA', 'HI', 'Honolulu', None, None, None, '', '', '', 'Jerome', 'Williams', 'Jerome Lee', '260', '75', 'R', 'R', '2003-04-26', '2016-09-26', 'willj003', 'willije01', None, datetime.date(1981, 12, 4)),\n",
       " ('williji01', 1876, 12, 20, 'USA', 'MO', 'St. Louis', 1965, 1, 16, 'USA', 'FL', 'St. Petersburg', 'Jimmy', 'Williams', 'James Thomas', '175', '69', 'R', 'R', '1899-04-15', '1909-10-03', 'willj106', 'williji01', datetime.date(1965, 1, 16), datetime.date(1876, 12, 20)),\n",
       " ('williji03', 1943, 10, 4, 'USA', 'CA', 'Santa Maria', None, None, None, '', '', '', 'Jimy', 'Williams', 'James Francis', '170', '70', 'R', 'R', '1966-04-26', '1967-09-21', 'willj107', 'williji03', None, datetime.date(1943, 10, 4)),\n",
       " ('williji04', 1947, 4, 29, 'USA', 'LA', 'Zachary', None, None, None, '', '', '', 'Jim', 'Williams', 'James Alfred', '190', '74', 'R', 'R', '1969-09-08', '1970-09-30', 'willj108', 'williji04', None, datetime.date(1947, 4, 29)),\n",
       " ('williji99', 1847, 1, 4, 'USA', 'OH', 'Catawba', 1918, 10, 23, 'USA', 'NY', 'Westbury', 'Jimmy', 'Williams', 'James Andrew', '', '', '', '', '', '', 'willj801', 'williji99', datetime.date(1918, 10, 23), datetime.date(1847, 1, 4)),\n",
       " ('willijo02', 1889, 7, 16, 'USA', 'HI', 'Honolulu', 1963, 9, 8, 'USA', 'CA', 'Long Beach', 'Johnnie', 'Williams', 'John Brodie', '180', '72', 'R', 'R', '1914-04-21', '1914-08-19', 'willj101', 'willijo02', datetime.date(1963, 9, 8), datetime.date(1889, 7, 16)),\n",
       " ('willijo99', 1885, 4, 6, 'USA', 'TX', 'Seguin', 1951, 2, 25, 'USA', 'NY', 'New York', 'Smokey Joe', 'Williams', 'Joseph', '190', '76', 'R', 'R', '', '', '', 'willijo99', datetime.date(1951, 2, 25), datetime.date(1885, 4, 6)),\n",
       " ('willike01', 1890, 6, 28, 'USA', 'OR', 'Grants Pass', 1959, 1, 22, 'USA', 'OR', 'Grants Pass', 'Ken', 'Williams', 'Kenneth Roy', '170', '72', 'L', 'R', '1915-07-14', '1929-08-10', 'willk101', 'willike01', datetime.date(1959, 1, 22), datetime.date(1890, 6, 28)),\n",
       " ('willike02', 1964, 4, 6, 'USA', 'CA', 'Berkeley', None, None, None, '', '', '', 'Ken', 'Williams', 'Kenneth Royal', '187', '74', 'R', 'R', '1986-09-02', '1991-10-04', 'willk001', 'willike02', None, datetime.date(1964, 4, 6)),\n",
       " ('willike03', 1972, 4, 21, 'USA', 'PA', 'Bedford', None, None, None, '', '', '', 'Keith', 'Williams', 'David Keith', '190', '72', 'R', 'R', '1996-06-07', '1996-06-23', 'willk002', 'willike03', None, datetime.date(1972, 4, 21)),\n",
       " ('willile01', 1893, 3, 9, 'USA', 'MO', 'Aurora', 1959, 11, 4, 'USA', 'CA', 'Laguna Beach', 'Lefty', 'Williams', 'Claude Preston', '160', '69', 'R', 'L', '1913-09-17', '1920-09-25', 'willl104', 'willile01', datetime.date(1959, 11, 4), datetime.date(1893, 3, 9)),\n",
       " ('willile03', 1905, 12, 2, 'USA', 'GA', 'Macon', 1984, 11, 20, 'USA', 'GA', 'Atlanta', 'Leon', 'Williams', 'Leon Theo', '154', '70', 'L', 'L', '1926-05-26', '1926-09-06', 'willl101', 'willile03', datetime.date(1984, 11, 20), datetime.date(1905, 12, 2)),\n",
       " ('willima01', 1893, 2, 21, 'USA', 'NC', 'Faison', 1935, 2, 22, 'USA', 'AZ', 'Tucson', 'Marsh', 'Williams', 'Marshall McDiarmid', '180', '72', 'R', 'R', '1916-07-07', '1916-08-25', 'willm104', 'willima01', datetime.date(1935, 2, 22), datetime.date(1893, 2, 21)),\n",
       " ('willima02', 1953, 7, 28, 'USA', 'NY', 'Elmira', None, None, None, '', '', '', 'Mark', 'Williams', 'Mark Westley', '180', '72', 'L', 'L', '1977-05-20', '1977-05-22', 'willm105', 'willima02', None, datetime.date(1953, 7, 28)),\n",
       " ('willima03', 1959, 7, 25, 'USA', 'TX', 'Houston', None, None, None, '', '', '', 'Matt', 'Williams', 'Matthew Evan', '200', '73', 'R', 'R', '1983-08-02', '1985-10-05', 'willm001', 'willima03', None, datetime.date(1959, 7, 25)),\n",
       " ('willima04', 1965, 11, 28, 'USA', 'CA', 'Bishop', None, None, None, '', '', '', 'Matt', 'Williams', 'Matthew Derrick', '205', '74', 'R', 'R', '1987-04-11', '2003-05-31', 'willm003', 'willima04', None, datetime.date(1965, 11, 28)),\n",
       " ('willima06', 1971, 4, 12, 'USA', 'VA', 'Virginia Beach', None, None, None, '', '', '', 'Matt', 'Williams', 'Matt Taylor', '185', '72', 'B', 'L', '2000-04-05', '2000-04-29', 'willm006', 'willima09', None, datetime.date(1971, 4, 12)),\n",
       " ('willima07', 1991, 8, 21, 'USA', 'RI', 'Pawtucket', None, None, None, '', '', '', 'Mason', 'Williams', 'Mason', '195', '73', 'L', 'R', '2015-06-12', '2017-06-25', 'willm007', 'willima10', None, datetime.date(1991, 8, 21)),\n",
       " ('willimi02', 1964, 11, 17, 'USA', 'CA', 'Santa Ana', None, None, None, '', '', '', 'Mitch', 'Williams', 'Mitchell Steven', '180', '75', 'L', 'L', '1986-04-09', '1997-05-10', 'willm002', 'willimi02', None, datetime.date(1964, 11, 17)),\n",
       " ('willimi03', 1968, 7, 29, 'USA', 'VA', 'Radford', None, None, None, '', '', '', 'Mike', 'Williams', 'Michael Darren', '190', '74', 'R', 'R', '1992-06-30', '2003-09-28', 'willm005', 'willimi03', None, datetime.date(1968, 7, 29)),\n",
       " ('willimu01', 1892, 7, 31, 'USA', 'AR', 'Ozark', 1962, 3, 30, 'USA', 'AR', 'Fayetteville', 'Mutt', 'Williams', 'David Carter', '195', '75', 'R', 'R', '1913-10-04', '1914-10-01', 'willm103', 'willimu01', datetime.date(1962, 3, 30), datetime.date(1892, 7, 31)),\n",
       " ('willini01', 1993, 9, 8, 'USA', 'TX', 'Galveston', None, None, None, '', '', '', 'Nick', 'Williams', 'Billy Nicholas', '195', '75', 'L', 'L', '2017-06-30', '2017-10-01', 'willn001', 'willini01', None, datetime.date(1993, 9, 8)),\n",
       " ('williot01', 1877, 11, 2, 'USA', 'NJ', 'Newark', 1937, 3, 19, 'USA', 'NE', 'Omaha', 'Otto', 'Williams', 'Otto George', '165', '68', 'R', 'R', '1902-10-05', '1906-06-09', 'willo101', 'williot01', datetime.date(1937, 3, 19), datetime.date(1877, 11, 2)),\n",
       " ('willipa01', 1913, 7, 17, 'USA', 'MS', 'Meridian', 1993, 11, 2, 'USA', 'MS', 'Meridian', 'Papa', 'Williams', 'Fred', '200', '73', 'R', 'R', '1945-04-19', '1945-07-08', 'willp102', 'willipa01', datetime.date(1993, 11, 2), datetime.date(1913, 7, 17)),\n",
       " ('willipo01', 1874, 5, 19, 'USA', 'ME', 'Bowdoinham', 1959, 8, 4, 'USA', 'ME', 'Topsham', 'Pop', 'Williams', 'Walter Merrill', '190', '71', 'R', 'L', '1898-09-14', '1903-09-15', 'willp101', 'willipo01', datetime.date(1959, 8, 4), datetime.date(1874, 5, 19)),\n",
       " ('willira01', 1975, 9, 18, 'USA', 'TX', 'Harlingen', None, None, None, '', '', '', 'Randy', 'Williams', 'Randall Duane', '200', '75', 'L', 'L', '2004-09-11', '2011-08-05', 'willr003', 'willira01', None, datetime.date(1975, 9, 18)),\n",
       " ('willire01', 1960, 8, 29, 'USA', 'TN', 'Memphis', None, None, None, '', '', '', 'Reggie', 'Williams', 'Reginald Dewayne', '185', '71', 'R', 'R', '1985-09-02', '1988-10-02', 'willr001', 'willire01', None, datetime.date(1960, 8, 29)),\n",
       " ('willire02', 1966, 5, 5, 'USA', 'SC', 'Laurens', None, None, None, '', '', '', 'Reggie', 'Williams', 'Reginald Bernard', '180', '73', 'B', 'R', '1992-09-08', '1999-07-25', 'willr002', 'willire02', None, datetime.date(1966, 5, 5)),\n",
       " ('williri01', 1882, 1, 31, 'USA', 'IL', 'Carthage', 1933, 7, 23, 'USA', 'IA', 'Keokuk', 'Rip', 'Williams', 'Alva Mitchell', '187', '71', 'R', 'R', '1911-04-12', '1918-06-09', 'willr104', 'williri01', datetime.date(1933, 7, 23), datetime.date(1882, 1, 31)),\n",
       " ('williri02', 1893, 12, 18, 'USA', 'CA', 'Santa Cruz', 1966, 4, 24, 'USA', 'AZ', 'Cottonwood', 'Rinaldo', 'Williams', 'Rinaldo Louis', '', '', 'L', 'R', '1914-10-08', '1914-10-10', 'willr103', 'williri02', datetime.date(1966, 4, 24), datetime.date(1893, 12, 18)),\n",
       " ('williri03', 1952, 11, 9, 'USA', 'CA', 'Merced', None, None, None, '', '', '', 'Rick', 'Williams', 'Richard Allen', '180', '73', 'R', 'R', '1978-06-12', '1979-09-26', 'willr101', 'williri03', None, datetime.date(1952, 11, 9)),\n",
       " ('willish01', 1971, 3, 10, 'USA', 'CA', 'Fresno', None, None, None, '', '', '', 'Shad', 'Williams', 'Shad Clayton', '185', '72', 'R', 'R', '1996-05-18', '1997-07-22', 'wills001', 'willish01', None, datetime.date(1971, 3, 10)),\n",
       " ('willist01', 1892, 1, 31, 'USA', 'MT', 'Cascade', 1979, 6, 29, 'USA', 'MN', 'Deer River', 'Steamboat', 'Williams', 'Rees Gephardt', '170', '71', 'L', 'R', '1914-07-12', '1916-10-01', 'wills101', 'willist01', datetime.date(1979, 6, 29), datetime.date(1892, 1, 31)),\n",
       " ('willist02', 1936, 9, 14, 'USA', 'NH', 'Enfield', None, None, None, '', '', '', 'Stan', 'Williams', 'Stanley Wilson', '230', '77', 'R', 'R', '1958-05-17', '1972-08-01', 'wills102', 'willist02', None, datetime.date(1936, 9, 14)),\n",
       " ('willita01', 1991, 7, 21, 'USA', 'WA', 'Vancouver', None, None, None, '', '', '', 'Taylor', 'Williams', 'Taylor Grant', '195', '71', 'B', 'R', '2017-09-06', '2017-10-01', 'willt003', 'willita01', None, datetime.date(1991, 7, 21)),\n",
       " ('willite01', 1918, 8, 30, 'USA', 'CA', 'San Diego', 2002, 7, 5, 'USA', 'FL', 'Inverness', 'Ted', 'Williams', 'Theodore Samuel', '205', '75', 'L', 'R', '1939-04-20', '1960-09-28', 'willt103', 'willite01', datetime.date(2002, 7, 5), datetime.date(1918, 8, 30)),\n",
       " ('willito01', 1870, 8, 19, 'USA', 'OH', 'Minersville', 1940, 7, 27, 'USA', 'OH', 'Columbus', 'Tom', 'Williams', 'Thomas C.', '', '', '', '', '1892-05-01', '1893-09-14', 'willt101', 'willito01', datetime.date(1940, 7, 27), datetime.date(1870, 8, 19)),\n",
       " ('willito02', 1971, 2, 13, 'USA', 'NY', 'Syracuse', None, None, None, '', '', '', 'Todd', 'Williams', 'Todd Michael', '185', '75', 'R', 'R', '1995-04-29', '2007-06-15', 'willt001', 'willito02', None, datetime.date(1971, 2, 13)),\n",
       " ('willitr01', 1992, 4, 25, 'USA', 'CA', 'San Diego', None, None, None, '', '', '', 'Trevor', 'Williams', 'Trevor Anthony', '230', '75', 'R', 'R', '2016-09-07', '2017-09-26', 'willt002', 'willitr01', None, datetime.date(1992, 4, 25)),\n",
       " ('williwa01', None, None, None, 'USA', 'PA', 'Philadelphia', None, None, None, '', '', '', 'Wash', 'Williams', 'Washington J.', '180', '71', '', '', '1884-08-05', '1885-06-08', 'willw102', 'williwa01', None, None),\n",
       " ('williwa02', 1943, 12, 19, 'USA', 'TX', 'Brownwood', 2016, 1, 23, 'USA', 'TX', 'Abilene', 'Walt', 'Williams', 'Walter Allen', '165', '66', 'R', 'R', '1964-04-21', '1975-09-22', 'willw103', 'williwa02', datetime.date(2016, 1, 23), datetime.date(1943, 12, 19)),\n",
       " ('williwo01', 1912, 8, 21, 'USA', 'VA', 'Pamplin', 1995, 2, 24, 'USA', 'VA', 'Appomattox', 'Woody', 'Williams', 'Woodrow Wilson', '175', '71', 'R', 'R', '1938-09-05', '1945-09-30', 'willw101', 'williwo01', datetime.date(1995, 2, 24), datetime.date(1912, 8, 21)),\n",
       " ('williwo02', 1966, 8, 19, 'USA', 'TX', 'Houston', None, None, None, '', '', '', 'Woody', 'Williams', 'Gregory Scott', '180', '72', 'R', 'R', '1993-05-14', '2007-09-22', 'willw001', 'williwo02', None, datetime.date(1966, 8, 19))]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from People where nameLast='Williams';"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- I am using a special plug-in [ipython-sql](https://pypi.org/project/ipython-sql/) for running SQL directly from a code cell in the Jupyter notebook.\n",
    "\n",
    "\n",
    "- I can use the SQL command from many database clients."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| <img src=\"../../images/sql_query_1.jpeg\"> |\n",
    "| :---: |\n",
    "| __Query MySQL Workbench__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| <img src=\"../../images/sql_select_terminal_1.jpeg\"> |\n",
    "| :---: |\n",
    "| __Query MySQL Terminal Client__ |"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- From Python code\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pymysql.cursors\n",
    "import pandas as pd\n",
    "import json\n",
    "\n",
    "# The database server is running somewhere in the network.\n",
    "# I must specify the IP address (HW server) and port number\n",
    "# (connection that SW server is listening on)\n",
    "# Also, I do not want to allow anyone to access the database\n",
    "# and different people have different permissions. So, the\n",
    "# client must log on.\n",
    "\n",
    "\n",
    "# Connect to the database over the network. Use the connection\n",
    "# to send commands to the DB.\n",
    "default_cnx = pymysql.connect(host='localhost',\n",
    "                             user='dbuser',\n",
    "                             password='dbuser',\n",
    "                             db='lahman2017',\n",
    "                             charset='utf8mb4',\n",
    "                             cursorclass=pymysql.cursors.DictCursor)\n",
    "\n",
    "\n",
    "def run_q(q, args=None, fields= None, fetch=True, cnx=None):\n",
    "    \"\"\"\n",
    "\n",
    "    :param q: An SQL query string that may have %s slots for argument insertion.\n",
    "    :param args: A tuple of values to insert in the %s slots.\n",
    "    :param fetch: If true, return the result.\n",
    "    :param cnx: A database connection. May be None\n",
    "    :return: A result set or None.\n",
    "    \"\"\"\n",
    "\n",
    "    try:\n",
    "        if cnx is None:\n",
    "            cnx = default_cnx\n",
    "\n",
    "        if fields:\n",
    "            q = q.format(\",\".join(fields))\n",
    "\n",
    "        cursor=cnx.cursor()             # Just ignore this for now.\n",
    "\n",
    "        print(\"Query = \", cursor.mogrify(q, args))\n",
    "        cursor.execute(q, args)         # Execute the query.\n",
    "\n",
    "        if fetch:\n",
    "            r = cursor.fetchall()       # Return all elements of the result.\n",
    "        else:\n",
    "            r = None\n",
    "    except Exception as e:\n",
    "        print(\"Exception e = \", e)\n",
    "        \n",
    "    cnx.commit()\n",
    "\n",
    "    return r"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Query =  select * from people where nameLast='Williams';\n",
      "Result = \n",
      "[{'playerID': 'williac01', 'birthYear': 1917, 'birthMonth': 3, 'birthDay': 18, 'birthCountry': 'USA', 'birthState': 'NJ', 'birthCity': 'Montclair', 'deathYear': 1999, 'deathMonth': 9, 'deathDay': 16, 'deathCountry': 'USA', 'deathState': 'FL', 'deathCity': 'Fort Myers', 'nameFirst': 'Ace', 'nameLast': 'Williams', 'nameGiven': 'Robert Fulton', 'weight': '174', 'height': '74', 'bats': 'R', 'throws': 'L', 'debut': '1940-07-15', 'finalGame': '1946-04-22', 'retroID': 'willa103', 'bbrefID': 'williac01', 'DOD': datetime.date(1999, 9, 16), 'DOB': datetime.date(1917, 3, 18)}, {'playerID': 'willial02', 'birthYear': 1914, 'birthMonth': 5, 'birthDay': 11, 'birthCountry': 'USA', 'birthState': 'AL', 'birthCity': 'Valhermosa Springs', 'deathYear': 1969, 'deathMonth': 7, 'deathDay': 19, 'deathCountry': 'USA', 'deathState': 'TX', 'deathCity': 'Groves', 'nameFirst': 'Al', 'nameLast': 'Williams', 'nameGiven': 'Almon Edward', 'weight': '200', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '1937-04-19', 'finalGame': '1938-09-04', 'retroID': 'willa101', 'bbrefID': 'willial02', 'DOD': datetime.date(1969, 7, 19), 'DOB': datetime.date(1914, 5, 11)}, {'playerID': 'willial03', 'birthYear': 1954, 'birthMonth': 5, 'birthDay': 6, 'birthCountry': 'Nicaragua', 'birthState': 'Atlantico Sur', 'birthCity': 'Pearl Lagoon', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Albert', 'nameLast': 'Williams', 'nameGiven': 'Albert Hamilton', 'weight': '190', 'height': '76', 'bats': 'R', 'throws': 'R', 'debut': '1980-05-07', 'finalGame': '1984-09-26', 'retroID': 'willa001', 'bbrefID': 'willial03', 'DOD': None, 'DOB': datetime.date(1954, 5, 6)}, {'playerID': 'williar01', 'birthYear': 1877, 'birthMonth': 8, 'birthDay': 24, 'birthCountry': 'USA', 'birthState': 'MA', 'birthCity': 'Somerville', 'deathYear': 1941, 'deathMonth': 5, 'deathDay': 16, 'deathCountry': 'USA', 'deathState': 'VA', 'deathCity': 'Arlington', 'nameFirst': 'Art', 'nameLast': 'Williams', 'nameGiven': 'Arthur Frank', 'weight': '', 'height': '', 'bats': 'L', 'throws': 'R', 'debut': '1902-05-07', 'finalGame': '1902-09-01', 'retroID': 'willa104', 'bbrefID': 'williar01', 'DOD': datetime.date(1941, 5, 16), 'DOB': datetime.date(1877, 8, 24)}, {'playerID': 'willibe01', 'birthYear': 1948, 'birthMonth': 10, 'birthDay': 8, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Alameda', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Bernie', 'nameLast': 'Williams', 'nameGiven': 'Bernard', 'weight': '175', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1970-09-07', 'finalGame': '1974-05-12', 'retroID': 'willb105', 'bbrefID': 'willibe01', 'DOD': None, 'DOB': datetime.date(1948, 10, 8)}, {'playerID': 'willibe02', 'birthYear': 1968, 'birthMonth': 9, 'birthDay': 13, 'birthCountry': 'P.R.', 'birthState': '', 'birthCity': 'San Juan', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Bernie', 'nameLast': 'Williams', 'nameGiven': 'Bernabe', 'weight': '180', 'height': '74', 'bats': 'B', 'throws': 'R', 'debut': '1991-07-07', 'finalGame': '2006-10-01', 'retroID': 'willb002', 'bbrefID': 'willibe02', 'DOD': None, 'DOB': datetime.date(1968, 9, 13)}, {'playerID': 'willibi01', 'birthYear': 1938, 'birthMonth': 6, 'birthDay': 15, 'birthCountry': 'USA', 'birthState': 'AL', 'birthCity': 'Whistler', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Billy', 'nameLast': 'Williams', 'nameGiven': 'Billy Leo', 'weight': '175', 'height': '73', 'bats': 'L', 'throws': 'R', 'debut': '1959-08-06', 'finalGame': '1976-10-02', 'retroID': 'willb104', 'bbrefID': 'willibi01', 'DOD': None, 'DOB': datetime.date(1938, 6, 15)}, {'playerID': 'willibi02', 'birthYear': 1932, 'birthMonth': 6, 'birthDay': 13, 'birthCountry': 'USA', 'birthState': 'SC', 'birthCity': 'Newberry', 'deathYear': 2013, 'deathMonth': 6, 'deathDay': 11, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'Berkeley', 'nameFirst': 'Billy', 'nameLast': 'Williams', 'nameGiven': 'William', 'weight': '195', 'height': '75', 'bats': 'L', 'throws': 'R', 'debut': '1969-08-15', 'finalGame': '1969-08-20', 'retroID': 'willb102', 'bbrefID': 'willibi02', 'DOD': datetime.date(2013, 6, 11), 'DOB': datetime.date(1932, 6, 13)}, {'playerID': 'willibo01', 'birthYear': 1884, 'birthMonth': 4, 'birthDay': 27, 'birthCountry': 'USA', 'birthState': 'OH', 'birthCity': 'Monday', 'deathYear': 1962, 'deathMonth': 8, 'deathDay': 6, 'deathCountry': 'USA', 'deathState': 'OH', 'deathCity': 'Nelsonville', 'nameFirst': 'Bob', 'nameLast': 'Williams', 'nameGiven': 'Robert Elias', 'weight': '190', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1911-07-03', 'finalGame': '1913-09-30', 'retroID': 'willb103', 'bbrefID': 'willibo01', 'DOD': datetime.date(1962, 8, 6), 'DOB': datetime.date(1884, 4, 27)}, {'playerID': 'willibr01', 'birthYear': 1969, 'birthMonth': 2, 'birthDay': 15, 'birthCountry': 'USA', 'birthState': 'SC', 'birthCity': 'Lancaster', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Brian', 'nameLast': 'Williams', 'nameGiven': \"Brian O'Neal\", 'weight': '205', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '1991-09-16', 'finalGame': '2000-07-05', 'retroID': 'willb001', 'bbrefID': 'willibr01', 'DOD': None, 'DOB': datetime.date(1969, 2, 15)}, {'playerID': 'willich01', 'birthYear': 1947, 'birthMonth': 10, 'birthDay': 11, 'birthCountry': 'USA', 'birthState': 'NY', 'birthCity': 'Flushing', 'deathYear': 2015, 'deathMonth': 1, 'deathDay': 27, 'deathCountry': 'USA', 'deathState': 'FL', 'deathCity': 'Port Orange', 'nameFirst': 'Charlie', 'nameLast': 'Williams', 'nameGiven': 'Charles Prosek', 'weight': '200', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1971-04-23', 'finalGame': '1978-09-11', 'retroID': 'willc101', 'bbrefID': 'willich01', 'DOD': datetime.date(2015, 1, 27), 'DOB': datetime.date(1947, 10, 11)}, {'playerID': 'willicy01', 'birthYear': 1887, 'birthMonth': 12, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'IN', 'birthCity': 'Wadena', 'deathYear': 1974, 'deathMonth': 4, 'deathDay': 23, 'deathCountry': 'USA', 'deathState': 'WI', 'deathCity': 'Eagle River', 'nameFirst': 'Cy', 'nameLast': 'Williams', 'nameGiven': 'Fred', 'weight': '180', 'height': '74', 'bats': 'L', 'throws': 'L', 'debut': '1912-07-18', 'finalGame': '1930-09-22', 'retroID': 'willc103', 'bbrefID': 'willicy01', 'DOD': datetime.date(1974, 4, 23), 'DOB': datetime.date(1887, 12, 21)}, {'playerID': 'willida01', 'birthYear': 1855, 'birthMonth': 10, 'birthDay': 6, 'birthCountry': 'USA', 'birthState': 'KY', 'birthCity': 'Ludlow', 'deathYear': 1939, 'deathMonth': 10, 'deathDay': 22, 'deathCountry': 'USA', 'deathState': 'KY', 'deathCity': 'Covington', 'nameFirst': 'Dale', 'nameLast': 'Williams', 'nameGiven': 'Elisha Alphonso', 'weight': '175', 'height': '69', 'bats': 'R', 'throws': 'R', 'debut': '1876-08-12', 'finalGame': '1876-09-09', 'retroID': 'willd106', 'bbrefID': 'willida01', 'DOD': datetime.date(1939, 10, 22), 'DOB': datetime.date(1855, 10, 6)}, {'playerID': 'willida02', 'birthYear': 1881, 'birthMonth': 2, 'birthDay': 7, 'birthCountry': 'USA', 'birthState': 'PA', 'birthCity': 'Scranton', 'deathYear': 1918, 'deathMonth': 4, 'deathDay': 25, 'deathCountry': 'USA', 'deathState': 'AR', 'deathCity': 'Hot Springs', 'nameFirst': 'Dave', 'nameLast': 'Williams', 'nameGiven': 'David Owen', 'weight': '167', 'height': '71', 'bats': 'R', 'throws': 'L', 'debut': '1902-07-02', 'finalGame': '1902-08-03', 'retroID': 'willd103', 'bbrefID': 'willida02', 'DOD': datetime.date(1918, 4, 25), 'DOB': datetime.date(1881, 2, 7)}, {'playerID': 'willida03', 'birthYear': 1927, 'birthMonth': 11, 'birthDay': 2, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Dallas', 'deathYear': 2009, 'deathMonth': 8, 'deathDay': 17, 'deathCountry': 'USA', 'deathState': 'TX', 'deathCity': 'Farmers Branch', 'nameFirst': 'Davey', 'nameLast': 'Williams', 'nameGiven': 'David Carlous', 'weight': '160', 'height': '70', 'bats': 'R', 'throws': 'R', 'debut': '1949-09-16', 'finalGame': '1955-07-31', 'retroID': 'willd102', 'bbrefID': 'willida03', 'DOD': datetime.date(2009, 8, 17), 'DOB': datetime.date(1927, 11, 2)}, {'playerID': 'willida05', 'birthYear': 1958, 'birthMonth': 2, 'birthDay': 28, 'birthCountry': 'USA', 'birthState': 'NY', 'birthCity': 'Brooklyn', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Dallas', 'nameLast': 'Williams', 'nameGiven': 'Dallas McKinley', 'weight': '165', 'height': '71', 'bats': 'L', 'throws': 'L', 'debut': '1981-09-19', 'finalGame': '1983-10-02', 'retroID': 'willd101', 'bbrefID': 'willida05', 'DOD': None, 'DOB': datetime.date(1958, 2, 28)}, {'playerID': 'willida06', 'birthYear': 1963, 'birthMonth': 3, 'birthDay': 20, 'birthCountry': 'USA', 'birthState': 'WV', 'birthCity': 'Weirton', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Dana', 'nameLast': 'Williams', 'nameGiven': 'Dana Lamont', 'weight': '170', 'height': '70', 'bats': 'R', 'throws': 'R', 'debut': '1989-06-19', 'finalGame': '1989-07-02', 'retroID': 'willd001', 'bbrefID': 'willida06', 'DOD': None, 'DOB': datetime.date(1963, 3, 20)}, {'playerID': 'willida07', 'birthYear': 1979, 'birthMonth': 3, 'birthDay': 12, 'birthCountry': 'USA', 'birthState': 'AK', 'birthCity': 'Anchorage', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'David', 'nameLast': 'Williams', 'nameGiven': 'David Aaron', 'weight': '215', 'height': '75', 'bats': 'L', 'throws': 'L', 'debut': '2001-06-06', 'finalGame': '2007-09-24', 'retroID': 'willd002', 'bbrefID': 'willida07', 'DOD': None, 'DOB': datetime.date(1979, 3, 12)}, {'playerID': 'willide01', 'birthYear': 1896, 'birthMonth': 12, 'birthDay': 13, 'birthCountry': 'USA', 'birthState': 'OR', 'birthCity': 'Portland', 'deathYear': 1929, 'deathMonth': 3, 'deathDay': 23, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'San Clemente', 'nameFirst': 'Denny', 'nameLast': 'Williams', 'nameGiven': 'Evon Daniel', 'weight': '150', 'height': '68', 'bats': 'L', 'throws': 'R', 'debut': '1921-04-15', 'finalGame': '1928-07-18', 'retroID': 'willd105', 'bbrefID': 'willide01', 'DOD': datetime.date(1929, 3, 23), 'DOB': datetime.date(1896, 12, 13)}, {'playerID': 'willide02', 'birthYear': 1916, 'birthMonth': 2, 'birthDay': 5, 'birthCountry': 'USA', 'birthState': 'NC', 'birthCity': 'Durham', 'deathYear': 2000, 'deathMonth': 3, 'deathDay': 19, 'deathCountry': 'USA', 'deathState': 'ND', 'deathCity': 'Williston', 'nameFirst': 'Dewey', 'nameLast': 'Williams', 'nameGiven': 'Dewey Edgar', 'weight': '160', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1944-06-28', 'finalGame': '1948-09-26', 'retroID': 'willd109', 'bbrefID': 'willide02', 'DOD': datetime.date(2000, 3, 19), 'DOB': datetime.date(1916, 2, 5)}, {'playerID': 'willidi01', 'birthYear': 1910, 'birthMonth': 1, 'birthDay': 19, 'birthCountry': 'USA', 'birthState': 'AR', 'birthCity': 'Greenbrier', 'deathYear': 1992, 'deathMonth': 4, 'deathDay': 2, 'deathCountry': 'USA', 'deathState': 'AR', 'deathCity': 'Searcy', 'nameFirst': 'Dib', 'nameLast': 'Williams', 'nameGiven': 'Edwin Dibrell', 'weight': '175', 'height': '71', 'bats': 'R', 'throws': 'R', 'debut': '1930-04-27', 'finalGame': '1935-09-29', 'retroID': 'willd107', 'bbrefID': 'willidi01', 'DOD': datetime.date(1992, 4, 2), 'DOB': datetime.date(1910, 1, 19)}, {'playerID': 'willidi02', 'birthYear': 1929, 'birthMonth': 5, 'birthDay': 7, 'birthCountry': 'USA', 'birthState': 'MO', 'birthCity': 'St. Louis', 'deathYear': 2011, 'deathMonth': 7, 'deathDay': 7, 'deathCountry': 'USA', 'deathState': 'NV', 'deathCity': 'Las Vegas', 'nameFirst': 'Dick', 'nameLast': 'Williams', 'nameGiven': 'Richard Hirschfeld', 'weight': '190', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1951-06-10', 'finalGame': '1964-10-01', 'retroID': 'willd104', 'bbrefID': 'willidi02', 'DOD': datetime.date(2011, 7, 7), 'DOB': datetime.date(1929, 5, 7)}, {'playerID': 'willido01', 'birthYear': 1931, 'birthMonth': 9, 'birthDay': 14, 'birthCountry': 'USA', 'birthState': 'VA', 'birthCity': 'Floyd', 'deathYear': 2011, 'deathMonth': 10, 'deathDay': 16, 'deathCountry': 'USA', 'deathState': 'VA', 'deathCity': 'Floyd', 'nameFirst': 'Don', 'nameLast': 'Williams', 'nameGiven': 'Don Fred', 'weight': '180', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1958-09-12', 'finalGame': '1962-08-23', 'retroID': 'willd108', 'bbrefID': 'willido01', 'DOD': datetime.date(2011, 10, 16), 'DOB': datetime.date(1931, 9, 14)}, {'playerID': 'willido02', 'birthYear': 1935, 'birthMonth': 9, 'birthDay': 2, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Los Angeles', 'deathYear': 1991, 'deathMonth': 12, 'deathDay': 20, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'La Jolla', 'nameFirst': 'Don', 'nameLast': 'Williams', 'nameGiven': 'Donald Reid', 'weight': '218', 'height': '77', 'bats': 'R', 'throws': 'R', 'debut': '1963-08-04', 'finalGame': '1963-08-17', 'retroID': 'willd110', 'bbrefID': 'willido02', 'DOD': datetime.date(1991, 12, 20), 'DOB': datetime.date(1935, 9, 2)}, {'playerID': 'williea01', 'birthYear': 1903, 'birthMonth': 1, 'birthDay': 27, 'birthCountry': 'USA', 'birthState': 'TN', 'birthCity': 'Cumberland Gap', 'deathYear': 1958, 'deathMonth': 3, 'deathDay': 10, 'deathCountry': 'USA', 'deathState': 'TN', 'deathCity': 'Knoxville', 'nameFirst': 'Earl', 'nameLast': 'Williams', 'nameGiven': 'Earl Baxter', 'weight': '185', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1928-05-27', 'finalGame': '1928-06-02', 'retroID': 'wille102', 'bbrefID': 'williea01', 'DOD': datetime.date(1958, 3, 10), 'DOB': datetime.date(1903, 1, 27)}, {'playerID': 'williea02', 'birthYear': 1948, 'birthMonth': 7, 'birthDay': 14, 'birthCountry': 'USA', 'birthState': 'NJ', 'birthCity': 'Newark', 'deathYear': 2013, 'deathMonth': 1, 'deathDay': 28, 'deathCountry': 'USA', 'deathState': 'NJ', 'deathCity': 'Somerset', 'nameFirst': 'Earl', 'nameLast': 'Williams', 'nameGiven': 'Earl Craig', 'weight': '215', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '1970-09-13', 'finalGame': '1977-09-25', 'retroID': 'wille101', 'bbrefID': 'williea02', 'DOD': datetime.date(2013, 1, 28), 'DOB': datetime.date(1948, 7, 14)}, {'playerID': 'willied01', 'birthYear': 1964, 'birthMonth': 11, 'birthDay': 1, 'birthCountry': 'USA', 'birthState': 'LA', 'birthCity': 'Shreveport', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Eddie', 'nameLast': 'Williams', 'nameGiven': 'Edward Laquan', 'weight': '175', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1986-04-18', 'finalGame': '1998-05-27', 'retroID': 'wille001', 'bbrefID': 'willied01', 'DOD': None, 'DOB': datetime.date(1964, 11, 1)}, {'playerID': 'willifr01', 'birthYear': 1958, 'birthMonth': 2, 'birthDay': 13, 'birthCountry': 'USA', 'birthState': 'WA', 'birthCity': 'Seattle', 'deathYear': 2009, 'deathMonth': 1, 'deathDay': 9, 'deathCountry': 'CAN', 'deathState': 'BC', 'deathCity': 'Victoria', 'nameFirst': 'Frank', 'nameLast': 'Williams', 'nameGiven': 'Frank Lee', 'weight': '180', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1984-04-05', 'finalGame': '1989-09-27', 'retroID': 'willf001', 'bbrefID': 'willifr01', 'DOD': datetime.date(2009, 1, 9), 'DOB': datetime.date(1958, 2, 13)}, {'playerID': 'willige01', 'birthYear': 1939, 'birthMonth': 10, 'birthDay': 23, 'birthCountry': 'USA', 'birthState': 'MI', 'birthCity': 'Detroit', 'deathYear': 2009, 'deathMonth': 5, 'deathDay': 14, 'deathCountry': 'USA', 'deathState': 'MI', 'deathCity': 'Detroit', 'nameFirst': 'George', 'nameLast': 'Williams', 'nameGiven': 'George', 'weight': '165', 'height': '71', 'bats': 'R', 'throws': 'R', 'debut': '1961-07-16', 'finalGame': '1964-07-05', 'retroID': 'willg101', 'bbrefID': 'willige01', 'DOD': datetime.date(2009, 5, 14), 'DOB': datetime.date(1939, 10, 23)}, {'playerID': 'willige02', 'birthYear': 1966, 'birthMonth': 8, 'birthDay': 10, 'birthCountry': 'USA', 'birthState': 'LA', 'birthCity': 'New Orleans', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Gerald', 'nameLast': 'Williams', 'nameGiven': 'Gerald Floyd', 'weight': '190', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1992-09-15', 'finalGame': '2005-10-02', 'retroID': 'willg001', 'bbrefID': 'willige02', 'DOD': None, 'DOB': datetime.date(1966, 8, 10)}, {'playerID': 'willige03', 'birthYear': 1969, 'birthMonth': 4, 'birthDay': 22, 'birthCountry': 'USA', 'birthState': 'WI', 'birthCity': 'La Crosse', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'George', 'nameLast': 'Williams', 'nameGiven': 'George Erik', 'weight': '190', 'height': '70', 'bats': 'B', 'throws': 'R', 'debut': '1995-07-14', 'finalGame': '2000-09-13', 'retroID': 'willg002', 'bbrefID': 'willige03', 'DOD': None, 'DOB': datetime.date(1969, 4, 22)}, {'playerID': 'willigl01', 'birthYear': 1977, 'birthMonth': 7, 'birthDay': 18, 'birthCountry': 'Australia', 'birthState': 'New South Wales', 'birthCity': 'Gosford', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Glenn', 'nameLast': 'Williams', 'nameGiven': 'Glenn David', 'weight': '195', 'height': '74', 'bats': 'B', 'throws': 'R', 'debut': '2005-06-07', 'finalGame': '2005-06-28', 'retroID': 'willg003', 'bbrefID': 'willigl01', 'DOD': None, 'DOB': datetime.date(1977, 7, 18)}, {'playerID': 'willigu01', 'birthYear': 1870, 'birthMonth': None, 'birthDay': None, 'birthCountry': 'USA', 'birthState': 'NY', 'birthCity': 'New York', 'deathYear': 1890, 'deathMonth': 10, 'deathDay': 14, 'deathCountry': 'USA', 'deathState': 'NY', 'deathCity': 'New York', 'nameFirst': 'Gus', 'nameLast': 'Williams', 'nameGiven': 'Augustine H.', 'weight': '170', 'height': '71', 'bats': '', 'throws': '', 'debut': '1890-04-18', 'finalGame': '1890-04-22', 'retroID': 'willg102', 'bbrefID': 'willigu01', 'DOD': datetime.date(1890, 10, 14), 'DOB': None}, {'playerID': 'willigu02', 'birthYear': 1888, 'birthMonth': 5, 'birthDay': 7, 'birthCountry': 'USA', 'birthState': 'NE', 'birthCity': 'Omaha', 'deathYear': 1964, 'deathMonth': 4, 'deathDay': 16, 'deathCountry': 'USA', 'deathState': 'IL', 'deathCity': 'Sterling', 'nameFirst': 'Gus', 'nameLast': 'Williams', 'nameGiven': 'August Joseph', 'weight': '185', 'height': '72', 'bats': 'L', 'throws': 'L', 'debut': '1911-04-12', 'finalGame': '1915-06-18', 'retroID': 'willg103', 'bbrefID': 'willigu02', 'DOD': datetime.date(1964, 4, 16), 'DOB': datetime.date(1888, 5, 7)}, {'playerID': 'williha01', 'birthYear': 1890, 'birthMonth': 6, 'birthDay': 23, 'birthCountry': 'USA', 'birthState': 'NE', 'birthCity': 'Omaha', 'deathYear': 1963, 'deathMonth': 12, 'deathDay': 21, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'Huntington Park', 'nameFirst': 'Harry', 'nameLast': 'Williams', 'nameGiven': 'Harry Peter', 'weight': '200', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1913-08-07', 'finalGame': '1914-06-30', 'retroID': 'willh103', 'bbrefID': 'williha01', 'DOD': datetime.date(1963, 12, 21), 'DOB': datetime.date(1890, 6, 23)}, {'playerID': 'willija01', 'birthYear': 1986, 'birthMonth': 5, 'birthDay': 14, 'birthCountry': 'USA', 'birthState': 'OK', 'birthCity': 'Tulsa', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Jackson', 'nameLast': 'Williams', 'nameGiven': 'Jackson Thomas', 'weight': '200', 'height': '70', 'bats': 'R', 'throws': 'R', 'debut': '2014-08-27', 'finalGame': '2015-10-04', 'retroID': 'willj005', 'bbrefID': 'willija01', 'DOD': None, 'DOB': datetime.date(1986, 5, 14)}, {'playerID': 'willije01', 'birthYear': 1972, 'birthMonth': 6, 'birthDay': 6, 'birthCountry': 'Australia', 'birthState': 'Capital Territory', 'birthCity': 'Canberra', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Jeff', 'nameLast': 'Williams', 'nameGiven': 'Jeffrey F.', 'weight': '185', 'height': '72', 'bats': 'R', 'throws': 'L', 'debut': '1999-09-12', 'finalGame': '2002-09-28', 'retroID': 'willj002', 'bbrefID': 'willije02', 'DOD': None, 'DOB': datetime.date(1972, 6, 6)}, {'playerID': 'willije02', 'birthYear': 1981, 'birthMonth': 12, 'birthDay': 4, 'birthCountry': 'USA', 'birthState': 'HI', 'birthCity': 'Honolulu', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Jerome', 'nameLast': 'Williams', 'nameGiven': 'Jerome Lee', 'weight': '260', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '2003-04-26', 'finalGame': '2016-09-26', 'retroID': 'willj003', 'bbrefID': 'willije01', 'DOD': None, 'DOB': datetime.date(1981, 12, 4)}, {'playerID': 'williji01', 'birthYear': 1876, 'birthMonth': 12, 'birthDay': 20, 'birthCountry': 'USA', 'birthState': 'MO', 'birthCity': 'St. Louis', 'deathYear': 1965, 'deathMonth': 1, 'deathDay': 16, 'deathCountry': 'USA', 'deathState': 'FL', 'deathCity': 'St. Petersburg', 'nameFirst': 'Jimmy', 'nameLast': 'Williams', 'nameGiven': 'James Thomas', 'weight': '175', 'height': '69', 'bats': 'R', 'throws': 'R', 'debut': '1899-04-15', 'finalGame': '1909-10-03', 'retroID': 'willj106', 'bbrefID': 'williji01', 'DOD': datetime.date(1965, 1, 16), 'DOB': datetime.date(1876, 12, 20)}, {'playerID': 'williji03', 'birthYear': 1943, 'birthMonth': 10, 'birthDay': 4, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Santa Maria', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Jimy', 'nameLast': 'Williams', 'nameGiven': 'James Francis', 'weight': '170', 'height': '70', 'bats': 'R', 'throws': 'R', 'debut': '1966-04-26', 'finalGame': '1967-09-21', 'retroID': 'willj107', 'bbrefID': 'williji03', 'DOD': None, 'DOB': datetime.date(1943, 10, 4)}, {'playerID': 'williji04', 'birthYear': 1947, 'birthMonth': 4, 'birthDay': 29, 'birthCountry': 'USA', 'birthState': 'LA', 'birthCity': 'Zachary', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Jim', 'nameLast': 'Williams', 'nameGiven': 'James Alfred', 'weight': '190', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1969-09-08', 'finalGame': '1970-09-30', 'retroID': 'willj108', 'bbrefID': 'williji04', 'DOD': None, 'DOB': datetime.date(1947, 4, 29)}, {'playerID': 'williji99', 'birthYear': 1847, 'birthMonth': 1, 'birthDay': 4, 'birthCountry': 'USA', 'birthState': 'OH', 'birthCity': 'Catawba', 'deathYear': 1918, 'deathMonth': 10, 'deathDay': 23, 'deathCountry': 'USA', 'deathState': 'NY', 'deathCity': 'Westbury', 'nameFirst': 'Jimmy', 'nameLast': 'Williams', 'nameGiven': 'James Andrew', 'weight': '', 'height': '', 'bats': '', 'throws': '', 'debut': '', 'finalGame': '', 'retroID': 'willj801', 'bbrefID': 'williji99', 'DOD': datetime.date(1918, 10, 23), 'DOB': datetime.date(1847, 1, 4)}, {'playerID': 'willijo02', 'birthYear': 1889, 'birthMonth': 7, 'birthDay': 16, 'birthCountry': 'USA', 'birthState': 'HI', 'birthCity': 'Honolulu', 'deathYear': 1963, 'deathMonth': 9, 'deathDay': 8, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'Long Beach', 'nameFirst': 'Johnnie', 'nameLast': 'Williams', 'nameGiven': 'John Brodie', 'weight': '180', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1914-04-21', 'finalGame': '1914-08-19', 'retroID': 'willj101', 'bbrefID': 'willijo02', 'DOD': datetime.date(1963, 9, 8), 'DOB': datetime.date(1889, 7, 16)}, {'playerID': 'willijo99', 'birthYear': 1885, 'birthMonth': 4, 'birthDay': 6, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Seguin', 'deathYear': 1951, 'deathMonth': 2, 'deathDay': 25, 'deathCountry': 'USA', 'deathState': 'NY', 'deathCity': 'New York', 'nameFirst': 'Smokey Joe', 'nameLast': 'Williams', 'nameGiven': 'Joseph', 'weight': '190', 'height': '76', 'bats': 'R', 'throws': 'R', 'debut': '', 'finalGame': '', 'retroID': '', 'bbrefID': 'willijo99', 'DOD': datetime.date(1951, 2, 25), 'DOB': datetime.date(1885, 4, 6)}, {'playerID': 'willike01', 'birthYear': 1890, 'birthMonth': 6, 'birthDay': 28, 'birthCountry': 'USA', 'birthState': 'OR', 'birthCity': 'Grants Pass', 'deathYear': 1959, 'deathMonth': 1, 'deathDay': 22, 'deathCountry': 'USA', 'deathState': 'OR', 'deathCity': 'Grants Pass', 'nameFirst': 'Ken', 'nameLast': 'Williams', 'nameGiven': 'Kenneth Roy', 'weight': '170', 'height': '72', 'bats': 'L', 'throws': 'R', 'debut': '1915-07-14', 'finalGame': '1929-08-10', 'retroID': 'willk101', 'bbrefID': 'willike01', 'DOD': datetime.date(1959, 1, 22), 'DOB': datetime.date(1890, 6, 28)}, {'playerID': 'willike02', 'birthYear': 1964, 'birthMonth': 4, 'birthDay': 6, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Berkeley', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Ken', 'nameLast': 'Williams', 'nameGiven': 'Kenneth Royal', 'weight': '187', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1986-09-02', 'finalGame': '1991-10-04', 'retroID': 'willk001', 'bbrefID': 'willike02', 'DOD': None, 'DOB': datetime.date(1964, 4, 6)}, {'playerID': 'willike03', 'birthYear': 1972, 'birthMonth': 4, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'PA', 'birthCity': 'Bedford', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Keith', 'nameLast': 'Williams', 'nameGiven': 'David Keith', 'weight': '190', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1996-06-07', 'finalGame': '1996-06-23', 'retroID': 'willk002', 'bbrefID': 'willike03', 'DOD': None, 'DOB': datetime.date(1972, 4, 21)}, {'playerID': 'willile01', 'birthYear': 1893, 'birthMonth': 3, 'birthDay': 9, 'birthCountry': 'USA', 'birthState': 'MO', 'birthCity': 'Aurora', 'deathYear': 1959, 'deathMonth': 11, 'deathDay': 4, 'deathCountry': 'USA', 'deathState': 'CA', 'deathCity': 'Laguna Beach', 'nameFirst': 'Lefty', 'nameLast': 'Williams', 'nameGiven': 'Claude Preston', 'weight': '160', 'height': '69', 'bats': 'R', 'throws': 'L', 'debut': '1913-09-17', 'finalGame': '1920-09-25', 'retroID': 'willl104', 'bbrefID': 'willile01', 'DOD': datetime.date(1959, 11, 4), 'DOB': datetime.date(1893, 3, 9)}, {'playerID': 'willile03', 'birthYear': 1905, 'birthMonth': 12, 'birthDay': 2, 'birthCountry': 'USA', 'birthState': 'GA', 'birthCity': 'Macon', 'deathYear': 1984, 'deathMonth': 11, 'deathDay': 20, 'deathCountry': 'USA', 'deathState': 'GA', 'deathCity': 'Atlanta', 'nameFirst': 'Leon', 'nameLast': 'Williams', 'nameGiven': 'Leon Theo', 'weight': '154', 'height': '70', 'bats': 'L', 'throws': 'L', 'debut': '1926-05-26', 'finalGame': '1926-09-06', 'retroID': 'willl101', 'bbrefID': 'willile03', 'DOD': datetime.date(1984, 11, 20), 'DOB': datetime.date(1905, 12, 2)}, {'playerID': 'willima01', 'birthYear': 1893, 'birthMonth': 2, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'NC', 'birthCity': 'Faison', 'deathYear': 1935, 'deathMonth': 2, 'deathDay': 22, 'deathCountry': 'USA', 'deathState': 'AZ', 'deathCity': 'Tucson', 'nameFirst': 'Marsh', 'nameLast': 'Williams', 'nameGiven': 'Marshall McDiarmid', 'weight': '180', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1916-07-07', 'finalGame': '1916-08-25', 'retroID': 'willm104', 'bbrefID': 'willima01', 'DOD': datetime.date(1935, 2, 22), 'DOB': datetime.date(1893, 2, 21)}, {'playerID': 'willima02', 'birthYear': 1953, 'birthMonth': 7, 'birthDay': 28, 'birthCountry': 'USA', 'birthState': 'NY', 'birthCity': 'Elmira', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Mark', 'nameLast': 'Williams', 'nameGiven': 'Mark Westley', 'weight': '180', 'height': '72', 'bats': 'L', 'throws': 'L', 'debut': '1977-05-20', 'finalGame': '1977-05-22', 'retroID': 'willm105', 'bbrefID': 'willima02', 'DOD': None, 'DOB': datetime.date(1953, 7, 28)}, {'playerID': 'willima03', 'birthYear': 1959, 'birthMonth': 7, 'birthDay': 25, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Houston', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Matt', 'nameLast': 'Williams', 'nameGiven': 'Matthew Evan', 'weight': '200', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1983-08-02', 'finalGame': '1985-10-05', 'retroID': 'willm001', 'bbrefID': 'willima03', 'DOD': None, 'DOB': datetime.date(1959, 7, 25)}, {'playerID': 'willima04', 'birthYear': 1965, 'birthMonth': 11, 'birthDay': 28, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Bishop', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Matt', 'nameLast': 'Williams', 'nameGiven': 'Matthew Derrick', 'weight': '205', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1987-04-11', 'finalGame': '2003-05-31', 'retroID': 'willm003', 'bbrefID': 'willima04', 'DOD': None, 'DOB': datetime.date(1965, 11, 28)}, {'playerID': 'willima06', 'birthYear': 1971, 'birthMonth': 4, 'birthDay': 12, 'birthCountry': 'USA', 'birthState': 'VA', 'birthCity': 'Virginia Beach', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Matt', 'nameLast': 'Williams', 'nameGiven': 'Matt Taylor', 'weight': '185', 'height': '72', 'bats': 'B', 'throws': 'L', 'debut': '2000-04-05', 'finalGame': '2000-04-29', 'retroID': 'willm006', 'bbrefID': 'willima09', 'DOD': None, 'DOB': datetime.date(1971, 4, 12)}, {'playerID': 'willima07', 'birthYear': 1991, 'birthMonth': 8, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'RI', 'birthCity': 'Pawtucket', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Mason', 'nameLast': 'Williams', 'nameGiven': 'Mason', 'weight': '195', 'height': '73', 'bats': 'L', 'throws': 'R', 'debut': '2015-06-12', 'finalGame': '2017-06-25', 'retroID': 'willm007', 'bbrefID': 'willima10', 'DOD': None, 'DOB': datetime.date(1991, 8, 21)}, {'playerID': 'willimi02', 'birthYear': 1964, 'birthMonth': 11, 'birthDay': 17, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Santa Ana', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Mitch', 'nameLast': 'Williams', 'nameGiven': 'Mitchell Steven', 'weight': '180', 'height': '75', 'bats': 'L', 'throws': 'L', 'debut': '1986-04-09', 'finalGame': '1997-05-10', 'retroID': 'willm002', 'bbrefID': 'willimi02', 'DOD': None, 'DOB': datetime.date(1964, 11, 17)}, {'playerID': 'willimi03', 'birthYear': 1968, 'birthMonth': 7, 'birthDay': 29, 'birthCountry': 'USA', 'birthState': 'VA', 'birthCity': 'Radford', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Mike', 'nameLast': 'Williams', 'nameGiven': 'Michael Darren', 'weight': '190', 'height': '74', 'bats': 'R', 'throws': 'R', 'debut': '1992-06-30', 'finalGame': '2003-09-28', 'retroID': 'willm005', 'bbrefID': 'willimi03', 'DOD': None, 'DOB': datetime.date(1968, 7, 29)}, {'playerID': 'willimu01', 'birthYear': 1892, 'birthMonth': 7, 'birthDay': 31, 'birthCountry': 'USA', 'birthState': 'AR', 'birthCity': 'Ozark', 'deathYear': 1962, 'deathMonth': 3, 'deathDay': 30, 'deathCountry': 'USA', 'deathState': 'AR', 'deathCity': 'Fayetteville', 'nameFirst': 'Mutt', 'nameLast': 'Williams', 'nameGiven': 'David Carter', 'weight': '195', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '1913-10-04', 'finalGame': '1914-10-01', 'retroID': 'willm103', 'bbrefID': 'willimu01', 'DOD': datetime.date(1962, 3, 30), 'DOB': datetime.date(1892, 7, 31)}, {'playerID': 'willini01', 'birthYear': 1993, 'birthMonth': 9, 'birthDay': 8, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Galveston', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Nick', 'nameLast': 'Williams', 'nameGiven': 'Billy Nicholas', 'weight': '195', 'height': '75', 'bats': 'L', 'throws': 'L', 'debut': '2017-06-30', 'finalGame': '2017-10-01', 'retroID': 'willn001', 'bbrefID': 'willini01', 'DOD': None, 'DOB': datetime.date(1993, 9, 8)}, {'playerID': 'williot01', 'birthYear': 1877, 'birthMonth': 11, 'birthDay': 2, 'birthCountry': 'USA', 'birthState': 'NJ', 'birthCity': 'Newark', 'deathYear': 1937, 'deathMonth': 3, 'deathDay': 19, 'deathCountry': 'USA', 'deathState': 'NE', 'deathCity': 'Omaha', 'nameFirst': 'Otto', 'nameLast': 'Williams', 'nameGiven': 'Otto George', 'weight': '165', 'height': '68', 'bats': 'R', 'throws': 'R', 'debut': '1902-10-05', 'finalGame': '1906-06-09', 'retroID': 'willo101', 'bbrefID': 'williot01', 'DOD': datetime.date(1937, 3, 19), 'DOB': datetime.date(1877, 11, 2)}, {'playerID': 'willipa01', 'birthYear': 1913, 'birthMonth': 7, 'birthDay': 17, 'birthCountry': 'USA', 'birthState': 'MS', 'birthCity': 'Meridian', 'deathYear': 1993, 'deathMonth': 11, 'deathDay': 2, 'deathCountry': 'USA', 'deathState': 'MS', 'deathCity': 'Meridian', 'nameFirst': 'Papa', 'nameLast': 'Williams', 'nameGiven': 'Fred', 'weight': '200', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1945-04-19', 'finalGame': '1945-07-08', 'retroID': 'willp102', 'bbrefID': 'willipa01', 'DOD': datetime.date(1993, 11, 2), 'DOB': datetime.date(1913, 7, 17)}, {'playerID': 'willipo01', 'birthYear': 1874, 'birthMonth': 5, 'birthDay': 19, 'birthCountry': 'USA', 'birthState': 'ME', 'birthCity': 'Bowdoinham', 'deathYear': 1959, 'deathMonth': 8, 'deathDay': 4, 'deathCountry': 'USA', 'deathState': 'ME', 'deathCity': 'Topsham', 'nameFirst': 'Pop', 'nameLast': 'Williams', 'nameGiven': 'Walter Merrill', 'weight': '190', 'height': '71', 'bats': 'R', 'throws': 'L', 'debut': '1898-09-14', 'finalGame': '1903-09-15', 'retroID': 'willp101', 'bbrefID': 'willipo01', 'DOD': datetime.date(1959, 8, 4), 'DOB': datetime.date(1874, 5, 19)}, {'playerID': 'willira01', 'birthYear': 1975, 'birthMonth': 9, 'birthDay': 18, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Harlingen', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Randy', 'nameLast': 'Williams', 'nameGiven': 'Randall Duane', 'weight': '200', 'height': '75', 'bats': 'L', 'throws': 'L', 'debut': '2004-09-11', 'finalGame': '2011-08-05', 'retroID': 'willr003', 'bbrefID': 'willira01', 'DOD': None, 'DOB': datetime.date(1975, 9, 18)}, {'playerID': 'willire01', 'birthYear': 1960, 'birthMonth': 8, 'birthDay': 29, 'birthCountry': 'USA', 'birthState': 'TN', 'birthCity': 'Memphis', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Reggie', 'nameLast': 'Williams', 'nameGiven': 'Reginald Dewayne', 'weight': '185', 'height': '71', 'bats': 'R', 'throws': 'R', 'debut': '1985-09-02', 'finalGame': '1988-10-02', 'retroID': 'willr001', 'bbrefID': 'willire01', 'DOD': None, 'DOB': datetime.date(1960, 8, 29)}, {'playerID': 'willire02', 'birthYear': 1966, 'birthMonth': 5, 'birthDay': 5, 'birthCountry': 'USA', 'birthState': 'SC', 'birthCity': 'Laurens', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Reggie', 'nameLast': 'Williams', 'nameGiven': 'Reginald Bernard', 'weight': '180', 'height': '73', 'bats': 'B', 'throws': 'R', 'debut': '1992-09-08', 'finalGame': '1999-07-25', 'retroID': 'willr002', 'bbrefID': 'willire02', 'DOD': None, 'DOB': datetime.date(1966, 5, 5)}, {'playerID': 'williri01', 'birthYear': 1882, 'birthMonth': 1, 'birthDay': 31, 'birthCountry': 'USA', 'birthState': 'IL', 'birthCity': 'Carthage', 'deathYear': 1933, 'deathMonth': 7, 'deathDay': 23, 'deathCountry': 'USA', 'deathState': 'IA', 'deathCity': 'Keokuk', 'nameFirst': 'Rip', 'nameLast': 'Williams', 'nameGiven': 'Alva Mitchell', 'weight': '187', 'height': '71', 'bats': 'R', 'throws': 'R', 'debut': '1911-04-12', 'finalGame': '1918-06-09', 'retroID': 'willr104', 'bbrefID': 'williri01', 'DOD': datetime.date(1933, 7, 23), 'DOB': datetime.date(1882, 1, 31)}, {'playerID': 'williri02', 'birthYear': 1893, 'birthMonth': 12, 'birthDay': 18, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Santa Cruz', 'deathYear': 1966, 'deathMonth': 4, 'deathDay': 24, 'deathCountry': 'USA', 'deathState': 'AZ', 'deathCity': 'Cottonwood', 'nameFirst': 'Rinaldo', 'nameLast': 'Williams', 'nameGiven': 'Rinaldo Louis', 'weight': '', 'height': '', 'bats': 'L', 'throws': 'R', 'debut': '1914-10-08', 'finalGame': '1914-10-10', 'retroID': 'willr103', 'bbrefID': 'williri02', 'DOD': datetime.date(1966, 4, 24), 'DOB': datetime.date(1893, 12, 18)}, {'playerID': 'williri03', 'birthYear': 1952, 'birthMonth': 11, 'birthDay': 9, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Merced', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Rick', 'nameLast': 'Williams', 'nameGiven': 'Richard Allen', 'weight': '180', 'height': '73', 'bats': 'R', 'throws': 'R', 'debut': '1978-06-12', 'finalGame': '1979-09-26', 'retroID': 'willr101', 'bbrefID': 'williri03', 'DOD': None, 'DOB': datetime.date(1952, 11, 9)}, {'playerID': 'willish01', 'birthYear': 1971, 'birthMonth': 3, 'birthDay': 10, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'Fresno', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Shad', 'nameLast': 'Williams', 'nameGiven': 'Shad Clayton', 'weight': '185', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1996-05-18', 'finalGame': '1997-07-22', 'retroID': 'wills001', 'bbrefID': 'willish01', 'DOD': None, 'DOB': datetime.date(1971, 3, 10)}, {'playerID': 'willist01', 'birthYear': 1892, 'birthMonth': 1, 'birthDay': 31, 'birthCountry': 'USA', 'birthState': 'MT', 'birthCity': 'Cascade', 'deathYear': 1979, 'deathMonth': 6, 'deathDay': 29, 'deathCountry': 'USA', 'deathState': 'MN', 'deathCity': 'Deer River', 'nameFirst': 'Steamboat', 'nameLast': 'Williams', 'nameGiven': 'Rees Gephardt', 'weight': '170', 'height': '71', 'bats': 'L', 'throws': 'R', 'debut': '1914-07-12', 'finalGame': '1916-10-01', 'retroID': 'wills101', 'bbrefID': 'willist01', 'DOD': datetime.date(1979, 6, 29), 'DOB': datetime.date(1892, 1, 31)}, {'playerID': 'willist02', 'birthYear': 1936, 'birthMonth': 9, 'birthDay': 14, 'birthCountry': 'USA', 'birthState': 'NH', 'birthCity': 'Enfield', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Stan', 'nameLast': 'Williams', 'nameGiven': 'Stanley Wilson', 'weight': '230', 'height': '77', 'bats': 'R', 'throws': 'R', 'debut': '1958-05-17', 'finalGame': '1972-08-01', 'retroID': 'wills102', 'bbrefID': 'willist02', 'DOD': None, 'DOB': datetime.date(1936, 9, 14)}, {'playerID': 'willita01', 'birthYear': 1991, 'birthMonth': 7, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'WA', 'birthCity': 'Vancouver', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Taylor', 'nameLast': 'Williams', 'nameGiven': 'Taylor Grant', 'weight': '195', 'height': '71', 'bats': 'B', 'throws': 'R', 'debut': '2017-09-06', 'finalGame': '2017-10-01', 'retroID': 'willt003', 'bbrefID': 'willita01', 'DOD': None, 'DOB': datetime.date(1991, 7, 21)}, {'playerID': 'willite01', 'birthYear': 1918, 'birthMonth': 8, 'birthDay': 30, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'San Diego', 'deathYear': 2002, 'deathMonth': 7, 'deathDay': 5, 'deathCountry': 'USA', 'deathState': 'FL', 'deathCity': 'Inverness', 'nameFirst': 'Ted', 'nameLast': 'Williams', 'nameGiven': 'Theodore Samuel', 'weight': '205', 'height': '75', 'bats': 'L', 'throws': 'R', 'debut': '1939-04-20', 'finalGame': '1960-09-28', 'retroID': 'willt103', 'bbrefID': 'willite01', 'DOD': datetime.date(2002, 7, 5), 'DOB': datetime.date(1918, 8, 30)}, {'playerID': 'willito01', 'birthYear': 1870, 'birthMonth': 8, 'birthDay': 19, 'birthCountry': 'USA', 'birthState': 'OH', 'birthCity': 'Minersville', 'deathYear': 1940, 'deathMonth': 7, 'deathDay': 27, 'deathCountry': 'USA', 'deathState': 'OH', 'deathCity': 'Columbus', 'nameFirst': 'Tom', 'nameLast': 'Williams', 'nameGiven': 'Thomas C.', 'weight': '', 'height': '', 'bats': '', 'throws': '', 'debut': '1892-05-01', 'finalGame': '1893-09-14', 'retroID': 'willt101', 'bbrefID': 'willito01', 'DOD': datetime.date(1940, 7, 27), 'DOB': datetime.date(1870, 8, 19)}, {'playerID': 'willito02', 'birthYear': 1971, 'birthMonth': 2, 'birthDay': 13, 'birthCountry': 'USA', 'birthState': 'NY', 'birthCity': 'Syracuse', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Todd', 'nameLast': 'Williams', 'nameGiven': 'Todd Michael', 'weight': '185', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '1995-04-29', 'finalGame': '2007-06-15', 'retroID': 'willt001', 'bbrefID': 'willito02', 'DOD': None, 'DOB': datetime.date(1971, 2, 13)}, {'playerID': 'willitr01', 'birthYear': 1992, 'birthMonth': 4, 'birthDay': 25, 'birthCountry': 'USA', 'birthState': 'CA', 'birthCity': 'San Diego', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Trevor', 'nameLast': 'Williams', 'nameGiven': 'Trevor Anthony', 'weight': '230', 'height': '75', 'bats': 'R', 'throws': 'R', 'debut': '2016-09-07', 'finalGame': '2017-09-26', 'retroID': 'willt002', 'bbrefID': 'willitr01', 'DOD': None, 'DOB': datetime.date(1992, 4, 25)}, {'playerID': 'williwa01', 'birthYear': None, 'birthMonth': None, 'birthDay': None, 'birthCountry': 'USA', 'birthState': 'PA', 'birthCity': 'Philadelphia', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Wash', 'nameLast': 'Williams', 'nameGiven': 'Washington J.', 'weight': '180', 'height': '71', 'bats': '', 'throws': '', 'debut': '1884-08-05', 'finalGame': '1885-06-08', 'retroID': 'willw102', 'bbrefID': 'williwa01', 'DOD': None, 'DOB': None}, {'playerID': 'williwa02', 'birthYear': 1943, 'birthMonth': 12, 'birthDay': 19, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Brownwood', 'deathYear': 2016, 'deathMonth': 1, 'deathDay': 23, 'deathCountry': 'USA', 'deathState': 'TX', 'deathCity': 'Abilene', 'nameFirst': 'Walt', 'nameLast': 'Williams', 'nameGiven': 'Walter Allen', 'weight': '165', 'height': '66', 'bats': 'R', 'throws': 'R', 'debut': '1964-04-21', 'finalGame': '1975-09-22', 'retroID': 'willw103', 'bbrefID': 'williwa02', 'DOD': datetime.date(2016, 1, 23), 'DOB': datetime.date(1943, 12, 19)}, {'playerID': 'williwo01', 'birthYear': 1912, 'birthMonth': 8, 'birthDay': 21, 'birthCountry': 'USA', 'birthState': 'VA', 'birthCity': 'Pamplin', 'deathYear': 1995, 'deathMonth': 2, 'deathDay': 24, 'deathCountry': 'USA', 'deathState': 'VA', 'deathCity': 'Appomattox', 'nameFirst': 'Woody', 'nameLast': 'Williams', 'nameGiven': 'Woodrow Wilson', 'weight': '175', 'height': '71', 'bats': 'R', 'throws': 'R', 'debut': '1938-09-05', 'finalGame': '1945-09-30', 'retroID': 'willw101', 'bbrefID': 'williwo01', 'DOD': datetime.date(1995, 2, 24), 'DOB': datetime.date(1912, 8, 21)}, {'playerID': 'williwo02', 'birthYear': 1966, 'birthMonth': 8, 'birthDay': 19, 'birthCountry': 'USA', 'birthState': 'TX', 'birthCity': 'Houston', 'deathYear': None, 'deathMonth': None, 'deathDay': None, 'deathCountry': '', 'deathState': '', 'deathCity': '', 'nameFirst': 'Woody', 'nameLast': 'Williams', 'nameGiven': 'Gregory Scott', 'weight': '180', 'height': '72', 'bats': 'R', 'throws': 'R', 'debut': '1993-05-14', 'finalGame': '2007-09-22', 'retroID': 'willw001', 'bbrefID': 'williwo02', 'DOD': None, 'DOB': datetime.date(1966, 8, 19)}]\n"
     ]
    }
   ],
   "source": [
    "result = run_q(\"select * from people where nameLast='Williams';\")\n",
    "print(\"Result = \")\n",
    "print(result)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- OK. That output is kind of icky.\n",
    "\n",
    "\n",
    "- The Python function json.dumps() makes the output a little cleaner."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<u>A more complex example that includes PROJECT</u>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Query =  SELECT nameLast as last_name, nameFirst as firstName, birthYear as birth_year  \n",
      "    from people where \n",
      "    nameLast='Williams' and birthYear > '1920';\n",
      "Result = \n",
      "[\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Albert\",\n",
      "    \"birth_year\": 1954\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Bernie\",\n",
      "    \"birth_year\": 1948\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Bernie\",\n",
      "    \"birth_year\": 1968\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Billy\",\n",
      "    \"birth_year\": 1938\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Billy\",\n",
      "    \"birth_year\": 1932\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Brian\",\n",
      "    \"birth_year\": 1969\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Charlie\",\n",
      "    \"birth_year\": 1947\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Davey\",\n",
      "    \"birth_year\": 1927\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Dallas\",\n",
      "    \"birth_year\": 1958\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Dana\",\n",
      "    \"birth_year\": 1963\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"David\",\n",
      "    \"birth_year\": 1979\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Dick\",\n",
      "    \"birth_year\": 1929\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Don\",\n",
      "    \"birth_year\": 1931\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Don\",\n",
      "    \"birth_year\": 1935\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Earl\",\n",
      "    \"birth_year\": 1948\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Eddie\",\n",
      "    \"birth_year\": 1964\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Frank\",\n",
      "    \"birth_year\": 1958\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"George\",\n",
      "    \"birth_year\": 1939\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Gerald\",\n",
      "    \"birth_year\": 1966\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"George\",\n",
      "    \"birth_year\": 1969\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Glenn\",\n",
      "    \"birth_year\": 1977\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Jackson\",\n",
      "    \"birth_year\": 1986\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Jeff\",\n",
      "    \"birth_year\": 1972\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Jerome\",\n",
      "    \"birth_year\": 1981\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Jimy\",\n",
      "    \"birth_year\": 1943\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Jim\",\n",
      "    \"birth_year\": 1947\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Ken\",\n",
      "    \"birth_year\": 1964\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Keith\",\n",
      "    \"birth_year\": 1972\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Mark\",\n",
      "    \"birth_year\": 1953\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Matt\",\n",
      "    \"birth_year\": 1959\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Matt\",\n",
      "    \"birth_year\": 1965\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Matt\",\n",
      "    \"birth_year\": 1971\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Mason\",\n",
      "    \"birth_year\": 1991\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Mitch\",\n",
      "    \"birth_year\": 1964\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Mike\",\n",
      "    \"birth_year\": 1968\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Nick\",\n",
      "    \"birth_year\": 1993\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Randy\",\n",
      "    \"birth_year\": 1975\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Reggie\",\n",
      "    \"birth_year\": 1960\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Reggie\",\n",
      "    \"birth_year\": 1966\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Rick\",\n",
      "    \"birth_year\": 1952\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Shad\",\n",
      "    \"birth_year\": 1971\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Stan\",\n",
      "    \"birth_year\": 1936\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Taylor\",\n",
      "    \"birth_year\": 1991\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Todd\",\n",
      "    \"birth_year\": 1971\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Trevor\",\n",
      "    \"birth_year\": 1992\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Walt\",\n",
      "    \"birth_year\": 1943\n",
      "  },\n",
      "  {\n",
      "    \"last_name\": \"Williams\",\n",
      "    \"firstName\": \"Woody\",\n",
      "    \"birth_year\": 1966\n",
      "  }\n",
      "]\n"
     ]
    }
   ],
   "source": [
    "q ='''SELECT nameLast as last_name, nameFirst as firstName, birthYear as birth_year  \n",
    "    from people where \n",
    "    nameLast='Williams' and birthYear > '1920';'''\n",
    "result = run_q(q)\n",
    "print(\"Result = \")\n",
    "print(json.dumps(result, indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<u>Using Arguments</u>\n",
    "\n",
    "- If you want to pass parameters into a query string, there are two options:\n",
    "    1. String concatentation functions.\n",
    "    2. %s templates and arguments\n",
    "\n",
    "\n",
    "- You cannot insert schema terms, like table name or columns using %s substitution. So, you using string formatting or concatenation.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "q2 =  select playerId,nameLast,nameFirst,throws from People where nameLast=%s and throws=%s\n"
     ]
    }
   ],
   "source": [
    "q = \"select {} from {} where nameLast=%s and throws=%s\"\n",
    "q2 = q.format(\",\".join(['playerId', 'nameLast', 'nameFirst', 'throws']), \"People\")\n",
    "print(\"q2 = \", q2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Result =  [\n",
      "  {\n",
      "    \"playerId\": \"willial02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willial03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Albert\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williar01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Art\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibe01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Bernie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibe02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Bernie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibi01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Billy\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibi02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Billy\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibo01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willibr01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Brian\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willich01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Charlie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willida01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Dale\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willida03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Davey\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willida06\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Dana\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willide01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Denny\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willide02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Dewey\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willidi01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Dib\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willidi02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Dick\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willido01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Don\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willido02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Don\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williea01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Earl\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williea02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Earl\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willied01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Eddie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willifr01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Frank\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willige01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"George\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willige02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Gerald\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willige03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"George\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willigl01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Glenn\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williha01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Harry\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willija01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Jackson\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willije02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Jerome\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williji01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Jimmy\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williji03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Jimy\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williji04\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Jim\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willijo02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Johnnie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willijo99\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Smokey Joe\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willike01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Ken\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willike02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Ken\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willike03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Keith\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willima01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Marsh\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willima03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Matt\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willima04\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Matt\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willima07\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Mason\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willimi03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willimu01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Mutt\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williot01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Otto\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willipa01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Papa\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willire01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Reggie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willire02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Reggie\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williri01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Rip\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williri02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Rinaldo\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williri03\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Rick\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willish01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Shad\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willist01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Steamboat\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willist02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Stan\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willita01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Taylor\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willite01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Ted\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willito02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Todd\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"willitr01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Trevor\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williwa02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Walt\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williwo01\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Woody\",\n",
      "    \"throws\": \"R\"\n",
      "  },\n",
      "  {\n",
      "    \"playerId\": \"williwo02\",\n",
      "    \"nameLast\": \"Williams\",\n",
      "    \"nameFirst\": \"Woody\",\n",
      "    \"throws\": \"R\"\n",
      "  }\n",
      "]\n"
     ]
    }
   ],
   "source": [
    "cur = default_cnx.cursor()\n",
    "cur.execute(q2, ('Williams', 'R'))\n",
    "result = cur.fetchall()\n",
    "print(\"Result = \", json.dumps(result, indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## A Digression on the Power of SQL\n",
    "\n",
    "- CourseWorks (Canvass) has a basic REST API for querying and updating information about courses, students, ...\n",
    "\n",
    "\n",
    "- More complex understanding of the data requires:\n",
    "    - Making GET calls to retrieve the information using query parameters.\n",
    "    - Writing a program to process the data to answer complex questions.\n",
    "    \n",
    "    \n",
    "- SQL provides simpler (once you understand it), more compact ways to analyze data than writing Python, Java, etc. programs.\n",
    "\n",
    "\n",
    "- To show with an example,\n",
    "    - I wrote a Python program to query and download information from CourseWorks/Canvass.\n",
    "    - Create and load the data into MySQL tables.\n",
    "    \n",
    "    \n",
    "- What does the data look like?\n",
    "\n",
    "<hr style=\"height:1px;\">\n",
    "\n",
    "| <img src=\"../../images/cw_er_model.jpg\"> |\n",
    "| :---: |\n",
    "| __My CourseWorks Data Model__ |\n",
    "\n",
    "<hr style=\"height:1px;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- The notation in the diagram is an example of [Crow's Foot Notation.](https://www.vertabelo.com/blog/technical-articles/crow-s-foot-notation).\n",
    "\n",
    "\n",
    "- We will go through the meanings, patterns, etc. later.\n",
    "\n",
    "\n",
    "- The CourseWorks REST API allows me to query what classes I have taken/taught, which students have been in which classes, etc.\n",
    "\n",
    "\n",
    "- I cannot ask interesting questions about complex combinations of the data.\n",
    "\n",
    "\n",
    "- <u>Question 1: \"Who is the bravest person in the world?\"</u> The answer is the person who has taken the most courses with me."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>last_name</th>\n",
       "        <th>first_name</th>\n",
       "        <th>number_of_courses</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>Gupta</td>\n",
       "        <td> Abhi</td>\n",
       "        <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>Liu</td>\n",
       "        <td> Sen</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>Ontiveros</td>\n",
       "        <td> Bryan</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('Gupta', ' Abhi', 4), ('Liu', ' Sen', 3), ('Ontiveros', ' Bryan', 3)]"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "select last_name, first_name, count(*) as number_of_courses from w4111f19.student_course_view\n",
    "    group by student_id\n",
    "    having number_of_courses > 2\n",
    "    order by count(*) desc\n",
    "    limit 5;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- I will not bore you with more Python code, but doing this on the REST APIs alone would be tedious.\n",
    "\n",
    "\n",
    "- The RDB query engine executes the diagram below to produce the result. You can think of each rectangle as being a block of code that you would have to write.\n",
    "\n",
    "\n",
    "<hr style=\"height:1px;\">\n",
    "\n",
    "| <img src=\"../../images/query_execution.jpg\" width=\"700px;\"> |\n",
    "| :---: |\n",
    "| __Query Execution Plan__ |\n",
    "\n",
    "<hr style=\"height:1px;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- <u>Question 1: \"Who is in this class and has previously taken a class with me? Maybe they can help you.\"</u>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "0 rows affected.\n",
      "9 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>first_name</th>\n",
       "        <th>count</th>\n",
       "        <th>course_codes_full</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Samantha</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Sharon</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Ahmed</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Joshua</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Bradley</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Derek</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Jetasri</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Jillian</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td> Lara</td>\n",
       "        <td>2</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[(' Samantha', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Sharon', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Ahmed', 2, 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Joshua', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Bradley', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Derek', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Jetasri', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Jillian', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES'),\n",
       " (' Lara', 2, 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI, COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES')]"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "use w4111f19;\n",
    "\n",
    "SELECT\n",
    "\tfirst_name, count(*) as count, group_concat(course_code_full separator \", \") as course_codes_full \n",
    "FROM\n",
    "\tstudent_course_view\n",
    "where\n",
    "\tstudent_id in ( select student_id from student_course_view where course_id='85777' or course_id='91884')\n",
    "    and\n",
    "    student_id in (select student_id from student_course_view where year < 2019 or (semester < 3 and year = 2019))\n",
    "group by\n",
    "\tuser_id, last_name, first_name\n",
    "having count > 1\n",
    "order by count desc;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- That SQL statement may seem complex until you realize the equivalent code algorithm is something like ...\n",
    "\n",
    "<hr style=\"height:1px;\">\n",
    "\n",
    "| <img src=\"../../images/explain_2.png\" width=\"900px;\"> |\n",
    "| :---: |\n",
    "| __Query Execution Plan__ |\n",
    "\n",
    "<hr style=\"height:1px;\">"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Connections, Cursors and Fetch...\n",
    "\n",
    "- We previously, briefly discussed connections.\n",
    "\n",
    "\n",
    "- Section 6.1.2 in Ramakrishnan and Gherke discuss cursors (p. 189, 191)\n",
    "\n",
    "\n",
    "\"SQL is a set-based language, meaning operations are completed on all or rows of the result.  However, there are times, when you want to do operation on a row by row basis.  This is where cursors come in to play.\n",
    "\n",
    "... ...\n",
    "\n",
    "A database cursor can be thought of as a pointer to a specific row within a query result.  The pointer can be moved from one row to the next.  Depending on the type of cursor, you may be even able to move it to the previous row.\" (https://www.essentialsql.com/database-cursor/)\n",
    "\n",
    "\n",
    "- Cursors are fundamental to relational database APIs, and many other types of databases.\n",
    "\n",
    "\n",
    "- The details are often hidden and not explicit, and programmers use them in advanced scenarios. But, they are always (logically) created. \n",
    "\n",
    "\n",
    "| <img src=\"../../images/cursor.png\"> |\n",
    "| :---: |\n",
    "| [Cursor Concept](https://codeandwork.github.io/courses/java/sp_cursors_triggers_indexes.html) |\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Concept is similar to an iterator in programming languages/libraries.\n",
    "\n",
    "\n",
    "- ```cursor.execute(...)``` sends the command to the database and produces the result set. The common operations on the result set are:\n",
    "    - ```fetchall()```\n",
    "    - ```fetchone()```\n",
    "    - ```fetchmany(size=...)```\n",
    "    \n",
    "    \n",
    "- ```cursor.mogrify(q, args)``` returns the actual query string that will be sent to the database.\n",
    "\n",
    "\n",
    "- The details are PyMySQL library specific but the concepts apply in general to all connection libraries.\n",
    "\n",
    "\n",
    "- A simple example:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pymysql\n",
    "default_cnx = pymysql.connect(host='localhost',\n",
    "                             user='dbuser',\n",
    "                             password='dbuserdbuser',\n",
    "                             db='lahman2019raw',\n",
    "                             charset='utf8mb4',\n",
    "                             cursorclass=pymysql.cursors.DictCursor)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The query produced 162 rows.\n"
     ]
    }
   ],
   "source": [
    "cur = default_cnx.cursor()\n",
    "how_many = cur.execute(\"select * from people where nameLast='Smith'\")\n",
    "print(\"The query produced\", how_many, \"rows.\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Fetch all returns a list of size:  162\n",
      "The result set is = \n",
      " [\n",
      "  {\n",
      "    \"playerID\": \"smith01\",\n",
      "    \"birthYear\": \"\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"\",\n",
      "    \"birthState\": \"\",\n",
      "    \"birthCity\": \"\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-06-05\",\n",
      "    \"finalGame\": \"1884-06-05\",\n",
      "    \"retroID\": \"smitu101\",\n",
      "    \"bbrefID\": \"smith01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal01\",\n",
      "    \"birthYear\": \"1871\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"New York\",\n",
      "    \"deathYear\": \"1919\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"9\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"New York\",\n",
      "    \"nameFirst\": \"Aleck\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alexander Benjamin\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1897-04-23\",\n",
      "    \"finalGame\": \"1906-10-05\",\n",
      "    \"retroID\": \"smita105\",\n",
      "    \"bbrefID\": \"smithal01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal02\",\n",
      "    \"birthYear\": \"1903\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Norristown\",\n",
      "    \"deathYear\": \"1995\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Diego\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alfred Kendricks\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1926-06-18\",\n",
      "    \"finalGame\": \"1926-06-18\",\n",
      "    \"retroID\": \"smita103\",\n",
      "    \"bbrefID\": \"smithal02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal03\",\n",
      "    \"birthYear\": \"1907\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Belleville\",\n",
      "    \"deathYear\": \"1977\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"28\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"TX\",\n",
      "    \"deathCity\": \"Brownsville\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alfred John\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1934-05-05\",\n",
      "    \"finalGame\": \"1945-09-15\",\n",
      "    \"retroID\": \"smita104\",\n",
      "    \"bbrefID\": \"smithal03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal04\",\n",
      "    \"birthYear\": \"1928\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MO\",\n",
      "    \"birthCity\": \"Kirkwood\",\n",
      "    \"deathYear\": \"2002\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IN\",\n",
      "    \"deathCity\": \"Hammond\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alphonse Eugene\",\n",
      "    \"weight\": \"189\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1953-07-10\",\n",
      "    \"finalGame\": \"1964-10-04\",\n",
      "    \"retroID\": \"smita102\",\n",
      "    \"bbrefID\": \"smithal04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithar01\",\n",
      "    \"birthYear\": \"1906\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Boston\",\n",
      "    \"deathYear\": \"1995\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"22\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CT\",\n",
      "    \"deathCity\": \"Norwalk\",\n",
      "    \"nameFirst\": \"Art\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Arthur Laird\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1932-06-09\",\n",
      "    \"finalGame\": \"1932-06-20\",\n",
      "    \"retroID\": \"smita101\",\n",
      "    \"bbrefID\": \"smithar01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbe01\",\n",
      "    \"birthYear\": \"1941\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Ponchatoula\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bernie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Calvin Bernard\",\n",
      "    \"weight\": \"164\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1970-07-31\",\n",
      "    \"finalGame\": \"1971-04-28\",\n",
      "    \"retroID\": \"smitb105\",\n",
      "    \"bbrefID\": \"smithbe01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi01\",\n",
      "    \"birthYear\": \"\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bill\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William J.\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1873-04-14\",\n",
      "    \"finalGame\": \"1873-07-11\",\n",
      "    \"retroID\": \"smitb113\",\n",
      "    \"bbrefID\": \"smithbi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi02\",\n",
      "    \"birthYear\": \"1865\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Cleveland\",\n",
      "    \"deathYear\": \"1886\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"9\",\n",
      "    \"deathCountry\": \"CAN\",\n",
      "    \"deathState\": \"ON\",\n",
      "    \"deathCity\": \"Toronto\",\n",
      "    \"nameFirst\": \"Bill\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William E.\",\n",
      "    \"weight\": \"178\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-09-17\",\n",
      "    \"finalGame\": \"1884-09-17\",\n",
      "    \"retroID\": \"smitb107\",\n",
      "    \"bbrefID\": \"smithbi02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi03\",\n",
      "    \"birthYear\": \"1861\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"New Orleans\",\n",
      "    \"deathYear\": \"1928\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"24\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"LA\",\n",
      "    \"deathCity\": \"New Orleans\",\n",
      "    \"nameFirst\": \"Billy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Frederick William\",\n",
      "    \"weight\": \"152\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1886-07-06\",\n",
      "    \"finalGame\": \"1886-09-13\",\n",
      "    \"retroID\": \"schmb104\",\n",
      "    \"bbrefID\": \"smithbi03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi04\",\n",
      "    \"birthYear\": \"1934\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"8\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"DC\",\n",
      "    \"birthCity\": \"Washington\",\n",
      "    \"deathYear\": \"1997\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"30\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MD\",\n",
      "    \"deathCity\": \"Clinton\",\n",
      "    \"nameFirst\": \"Bill\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William Garland\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1958-09-13\",\n",
      "    \"finalGame\": \"1962-09-28\",\n",
      "    \"retroID\": \"smitb112\",\n",
      "    \"bbrefID\": \"smithbi04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi05\",\n",
      "    \"birthYear\": \"1953\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Hodge\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Billy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Billy Edward\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1975-04-13\",\n",
      "    \"finalGame\": \"1981-09-24\",\n",
      "    \"retroID\": \"smitb101\",\n",
      "    \"bbrefID\": \"smithbi05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi06\",\n",
      "    \"birthYear\": \"1954\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"La Marque\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Billy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Billy Lavern\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"79\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1981-06-09\",\n",
      "    \"finalGame\": \"1981-10-03\",\n",
      "    \"retroID\": \"smitb102\",\n",
      "    \"bbrefID\": \"smithbi06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbl01\",\n",
      "    \"birthYear\": \"1987\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"9\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Modesto\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Blake\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Blake Matthew\",\n",
      "    \"weight\": \"220\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2016-09-10\",\n",
      "    \"finalGame\": \"2016-09-21\",\n",
      "    \"retroID\": \"smitb006\",\n",
      "    \"bbrefID\": \"smithbl01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo01\",\n",
      "    \"birthYear\": \"1890\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"VT\",\n",
      "    \"birthCity\": \"Woodbury\",\n",
      "    \"deathYear\": \"1965\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"27\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"West Los Angeles\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Ashley\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1913-04-19\",\n",
      "    \"finalGame\": \"1915-04-19\",\n",
      "    \"retroID\": \"smitb103\",\n",
      "    \"bbrefID\": \"smithbo01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo02\",\n",
      "    \"birthYear\": \"1895\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"22\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TN\",\n",
      "    \"birthCity\": \"Rogersville\",\n",
      "    \"deathYear\": \"1987\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"19\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"GA\",\n",
      "    \"deathCity\": \"Waycross\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Eldridge\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1923-04-19\",\n",
      "    \"finalGame\": \"1937-08-06\",\n",
      "    \"retroID\": \"smitb110\",\n",
      "    \"bbrefID\": \"smithbo02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo03\",\n",
      "    \"birthYear\": \"1930\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"1\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NH\",\n",
      "    \"birthCity\": \"Woodsville\",\n",
      "    \"deathYear\": \"2013\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"GA\",\n",
      "    \"deathCity\": \"Augusta\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Gilchrist\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1955-04-29\",\n",
      "    \"finalGame\": \"1959-09-23\",\n",
      "    \"retroID\": \"smitb109\",\n",
      "    \"bbrefID\": \"smithbo03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo04\",\n",
      "    \"birthYear\": \"1934\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"28\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OR\",\n",
      "    \"birthCity\": \"Hood River\",\n",
      "    \"deathYear\": \"2015\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"24\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OR\",\n",
      "    \"deathCity\": \"Hood River\",\n",
      "    \"nameFirst\": \"Bobby\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Bobby Gene\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1957-04-16\",\n",
      "    \"finalGame\": \"1965-07-17\",\n",
      "    \"retroID\": \"smitb104\",\n",
      "    \"bbrefID\": \"smithbo04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo05\",\n",
      "    \"birthYear\": \"1928\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MO\",\n",
      "    \"birthCity\": \"Clarence\",\n",
      "    \"deathYear\": \"2003\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"23\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MO\",\n",
      "    \"deathCity\": \"Clarence\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Walkup\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1958-04-22\",\n",
      "    \"finalGame\": \"1959-09-27\",\n",
      "    \"retroID\": \"smitb108\",\n",
      "    \"bbrefID\": \"smithbo05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbo06\",\n",
      "    \"birthYear\": \"1974\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"10\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Oakland\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bob\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Eugene\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1998-03-31\",\n",
      "    \"finalGame\": \"2002-05-06\",\n",
      "    \"retroID\": \"smitr003\",\n",
      "    \"bbrefID\": \"smithbo06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbr01\",\n",
      "    \"birthYear\": \"1955\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Marietta\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bryn\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Bryn Nelson\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1981-09-08\",\n",
      "    \"finalGame\": \"1993-06-01\",\n",
      "    \"retroID\": \"smitb001\",\n",
      "    \"bbrefID\": \"smithbr01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbr02\",\n",
      "    \"birthYear\": \"1959\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Charlotte\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Brick\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Brick Dudley\",\n",
      "    \"weight\": \"225\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1987-09-13\",\n",
      "    \"finalGame\": \"1988-04-23\",\n",
      "    \"retroID\": \"smitb002\",\n",
      "    \"bbrefID\": \"smithbr02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbr03\",\n",
      "    \"birthYear\": \"1972\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Salisbury\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Brian\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Randall Brian\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2000-09-11\",\n",
      "    \"finalGame\": \"2000-09-15\",\n",
      "    \"retroID\": \"smitb003\",\n",
      "    \"bbrefID\": \"smithbr03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbu01\",\n",
      "    \"birthYear\": \"1880\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"WV\",\n",
      "    \"birthCity\": \"Plum\",\n",
      "    \"deathYear\": \"1928\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"WV\",\n",
      "    \"deathCity\": \"Charleston\",\n",
      "    \"nameFirst\": \"Bull\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lewis Oscar\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1904-08-30\",\n",
      "    \"finalGame\": \"1911-08-30\",\n",
      "    \"retroID\": \"smitb111\",\n",
      "    \"bbrefID\": \"smithbu01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbu02\",\n",
      "    \"birthYear\": \"1979\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Torrance\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bud\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Robert Allan\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2001-06-10\",\n",
      "    \"finalGame\": \"2002-07-19\",\n",
      "    \"retroID\": \"smitb004\",\n",
      "    \"bbrefID\": \"smithbu02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbu03\",\n",
      "    \"birthYear\": \"1990\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"San Antonio\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Burch\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Burch Taylor\",\n",
      "    \"weight\": \"225\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2013-05-11\",\n",
      "    \"finalGame\": \"2018-09-28\",\n",
      "    \"retroID\": \"smitb005\",\n",
      "    \"bbrefID\": \"smithbu03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithca01\",\n",
      "    \"birthYear\": \"1901\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"8\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Kernersville\",\n",
      "    \"deathYear\": \"1989\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"14\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Miami\",\n",
      "    \"nameFirst\": \"Carr\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Emanuel Carr\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1923-09-23\",\n",
      "    \"finalGame\": \"1924-06-09\",\n",
      "    \"retroID\": \"smitc103\",\n",
      "    \"bbrefID\": \"smithca01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithca02\",\n",
      "    \"birthYear\": \"1989\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"Midland\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Carson\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Carson Donald\",\n",
      "    \"weight\": \"215\",\n",
      "    \"height\": \"78\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2014-09-01\",\n",
      "    \"finalGame\": \"2018-05-14\",\n",
      "    \"retroID\": \"smitc004\",\n",
      "    \"bbrefID\": \"smithca02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithca03\",\n",
      "    \"birthYear\": \"1991\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"28\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"Huntsville\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Caleb\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Caleb Anthony\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2017-07-17\",\n",
      "    \"finalGame\": \"2018-06-24\",\n",
      "    \"retroID\": \"smitc006\",\n",
      "    \"bbrefID\": \"smithca03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch01\",\n",
      "    \"birthYear\": \"1840\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Brooklyn\",\n",
      "    \"deathYear\": \"1897\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"15\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Great Neck\",\n",
      "    \"nameFirst\": \"Charlie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Charles J.\",\n",
      "    \"weight\": \"150\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1871-05-18\",\n",
      "    \"finalGame\": \"1871-08-01\",\n",
      "    \"retroID\": \"smitc106\",\n",
      "    \"bbrefID\": \"smithch01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch02\",\n",
      "    \"birthYear\": \"1880\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Cleveland\",\n",
      "    \"deathYear\": \"1929\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OH\",\n",
      "    \"deathCity\": \"Wickliffe\",\n",
      "    \"nameFirst\": \"Charlie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Charles Edwin\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1902-08-06\",\n",
      "    \"finalGame\": \"1914-09-19\",\n",
      "    \"retroID\": \"smitc107\",\n",
      "    \"bbrefID\": \"smithch02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch03\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KY\",\n",
      "    \"birthCity\": \"Dayton\",\n",
      "    \"deathYear\": \"1935\",\n",
      "    \"deathMonth\": \"10\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"KY\",\n",
      "    \"deathCity\": \"Dayton\",\n",
      "    \"nameFirst\": \"Chick\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John William\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1913-04-12\",\n",
      "    \"finalGame\": \"1913-05-21\",\n",
      "    \"retroID\": \"smitc102\",\n",
      "    \"bbrefID\": \"smithch03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch04\",\n",
      "    \"birthYear\": \"1937\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"SC\",\n",
      "    \"birthCity\": \"Charleston\",\n",
      "    \"deathYear\": \"1994\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"29\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NV\",\n",
      "    \"deathCity\": \"Reno\",\n",
      "    \"nameFirst\": \"Charley\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Charles William\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1960-09-08\",\n",
      "    \"finalGame\": \"1969-04-22\",\n",
      "    \"retroID\": \"smitc105\",\n",
      "    \"bbrefID\": \"smithch04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch05\",\n",
      "    \"birthYear\": \"1957\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"18\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Torrance\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Chris\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Christopher William\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1981-05-14\",\n",
      "    \"finalGame\": \"1983-10-02\",\n",
      "    \"retroID\": \"smitc101\",\n",
      "    \"bbrefID\": \"smithch05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch06\",\n",
      "    \"birthYear\": \"1969\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TN\",\n",
      "    \"birthCity\": \"Memphis\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Chuck\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Charles Edward\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2000-06-13\",\n",
      "    \"finalGame\": \"2001-07-24\",\n",
      "    \"retroID\": \"smitc001\",\n",
      "    \"bbrefID\": \"smithch07\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch07\",\n",
      "    \"birthYear\": \"1981\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"9\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Apple Valley\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Chris\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Christopher Michael\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2008-06-21\",\n",
      "    \"finalGame\": \"2017-09-30\",\n",
      "    \"retroID\": \"smitc002\",\n",
      "    \"bbrefID\": \"smithch08\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch08\",\n",
      "    \"birthYear\": \"1989\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Thousand Oaks\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Chad\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Chad Dennis\",\n",
      "    \"weight\": \"220\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2014-06-22\",\n",
      "    \"finalGame\": \"2015-05-06\",\n",
      "    \"retroID\": \"smitc003\",\n",
      "    \"bbrefID\": \"smithch09\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithch09\",\n",
      "    \"birthYear\": \"1988\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KY\",\n",
      "    \"birthCity\": \"Louisville\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Chris\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Christopher Patrick\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2017-06-27\",\n",
      "    \"finalGame\": \"2017-07-28\",\n",
      "    \"retroID\": \"smitc005\",\n",
      "    \"bbrefID\": \"smithch10\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithcl01\",\n",
      "    \"birthYear\": \"1914\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KS\",\n",
      "    \"birthCity\": \"Cambridge\",\n",
      "    \"deathYear\": \"2002\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"5\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"KS\",\n",
      "    \"deathCity\": \"Winfield\",\n",
      "    \"nameFirst\": \"Clay\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Clay Jamieson\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1938-09-13\",\n",
      "    \"finalGame\": \"1940-09-22\",\n",
      "    \"retroID\": \"smitc104\",\n",
      "    \"bbrefID\": \"smithcl01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda01\",\n",
      "    \"birthYear\": \"1914\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"17\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"SC\",\n",
      "    \"birthCity\": \"Sellers\",\n",
      "    \"deathYear\": \"1998\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NC\",\n",
      "    \"deathCity\": \"Whiteville\",\n",
      "    \"nameFirst\": \"Dave\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"David Merwin\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1938-06-16\",\n",
      "    \"finalGame\": \"1939-04-23\",\n",
      "    \"retroID\": \"smitd105\",\n",
      "    \"bbrefID\": \"smithda01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda02\",\n",
      "    \"birthYear\": \"1955\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Richmond\",\n",
      "    \"deathYear\": \"2008\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"17\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Diego\",\n",
      "    \"nameFirst\": \"Dave\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"David Stanley\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1980-04-11\",\n",
      "    \"finalGame\": \"1992-06-08\",\n",
      "    \"retroID\": \"smitd001\",\n",
      "    \"bbrefID\": \"smithda02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda03\",\n",
      "    \"birthYear\": \"1957\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"30\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"Tomball\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dave\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"David Wayne\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1984-09-18\",\n",
      "    \"finalGame\": \"1985-09-14\",\n",
      "    \"retroID\": \"smitd002\",\n",
      "    \"bbrefID\": \"smithda03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda04\",\n",
      "    \"birthYear\": \"1960\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"29\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dar\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Daryl Clinton\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1990-09-18\",\n",
      "    \"finalGame\": \"1990-10-03\",\n",
      "    \"retroID\": \"smitd004\",\n",
      "    \"bbrefID\": \"smithda04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda05\",\n",
      "    \"birthYear\": \"1969\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MN\",\n",
      "    \"birthCity\": \"St. Paul\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dan\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Daniel Scott\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1992-09-12\",\n",
      "    \"finalGame\": \"1994-07-08\",\n",
      "    \"retroID\": \"smitd005\",\n",
      "    \"bbrefID\": \"smithda05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithda06\",\n",
      "    \"birthYear\": \"1975\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NJ\",\n",
      "    \"birthCity\": \"Flemington\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dan\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Daniel Charles\",\n",
      "    \"weight\": \"210\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1999-06-08\",\n",
      "    \"finalGame\": \"2003-06-25\",\n",
      "    \"retroID\": \"smitd006\",\n",
      "    \"bbrefID\": \"smithda07\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdi01\",\n",
      "    \"birthYear\": \"1927\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Blandburg\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dick\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Richard Harrison\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1951-09-14\",\n",
      "    \"finalGame\": \"1955-05-01\",\n",
      "    \"retroID\": \"smitd103\",\n",
      "    \"bbrefID\": \"smithdi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdi02\",\n",
      "    \"birthYear\": \"1939\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"17\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OR\",\n",
      "    \"birthCity\": \"Lebanon\",\n",
      "    \"deathYear\": \"2012\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"19\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OR\",\n",
      "    \"deathCity\": \"Medford\",\n",
      "    \"nameFirst\": \"Dick\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Richard Arthur\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1963-07-20\",\n",
      "    \"finalGame\": \"1965-05-02\",\n",
      "    \"retroID\": \"smitd104\",\n",
      "    \"bbrefID\": \"smithdi02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdi03\",\n",
      "    \"birthYear\": \"1944\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"25\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Lincolnton\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dick\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Richard Kelly\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1969-08-20\",\n",
      "    \"finalGame\": \"1969-09-27\",\n",
      "    \"retroID\": \"smitd102\",\n",
      "    \"bbrefID\": \"smithdi03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdo01\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"25\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Millers Falls\",\n",
      "    \"deathYear\": \"1973\",\n",
      "    \"deathMonth\": \"9\",\n",
      "    \"deathDay\": \"18\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MA\",\n",
      "    \"deathCity\": \"Greenfield\",\n",
      "    \"nameFirst\": \"Doug\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Douglass Weldon\",\n",
      "    \"weight\": \"168\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1912-07-10\",\n",
      "    \"finalGame\": \"1912-07-10\",\n",
      "    \"retroID\": \"smitd101\",\n",
      "    \"bbrefID\": \"smithdo01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdo02\",\n",
      "    \"birthYear\": \"1995\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Los Angeles\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dominic\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Dominic David Rene\",\n",
      "    \"weight\": \"239\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2017-08-11\",\n",
      "    \"finalGame\": \"2018-09-30\",\n",
      "    \"retroID\": \"smitd008\",\n",
      "    \"bbrefID\": \"smithdo02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdr01\",\n",
      "    \"birthYear\": \"1993\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"Fort Worth\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Drew\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Andrew David\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2018-06-23\",\n",
      "    \"finalGame\": \"2018-09-29\",\n",
      "    \"retroID\": \"smitd009\",\n",
      "    \"bbrefID\": \"smithdr01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdw01\",\n",
      "    \"birthYear\": \"1963\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"8\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"Tallahassee\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dwight\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Dwight\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1989-05-01\",\n",
      "    \"finalGame\": \"1996-09-29\",\n",
      "    \"retroID\": \"smitd003\",\n",
      "    \"bbrefID\": \"smithdw01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithdw02\",\n",
      "    \"birthYear\": \"1992\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"26\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Peachtree City\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Dwight\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Dwight\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2017-05-18\",\n",
      "    \"finalGame\": \"2018-09-30\",\n",
      "    \"retroID\": \"smitd007\",\n",
      "    \"bbrefID\": \"smithdw02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithea01\",\n",
      "    \"birthYear\": \"1891\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Oak Hill\",\n",
      "    \"deathYear\": \"1943\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"13\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OH\",\n",
      "    \"deathCity\": \"Portsmouth\",\n",
      "    \"nameFirst\": \"Earl\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Earl Leonard\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1916-09-10\",\n",
      "    \"finalGame\": \"1922-08-06\",\n",
      "    \"retroID\": \"smite107\",\n",
      "    \"bbrefID\": \"smithea01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithea02\",\n",
      "    \"birthYear\": \"1897\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"AR\",\n",
      "    \"birthCity\": \"Sheridan\",\n",
      "    \"deathYear\": \"1963\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"8\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"AR\",\n",
      "    \"deathCity\": \"Little Rock\",\n",
      "    \"nameFirst\": \"Earl\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Earl Sutton\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1919-04-24\",\n",
      "    \"finalGame\": \"1930-09-28\",\n",
      "    \"retroID\": \"smite106\",\n",
      "    \"bbrefID\": \"smithea02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithea03\",\n",
      "    \"birthYear\": \"1928\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"WA\",\n",
      "    \"birthCity\": \"Sunnyside\",\n",
      "    \"deathYear\": \"2014\",\n",
      "    \"deathMonth\": \"9\",\n",
      "    \"deathDay\": \"27\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"Fresno\",\n",
      "    \"nameFirst\": \"Earl\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Earl Calvin\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1955-04-14\",\n",
      "    \"finalGame\": \"1955-04-29\",\n",
      "    \"retroID\": \"smite108\",\n",
      "    \"bbrefID\": \"smithea03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithed01\",\n",
      "    \"birthYear\": \"1862\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"RI\",\n",
      "    \"birthCity\": \"Providence\",\n",
      "    \"deathYear\": \"1892\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"RI\",\n",
      "    \"deathCity\": \"Providence\",\n",
      "    \"nameFirst\": \"Edgar\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Edgar Eugene\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1883-05-25\",\n",
      "    \"finalGame\": \"1890-08-12\",\n",
      "    \"retroID\": \"smite101\",\n",
      "    \"bbrefID\": \"smithed01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithed02\",\n",
      "    \"birthYear\": \"1860\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CT\",\n",
      "    \"birthCity\": \"North Haven\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Edgar\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Albert Edward\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1883-06-20\",\n",
      "    \"finalGame\": \"1883-09-29\",\n",
      "    \"retroID\": \"smite109\",\n",
      "    \"bbrefID\": \"smithed02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithed03\",\n",
      "    \"birthYear\": \"1879\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IN\",\n",
      "    \"birthCity\": \"Mentone\",\n",
      "    \"deathYear\": \"1956\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"20\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Tarpon Springs\",\n",
      "    \"nameFirst\": \"Ed\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Rhesa Edward\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1906-04-27\",\n",
      "    \"finalGame\": \"1906-10-07\",\n",
      "    \"retroID\": \"smite102\",\n",
      "    \"bbrefID\": \"smithed03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithed04\",\n",
      "    \"birthYear\": \"1913\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NJ\",\n",
      "    \"birthCity\": \"Mansfield\",\n",
      "    \"deathYear\": \"1994\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"2\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NJ\",\n",
      "    \"deathCity\": \"Willingboro\",\n",
      "    \"nameFirst\": \"Eddie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Edgar\",\n",
      "    \"weight\": \"174\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1936-09-20\",\n",
      "    \"finalGame\": \"1947-09-20\",\n",
      "    \"retroID\": \"smite105\",\n",
      "    \"bbrefID\": \"smithed04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithed05\",\n",
      "    \"birthYear\": \"1863\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"CAN\",\n",
      "    \"birthState\": \"ON\",\n",
      "    \"birthCity\": \"Sparta\",\n",
      "    \"deathYear\": \"1948\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"5\",\n",
      "    \"deathCountry\": \"CAN\",\n",
      "    \"deathState\": \"ON\",\n",
      "    \"deathCity\": \"St. Thomas\",\n",
      "    \"nameFirst\": \"Ed\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Edgar Alexander\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-04-18\",\n",
      "    \"finalGame\": \"1884-05-22\",\n",
      "    \"retroID\": \"smite110\",\n",
      "    \"bbrefID\": \"smithed05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithel01\",\n",
      "    \"birthYear\": \"1868\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"1945\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"Pittsburgh\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Elmer Ellsworth\",\n",
      "    \"weight\": \"178\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1886-09-10\",\n",
      "    \"finalGame\": \"1901-06-15\",\n",
      "    \"retroID\": \"smitm104\",\n",
      "    \"bbrefID\": \"smithel01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithel02\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Erie County\",\n",
      "    \"deathYear\": \"1984\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"KY\",\n",
      "    \"deathCity\": \"Columbia\",\n",
      "    \"nameFirst\": \"Elmer\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Elmer John\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1914-09-20\",\n",
      "    \"finalGame\": \"1925-09-27\",\n",
      "    \"retroID\": \"smite104\",\n",
      "    \"bbrefID\": \"smithel02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smither01\",\n",
      "    \"birthYear\": \"1899\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NJ\",\n",
      "    \"birthCity\": \"Totowa\",\n",
      "    \"deathYear\": \"1973\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"6\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Brooklyn\",\n",
      "    \"nameFirst\": \"Ernie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Ernest Henry\",\n",
      "    \"weight\": \"155\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1930-04-17\",\n",
      "    \"finalGame\": \"1930-05-22\",\n",
      "    \"retroID\": \"smite103\",\n",
      "    \"bbrefID\": \"smither01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr01\",\n",
      "    \"birthYear\": \"1857\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"CAN\",\n",
      "    \"birthState\": \"ON\",\n",
      "    \"birthCity\": \"Fonthill\",\n",
      "    \"deathYear\": \"1928\",\n",
      "    \"deathMonth\": \"10\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Canandaigua\",\n",
      "    \"nameFirst\": \"Frank\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Frank L.\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-08-06\",\n",
      "    \"finalGame\": \"1884-10-03\",\n",
      "    \"retroID\": \"smitf105\",\n",
      "    \"bbrefID\": \"smithfr01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr02\",\n",
      "    \"birthYear\": \"1865\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"1926\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"19\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IL\",\n",
      "    \"deathCity\": \"Chicago\",\n",
      "    \"nameFirst\": \"Fred\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Fred Christopher\",\n",
      "    \"weight\": \"156\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1890-04-18\",\n",
      "    \"finalGame\": \"1890-10-12\",\n",
      "    \"retroID\": \"smitf101\",\n",
      "    \"bbrefID\": \"smithfr02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr03\",\n",
      "    \"birthYear\": \"1879\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"28\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"1952\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"Pittsburgh\",\n",
      "    \"nameFirst\": \"Frank\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Frank Elmer\",\n",
      "    \"weight\": \"194\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1904-04-22\",\n",
      "    \"finalGame\": \"1915-09-30\",\n",
      "    \"retroID\": \"smitf106\",\n",
      "    \"bbrefID\": \"smithfr03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr04\",\n",
      "    \"birthYear\": \"1878\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"WI\",\n",
      "    \"birthCity\": \"New Diggings\",\n",
      "    \"deathYear\": \"1964\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"4\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"Los Angeles\",\n",
      "    \"nameFirst\": \"Fred\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Frederick\",\n",
      "    \"weight\": \"186\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1907-06-14\",\n",
      "    \"finalGame\": \"1907-09-21\",\n",
      "    \"retroID\": \"smitf102\",\n",
      "    \"bbrefID\": \"smithfr04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr05\",\n",
      "    \"birthYear\": \"1891\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"29\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Cleveland\",\n",
      "    \"deathYear\": \"1961\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"28\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OH\",\n",
      "    \"deathCity\": \"Cleveland\",\n",
      "    \"nameFirst\": \"Fred\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Fred Vincent\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1913-04-17\",\n",
      "    \"finalGame\": \"1917-09-30\",\n",
      "    \"retroID\": \"smitf103\",\n",
      "    \"bbrefID\": \"smithfr05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithfr06\",\n",
      "    \"birthYear\": \"1928\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Pierrepont Manor\",\n",
      "    \"deathYear\": \"2005\",\n",
      "    \"deathMonth\": \"9\",\n",
      "    \"deathDay\": \"24\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Malone\",\n",
      "    \"nameFirst\": \"Frank\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Frank Thomas\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1950-04-18\",\n",
      "    \"finalGame\": \"1956-05-13\",\n",
      "    \"retroID\": \"smitf104\",\n",
      "    \"bbrefID\": \"smithfr06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithge01\",\n",
      "    \"birthYear\": \"1859\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"1927\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"Altoona\",\n",
      "    \"nameFirst\": \"Germany\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"George J.\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1884-04-17\",\n",
      "    \"finalGame\": \"1898-10-09\",\n",
      "    \"retroID\": \"smitg103\",\n",
      "    \"bbrefID\": \"smithge01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithge02\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"31\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CT\",\n",
      "    \"birthCity\": \"East Port Chester\",\n",
      "    \"deathYear\": \"1965\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"7\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CT\",\n",
      "    \"deathCity\": \"Greenwich\",\n",
      "    \"nameFirst\": \"George\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"George Allen\",\n",
      "    \"weight\": \"163\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1916-08-09\",\n",
      "    \"finalGame\": \"1923-09-21\",\n",
      "    \"retroID\": \"smitg104\",\n",
      "    \"bbrefID\": \"smithge02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithge03\",\n",
      "    \"birthYear\": \"1901\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KY\",\n",
      "    \"birthCity\": \"Louisville\",\n",
      "    \"deathYear\": \"1981\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"26\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"VA\",\n",
      "    \"deathCity\": \"Richmond\",\n",
      "    \"nameFirst\": \"George\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"George Shelby\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1926-04-21\",\n",
      "    \"finalGame\": \"1930-09-17\",\n",
      "    \"retroID\": \"smitg102\",\n",
      "    \"bbrefID\": \"smithge03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithge04\",\n",
      "    \"birthYear\": \"1937\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"St. Petersburg\",\n",
      "    \"deathYear\": \"1987\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"15\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"St. Petersburg\",\n",
      "    \"nameFirst\": \"George\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"George Cornelius\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1963-08-04\",\n",
      "    \"finalGame\": \"1966-09-17\",\n",
      "    \"retroID\": \"smitg101\",\n",
      "    \"bbrefID\": \"smithge04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithgr01\",\n",
      "    \"birthYear\": \"1967\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"5\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Greg\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Gregory Alan\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1989-09-02\",\n",
      "    \"finalGame\": \"1991-05-24\",\n",
      "    \"retroID\": \"smitg001\",\n",
      "    \"bbrefID\": \"smithgr01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithgr02\",\n",
      "    \"birthYear\": \"1983\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"22\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Alexandria\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Greg\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Gregory Thomas\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2008-04-09\",\n",
      "    \"finalGame\": \"2010-05-19\",\n",
      "    \"retroID\": \"smitg002\",\n",
      "    \"bbrefID\": \"smithgr02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha01\",\n",
      "    \"birthYear\": \"1856\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"5\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IN\",\n",
      "    \"birthCity\": \"North Vernon\",\n",
      "    \"deathYear\": \"1898\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"4\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IN\",\n",
      "    \"deathCity\": \"Queensville\",\n",
      "    \"nameFirst\": \"Harry\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harry W.\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1877-05-08\",\n",
      "    \"finalGame\": \"1889-08-19\",\n",
      "    \"retroID\": \"smith103\",\n",
      "    \"bbrefID\": \"smithha01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha02\",\n",
      "    \"birthYear\": \"1871\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Union Deposit\",\n",
      "    \"deathYear\": \"1962\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"12\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"Harrisburg\",\n",
      "    \"nameFirst\": \"Harvey\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harvey Fetterhoff\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1896-08-19\",\n",
      "    \"finalGame\": \"1896-09-26\",\n",
      "    \"retroID\": \"smith102\",\n",
      "    \"bbrefID\": \"smithha02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha03\",\n",
      "    \"birthYear\": \"1874\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"31\",\n",
      "    \"birthCountry\": \"United Kingdom\",\n",
      "    \"birthState\": \"Yorkshire\",\n",
      "    \"birthCity\": \"\",\n",
      "    \"deathYear\": \"1933\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"17\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NJ\",\n",
      "    \"deathCity\": \"Salem\",\n",
      "    \"nameFirst\": \"Harry\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harry Thomas\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1901-07-11\",\n",
      "    \"finalGame\": \"1910-09-15\",\n",
      "    \"retroID\": \"smith104\",\n",
      "    \"bbrefID\": \"smithha03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha04\",\n",
      "    \"birthYear\": \"1883\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OR\",\n",
      "    \"birthCity\": \"Coquille\",\n",
      "    \"deathYear\": \"1961\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"26\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Jose\",\n",
      "    \"nameFirst\": \"Happy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Henry Joseph\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1910-04-15\",\n",
      "    \"finalGame\": \"1910-07-22\",\n",
      "    \"retroID\": \"smith101\",\n",
      "    \"bbrefID\": \"smithha04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha05\",\n",
      "    \"birthYear\": \"1889\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NE\",\n",
      "    \"birthCity\": \"Union\",\n",
      "    \"deathYear\": \"1964\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"26\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NE\",\n",
      "    \"deathCity\": \"Dunbar\",\n",
      "    \"nameFirst\": \"Harry\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harrison Morton\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1912-10-06\",\n",
      "    \"finalGame\": \"1912-10-06\",\n",
      "    \"retroID\": \"smith105\",\n",
      "    \"bbrefID\": \"smithha05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha06\",\n",
      "    \"birthYear\": \"1890\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Brooklyn\",\n",
      "    \"deathYear\": \"1922\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NC\",\n",
      "    \"deathCity\": \"Charlotte\",\n",
      "    \"nameFirst\": \"Harry\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"James Harry\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1914-09-21\",\n",
      "    \"finalGame\": \"1918-06-23\",\n",
      "    \"retroID\": \"smith107\",\n",
      "    \"bbrefID\": \"smithha06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha07\",\n",
      "    \"birthYear\": \"1902\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"30\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IA\",\n",
      "    \"birthCity\": \"Creston\",\n",
      "    \"deathYear\": \"1992\",\n",
      "    \"deathMonth\": \"9\",\n",
      "    \"deathDay\": \"27\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Fort Lauderdale\",\n",
      "    \"nameFirst\": \"Hal\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harold Laverne\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1932-09-14\",\n",
      "    \"finalGame\": \"1935-04-18\",\n",
      "    \"retroID\": \"smith109\",\n",
      "    \"bbrefID\": \"smithha07\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha08\",\n",
      "    \"birthYear\": \"1930\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"West Frankfort\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Hal\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harold Wayne\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1955-04-11\",\n",
      "    \"finalGame\": \"1964-07-22\",\n",
      "    \"retroID\": \"smith106\",\n",
      "    \"bbrefID\": \"smithha08\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithha09\",\n",
      "    \"birthYear\": \"1931\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"1\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"AR\",\n",
      "    \"birthCity\": \"Barling\",\n",
      "    \"deathYear\": \"2014\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"12\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"AR\",\n",
      "    \"deathCity\": \"Fort Smith\",\n",
      "    \"nameFirst\": \"Hal\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Harold Raymond\",\n",
      "    \"weight\": \"186\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1956-05-02\",\n",
      "    \"finalGame\": \"1965-07-08\",\n",
      "    \"retroID\": \"smith108\",\n",
      "    \"bbrefID\": \"smithha09\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithhe01\",\n",
      "    \"birthYear\": \"1871\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"1939\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"25\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Buffalo\",\n",
      "    \"nameFirst\": \"Heinie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"George Henry\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1897-09-01\",\n",
      "    \"finalGame\": \"1903-08-16\",\n",
      "    \"retroID\": \"smith110\",\n",
      "    \"bbrefID\": \"smithhe01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithhi99\",\n",
      "    \"birthYear\": \"1907\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"Giddings\",\n",
      "    \"deathYear\": \"1983\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"18\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MO\",\n",
      "    \"deathCity\": \"Kansas City\",\n",
      "    \"nameFirst\": \"Hilton\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Hilton Lee\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"\",\n",
      "    \"finalGame\": \"\",\n",
      "    \"retroID\": \"\",\n",
      "    \"bbrefID\": \"smithhi99\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja01\",\n",
      "    \"birthYear\": \"1887\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"10\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Dravosburg\",\n",
      "    \"deathYear\": \"1948\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"7\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"East McKeesport\",\n",
      "    \"nameFirst\": \"Jake\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jacob John\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1911-10-03\",\n",
      "    \"finalGame\": \"1911-10-09\",\n",
      "    \"retroID\": \"smitj108\",\n",
      "    \"bbrefID\": \"smithja01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja02\",\n",
      "    \"birthYear\": \"1893\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"8\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Oswayo\",\n",
      "    \"deathYear\": \"1962\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"4\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"New York\",\n",
      "    \"nameFirst\": \"Jack\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Joseph\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1912-05-18\",\n",
      "    \"finalGame\": \"1912-05-18\",\n",
      "    \"retroID\": \"smitj102\",\n",
      "    \"bbrefID\": \"smithja02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja03\",\n",
      "    \"birthYear\": \"1895\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Chicago\",\n",
      "    \"deathYear\": \"1972\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"2\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IL\",\n",
      "    \"deathCity\": \"Westchester\",\n",
      "    \"nameFirst\": \"Jack\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jack\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1915-09-30\",\n",
      "    \"finalGame\": \"1929-05-23\",\n",
      "    \"retroID\": \"smitj106\",\n",
      "    \"bbrefID\": \"smithja03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja04\",\n",
      "    \"birthYear\": \"1935\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KY\",\n",
      "    \"birthCity\": \"Pikeville\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Jack\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jack Hatfield\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1962-09-10\",\n",
      "    \"finalGame\": \"1964-06-21\",\n",
      "    \"retroID\": \"smitj109\",\n",
      "    \"bbrefID\": \"smithja04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja05\",\n",
      "    \"birthYear\": \"1977\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MS\",\n",
      "    \"birthCity\": \"Meridian\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Jason\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jason William\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2001-06-17\",\n",
      "    \"finalGame\": \"2009-05-21\",\n",
      "    \"retroID\": \"smitj001\",\n",
      "    \"bbrefID\": \"smithja05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithja06\",\n",
      "    \"birthYear\": \"1990\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"SC\",\n",
      "    \"birthCity\": \"North Augusta\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Jake\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jacob Matthew\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2016-09-07\",\n",
      "    \"finalGame\": \"2016-09-29\",\n",
      "    \"retroID\": \"smitj005\",\n",
      "    \"bbrefID\": \"smithja06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithji01\",\n",
      "    \"birthYear\": \"1895\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"1974\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"1\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"PA\",\n",
      "    \"deathCity\": \"Pittsburgh\",\n",
      "    \"nameFirst\": \"Jimmy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"James Lawrence\",\n",
      "    \"weight\": \"152\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1914-09-26\",\n",
      "    \"finalGame\": \"1922-09-03\",\n",
      "    \"retroID\": \"smitj107\",\n",
      "    \"bbrefID\": \"smithji01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithji02\",\n",
      "    \"birthYear\": \"1954\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"8\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Santa Monica\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Jim\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"James Lorne\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1982-04-12\",\n",
      "    \"finalGame\": \"1982-09-28\",\n",
      "    \"retroID\": \"smitj101\",\n",
      "    \"bbrefID\": \"smithji02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo01\",\n",
      "    \"birthYear\": \"\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"John\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1873-04-14\",\n",
      "    \"finalGame\": \"1875-05-21\",\n",
      "    \"retroID\": \"smitj105\",\n",
      "    \"bbrefID\": \"smithjo01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo02\",\n",
      "    \"birthYear\": \"1858\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"New York\",\n",
      "    \"deathYear\": \"1899\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"6\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Francisco\",\n",
      "    \"nameFirst\": \"John\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Joseph\",\n",
      "    \"weight\": \"210\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1882-05-01\",\n",
      "    \"finalGame\": \"1882-09-27\",\n",
      "    \"retroID\": \"smitj104\",\n",
      "    \"bbrefID\": \"smithjo02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo03\",\n",
      "    \"birthYear\": \"1893\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"29\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"New York\",\n",
      "    \"deathYear\": \"1974\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"12\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Yonkers\",\n",
      "    \"nameFirst\": \"Joe\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Salvatore Joseph\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"67\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1913-07-07\",\n",
      "    \"finalGame\": \"1913-09-27\",\n",
      "    \"retroID\": \"smitj111\",\n",
      "    \"bbrefID\": \"smithjo03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo04\",\n",
      "    \"birthYear\": \"1906\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"DC\",\n",
      "    \"birthCity\": \"Washington\",\n",
      "    \"deathYear\": \"1982\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"9\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MD\",\n",
      "    \"deathCity\": \"Silver Spring\",\n",
      "    \"nameFirst\": \"John\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Marshall\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1931-09-17\",\n",
      "    \"finalGame\": \"1931-09-18\",\n",
      "    \"retroID\": \"smitj110\",\n",
      "    \"bbrefID\": \"smithjo04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo05\",\n",
      "    \"birthYear\": \"1984\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"22\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Cincinnati\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Joe\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Joseph Michael\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2007-04-01\",\n",
      "    \"finalGame\": \"2018-09-29\",\n",
      "    \"retroID\": \"smitj002\",\n",
      "    \"bbrefID\": \"smithjo05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo06\",\n",
      "    \"birthYear\": \"1986\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"UT\",\n",
      "    \"birthCity\": \"American Fork\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Jordan\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Jordan L.\",\n",
      "    \"weight\": \"220\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2010-06-15\",\n",
      "    \"finalGame\": \"2011-05-22\",\n",
      "    \"retroID\": \"smitj003\",\n",
      "    \"bbrefID\": \"smithjo06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithjo07\",\n",
      "    \"birthYear\": \"1987\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"Margate\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Josh\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Joshua Allen\",\n",
      "    \"weight\": \"220\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2015-06-23\",\n",
      "    \"finalGame\": \"2017-08-14\",\n",
      "    \"retroID\": \"smitj004\",\n",
      "    \"bbrefID\": \"smithjo07\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithju01\",\n",
      "    \"birthYear\": \"1869\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MI\",\n",
      "    \"birthCity\": \"Green Oak\",\n",
      "    \"deathYear\": \"1947\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"7\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"Los Angeles\",\n",
      "    \"nameFirst\": \"Jud\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Judson Grant\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1893-05-21\",\n",
      "    \"finalGame\": \"1901-09-15\",\n",
      "    \"retroID\": \"smitj103\",\n",
      "    \"bbrefID\": \"smithju01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithke01\",\n",
      "    \"birthYear\": \"1953\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"3\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"Palmetto\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Keith\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Keith Lavarne\",\n",
      "    \"weight\": \"178\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1977-08-02\",\n",
      "    \"finalGame\": \"1980-10-05\",\n",
      "    \"retroID\": \"smitk101\",\n",
      "    \"bbrefID\": \"smithke01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithke02\",\n",
      "    \"birthYear\": \"1958\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Youngstown\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Ken\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Kenneth Earl\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1981-09-22\",\n",
      "    \"finalGame\": \"1983-06-14\",\n",
      "    \"retroID\": \"smitk102\",\n",
      "    \"bbrefID\": \"smithke02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithke03\",\n",
      "    \"birthYear\": \"1961\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"20\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Los Angeles\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Keith\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Patrick Keith\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1984-04-12\",\n",
      "    \"finalGame\": \"1985-10-05\",\n",
      "    \"retroID\": \"smitk001\",\n",
      "    \"bbrefID\": \"smithke03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithke04\",\n",
      "    \"birthYear\": \"1988\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"28\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Pittsburgh\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Kevan\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Kevan Alan\",\n",
      "    \"weight\": \"230\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2016-09-01\",\n",
      "    \"finalGame\": \"2018-09-29\",\n",
      "    \"retroID\": \"smitk002\",\n",
      "    \"bbrefID\": \"smithke04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithkl01\",\n",
      "    \"birthYear\": \"1887\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"United Kingdom\",\n",
      "    \"birthState\": \"London\",\n",
      "    \"birthCity\": \"London\",\n",
      "    \"deathYear\": \"1959\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"15\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MA\",\n",
      "    \"deathCity\": \"Springfield\",\n",
      "    \"nameFirst\": \"Klondike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Armstrong Frederick\",\n",
      "    \"weight\": \"160\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1912-09-28\",\n",
      "    \"finalGame\": \"1912-10-05\",\n",
      "    \"retroID\": \"smitk103\",\n",
      "    \"bbrefID\": \"smithkl01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithl01\",\n",
      "    \"birthYear\": \"1858\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"1899\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"14\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MD\",\n",
      "    \"deathCity\": \"Baltimore\",\n",
      "    \"nameFirst\": \"Lewis\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lewis J.\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1882-09-07\",\n",
      "    \"finalGame\": \"1882-09-07\",\n",
      "    \"retroID\": \"smitl102\",\n",
      "    \"bbrefID\": \"smithl.01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithle01\",\n",
      "    \"birthYear\": \"1859\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Brooklyn\",\n",
      "    \"deathYear\": \"1935\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"30\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"Brooklyn\",\n",
      "    \"nameFirst\": \"Leo\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lionel H.\",\n",
      "    \"weight\": \"142\",\n",
      "    \"height\": \"66\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1890-08-28\",\n",
      "    \"finalGame\": \"1890-10-15\",\n",
      "    \"retroID\": \"smitl101\",\n",
      "    \"bbrefID\": \"smithle01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithle02\",\n",
      "    \"birthYear\": \"1957\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Jamestown\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Lee\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lee Arthur\",\n",
      "    \"weight\": \"220\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1980-09-01\",\n",
      "    \"finalGame\": \"1997-07-02\",\n",
      "    \"retroID\": \"smitl001\",\n",
      "    \"bbrefID\": \"smithle02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithlo01\",\n",
      "    \"birthYear\": \"1955\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"22\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Chicago\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Lonnie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lonnie\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1978-09-02\",\n",
      "    \"finalGame\": \"1994-08-10\",\n",
      "    \"retroID\": \"smitl002\",\n",
      "    \"bbrefID\": \"smithlo01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithma01\",\n",
      "    \"birthYear\": \"1915\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"17\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MO\",\n",
      "    \"birthCity\": \"New London\",\n",
      "    \"deathYear\": \"1977\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"24\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Boynton Beach\",\n",
      "    \"nameFirst\": \"Mayo\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Edward Mayo\",\n",
      "    \"weight\": \"183\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1945-06-24\",\n",
      "    \"finalGame\": \"1945-09-27\",\n",
      "    \"retroID\": \"smitm105\",\n",
      "    \"bbrefID\": \"smithma01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithma02\",\n",
      "    \"birthYear\": \"1955\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"VA\",\n",
      "    \"birthCity\": \"Alexandria\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mark\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Mark Christopher\",\n",
      "    \"weight\": \"215\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1983-08-12\",\n",
      "    \"finalGame\": \"1983-10-02\",\n",
      "    \"retroID\": \"smitm101\",\n",
      "    \"bbrefID\": \"smithma02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithma03\",\n",
      "    \"birthYear\": \"1970\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Pasadena\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mark\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Mark Edward\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1994-05-14\",\n",
      "    \"finalGame\": \"2003-09-28\",\n",
      "    \"retroID\": \"smitm004\",\n",
      "    \"bbrefID\": \"smithma03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithma04\",\n",
      "    \"birthYear\": \"1979\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"15\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NV\",\n",
      "    \"birthCity\": \"Las Vegas\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Matt\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Matthew Joel\",\n",
      "    \"weight\": \"225\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2006-04-14\",\n",
      "    \"finalGame\": \"2007-04-25\",\n",
      "    \"retroID\": \"smitm006\",\n",
      "    \"bbrefID\": \"smithma04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithma05\",\n",
      "    \"birthYear\": \"1993\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"6\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"Tallahassee\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mallex\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Mallex Lydell\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2016-04-11\",\n",
      "    \"finalGame\": \"2018-09-30\",\n",
      "    \"retroID\": \"smitm007\",\n",
      "    \"bbrefID\": \"smithma05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmi01\",\n",
      "    \"birthYear\": \"1904\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"16\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"VA\",\n",
      "    \"birthCity\": \"Norfolk\",\n",
      "    \"deathYear\": \"1981\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"31\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"VA\",\n",
      "    \"deathCity\": \"Chesapeake\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Elwood Hope\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1926-09-04\",\n",
      "    \"finalGame\": \"1926-09-20\",\n",
      "    \"retroID\": \"smitm103\",\n",
      "    \"bbrefID\": \"smithmi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmi02\",\n",
      "    \"birthYear\": \"1929\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Columbus\",\n",
      "    \"deathYear\": \"1997\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Diego\",\n",
      "    \"nameFirst\": \"Milt\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Milton\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1955-07-21\",\n",
      "    \"finalGame\": \"1955-09-25\",\n",
      "    \"retroID\": \"smitm102\",\n",
      "    \"bbrefID\": \"smithmi02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmi04\",\n",
      "    \"birthYear\": \"1961\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MS\",\n",
      "    \"birthCity\": \"Jackson\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Michael Anthony\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1984-04-06\",\n",
      "    \"finalGame\": \"1989-09-30\",\n",
      "    \"retroID\": \"smitm001\",\n",
      "    \"bbrefID\": \"smithmi04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmi05\",\n",
      "    \"birthYear\": \"1963\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"31\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TX\",\n",
      "    \"birthCity\": \"San Antonio\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Michael Anthony\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1989-06-30\",\n",
      "    \"finalGame\": \"1990-09-30\",\n",
      "    \"retroID\": \"smitm003\",\n",
      "    \"bbrefID\": \"smithmi05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmi06\",\n",
      "    \"birthYear\": \"1977\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Norwood\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Mike\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Michael Anthony\",\n",
      "    \"weight\": \"205\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2002-04-26\",\n",
      "    \"finalGame\": \"2006-08-06\",\n",
      "    \"retroID\": \"smitm005\",\n",
      "    \"bbrefID\": \"smithmi06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithmu01\",\n",
      "    \"birthYear\": \"1987\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"25\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NH\",\n",
      "    \"birthCity\": \"Nashua\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Murphy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Murphy\",\n",
      "    \"weight\": \"210\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2018-08-27\",\n",
      "    \"finalGame\": \"2018-08-31\",\n",
      "    \"retroID\": \"smitm008\",\n",
      "    \"bbrefID\": \"smithmu01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithna01\",\n",
      "    \"birthYear\": \"1935\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"26\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Chicago\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Nate\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Nathaniel Beverly\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1962-09-19\",\n",
      "    \"finalGame\": \"1962-09-29\",\n",
      "    \"retroID\": \"smitn101\",\n",
      "    \"bbrefID\": \"smithna01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithol01\",\n",
      "    \"birthYear\": \"1865\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Mount Vernon\",\n",
      "    \"deathYear\": \"1954\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"4\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"Torrance\",\n",
      "    \"nameFirst\": \"Ollie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Orlin Hudson\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"66\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1894-07-11\",\n",
      "    \"finalGame\": \"1894-08-25\",\n",
      "    \"retroID\": \"smito101\",\n",
      "    \"bbrefID\": \"smithol01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithoz01\",\n",
      "    \"birthYear\": \"1954\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"26\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"AL\",\n",
      "    \"birthCity\": \"Mobile\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Ozzie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Osborne Earl\",\n",
      "    \"weight\": \"150\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1978-04-07\",\n",
      "    \"finalGame\": \"1996-09-29\",\n",
      "    \"retroID\": \"smito001\",\n",
      "    \"bbrefID\": \"smithoz01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpa01\",\n",
      "    \"birthYear\": \"1888\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Mount Zion\",\n",
      "    \"deathYear\": \"1958\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IL\",\n",
      "    \"deathCity\": \"Decatur\",\n",
      "    \"nameFirst\": \"Paul\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Paul Stoner\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1916-09-19\",\n",
      "    \"finalGame\": \"1916-10-01\",\n",
      "    \"retroID\": \"smitp103\",\n",
      "    \"bbrefID\": \"smithpa01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpa02\",\n",
      "    \"birthYear\": \"1894\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"16\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Pelham\",\n",
      "    \"deathYear\": \"1990\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"2\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"New Rochelle\",\n",
      "    \"nameFirst\": \"Paddy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Lawrence Patrick\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1920-07-06\",\n",
      "    \"finalGame\": \"1920-07-07\",\n",
      "    \"retroID\": \"smitp105\",\n",
      "    \"bbrefID\": \"smithpa02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpa03\",\n",
      "    \"birthYear\": \"1931\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"New Castle\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Paul\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Paul Leslie\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1953-04-14\",\n",
      "    \"finalGame\": \"1958-06-07\",\n",
      "    \"retroID\": \"smitp104\",\n",
      "    \"bbrefID\": \"smithpa03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpe01\",\n",
      "    \"birthYear\": \"1940\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Natick\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Pete\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Peter Luke\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1962-09-13\",\n",
      "    \"finalGame\": \"1963-09-28\",\n",
      "    \"retroID\": \"smitp102\",\n",
      "    \"bbrefID\": \"smithpe01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpe02\",\n",
      "    \"birthYear\": \"1966\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Abington\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Pete\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Peter John\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1987-09-08\",\n",
      "    \"finalGame\": \"1998-09-24\",\n",
      "    \"retroID\": \"smitp001\",\n",
      "    \"bbrefID\": \"smithpe02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithph01\",\n",
      "    \"birthYear\": \"1864\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Philadelphia\",\n",
      "    \"deathYear\": \"1952\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NH\",\n",
      "    \"deathCity\": \"Manchester\",\n",
      "    \"nameFirst\": \"Phenomenal\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"John Francis\",\n",
      "    \"weight\": \"161\",\n",
      "    \"height\": \"66\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1884-08-14\",\n",
      "    \"finalGame\": \"1891-06-15\",\n",
      "    \"retroID\": \"smitp106\",\n",
      "    \"bbrefID\": \"smithph01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpo01\",\n",
      "    \"birthYear\": \"1856\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"CAN\",\n",
      "    \"birthState\": \"NS\",\n",
      "    \"birthCity\": \"Digby\",\n",
      "    \"deathYear\": \"1927\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"18\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MA\",\n",
      "    \"deathCity\": \"Boston\",\n",
      "    \"nameFirst\": \"Pop\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Charles Marvin\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1880-05-01\",\n",
      "    \"finalGame\": \"1891-06-09\",\n",
      "    \"retroID\": \"smitp101\",\n",
      "    \"bbrefID\": \"smithpo01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithpo02\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"23\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"TN\",\n",
      "    \"birthCity\": \"Newport\",\n",
      "    \"deathYear\": \"1924\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"16\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"TX\",\n",
      "    \"deathCity\": \"Sweetwater\",\n",
      "    \"nameFirst\": \"Pop-boy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Clarence Ossie\",\n",
      "    \"weight\": \"176\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1913-04-19\",\n",
      "    \"finalGame\": \"1917-05-02\",\n",
      "    \"retroID\": \"smitp107\",\n",
      "    \"bbrefID\": \"smithpo02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithra01\",\n",
      "    \"birthYear\": \"1955\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"18\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Glendale\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Ray\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Raymond Edward\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1981-04-09\",\n",
      "    \"finalGame\": \"1983-09-21\",\n",
      "    \"retroID\": \"smitr102\",\n",
      "    \"bbrefID\": \"smithra01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre01\",\n",
      "    \"birthYear\": \"1861\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"KY\",\n",
      "    \"birthCity\": \"Louisville\",\n",
      "    \"deathYear\": \"1895\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"21\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"KY\",\n",
      "    \"deathCity\": \"Louisville\",\n",
      "    \"nameFirst\": \"Rex\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Rex\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1886-05-31\",\n",
      "    \"finalGame\": \"1886-07-11\",\n",
      "    \"retroID\": \"smitr106\",\n",
      "    \"bbrefID\": \"smithre01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre02\",\n",
      "    \"birthYear\": \"1890\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"6\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"SC\",\n",
      "    \"birthCity\": \"Greenville\",\n",
      "    \"deathYear\": \"1966\",\n",
      "    \"deathMonth\": \"10\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"GA\",\n",
      "    \"deathCity\": \"Atlanta\",\n",
      "    \"nameFirst\": \"Red\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"James Carlisle\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1911-09-05\",\n",
      "    \"finalGame\": \"1919-09-25\",\n",
      "    \"retroID\": \"smitr108\",\n",
      "    \"bbrefID\": \"smithre02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre03\",\n",
      "    \"birthYear\": \"1892\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IN\",\n",
      "    \"birthCity\": \"Logansport\",\n",
      "    \"deathYear\": \"1970\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"23\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"FL\",\n",
      "    \"deathCity\": \"Bradenton\",\n",
      "    \"nameFirst\": \"Red\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Willard Jehu\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1917-09-17\",\n",
      "    \"finalGame\": \"1918-09-01\",\n",
      "    \"retroID\": \"smitr104\",\n",
      "    \"bbrefID\": \"smithre03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre04\",\n",
      "    \"birthYear\": \"1899\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"17\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Ashley\",\n",
      "    \"deathYear\": \"1961\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"19\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"Los Angeles\",\n",
      "    \"nameFirst\": \"Red\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Marvin Harold\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"67\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1925-04-14\",\n",
      "    \"finalGame\": \"1925-09-26\",\n",
      "    \"retroID\": \"smitr107\",\n",
      "    \"bbrefID\": \"smithre04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre05\",\n",
      "    \"birthYear\": \"1904\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"18\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"WI\",\n",
      "    \"birthCity\": \"Brokaw\",\n",
      "    \"deathYear\": \"1978\",\n",
      "    \"deathMonth\": \"5\",\n",
      "    \"deathDay\": \"8\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"OH\",\n",
      "    \"deathCity\": \"Sylvania\",\n",
      "    \"nameFirst\": \"Red\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Richard Paul\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1927-05-31\",\n",
      "    \"finalGame\": \"1927-05-31\",\n",
      "    \"retroID\": \"smitr105\",\n",
      "    \"bbrefID\": \"smithre05\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithre06\",\n",
      "    \"birthYear\": \"1945\",\n",
      "    \"birthMonth\": \"4\",\n",
      "    \"birthDay\": \"2\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Shreveport\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Reggie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Carl Reginald\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"B\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1966-09-18\",\n",
      "    \"finalGame\": \"1982-10-03\",\n",
      "    \"retroID\": \"smitr101\",\n",
      "    \"bbrefID\": \"smithre06\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithro01\",\n",
      "    \"birthYear\": \"1961\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"6\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"Mount Vernon\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Roy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"LeRoy Purdy\",\n",
      "    \"weight\": \"200\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1984-06-23\",\n",
      "    \"finalGame\": \"1991-08-16\",\n",
      "    \"retroID\": \"smitr001\",\n",
      "    \"bbrefID\": \"smithro01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithro03\",\n",
      "    \"birthYear\": \"1976\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"18\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"FL\",\n",
      "    \"birthCity\": \"St. Petersburg\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Roy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Walter Roy\",\n",
      "    \"weight\": \"235\",\n",
      "    \"height\": \"78\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2001-05-26\",\n",
      "    \"finalGame\": \"2002-09-29\",\n",
      "    \"retroID\": \"smitr004\",\n",
      "    \"bbrefID\": \"smithro03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithru01\",\n",
      "    \"birthYear\": \"1905\",\n",
      "    \"birthMonth\": \"1\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Guilford College\",\n",
      "    \"deathYear\": \"1984\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"21\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"SC\",\n",
      "    \"deathCity\": \"Aiken\",\n",
      "    \"nameFirst\": \"Rufus\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Rufus Frazier\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1927-10-02\",\n",
      "    \"finalGame\": \"1927-10-02\",\n",
      "    \"retroID\": \"smitr103\",\n",
      "    \"bbrefID\": \"smithru01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithse01\",\n",
      "    \"birthYear\": \"1982\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"30\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MS\",\n",
      "    \"birthCity\": \"Jackson\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Seth\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Garry Seth\",\n",
      "    \"weight\": \"210\",\n",
      "    \"height\": \"75\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2007-09-16\",\n",
      "    \"finalGame\": \"2017-09-30\",\n",
      "    \"retroID\": \"smits002\",\n",
      "    \"bbrefID\": \"smithse01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithsh01\",\n",
      "    \"birthYear\": \"1891\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"18\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Monticello\",\n",
      "    \"deathYear\": \"1949\",\n",
      "    \"deathMonth\": \"9\",\n",
      "    \"deathDay\": \"12\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"GA\",\n",
      "    \"deathCity\": \"Reidsville\",\n",
      "    \"nameFirst\": \"Sherry\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Sherrod Malone\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1911-05-11\",\n",
      "    \"finalGame\": \"1927-07-18\",\n",
      "    \"retroID\": \"smits102\",\n",
      "    \"bbrefID\": \"smithsh01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithsk01\",\n",
      "    \"birthYear\": \"1868\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"19\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"1916\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"26\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MO\",\n",
      "    \"deathCity\": \"St. Louis\",\n",
      "    \"nameFirst\": \"Skyrocket\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Samuel J.\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1888-04-18\",\n",
      "    \"finalGame\": \"1888-07-08\",\n",
      "    \"retroID\": \"smits103\",\n",
      "    \"bbrefID\": \"smithsk01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithst01\",\n",
      "    \"birthYear\": \"1873\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"24\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Elmwood\",\n",
      "    \"deathYear\": \"1947\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"14\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MA\",\n",
      "    \"deathCity\": \"Fall River\",\n",
      "    \"nameFirst\": \"Stub\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"James Abner\",\n",
      "    \"weight\": \"145\",\n",
      "    \"height\": \"66\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1898-09-10\",\n",
      "    \"finalGame\": \"1898-10-15\",\n",
      "    \"retroID\": \"smits104\",\n",
      "    \"bbrefID\": \"smithst01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithsy01\",\n",
      "    \"birthYear\": \"1883\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"31\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"SC\",\n",
      "    \"birthCity\": \"Smithville\",\n",
      "    \"deathYear\": \"1961\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"5\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"SC\",\n",
      "    \"deathCity\": \"Orangeburg\",\n",
      "    \"nameFirst\": \"Syd\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Sydney A.\",\n",
      "    \"weight\": \"190\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1908-04-14\",\n",
      "    \"finalGame\": \"1915-04-18\",\n",
      "    \"retroID\": \"smits101\",\n",
      "    \"bbrefID\": \"smithsy01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithto01\",\n",
      "    \"birthYear\": \"1851\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"CAN\",\n",
      "    \"birthState\": \"ON\",\n",
      "    \"birthCity\": \"Guelph\",\n",
      "    \"deathYear\": \"1889\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"27\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MI\",\n",
      "    \"deathCity\": \"Detroit\",\n",
      "    \"nameFirst\": \"Tom\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Thomas N.\",\n",
      "    \"weight\": \"141\",\n",
      "    \"height\": \"68\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1875-09-15\",\n",
      "    \"finalGame\": \"1875-10-09\",\n",
      "    \"retroID\": \"smitt103\",\n",
      "    \"bbrefID\": \"smithto01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithto02\",\n",
      "    \"birthYear\": \"1871\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"5\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Boston\",\n",
      "    \"deathYear\": \"1929\",\n",
      "    \"deathMonth\": \"3\",\n",
      "    \"deathDay\": \"2\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"MA\",\n",
      "    \"deathCity\": \"Dorchester\",\n",
      "    \"nameFirst\": \"Tom\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Thomas Edward\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"67\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1894-06-06\",\n",
      "    \"finalGame\": \"1898-05-12\",\n",
      "    \"retroID\": \"smitt104\",\n",
      "    \"bbrefID\": \"smithto02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithto03\",\n",
      "    \"birthYear\": \"1884\",\n",
      "    \"birthMonth\": \"5\",\n",
      "    \"birthDay\": \"14\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Chicago\",\n",
      "    \"deathYear\": \"1964\",\n",
      "    \"deathMonth\": \"2\",\n",
      "    \"deathDay\": \"27\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"TX\",\n",
      "    \"deathCity\": \"Galveston\",\n",
      "    \"nameFirst\": \"Tony\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Anthony\",\n",
      "    \"weight\": \"150\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1907-08-12\",\n",
      "    \"finalGame\": \"1911-07-11\",\n",
      "    \"retroID\": \"smitt101\",\n",
      "    \"bbrefID\": \"smithto03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithto04\",\n",
      "    \"birthYear\": \"1948\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"1\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NC\",\n",
      "    \"birthCity\": \"Albemarle\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Tommy\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Tommy Alexander\",\n",
      "    \"weight\": \"210\",\n",
      "    \"height\": \"76\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1973-09-06\",\n",
      "    \"finalGame\": \"1977-09-10\",\n",
      "    \"retroID\": \"smitt102\",\n",
      "    \"bbrefID\": \"smithto04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithtr01\",\n",
      "    \"birthYear\": \"1972\",\n",
      "    \"birthMonth\": \"11\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OR\",\n",
      "    \"birthCity\": \"Springfield\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Travis\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Travis William\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1998-06-21\",\n",
      "    \"finalGame\": \"2006-05-20\",\n",
      "    \"retroID\": \"smitt001\",\n",
      "    \"bbrefID\": \"smithtr01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithty01\",\n",
      "    \"birthYear\": \"1991\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"1\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"CA\",\n",
      "    \"birthCity\": \"Long Beach\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Tyler\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Tyler Douglas\",\n",
      "    \"weight\": \"195\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"2017-06-02\",\n",
      "    \"finalGame\": \"2017-06-20\",\n",
      "    \"retroID\": \"smitt002\",\n",
      "    \"bbrefID\": \"smithty01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithvi01\",\n",
      "    \"birthYear\": \"1915\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"VA\",\n",
      "    \"birthCity\": \"Richmond\",\n",
      "    \"deathYear\": \"1979\",\n",
      "    \"deathMonth\": \"12\",\n",
      "    \"deathDay\": \"14\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"VA\",\n",
      "    \"deathCity\": \"Virginia Beach\",\n",
      "    \"nameFirst\": \"Vinnie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Vincent Ambrose\",\n",
      "    \"weight\": \"176\",\n",
      "    \"height\": \"73\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1941-09-10\",\n",
      "    \"finalGame\": \"1946-04-27\",\n",
      "    \"retroID\": \"smitv101\",\n",
      "    \"bbrefID\": \"smithvi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithwa01\",\n",
      "    \"birthYear\": \"1888\",\n",
      "    \"birthMonth\": \"3\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Philadelphia\",\n",
      "    \"deathYear\": \"1930\",\n",
      "    \"deathMonth\": \"6\",\n",
      "    \"deathDay\": \"10\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"AZ\",\n",
      "    \"deathCity\": \"Florence\",\n",
      "    \"nameFirst\": \"Wally\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Wallace Henry\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1911-04-17\",\n",
      "    \"finalGame\": \"1914-10-07\",\n",
      "    \"retroID\": \"smitw103\",\n",
      "    \"bbrefID\": \"smithwa01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithwi01\",\n",
      "    \"birthYear\": \"1886\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"30\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MI\",\n",
      "    \"birthCity\": \"Evart\",\n",
      "    \"deathYear\": \"1959\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"18\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"ND\",\n",
      "    \"deathCity\": \"Fargo\",\n",
      "    \"nameFirst\": \"Wib\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Wilbur Floyd\",\n",
      "    \"weight\": \"165\",\n",
      "    \"height\": \"70\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1909-05-31\",\n",
      "    \"finalGame\": \"1909-09-29\",\n",
      "    \"retroID\": \"smitw101\",\n",
      "    \"bbrefID\": \"smithwi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithwi02\",\n",
      "    \"birthYear\": \"1939\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"11\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"AL\",\n",
      "    \"birthCity\": \"Anniston\",\n",
      "    \"deathYear\": \"2006\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"16\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"AL\",\n",
      "    \"deathCity\": \"Anniston\",\n",
      "    \"nameFirst\": \"Willie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Willie\",\n",
      "    \"weight\": \"182\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1963-06-18\",\n",
      "    \"finalGame\": \"1971-09-30\",\n",
      "    \"retroID\": \"smitw102\",\n",
      "    \"bbrefID\": \"smithwi02\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithwi03\",\n",
      "    \"birthYear\": \"1967\",\n",
      "    \"birthMonth\": \"8\",\n",
      "    \"birthDay\": \"27\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Savannah\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Willie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Willie Everett\",\n",
      "    \"weight\": \"250\",\n",
      "    \"height\": \"78\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1994-04-25\",\n",
      "    \"finalGame\": \"1994-05-10\",\n",
      "    \"retroID\": \"smitw001\",\n",
      "    \"bbrefID\": \"smithwi03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithwi04\",\n",
      "    \"birthYear\": \"1989\",\n",
      "    \"birthMonth\": \"7\",\n",
      "    \"birthDay\": \"10\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"GA\",\n",
      "    \"birthCity\": \"Newnan\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Will\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William Michael\",\n",
      "    \"weight\": \"248\",\n",
      "    \"height\": \"77\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"2012-05-23\",\n",
      "    \"finalGame\": \"2018-09-29\",\n",
      "    \"retroID\": \"smitw002\",\n",
      "    \"bbrefID\": \"smithwi04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithza01\",\n",
      "    \"birthYear\": \"1960\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"28\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"WI\",\n",
      "    \"birthCity\": \"Madison\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Zane\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Zane William\",\n",
      "    \"weight\": \"185\",\n",
      "    \"height\": \"74\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1984-09-10\",\n",
      "    \"finalGame\": \"1996-07-05\",\n",
      "    \"retroID\": \"smitz001\",\n",
      "    \"bbrefID\": \"smithza01\"\n",
      "  }\n",
      "]\n"
     ]
    }
   ],
   "source": [
    "import json\n",
    "all_result = cur.fetchall()\n",
    "print(\"Fetch all returns a list of size: \", len(all_result))\n",
    "print(\"The result set is = \\n\", json.dumps(all_result, indent=2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The query produced 162 rows.\n"
     ]
    }
   ],
   "source": [
    "cur = default_cnx.cursor()\n",
    "how_many = cur.execute(\"select * from people where nameLast='Smith'\")\n",
    "print(\"The query produced\", how_many, \"rows.\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The next 3 rows are:\n",
      " [\n",
      "  {\n",
      "    \"playerID\": \"smith01\",\n",
      "    \"birthYear\": \"\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"\",\n",
      "    \"birthState\": \"\",\n",
      "    \"birthCity\": \"\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-06-05\",\n",
      "    \"finalGame\": \"1884-06-05\",\n",
      "    \"retroID\": \"smitu101\",\n",
      "    \"bbrefID\": \"smith01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal01\",\n",
      "    \"birthYear\": \"1871\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"NY\",\n",
      "    \"birthCity\": \"New York\",\n",
      "    \"deathYear\": \"1919\",\n",
      "    \"deathMonth\": \"7\",\n",
      "    \"deathDay\": \"9\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"NY\",\n",
      "    \"deathCity\": \"New York\",\n",
      "    \"nameFirst\": \"Aleck\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alexander Benjamin\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1897-04-23\",\n",
      "    \"finalGame\": \"1906-10-05\",\n",
      "    \"retroID\": \"smita105\",\n",
      "    \"bbrefID\": \"smithal01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal02\",\n",
      "    \"birthYear\": \"1903\",\n",
      "    \"birthMonth\": \"12\",\n",
      "    \"birthDay\": \"13\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"PA\",\n",
      "    \"birthCity\": \"Norristown\",\n",
      "    \"deathYear\": \"1995\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"11\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CA\",\n",
      "    \"deathCity\": \"San Diego\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alfred Kendricks\",\n",
      "    \"weight\": \"170\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1926-06-18\",\n",
      "    \"finalGame\": \"1926-06-18\",\n",
      "    \"retroID\": \"smita103\",\n",
      "    \"bbrefID\": \"smithal02\"\n",
      "  }\n",
      "]\n",
      "Do you want to see more (Y/N)?Y\n",
      "The next 3 rows are:\n",
      " [\n",
      "  {\n",
      "    \"playerID\": \"smithal03\",\n",
      "    \"birthYear\": \"1907\",\n",
      "    \"birthMonth\": \"10\",\n",
      "    \"birthDay\": \"12\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"IL\",\n",
      "    \"birthCity\": \"Belleville\",\n",
      "    \"deathYear\": \"1977\",\n",
      "    \"deathMonth\": \"4\",\n",
      "    \"deathDay\": \"28\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"TX\",\n",
      "    \"deathCity\": \"Brownsville\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alfred John\",\n",
      "    \"weight\": \"180\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"L\",\n",
      "    \"throws\": \"L\",\n",
      "    \"debut\": \"1934-05-05\",\n",
      "    \"finalGame\": \"1945-09-15\",\n",
      "    \"retroID\": \"smita104\",\n",
      "    \"bbrefID\": \"smithal03\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithal04\",\n",
      "    \"birthYear\": \"1928\",\n",
      "    \"birthMonth\": \"2\",\n",
      "    \"birthDay\": \"7\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MO\",\n",
      "    \"birthCity\": \"Kirkwood\",\n",
      "    \"deathYear\": \"2002\",\n",
      "    \"deathMonth\": \"1\",\n",
      "    \"deathDay\": \"3\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"IN\",\n",
      "    \"deathCity\": \"Hammond\",\n",
      "    \"nameFirst\": \"Al\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Alphonse Eugene\",\n",
      "    \"weight\": \"189\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1953-07-10\",\n",
      "    \"finalGame\": \"1964-10-04\",\n",
      "    \"retroID\": \"smita102\",\n",
      "    \"bbrefID\": \"smithal04\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithar01\",\n",
      "    \"birthYear\": \"1906\",\n",
      "    \"birthMonth\": \"6\",\n",
      "    \"birthDay\": \"21\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MA\",\n",
      "    \"birthCity\": \"Boston\",\n",
      "    \"deathYear\": \"1995\",\n",
      "    \"deathMonth\": \"11\",\n",
      "    \"deathDay\": \"22\",\n",
      "    \"deathCountry\": \"USA\",\n",
      "    \"deathState\": \"CT\",\n",
      "    \"deathCity\": \"Norwalk\",\n",
      "    \"nameFirst\": \"Art\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Arthur Laird\",\n",
      "    \"weight\": \"175\",\n",
      "    \"height\": \"72\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1932-06-09\",\n",
      "    \"finalGame\": \"1932-06-20\",\n",
      "    \"retroID\": \"smita101\",\n",
      "    \"bbrefID\": \"smithar01\"\n",
      "  }\n",
      "]\n",
      "Do you want to see more (Y/N)?Y\n",
      "The next 3 rows are:\n",
      " [\n",
      "  {\n",
      "    \"playerID\": \"smithbe01\",\n",
      "    \"birthYear\": \"1941\",\n",
      "    \"birthMonth\": \"9\",\n",
      "    \"birthDay\": \"4\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"LA\",\n",
      "    \"birthCity\": \"Ponchatoula\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bernie\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"Calvin Bernard\",\n",
      "    \"weight\": \"164\",\n",
      "    \"height\": \"69\",\n",
      "    \"bats\": \"R\",\n",
      "    \"throws\": \"R\",\n",
      "    \"debut\": \"1970-07-31\",\n",
      "    \"finalGame\": \"1971-04-28\",\n",
      "    \"retroID\": \"smitb105\",\n",
      "    \"bbrefID\": \"smithbe01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi01\",\n",
      "    \"birthYear\": \"\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"MD\",\n",
      "    \"birthCity\": \"Baltimore\",\n",
      "    \"deathYear\": \"\",\n",
      "    \"deathMonth\": \"\",\n",
      "    \"deathDay\": \"\",\n",
      "    \"deathCountry\": \"\",\n",
      "    \"deathState\": \"\",\n",
      "    \"deathCity\": \"\",\n",
      "    \"nameFirst\": \"Bill\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William J.\",\n",
      "    \"weight\": \"\",\n",
      "    \"height\": \"\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1873-04-14\",\n",
      "    \"finalGame\": \"1873-07-11\",\n",
      "    \"retroID\": \"smitb113\",\n",
      "    \"bbrefID\": \"smithbi01\"\n",
      "  },\n",
      "  {\n",
      "    \"playerID\": \"smithbi02\",\n",
      "    \"birthYear\": \"1865\",\n",
      "    \"birthMonth\": \"\",\n",
      "    \"birthDay\": \"\",\n",
      "    \"birthCountry\": \"USA\",\n",
      "    \"birthState\": \"OH\",\n",
      "    \"birthCity\": \"Cleveland\",\n",
      "    \"deathYear\": \"1886\",\n",
      "    \"deathMonth\": \"8\",\n",
      "    \"deathDay\": \"9\",\n",
      "    \"deathCountry\": \"CAN\",\n",
      "    \"deathState\": \"ON\",\n",
      "    \"deathCity\": \"Toronto\",\n",
      "    \"nameFirst\": \"Bill\",\n",
      "    \"nameLast\": \"Smith\",\n",
      "    \"nameGiven\": \"William E.\",\n",
      "    \"weight\": \"178\",\n",
      "    \"height\": \"71\",\n",
      "    \"bats\": \"\",\n",
      "    \"throws\": \"\",\n",
      "    \"debut\": \"1884-09-17\",\n",
      "    \"finalGame\": \"1884-09-17\",\n",
      "    \"retroID\": \"smitb107\",\n",
      "    \"bbrefID\": \"smithbi02\"\n",
      "  }\n",
      "]\n",
      "Do you want to see more (Y/N)?N\n"
     ]
    }
   ],
   "source": [
    "result = cur.fetchmany(size=3)\n",
    "while result is not None and len(result) > 0:\n",
    "    print(\"The next 3 rows are:\\n\", json.dumps(result, indent=2))\n",
    "    cont = input(\"Do you want to see more (Y/N)?\")\n",
    "    if cont == 'Y' or cont=='y':\n",
    "        result = cur.fetchmany(size=3)\n",
    "    else:\n",
    "        result = None"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- There are many implications for cursors. Two of the most important are:\n",
    "    1. Remember that the database application is a network connected client of the database. Returning all rows in a large result may swamp the client program or network.\n",
    "    2. DBMS use locking to implement transactions, which we will cover later. Cursors are fundamental to locking."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## INSERT, UPDATE, DELETE\n",
    "\n",
    "### Note on Examples\n",
    "\n",
    "I do not want to \"mess up\" the Lahman2017 stats with insert, update, delete. So, I am going to use the the [MySQL Tutorial Classic Cars](http://www.mysqltutorial.org/mysql-sample-database.aspx) database/schema.\n",
    "\n",
    "| <img src=\"http://www.mysqltutorial.org/wp-content/uploads/2009/12/MySQL-Sample-Database-Schema.png\"> |\n",
    "| :---: |\n",
    "| __Classic Cars Schema__ |\n",
    "\n",
    "### Overview\n",
    "\n",
    "- All databases support some form of Create-Retrieve-Update-Delete (CRUD)\n",
    "\n",
    "\n",
    "- ```SELECT``` is the SQL retrieve operation.\n",
    "\n",
    "\n",
    "- The verbs for the other operations are:\n",
    "    - ```INSERT``` for Create\n",
    "    - ```UPDATE```\n",
    "    - ```DELETE```\n",
    "    \n",
    "### INSERT\n",
    "\n",
    "#### Overview\n",
    "\n",
    "- The basic form is\n",
    "\n",
    "```\n",
    "INSERT INTO table_name (column1, column2, column3, ...)\n",
    "VALUES (value1, value2, value3, ...);\n",
    "```\n",
    "\n",
    "- If you are passing a value for every column, in the order in which the columns are defined in the table, you can skip the columns list because it is implied.\n",
    "\n",
    "```\n",
    "INSERT INTO table_name\n",
    "VALUES (value1, value2, value3, ...);\n",
    "```\n",
    "\n",
    "- For MySQL and most RDB engines, the ```INSERT``` statement has many more options. The MySQL version is\n",
    "\n",
    "```\n",
    "INSERT [LOW_PRIORITY | DELAYED | HIGH_PRIORITY] [IGNORE]\n",
    "    [INTO] tbl_name\n",
    "    [PARTITION (partition_name [, partition_name] ...)]\n",
    "    [(col_name [, col_name] ...)]\n",
    "    {VALUES | VALUE} (value_list) [, (value_list)] ...\n",
    "    [ON DUPLICATE KEY UPDATE assignment_list]\n",
    "\n",
    "INSERT [LOW_PRIORITY | DELAYED | HIGH_PRIORITY] [IGNORE]\n",
    "    [INTO] tbl_name\n",
    "    [PARTITION (partition_name [, partition_name] ...)]\n",
    "    SET assignment_list\n",
    "    [ON DUPLICATE KEY UPDATE assignment_list]\n",
    "\n",
    "INSERT [LOW_PRIORITY | HIGH_PRIORITY] [IGNORE]\n",
    "    [INTO] tbl_name\n",
    "    [PARTITION (partition_name [, partition_name] ...)]\n",
    "    [(col_name [, col_name] ...)]\n",
    "    SELECT ...\n",
    "    [ON DUPLICATE KEY UPDATE assignment_list]\n",
    "\n",
    "value:\n",
    "    {expr | DEFAULT}\n",
    "\n",
    "value_list:\n",
    "    value [, value] ...\n",
    "\n",
    "assignment:\n",
    "    col_name = value\n",
    "\n",
    "assignment_list:\n",
    "    assignment [, assignment] ...\n",
    "```\n",
    "\n",
    "- We will not cover most of the options in the course.\n",
    "\n",
    "#### Examples\n",
    "\n",
    "__Note:__ We will switch to a simpler table to demonstrate ```INSERT, UPDATE``` and ```DELETE.```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "7 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>1</td>\n",
       "        <td>San Francisco</td>\n",
       "        <td>+1 650 219 4782</td>\n",
       "        <td>100 Market Street</td>\n",
       "        <td>Suite 300</td>\n",
       "        <td>CA</td>\n",
       "        <td>USA</td>\n",
       "        <td>94080</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>2</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 215 837 0825</td>\n",
       "        <td>1550 Court Place</td>\n",
       "        <td>Suite 102</td>\n",
       "        <td>MA</td>\n",
       "        <td>USA</td>\n",
       "        <td>02107</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>3</td>\n",
       "        <td>NYC</td>\n",
       "        <td>+1 212 555 3000</td>\n",
       "        <td>523 East 53rd Street</td>\n",
       "        <td>apt. 5A</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10022</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "        <td>Paris</td>\n",
       "        <td>+33 14 723 4404</td>\n",
       "        <td>43 Rue Jouffroy D&#x27;abbans</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>France</td>\n",
       "        <td>75017</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>5</td>\n",
       "        <td>Tokyo</td>\n",
       "        <td>+81 33 224 5000</td>\n",
       "        <td>4-1 Kioicho</td>\n",
       "        <td>None</td>\n",
       "        <td>Chiyoda-Ku</td>\n",
       "        <td>Japan</td>\n",
       "        <td>102-8578</td>\n",
       "        <td>Japan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>6</td>\n",
       "        <td>Sydney</td>\n",
       "        <td>+61 2 9264 2451</td>\n",
       "        <td>5-11 Wentworth Avenue</td>\n",
       "        <td>Floor #2</td>\n",
       "        <td>None</td>\n",
       "        <td>Australia</td>\n",
       "        <td>NSW 2010</td>\n",
       "        <td>APAC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>7</td>\n",
       "        <td>London</td>\n",
       "        <td>+44 20 7877 2041</td>\n",
       "        <td>25 Old Broad Street</td>\n",
       "        <td>Level 7</td>\n",
       "        <td>None</td>\n",
       "        <td>UK</td>\n",
       "        <td>EC2N 1HN</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('1', 'San Francisco', '+1 650 219 4782', '100 Market Street', 'Suite 300', 'CA', 'USA', '94080', 'NA'),\n",
       " ('2', 'Boston', '+1 215 837 0825', '1550 Court Place', 'Suite 102', 'MA', 'USA', '02107', 'NA'),\n",
       " ('3', 'NYC', '+1 212 555 3000', '523 East 53rd Street', 'apt. 5A', 'NY', 'USA', '10022', 'NA'),\n",
       " ('4', 'Paris', '+33 14 723 4404', \"43 Rue Jouffroy D'abbans\", None, None, 'France', '75017', 'EMEA'),\n",
       " ('5', 'Tokyo', '+81 33 224 5000', '4-1 Kioicho', None, 'Chiyoda-Ku', 'Japan', '102-8578', 'Japan'),\n",
       " ('6', 'Sydney', '+61 2 9264 2451', '5-11 Wentworth Avenue', 'Floor #2', None, 'Australia', 'NSW 2010', 'APAC'),\n",
       " ('7', 'London', '+44 20 7877 2041', '25 Old Broad Street', 'Level 7', None, 'UK', 'EC2N 1HN', 'EMEA')]"
      ]
     },
     "execution_count": 54,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "    INSERT INTO classicmodels.offices\n",
    "    values(8, 'New York', '+1 212 555-1212', 'W 116th Street', 'and Broadway', 'NY', 'USA', '10027', 'NA')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "8 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>1</td>\n",
       "        <td>San Francisco</td>\n",
       "        <td>+1 650 219 4782</td>\n",
       "        <td>100 Market Street</td>\n",
       "        <td>Suite 300</td>\n",
       "        <td>CA</td>\n",
       "        <td>USA</td>\n",
       "        <td>94080</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>2</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 215 837 0825</td>\n",
       "        <td>1550 Court Place</td>\n",
       "        <td>Suite 102</td>\n",
       "        <td>MA</td>\n",
       "        <td>USA</td>\n",
       "        <td>02107</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>3</td>\n",
       "        <td>NYC</td>\n",
       "        <td>+1 212 555 3000</td>\n",
       "        <td>523 East 53rd Street</td>\n",
       "        <td>apt. 5A</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10022</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "        <td>Paris</td>\n",
       "        <td>+33 14 723 4404</td>\n",
       "        <td>43 Rue Jouffroy D&#x27;abbans</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>France</td>\n",
       "        <td>75017</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>5</td>\n",
       "        <td>Tokyo</td>\n",
       "        <td>+81 33 224 5000</td>\n",
       "        <td>4-1 Kioicho</td>\n",
       "        <td>None</td>\n",
       "        <td>Chiyoda-Ku</td>\n",
       "        <td>Japan</td>\n",
       "        <td>102-8578</td>\n",
       "        <td>Japan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>6</td>\n",
       "        <td>Sydney</td>\n",
       "        <td>+61 2 9264 2451</td>\n",
       "        <td>5-11 Wentworth Avenue</td>\n",
       "        <td>Floor #2</td>\n",
       "        <td>None</td>\n",
       "        <td>Australia</td>\n",
       "        <td>NSW 2010</td>\n",
       "        <td>APAC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>7</td>\n",
       "        <td>London</td>\n",
       "        <td>+44 20 7877 2041</td>\n",
       "        <td>25 Old Broad Street</td>\n",
       "        <td>Level 7</td>\n",
       "        <td>None</td>\n",
       "        <td>UK</td>\n",
       "        <td>EC2N 1HN</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>8</td>\n",
       "        <td>New York</td>\n",
       "        <td>+1 212 555-1212</td>\n",
       "        <td>W 116th Street</td>\n",
       "        <td>and Broadway</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10027</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('1', 'San Francisco', '+1 650 219 4782', '100 Market Street', 'Suite 300', 'CA', 'USA', '94080', 'NA'),\n",
       " ('2', 'Boston', '+1 215 837 0825', '1550 Court Place', 'Suite 102', 'MA', 'USA', '02107', 'NA'),\n",
       " ('3', 'NYC', '+1 212 555 3000', '523 East 53rd Street', 'apt. 5A', 'NY', 'USA', '10022', 'NA'),\n",
       " ('4', 'Paris', '+33 14 723 4404', \"43 Rue Jouffroy D'abbans\", None, None, 'France', '75017', 'EMEA'),\n",
       " ('5', 'Tokyo', '+81 33 224 5000', '4-1 Kioicho', None, 'Chiyoda-Ku', 'Japan', '102-8578', 'Japan'),\n",
       " ('6', 'Sydney', '+61 2 9264 2451', '5-11 Wentworth Avenue', 'Floor #2', None, 'Australia', 'NSW 2010', 'APAC'),\n",
       " ('7', 'London', '+44 20 7877 2041', '25 Old Broad Street', 'Level 7', None, 'UK', 'EC2N 1HN', 'EMEA'),\n",
       " ('8', 'New York', '+1 212 555-1212', 'W 116th Street', 'and Broadway', 'NY', 'USA', '10027', 'NA')]"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Example insert with explicitly enumerated columns:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "    INSERT INTO classicmodels.offices\n",
    "    (city, officeCode, country, phone, territory, addressLine1, postalCode)\n",
    "    values('Boston', 9, 'USA', '+1 617 555 1212', 'NA', '1 Government Plaza', '02101')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "9 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>1</td>\n",
       "        <td>San Francisco</td>\n",
       "        <td>+1 650 219 4782</td>\n",
       "        <td>100 Market Street</td>\n",
       "        <td>Suite 300</td>\n",
       "        <td>CA</td>\n",
       "        <td>USA</td>\n",
       "        <td>94080</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>2</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 215 837 0825</td>\n",
       "        <td>1550 Court Place</td>\n",
       "        <td>Suite 102</td>\n",
       "        <td>MA</td>\n",
       "        <td>USA</td>\n",
       "        <td>02107</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>3</td>\n",
       "        <td>NYC</td>\n",
       "        <td>+1 212 555 3000</td>\n",
       "        <td>523 East 53rd Street</td>\n",
       "        <td>apt. 5A</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10022</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "        <td>Paris</td>\n",
       "        <td>+33 14 723 4404</td>\n",
       "        <td>43 Rue Jouffroy D&#x27;abbans</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>France</td>\n",
       "        <td>75017</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>5</td>\n",
       "        <td>Tokyo</td>\n",
       "        <td>+81 33 224 5000</td>\n",
       "        <td>4-1 Kioicho</td>\n",
       "        <td>None</td>\n",
       "        <td>Chiyoda-Ku</td>\n",
       "        <td>Japan</td>\n",
       "        <td>102-8578</td>\n",
       "        <td>Japan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>6</td>\n",
       "        <td>Sydney</td>\n",
       "        <td>+61 2 9264 2451</td>\n",
       "        <td>5-11 Wentworth Avenue</td>\n",
       "        <td>Floor #2</td>\n",
       "        <td>None</td>\n",
       "        <td>Australia</td>\n",
       "        <td>NSW 2010</td>\n",
       "        <td>APAC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>7</td>\n",
       "        <td>London</td>\n",
       "        <td>+44 20 7877 2041</td>\n",
       "        <td>25 Old Broad Street</td>\n",
       "        <td>Level 7</td>\n",
       "        <td>None</td>\n",
       "        <td>UK</td>\n",
       "        <td>EC2N 1HN</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>8</td>\n",
       "        <td>New York</td>\n",
       "        <td>+1 212 555-1212</td>\n",
       "        <td>W 116th Street</td>\n",
       "        <td>and Broadway</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10027</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>9</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 617 555 1212</td>\n",
       "        <td>1 Government Plaza</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>02101</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('1', 'San Francisco', '+1 650 219 4782', '100 Market Street', 'Suite 300', 'CA', 'USA', '94080', 'NA'),\n",
       " ('2', 'Boston', '+1 215 837 0825', '1550 Court Place', 'Suite 102', 'MA', 'USA', '02107', 'NA'),\n",
       " ('3', 'NYC', '+1 212 555 3000', '523 East 53rd Street', 'apt. 5A', 'NY', 'USA', '10022', 'NA'),\n",
       " ('4', 'Paris', '+33 14 723 4404', \"43 Rue Jouffroy D'abbans\", None, None, 'France', '75017', 'EMEA'),\n",
       " ('5', 'Tokyo', '+81 33 224 5000', '4-1 Kioicho', None, 'Chiyoda-Ku', 'Japan', '102-8578', 'Japan'),\n",
       " ('6', 'Sydney', '+61 2 9264 2451', '5-11 Wentworth Avenue', 'Floor #2', None, 'Australia', 'NSW 2010', 'APAC'),\n",
       " ('7', 'London', '+44 20 7877 2041', '25 Old Broad Street', 'Level 7', None, 'UK', 'EC2N 1HN', 'EMEA'),\n",
       " ('8', 'New York', '+1 212 555-1212', 'W 116th Street', 'and Broadway', 'NY', 'USA', '10027', 'NA'),\n",
       " ('9', 'Boston', '+1 617 555 1212', '1 Government Plaza', None, None, 'USA', '02101', 'NA')]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### UPDATE\n",
    "\n",
    "#### Overview\n",
    "\n",
    "- The basic syntax is:\n",
    "\n",
    "```\n",
    "UPDATE table_name\n",
    "    SET column1 = value1, column2 = value2, ...\n",
    "    WHERE condition;\n",
    "```\n",
    "\n",
    "- The ```WHERE``` condition syntax and behavior is exactly the same as the ```WHERE``` clause in a ```SELECT.```\n",
    "\n",
    "\n",
    "- There ```WHERE``` clause determines the matching rows. The ```SET``` changes the values of the specified columns.\n",
    "\n",
    "\n",
    "- The full MySQL syntax is a little more complicated.\n",
    "\n",
    "```\n",
    "UPDATE [LOW_PRIORITY] [IGNORE] table_reference\n",
    "    SET assignment_list\n",
    "    [WHERE where_condition]\n",
    "    [ORDER BY ...]\n",
    "    [LIMIT row_count]\n",
    "\n",
    "value:\n",
    "    {expr | DEFAULT}\n",
    "\n",
    "assignment:\n",
    "    col_name = value\n",
    "\n",
    "assignment_list:\n",
    "    assignment [, assignment] ...\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Examples\n",
    "\n",
    "##### Example 1: Simple\n",
    "\n",
    "- Change of the zip code for the office with officeCode=11."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>9</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 617 555 1212</td>\n",
       "        <td>1 Government Plaza</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>02101</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('9', 'Boston', '+1 617 555 1212', '1 Government Plaza', None, None, 'USA', '02101', 'NA')]"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices where officeCode=9"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql update classicmodels.offices set postalCode=\"02343\",city=\"Pembroke\" where officeCode=9"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>9</td>\n",
       "        <td>Pembroke</td>\n",
       "        <td>+1 617 555 1212</td>\n",
       "        <td>1 Government Plaza</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>02343</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('9', 'Pembroke', '+1 617 555 1212', '1 Government Plaza', None, None, 'USA', '02343', 'NA')]"
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices where officeCode=9"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Example 2: More Complex\n",
    "\n",
    "- Increase the MSRP for products from ```productLine``` Motorcycles and ```productScale``` 1:10 by 5%.\n",
    "\n",
    "\n",
    "- First, let's get a feel for the ```products``` table."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>productCount</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>110</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[(110,)]"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select count(*) as productCount from classicmodels.products;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- There are 110 products. Let's just look at the first 10 to understand structure."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>productCode</th>\n",
       "        <th>productName</th>\n",
       "        <th>productLine</th>\n",
       "        <th>productScale</th>\n",
       "        <th>productVendor</th>\n",
       "        <th>productDescription</th>\n",
       "        <th>quantityInStock</th>\n",
       "        <th>buyPrice</th>\n",
       "        <th>MSRP</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_1678</td>\n",
       "        <td>1969 Harley Davidson Ultimate Chopper</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Min Lin Diecast</td>\n",
       "        <td>This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.</td>\n",
       "        <td>7933</td>\n",
       "        <td>48.81</td>\n",
       "        <td>95.70</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_1949</td>\n",
       "        <td>1952 Alpine Renault 1300</td>\n",
       "        <td>Classic Cars</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Classic Metal Creations</td>\n",
       "        <td>Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.</td>\n",
       "        <td>7305</td>\n",
       "        <td>98.58</td>\n",
       "        <td>214.30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_2016</td>\n",
       "        <td>1996 Moto Guzzi 1100i</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Highway 66 Mini Classics</td>\n",
       "        <td>Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, luggage rack, dual exhaust pipes, small saddle bag located on handle bars, two-tone paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.</td>\n",
       "        <td>6625</td>\n",
       "        <td>68.99</td>\n",
       "        <td>118.94</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4698</td>\n",
       "        <td>2003 Harley-Davidson Eagle Drag Bike</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Red Start Diecast</td>\n",
       "        <td>Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-color tampo-printed graphics, separate engine drive belts, free-turning front fork, rotating tires and rear racing slick, certificate of authenticity, detailed engine, display stand\r",
       "<br>, precision diecast replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine</td>\n",
       "        <td>5582</td>\n",
       "        <td>91.02</td>\n",
       "        <td>193.66</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4757</td>\n",
       "        <td>1972 Alfa Romeo GTA</td>\n",
       "        <td>Classic Cars</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Motor City Art Classics</td>\n",
       "        <td>Features include: Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.</td>\n",
       "        <td>3252</td>\n",
       "        <td>85.68</td>\n",
       "        <td>136.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4962</td>\n",
       "        <td>1962 LanciaA Delta 16V</td>\n",
       "        <td>Classic Cars</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Second Gear Diecast</td>\n",
       "        <td>Features include: Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.</td>\n",
       "        <td>6791</td>\n",
       "        <td>103.42</td>\n",
       "        <td>147.74</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S12_1099</td>\n",
       "        <td>1968 Ford Mustang</td>\n",
       "        <td>Classic Cars</td>\n",
       "        <td>1:12</td>\n",
       "        <td>Autoart Studio Design</td>\n",
       "        <td>Hood, doors and trunk all open to reveal highly detailed interior features. Steering wheel actually turns the front wheels. Color dark green.</td>\n",
       "        <td>68</td>\n",
       "        <td>95.34</td>\n",
       "        <td>194.57</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S12_1108</td>\n",
       "        <td>2001 Ferrari Enzo</td>\n",
       "        <td>Classic Cars</td>\n",
       "        <td>1:12</td>\n",
       "        <td>Second Gear Diecast</td>\n",
       "        <td>Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.</td>\n",
       "        <td>3619</td>\n",
       "        <td>95.59</td>\n",
       "        <td>207.80</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S12_1666</td>\n",
       "        <td>1958 Setra Bus</td>\n",
       "        <td>Trucks and Buses</td>\n",
       "        <td>1:12</td>\n",
       "        <td>Welly Diecast Productions</td>\n",
       "        <td>Model features 30 windows, skylights &amp; glare resistant glass, working steering system, original logos</td>\n",
       "        <td>1579</td>\n",
       "        <td>77.90</td>\n",
       "        <td>136.67</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S12_2823</td>\n",
       "        <td>2002 Suzuki XREO</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:12</td>\n",
       "        <td>Unimax Art Galleries</td>\n",
       "        <td>Official logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, luggage rack, dual exhaust pipes, small saddle bag located on handle bars, two-tone paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.</td>\n",
       "        <td>9997</td>\n",
       "        <td>66.27</td>\n",
       "        <td>150.62</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('S10_1678', '1969 Harley Davidson Ultimate Chopper', 'Motorcycles', '1:10', 'Min Lin Diecast', 'This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.', 7933, Decimal('48.81'), Decimal('95.70')),\n",
       " ('S10_1949', '1952 Alpine Renault 1300', 'Classic Cars', '1:10', 'Classic Metal Creations', 'Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.', 7305, Decimal('98.58'), Decimal('214.30')),\n",
       " ('S10_2016', '1996 Moto Guzzi 1100i', 'Motorcycles', '1:10', 'Highway 66 Mini Classics', 'Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leathe ... (93 characters truncated) ... paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.', 6625, Decimal('68.99'), Decimal('118.94')),\n",
       " ('S10_4698', '2003 Harley-Davidson Eagle Drag Bike', 'Motorcycles', '1:10', 'Red Start Diecast', 'Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-colo ... (199 characters truncated) ... t replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine', 5582, Decimal('91.02'), Decimal('193.66')),\n",
       " ('S10_4757', '1972 Alfa Romeo GTA', 'Classic Cars', '1:10', 'Motor City Art Classics', 'Features include: Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.', 3252, Decimal('85.68'), Decimal('136.00')),\n",
       " ('S10_4962', '1962 LanciaA Delta 16V', 'Classic Cars', '1:10', 'Second Gear Diecast', 'Features include: Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.', 6791, Decimal('103.42'), Decimal('147.74')),\n",
       " ('S12_1099', '1968 Ford Mustang', 'Classic Cars', '1:12', 'Autoart Studio Design', 'Hood, doors and trunk all open to reveal highly detailed interior features. Steering wheel actually turns the front wheels. Color dark green.', 68, Decimal('95.34'), Decimal('194.57')),\n",
       " ('S12_1108', '2001 Ferrari Enzo', 'Classic Cars', '1:12', 'Second Gear Diecast', 'Turnable front wheels; steering function; detailed interior; detailed engine; opening hood; opening trunk; opening doors; and detailed chassis.', 3619, Decimal('95.59'), Decimal('207.80')),\n",
       " ('S12_1666', '1958 Setra Bus', 'Trucks and Buses', '1:12', 'Welly Diecast Productions', 'Model features 30 windows, skylights & glare resistant glass, working steering system, original logos', 1579, Decimal('77.90'), Decimal('136.67')),\n",
       " ('S12_2823', '2002 Suzuki XREO', 'Motorcycles', '1:12', 'Unimax Art Galleries', 'Official logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, lu ... (82 characters truncated) ... paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.', 9997, Decimal('66.27'), Decimal('150.62'))]"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.products limit 10;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Just for verification, let's find the set of rows we plan to update."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>productCode</th>\n",
       "        <th>productName</th>\n",
       "        <th>productLine</th>\n",
       "        <th>productScale</th>\n",
       "        <th>productVendor</th>\n",
       "        <th>productDescription</th>\n",
       "        <th>quantityInStock</th>\n",
       "        <th>buyPrice</th>\n",
       "        <th>MSRP</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_1678</td>\n",
       "        <td>1969 Harley Davidson Ultimate Chopper</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Min Lin Diecast</td>\n",
       "        <td>This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.</td>\n",
       "        <td>7933</td>\n",
       "        <td>48.81</td>\n",
       "        <td>95.70</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_2016</td>\n",
       "        <td>1996 Moto Guzzi 1100i</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Highway 66 Mini Classics</td>\n",
       "        <td>Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, luggage rack, dual exhaust pipes, small saddle bag located on handle bars, two-tone paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.</td>\n",
       "        <td>6625</td>\n",
       "        <td>68.99</td>\n",
       "        <td>118.94</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4698</td>\n",
       "        <td>2003 Harley-Davidson Eagle Drag Bike</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Red Start Diecast</td>\n",
       "        <td>Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-color tampo-printed graphics, separate engine drive belts, free-turning front fork, rotating tires and rear racing slick, certificate of authenticity, detailed engine, display stand\r",
       "<br>, precision diecast replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine</td>\n",
       "        <td>5582</td>\n",
       "        <td>91.02</td>\n",
       "        <td>193.66</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('S10_1678', '1969 Harley Davidson Ultimate Chopper', 'Motorcycles', '1:10', 'Min Lin Diecast', 'This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.', 7933, Decimal('48.81'), Decimal('95.70')),\n",
       " ('S10_2016', '1996 Moto Guzzi 1100i', 'Motorcycles', '1:10', 'Highway 66 Mini Classics', 'Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leathe ... (93 characters truncated) ... paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.', 6625, Decimal('68.99'), Decimal('118.94')),\n",
       " ('S10_4698', '2003 Harley-Davidson Eagle Drag Bike', 'Motorcycles', '1:10', 'Red Start Diecast', 'Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-colo ... (199 characters truncated) ... t replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine', 5582, Decimal('91.02'), Decimal('193.66'))]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql SELECT * FROM classicmodels.products where productLine='Motorcycles' and productScale='1:10';"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Now perform the update:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "C:\\Users\\dferguso\\Anaconda\\lib\\site-packages\\pymysql\\cursors.py:170: Warning: (1265, \"Data truncated for column 'MSRP' at row 1\")\n",
      "  result = self._query(query)\n",
      "C:\\Users\\dferguso\\Anaconda\\lib\\site-packages\\pymysql\\cursors.py:170: Warning: (1265, \"Data truncated for column 'MSRP' at row 2\")\n",
      "  result = self._query(query)\n",
      "C:\\Users\\dferguso\\Anaconda\\lib\\site-packages\\pymysql\\cursors.py:170: Warning: (1265, \"Data truncated for column 'MSRP' at row 3\")\n",
      "  result = self._query(query)\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "update classicmodels.products set MSRP=(1.05*MSRP) where productLine='Motorcycles' and productScale='1:10';"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>productCode</th>\n",
       "        <th>productName</th>\n",
       "        <th>productLine</th>\n",
       "        <th>productScale</th>\n",
       "        <th>productVendor</th>\n",
       "        <th>productDescription</th>\n",
       "        <th>quantityInStock</th>\n",
       "        <th>buyPrice</th>\n",
       "        <th>MSRP</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_1678</td>\n",
       "        <td>1969 Harley Davidson Ultimate Chopper</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Min Lin Diecast</td>\n",
       "        <td>This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.</td>\n",
       "        <td>7933</td>\n",
       "        <td>48.81</td>\n",
       "        <td>100.49</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_2016</td>\n",
       "        <td>1996 Moto Guzzi 1100i</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Highway 66 Mini Classics</td>\n",
       "        <td>Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, luggage rack, dual exhaust pipes, small saddle bag located on handle bars, two-tone paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.</td>\n",
       "        <td>6625</td>\n",
       "        <td>68.99</td>\n",
       "        <td>124.89</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4698</td>\n",
       "        <td>2003 Harley-Davidson Eagle Drag Bike</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Red Start Diecast</td>\n",
       "        <td>Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-color tampo-printed graphics, separate engine drive belts, free-turning front fork, rotating tires and rear racing slick, certificate of authenticity, detailed engine, display stand\r",
       "<br>, precision diecast replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine</td>\n",
       "        <td>5582</td>\n",
       "        <td>91.02</td>\n",
       "        <td>203.34</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('S10_1678', '1969 Harley Davidson Ultimate Chopper', 'Motorcycles', '1:10', 'Min Lin Diecast', 'This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.', 7933, Decimal('48.81'), Decimal('100.49')),\n",
       " ('S10_2016', '1996 Moto Guzzi 1100i', 'Motorcycles', '1:10', 'Highway 66 Mini Classics', 'Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leathe ... (93 characters truncated) ... paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.', 6625, Decimal('68.99'), Decimal('124.89')),\n",
       " ('S10_4698', '2003 Harley-Davidson Eagle Drag Bike', 'Motorcycles', '1:10', 'Red Start Diecast', 'Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-colo ... (199 characters truncated) ... t replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine', 5582, Decimal('91.02'), Decimal('203.34'))]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql SELECT * FROM classicmodels.products where productLine='Motorcycles' and productScale='1:10';"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- The truncated warning is due to the fact that:\n",
    "    - The MSRP columns is of type DECIMAL(10,2).\n",
    "    - Multiplying by 1.05 produces real numbers with more than two digits after the decimal. \n",
    "    - The value is truncated to DECIMAL(10,2)\n",
    "    \n",
    "\n",
    "- We can fix several ways. The easiest way is to round the result to two decimal places.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "update classicmodels.products set MSRP=round((1.05*MSRP),2) where productLine='Motorcycles' and productScale='1:10';"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "3 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>productCode</th>\n",
       "        <th>productName</th>\n",
       "        <th>productLine</th>\n",
       "        <th>productScale</th>\n",
       "        <th>productVendor</th>\n",
       "        <th>productDescription</th>\n",
       "        <th>quantityInStock</th>\n",
       "        <th>buyPrice</th>\n",
       "        <th>MSRP</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_1678</td>\n",
       "        <td>1969 Harley Davidson Ultimate Chopper</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Min Lin Diecast</td>\n",
       "        <td>This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.</td>\n",
       "        <td>7933</td>\n",
       "        <td>48.81</td>\n",
       "        <td>105.51</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_2016</td>\n",
       "        <td>1996 Moto Guzzi 1100i</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Highway 66 Mini Classics</td>\n",
       "        <td>Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leather seats, luggage rack, dual exhaust pipes, small saddle bag located on handle bars, two-tone paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.</td>\n",
       "        <td>6625</td>\n",
       "        <td>68.99</td>\n",
       "        <td>131.13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>S10_4698</td>\n",
       "        <td>2003 Harley-Davidson Eagle Drag Bike</td>\n",
       "        <td>Motorcycles</td>\n",
       "        <td>1:10</td>\n",
       "        <td>Red Start Diecast</td>\n",
       "        <td>Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-color tampo-printed graphics, separate engine drive belts, free-turning front fork, rotating tires and rear racing slick, certificate of authenticity, detailed engine, display stand\r",
       "<br>, precision diecast replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine</td>\n",
       "        <td>5582</td>\n",
       "        <td>91.02</td>\n",
       "        <td>213.51</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('S10_1678', '1969 Harley Davidson Ultimate Chopper', 'Motorcycles', '1:10', 'Min Lin Diecast', 'This replica features working kickstand, front suspension, gear-shift lever, footbrake lever, drive chain, wheels and steering. All parts are particularly delicate due to their precise scale and require special care and attention.', 7933, Decimal('48.81'), Decimal('105.51')),\n",
       " ('S10_2016', '1996 Moto Guzzi 1100i', 'Motorcycles', '1:10', 'Highway 66 Mini Classics', 'Official Moto Guzzi logos and insignias, saddle bags located on side of motorcycle, detailed engine, working steering, working suspension, two leathe ... (93 characters truncated) ... paint with chrome accents, superior die-cast detail , rotating wheels , working kick stand, diecast metal with plastic parts and baked enamel finish.', 6625, Decimal('68.99'), Decimal('131.13')),\n",
       " ('S10_4698', '2003 Harley-Davidson Eagle Drag Bike', 'Motorcycles', '1:10', 'Red Start Diecast', 'Model features, official Harley Davidson logos and insignias, detachable rear wheelie bar, heavy diecast metal with resin parts, authentic multi-colo ... (199 characters truncated) ... t replica, baked enamel finish, 1:10 scale model, removable fender, seat and tank cover piece for displaying the superior detail of the v-twin engine', 5582, Decimal('91.02'), Decimal('213.51'))]"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql SELECT * FROM classicmodels.products where productLine='Motorcycles' and productScale='1:10';"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### DELETE\n",
    "\n",
    "#### Overview\n",
    "\n",
    "- Very similar to ```SELECT``` and ```UPDATE.```\n",
    "\n",
    "```\n",
    "DELETE FROM table_name WHERE condition;\n",
    "```\n",
    "\n",
    "- The more complex, full MySQL syntax is:\n",
    "\n",
    "```\n",
    "DELETE [LOW_PRIORITY] [QUICK] [IGNORE] FROM tbl_name\n",
    "    [PARTITION (partition_name [, partition_name] ...)]\n",
    "    [WHERE where_condition]\n",
    "    [ORDER BY ...]\n",
    "    [LIMIT row_count]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Example\n",
    "\n",
    "- I do not want to delete, or try to delete, too much of the various databases I have installed.\n",
    "\n",
    "\n",
    "- I am going to delete a couple of the rows that I previously inserted.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "9 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>1</td>\n",
       "        <td>San Francisco</td>\n",
       "        <td>+1 650 219 4782</td>\n",
       "        <td>100 Market Street</td>\n",
       "        <td>Suite 300</td>\n",
       "        <td>CA</td>\n",
       "        <td>USA</td>\n",
       "        <td>94080</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>2</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 215 837 0825</td>\n",
       "        <td>1550 Court Place</td>\n",
       "        <td>Suite 102</td>\n",
       "        <td>MA</td>\n",
       "        <td>USA</td>\n",
       "        <td>02107</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>3</td>\n",
       "        <td>NYC</td>\n",
       "        <td>+1 212 555 3000</td>\n",
       "        <td>523 East 53rd Street</td>\n",
       "        <td>apt. 5A</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10022</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "        <td>Paris</td>\n",
       "        <td>+33 14 723 4404</td>\n",
       "        <td>43 Rue Jouffroy D&#x27;abbans</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>France</td>\n",
       "        <td>75017</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>5</td>\n",
       "        <td>Tokyo</td>\n",
       "        <td>+81 33 224 5000</td>\n",
       "        <td>4-1 Kioicho</td>\n",
       "        <td>None</td>\n",
       "        <td>Chiyoda-Ku</td>\n",
       "        <td>Japan</td>\n",
       "        <td>102-8578</td>\n",
       "        <td>Japan</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>6</td>\n",
       "        <td>Sydney</td>\n",
       "        <td>+61 2 9264 2451</td>\n",
       "        <td>5-11 Wentworth Avenue</td>\n",
       "        <td>Floor #2</td>\n",
       "        <td>None</td>\n",
       "        <td>Australia</td>\n",
       "        <td>NSW 2010</td>\n",
       "        <td>APAC</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>7</td>\n",
       "        <td>London</td>\n",
       "        <td>+44 20 7877 2041</td>\n",
       "        <td>25 Old Broad Street</td>\n",
       "        <td>Level 7</td>\n",
       "        <td>None</td>\n",
       "        <td>UK</td>\n",
       "        <td>EC2N 1HN</td>\n",
       "        <td>EMEA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>8</td>\n",
       "        <td>New York</td>\n",
       "        <td>+1 212 555-1212</td>\n",
       "        <td>W 116th Street</td>\n",
       "        <td>and Broadway</td>\n",
       "        <td>NY</td>\n",
       "        <td>USA</td>\n",
       "        <td>10027</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>9</td>\n",
       "        <td>Boston</td>\n",
       "        <td>+1 617 555 1212</td>\n",
       "        <td>1 Government Plaza</td>\n",
       "        <td>None</td>\n",
       "        <td>None</td>\n",
       "        <td>USA</td>\n",
       "        <td>02101</td>\n",
       "        <td>NA</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('1', 'San Francisco', '+1 650 219 4782', '100 Market Street', 'Suite 300', 'CA', 'USA', '94080', 'NA'),\n",
       " ('2', 'Boston', '+1 215 837 0825', '1550 Court Place', 'Suite 102', 'MA', 'USA', '02107', 'NA'),\n",
       " ('3', 'NYC', '+1 212 555 3000', '523 East 53rd Street', 'apt. 5A', 'NY', 'USA', '10022', 'NA'),\n",
       " ('4', 'Paris', '+33 14 723 4404', \"43 Rue Jouffroy D'abbans\", None, None, 'France', '75017', 'EMEA'),\n",
       " ('5', 'Tokyo', '+81 33 224 5000', '4-1 Kioicho', None, 'Chiyoda-Ku', 'Japan', '102-8578', 'Japan'),\n",
       " ('6', 'Sydney', '+61 2 9264 2451', '5-11 Wentworth Avenue', 'Floor #2', None, 'Australia', 'NSW 2010', 'APAC'),\n",
       " ('7', 'London', '+44 20 7877 2041', '25 Old Broad Street', 'Level 7', None, 'UK', 'EC2N 1HN', 'EMEA'),\n",
       " ('8', 'New York', '+1 212 555-1212', 'W 116th Street', 'and Broadway', 'NY', 'USA', '10027', 'NA'),\n",
       " ('9', 'Boston', '+1 617 555 1212', '1 Government Plaza', None, None, 'USA', '02101', 'NA')]"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Just to show a slightly more complex example of ```DELETE```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "delete from classicmodels.offices where city='Boston' and addressLine1='1 Government Plaza'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "0 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>officeCode</th>\n",
       "        <th>city</th>\n",
       "        <th>phone</th>\n",
       "        <th>addressLine1</th>\n",
       "        <th>addressLine2</th>\n",
       "        <th>state</th>\n",
       "        <th>country</th>\n",
       "        <th>postalCode</th>\n",
       "        <th>territory</th>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from classicmodels.offices where officeCode=9"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HW1 Checkpoint\n",
    "\n",
    "### Core Concept\n",
    "\n",
    "- ```RDBDataTable``` and ```CSVDataTable``` have four core methods:\n",
    "    - ```find_by_template(self, template, field_list=None, limit=None, offset=None, order_by=None)```\n",
    "    - ```delete_by_template(self, template)```\n",
    "    - ```update_by_template(self, template, new_values)```\n",
    "    - ```insert(self, new_record)```\n",
    "    \n",
    "\n",
    "- ```by_template``` is core to three of the methods: ```find_by_template, udate_by_template, delete_by_template.```\n",
    "\n",
    "\n",
    "- How do you handle templates?\n",
    "\n",
    "\n",
    "### CSV Files\n",
    "\n",
    "```1.``` The first step is to load the CSV file into a data structure, e.g. _list_\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "import csv\n",
    "\n",
    "_default_directory = \\\n",
    "        \"C:\\\\Users\\\\dferguso\\\\ansys_one_drive\\\\Columbia\\Projects\\\\W4111\\\\HW1Impl\\\\Data\" + \\\n",
    "            \"\\\\baseballdatabank-2019.2\\\\core\\\\\"\n",
    "\n",
    "def load_csv_file(fn):\n",
    "    \n",
    "    # Open the file in read model\n",
    "    with open(fn, \"r\") as in_file:\n",
    "        \n",
    "        # Wrap with class that helps reading CSV files.\n",
    "        csv_rdr = csv.DictReader(in_file)\n",
    "        \n",
    "        # Place to hold the result\n",
    "        result = []\n",
    "        \n",
    "        # Build the result\n",
    "        for r in csv_rdr:\n",
    "            result.append(r)\n",
    "            \n",
    "    return result\n",
    "        \n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "fn = os.path.join(_default_directory, \"People.csv\")\n",
    "the_people = load_csv_file(fn)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Load got 19617 rows.\n"
     ]
    }
   ],
   "source": [
    "print(\"Load got\", len(the_people), \"rows.\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "A typical row looks like: \n",
      " {\n",
      "  \"playerID\": \"aardsda01\",\n",
      "  \"birthYear\": \"1981\",\n",
      "  \"birthMonth\": \"12\",\n",
      "  \"birthDay\": \"27\",\n",
      "  \"birthCountry\": \"USA\",\n",
      "  \"birthState\": \"CO\",\n",
      "  \"birthCity\": \"Denver\",\n",
      "  \"deathYear\": \"\",\n",
      "  \"deathMonth\": \"\",\n",
      "  \"deathDay\": \"\",\n",
      "  \"deathCountry\": \"\",\n",
      "  \"deathState\": \"\",\n",
      "  \"deathCity\": \"\",\n",
      "  \"nameFirst\": \"David\",\n",
      "  \"nameLast\": \"Aardsma\",\n",
      "  \"nameGiven\": \"David Allan\",\n",
      "  \"weight\": \"215\",\n",
      "  \"height\": \"75\",\n",
      "  \"bats\": \"R\",\n",
      "  \"throws\": \"R\",\n",
      "  \"debut\": \"2004-04-06\",\n",
      "  \"finalGame\": \"2015-08-23\",\n",
      "  \"retroID\": \"aardd001\",\n",
      "  \"bbrefID\": \"aardsda01\"\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "import json\n",
    "print(\"A typical row looks like: \\n\", json.dumps(the_people[0], indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```2.``` How do you check if a specific row matches a template?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "template = {\"nameLast\": \"Aardsma\", \"throws\": \"R\"}\n",
    "\n",
    "\n",
    "def matches_template(row, template):\n",
    "    \n",
    "    result = True\n",
    "    \n",
    "    # Look at every attribute in the template and see if there is a match.\n",
    "    for k,v in template.items():\n",
    "        \n",
    "        # Get the corresponding value in the row, or None if not there.\n",
    "        row_v = row.get(k, None)\n",
    "       \n",
    "        if v != row_v:\n",
    "            result = False\n",
    "            break\n",
    "            \n",
    "    return result"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "True"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "match = matches_template(the_people[0], template)\n",
    "match"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "template2 = {\"nameLast\": \"Aardsma\", \"throws\": \"L\"}\n",
    "match = matches_template(the_people[0], template2)\n",
    "match"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```3.``` Apply the matcher to all the rows. This is a simple loop.\n",
    "\n",
    "\n",
    "```4.``` You also need to get the subset of fields requested."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_fields(row, field_list):\n",
    "    \n",
    "    result = {}\n",
    "    for f in field_list:\n",
    "        \n",
    "        # A good program would catch an exception if field is not in the row.\n",
    "        # Do not worry about it. This is not a robust programming course.\n",
    "        result[f] = row[f]\n",
    "        \n",
    "    return result"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Requested fields =  {\n",
      "  \"nameFirst\": \"David\",\n",
      "  \"nameLast\": \"Aardsma\",\n",
      "  \"birthState\": \"CO\"\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "field_list = ['nameFirst', 'nameLast', 'birthState']\n",
    "requested_fields = get_fields(the_people[0], field_list)\n",
    "print(\"Requested fields = \", json.dumps(requested_fields, indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### How do You do this for SQL\n",
    "\n",
    "```1.``` You have to make a ```WHERE``` clause."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [],
   "source": [
    "def template_to_where_clause(template):\n",
    "    \n",
    "    if template is None or template == {}:\n",
    "        w_clause = None\n",
    "        args = None\n",
    "    else:\n",
    "        terms = []\n",
    "        args = []\n",
    "        for k,v in template.items():\n",
    "            terms.append(k + \"=%s\")\n",
    "            args.append(v)\n",
    "            \n",
    "        w_clause = \"where \" + (\" and \".join(terms))\n",
    "        \n",
    "    return w_clause, args"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "template = {\"nameLast\": \"Aardsma\", \"nameFirst\": \"David\"}\n",
    "w_clause, args = template_to_where_clause(template)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'where nameLast=%s and nameFirst=%s'"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "w_clause"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['Aardsma', 'David']"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "args"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```2.``` You also have to pick some fields."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_select_fields(fields):\n",
    "    \n",
    "    if fields is None or fields == []:\n",
    "        field_list = \" * \"\n",
    "    else:\n",
    "        field_list = \",\".join(fields)\n",
    "        \n",
    "    return field_list"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'nameLast,nameFirst,birthCity,throws'"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "fields = ['nameLast', 'nameFirst', 'birthCity', 'throws']\n",
    "field_list = get_select_fields(fields)\n",
    "field_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```3.``` Now, we can put the pieces together."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [],
   "source": [
    "fields = ['nameLast', 'nameFirst', 'birthCity', 'throws']\n",
    "template = {\"nameLast\": \"Aardsma\", \"nameFirst\": \"David\"}\n",
    "w_clause, arhs = template_to_where_clause(template)\n",
    "field_list = get_select_fields(fields)\n",
    "table_name = \"lahman2019raw.people\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'select nameLast,nameFirst,birthCity,throws from lahman2019raw.people where nameLast=%s and nameFirst=%s'"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "sql = \"select \" + field_list + \" from \" + table_name + \" \" + w_clause\n",
    "sql"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```4.``` Now run the query."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Result =  [\n",
      "  {\n",
      "    \"nameLast\": \"Aardsma\",\n",
      "    \"nameFirst\": \"David\",\n",
      "    \"birthCity\": \"Denver\",\n",
      "    \"throws\": \"R\"\n",
      "  }\n",
      "]\n"
     ]
    }
   ],
   "source": [
    "cur = default_cnx.cursor()\n",
    "res = cur.execute(sql, args)\n",
    "result = cur.fetchall()\n",
    "print(\"Result = \", json.dumps(result, indent=2))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Summary\n",
    "\n",
    "1. This HW may seem overwhelming. It is actually very simple.<br><br>\n",
    "2. The homework only requires programming knowledge that you learn in 1004, 1007 or 1007.<br><br>\n",
    "3. Solving the HW requires:\n",
    "    - Writing several \"helper\" functions each of which does a simple task.\n",
    "    - Putting the smaller pieces together into the larger methods in the class.<br><br>\n",
    "4. The complexity stems for the fact that we do not sufficiently teach you how to write larger programs through decomposition and assembly. All of your past programming assignments have not taught you do develop and test this way."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Primary Key\n",
    "\n",
    "### Conept\n",
    "\n",
    "- Briefly discussed the concept in lecture 1, and will cover in more detail now.\n",
    "\n",
    "\n",
    "- There are several types of keys:\n",
    "    - Super key: A set of attributes within a table whose values can be used to uniquely identify a tuple. \n",
    "    - Candidate key: A minimal super key. That is, no subset of the columns is a super key.\n",
    "    - Primary key: Candidate key arbitrarily chosen to be the \"primary\" key.\n",
    "    - Alternate key: Alternate key is the key that can work as a primary key. Basically it is a candidate key that currently is not primary key.\n",
    "    - Composite/Compound key: Composite Key is a combination of more than one fields/columns of a table. It can be a Candidate key, Primary key.\n",
    "    - Unique Key: Unique key is a set of one or more fields/columns of a table that uniquely identify a record in database table but can be NULL.\n",
    "    - Foreign key: Foreign key is a a set of columns in database table that is primary key in another table. It can accept multiple null, duplicate values.\n",
    "    - Natural key: A natural key (also known as business key) is a type of unique key, found in relational model database design, that is formed of attributes that already exist in the real world. It is used in business-related columns. In other words, a natural key is a candidate key that has a logical relationship to the attributes within that row. A natural key is sometimes called domain key. (https://en.wikipedia.org/wiki/Candidate_key)\n",
    "    - Surrogate key: A surrogate key (or synthetic key, entity identifier, system-generated key, database sequence number, factless key, technical key, or arbitrary unique identifier) in a database is a unique identifier for either an entity in the modeled world or an object in the database. The surrogate key is not derived from application data, unlike a natural (or business) key which is derived from application data. (https://en.wikipedia.org/wiki/Surrogate_key)\n",
    "\n",
    "\n",
    "- \"In the relational model of databases, a primary key is a specific choice of a minimal set of attributes (columns) that uniquely specify a tuple (row) in a relation (table). Informally, a primary key is 'which attributes identify a record', and in simple cases are simply a single attribute: a unique id. More formally, a primary key is a choice of candidate key (a minimal superkey); any other candidate key is an alternate key.<br><br>\n",
    "A primary key may consist of real-world observables, in which case it is called a natural key, while an attribute created to function as a key is called a surrogate key. For example, for a database of people (of a given nationality), time and location of birth is a natural key, while national identification numbers are surrogate keys.\" (https://en.wikipedia.org/wiki/Primary_key)\n",
    "\n",
    "\n",
    "- __Note:__\n",
    "    - Time and location of birth is a terrible natural key.\n",
    "    - A better example is ```Appearances``` in Lahman database, the columns: ```playerID, teamID, yearID``` uniquely identify a tuple.\n",
    "    - The RDB engine will enforce any defined primary key. Your code just needs to handle any exceptions.\n",
    "    - You will need to implement primary key definition on ```CSVDataTable``` instance creation.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Relational Model $-$ Keys\n",
    "\n",
    "- \"_Data integrity_ is the maintenance of, and the assurance of the accuracy and consistency of, data over its entire life-cycle, and is a critical aspect to the design, implementation and usage of any system which stores, processes, or retrieves data.\" (https://en.wikipedia.org/wiki/Data_integrity)\n",
    "\n",
    "\n",
    "- _Relational (integrity) constraints_ are central to the value of relational databases.\n",
    "    - The database designer _declares (defines)_ integrity constraints.\n",
    "    - The database management system _rejects_ any _create, update_ or _delete_ operation that would result in a constraint violation.\n",
    "\n",
    "\n",
    "- _Key(s)_ is a core  _(integrity) constraint_ enforcing _data integrity._ \n",
    "    - A _super key_ is a combination of columns with the property that no two rows have the same values for the fields of a super key.\n",
    "    - A _candidate key_ is a minimal _super key_, that is removing a column from the key definition means that the key no longer uniquely identifies a row.,\n",
    "    - The _primary key_ is a candidate key subjectively chosen as the \"best key\" for uniquely identifying the tuples.\n",
    "    \n",
    "    \n",
    "- You will some times here the term _functionally determines._\n",
    "    - Assume we have a relation $R(a,b,c,d,e)$.\n",
    "    - If $(a,b)$ is a key $k$, then\n",
    "    - The we can say that $k(a,b)$ _functionally determines_ $(c,d,e).$\n",
    "    - Given values $(x,y)$ for $(a,b)$ we can functionally return $(c,d,e).$ The function is\n",
    "    \n",
    "    $\\pi$<sub>$c,d,e$</sub>$(\\sigma$<sub>$(a=x)\\land(b=y)$</sub>$(R))$\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- One common notation for identifying a key in the relational notation is an ```overline.```<br>      \n",
    "\\begin{equation}\n",
    "R = (\\overline{a,b},c,d)\n",
    "\\end{equation}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Keys and Indexes $-$ SQL\n",
    "\n",
    "#### Overview\n",
    "\n",
    "- Relational database engines support additional key semantics and also support _indexes._\n",
    "\n",
    "\n",
    "- MySQL supports the following keys/index:\n",
    "    - PRIMARY KEY: Key is unique and NOT NULL. $\\Rightarrow$ Indexed\n",
    "    - UNIQUE: Key is unique or NULL. Multiple rows may have NULL for a value if column definition allows NULL. $\\Rightarrow$ Indexed\n",
    "    - INDEX: Non-unique but indexed for performance.\n",
    "    - FULLTEXT (INDEX) -- Will cover later.\n",
    "    \n",
    "    \n",
    "- In database engines, keys represent/implement\n",
    "    - Integrity constraints. We will cover the concept in detail in future lectures.\n",
    "    - Performance optimization.\n",
    "    \n",
    "    \n",
    "- For now, just think:\n",
    "    - Every table should have a primary key.\n",
    "    - Put indexes on other columns or sets of columns that will frequently be in WHERE clauses.\n",
    "    \n",
    "    \n",
    "- For a table with 1,000,000 rows:\n",
    "    - SELECT without a index examines O(1,000,000) rows.\n",
    "    - SELECT with an index examines O(log(1,000,000)) = 20 rows.\n",
    "    \n",
    "\n",
    "- RDB query engine compute a \"cost\" in terms of CPU and disk input/output for relational operations. This is critical to _query optimization,_ which we will cover later. For comparison of the benefits of indexes, the cost of ```select * from people where playerid='willite01'```\n",
    "    - Without index = 4,071.\n",
    "    - With index = 1\n",
    "    \n",
    "    \n",
    "- We will cover query optimization and cost in Module II: Database Management System Implementation/Architecture."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### An Example\n",
    "\n",
    "- A course directory entry for a database course/section.\n",
    "\n",
    "<hr style=\"height: 1px;\">\n",
    "\n",
    "| <img src=\"../../images/course_directory_entry.jpeg\"> |\n",
    "| :---: |\n",
    "| __Student SSOL for W4111__ |\n",
    "\n",
    "<hr style=\"height: 1px;\">\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- I pulled down some course data for me.\n",
    "\n",
    "\n",
    "- How do I figure out the keys?\n",
    "\n",
    "\n",
    "- You can use ```SELECT COUNT(*) GROUP BY A,B,C``` for various sets of columns.\n",
    "\n",
    "\n",
    "- We will cover _Aggregation_ in the next lecture, but you can use now.\n",
    "\n",
    "\n",
    "- Let's look at the data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "15 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>id</th>\n",
       "        <th>name</th>\n",
       "        <th>course_no</th>\n",
       "        <th>section</th>\n",
       "        <th>year</th>\n",
       "        <th>semester</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>11912</td>\n",
       "        <td>TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>010</td>\n",
       "        <td>2016</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>34758</td>\n",
       "        <td>TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>006</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47421</td>\n",
       "        <td>TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>014</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47468</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53309</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53496</td>\n",
       "        <td>INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59651</td>\n",
       "        <td>FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59653</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>61720</td>\n",
       "        <td>THE ART OF ENGINEERING</td>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>69174</td>\n",
       "        <td>TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>79571</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2019</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>82004</td>\n",
       "        <td>FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2019</td>\n",
       "        <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>85777</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2019</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>87722</td>\n",
       "        <td>TOPICS IN SOFTWARE ENGINEERING</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2019</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>91884</td>\n",
       "        <td>INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>H02</td>\n",
       "        <td>2019</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('11912', 'TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '010', '2016', '3'),\n",
       " ('34758', 'TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '006', '2017', '1'),\n",
       " ('47421', 'TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '014', '2017', '3'),\n",
       " ('47468', 'INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2017', '3'),\n",
       " ('53309', 'INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2018', '1'),\n",
       " ('53496', 'INTRO TO COMP FOR ENG/APP SCI', 'ENGIE1006', '001', '2018', '1'),\n",
       " ('59651', 'FIELDWORK', 'COMSW3999', '063', '2018', '3'),\n",
       " ('59653', 'INTRODUCTION TO DATABASES', 'COMSW4111', '001', '2018', '3'),\n",
       " ('61720', 'THE ART OF ENGINEERING', 'ENGIE1102', '001', '2018', '3'),\n",
       " ('69174', 'TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications', 'COMSE6156', '001', '2018', '3'),\n",
       " ('79571', 'INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2019', '1'),\n",
       " ('82004', 'FIELDWORK', 'COMSW3999', '063', '2019', '2'),\n",
       " ('85777', 'INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2019', '3'),\n",
       " ('87722', 'TOPICS IN SOFTWARE ENGINEERING', 'COMSE6156', '001', '2019', '3'),\n",
       " ('91884', 'INTRODUCTION TO DATABASES', 'COMSW4111', 'H02', '2019', '3')]"
      ]
     },
     "execution_count": 68,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from w4111f19.course_catalog"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>no_of_rows</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>15</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[(15,)]"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select count(*) as no_of_rows from w4111f19.course_catalog"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Is ```course_no``` a key?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "6 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>course_no</th>\n",
       "        <th>no_of_occurences</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>2</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('COMSE6998', 3),\n",
       " ('COMSW4111', 6),\n",
       " ('ENGIE1006', 1),\n",
       " ('COMSW3999', 2),\n",
       " ('ENGIE1102', 1),\n",
       " ('COMSE6156', 2)]"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select course_no, count(*) as no_of_occurences  from w4111f19.course_catalog group by course_no;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Clearly not."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- How about ```course_no``` and ```year?```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "11 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>course_no</th>\n",
       "        <th>year</th>\n",
       "        <th>no_of_occurences</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>2016</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>2017</td>\n",
       "        <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2018</td>\n",
       "        <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2019</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>2019</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>2019</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('COMSE6998', '2016', 1),\n",
       " ('COMSE6998', '2017', 2),\n",
       " ('COMSW4111', '2017', 1),\n",
       " ('COMSW4111', '2018', 2),\n",
       " ('ENGIE1006', '2018', 1),\n",
       " ('COMSW3999', '2018', 1),\n",
       " ('ENGIE1102', '2018', 1),\n",
       " ('COMSE6156', '2018', 1),\n",
       " ('COMSW4111', '2019', 3),\n",
       " ('COMSW3999', '2019', 1),\n",
       " ('COMSE6156', '2019', 1)]"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select course_no, year, count(*) as no_of_occurences  from w4111f19.course_catalog group by course_no, year;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- How about ```course_no, year, section?```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "15 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>course_no</th>\n",
       "        <th>year</th>\n",
       "        <th>section</th>\n",
       "        <th>no_of_occurences</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>2016</td>\n",
       "        <td>010</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>2017</td>\n",
       "        <td>006</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>2017</td>\n",
       "        <td>014</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2017</td>\n",
       "        <td>003</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2018</td>\n",
       "        <td>002</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>2018</td>\n",
       "        <td>001</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>2018</td>\n",
       "        <td>063</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2018</td>\n",
       "        <td>001</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>2018</td>\n",
       "        <td>001</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>2018</td>\n",
       "        <td>001</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2019</td>\n",
       "        <td>003</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>2019</td>\n",
       "        <td>063</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2019</td>\n",
       "        <td>002</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>2019</td>\n",
       "        <td>001</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>2019</td>\n",
       "        <td>H02</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('COMSE6998', '2016', '010', 1),\n",
       " ('COMSE6998', '2017', '006', 1),\n",
       " ('COMSE6998', '2017', '014', 1),\n",
       " ('COMSW4111', '2017', '003', 1),\n",
       " ('COMSW4111', '2018', '002', 1),\n",
       " ('ENGIE1006', '2018', '001', 1),\n",
       " ('COMSW3999', '2018', '063', 1),\n",
       " ('COMSW4111', '2018', '001', 1),\n",
       " ('ENGIE1102', '2018', '001', 1),\n",
       " ('COMSE6156', '2018', '001', 1),\n",
       " ('COMSW4111', '2019', '003', 1),\n",
       " ('COMSW3999', '2019', '063', 1),\n",
       " ('COMSW4111', '2019', '002', 1),\n",
       " ('COMSE6156', '2019', '001', 1),\n",
       " ('COMSW4111', '2019', 'H02', 1)]"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select course_no, year, section, count(*) as no_of_occurences  from w4111f19.course_catalog \\\n",
    "    group by course_no, year, section;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- That looks promising, but ... \n",
    "    - This is due to the fact that these are the courses that I teach.\n",
    "    - There are three or four database sections each semester.\n",
    "    - It is possible that I could teach ```section 003``` in different semesters. This has not happened, __but it could.__\n",
    "    \n",
    "    \n",
    "- A key is a statement about the __all possible values for the relation/table,__ not just the rows currently in the table.\n",
    "\n",
    "\n",
    "- In this simple case, the actual answer is:\n",
    "    - Course number.\n",
    "    - Section number.\n",
    "    - Semester.\n",
    "    - Year."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# A Worked Example\n",
    "\n",
    "## The Example\n",
    "\n",
    "- CourseWorks, Piazza and a few other places refer to this course with number/title ```COMSW4111_002_2019_3 - INTRODUCTION TO DATABASES```\n",
    "\n",
    "\n",
    "- What does ```COMSW4111_002_2019_3``` mean?\n",
    "\n",
    "\n",
    "- Well, this is documented.\n",
    "\n",
    "\n",
    "- __Note to Instructor:__ Open PDF file for better resolution.\n",
    "\n",
    "| <img src=\"../../images/columbia_course_1.jpg\" width=\"700px\"> |\n",
    "| :---: |\n",
    "| __Course Listing__ |\n",
    "\n",
    "| <img src=\"../../images/columbia_course_2.jpg\" width=\"700px\"> |\n",
    "| :---: |\n",
    "| __Course Listing__ |\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- You can also see information here."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "        <iframe\n",
       "            width=\"800\"\n",
       "            height=\"900\"\n",
       "            src=\"https://bulletin.engineering.columbia.edu/key-course-listings\"\n",
       "            frameborder=\"0\"\n",
       "            allowfullscreen\n",
       "        ></iframe>\n",
       "        "
      ],
      "text/plain": [
       "<IPython.lib.display.IFrame at 0x1e4afdb4e80>"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.display import IFrame    \n",
    "IFrame('https://bulletin.engineering.columbia.edu/key-course-listings', width=800, height=900)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- This exposes some core concepts in data modeling and the relational model. One of the first is \"attribute.\"\n",
    "\n",
    "\n",
    "- The real world likes to think in terms of complex attributes but the relational model focuses on primitive types, which we will see in the next lecture.\n",
    "\n",
    "| <img src=\"../../images/new_ch6/Slide21.jpg\" width=\"700px\"> |\n",
    "| :---: |\n",
    "| __Attributes__ |\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- The first thing we will do is handle the department code in the course ID. \n",
    "    - ```COMSW4111``` or ```ECONW1001``` are valid.\n",
    "    - ```XYPQW4111``` is not.\n",
    "    - There is a fixed set of allowed values for the four characters. $\\Rightarrow$ We need to be able to look up the valid values. $\\Rightarrow$ We need a table with the values.\n",
    "    \n",
    "```\n",
    "CREATE TABLE `cu_dept_codes` (\n",
    "  `dept_code` varchar(4) NOT NULL,\n",
    "  `dept_name` varchar(128) NOT NULL,\n",
    "  PRIMARY KEY (`dept_code`)\n",
    ") ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci;\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>dept_code</th>\n",
       "        <th>dept_name</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td></td>\n",
       "        <td></td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>AHIS</td>\n",
       "        <td>Art History</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>AMCS</td>\n",
       "        <td>Applied Math and Computer Science</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>AMST</td>\n",
       "        <td>American Studies</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>APAM</td>\n",
       "        <td>Applied Physics and Applied Math</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>APBM</td>\n",
       "        <td>Applied Physics and Biomedical Engineering</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>APCH</td>\n",
       "        <td>Applied Physics and Chemical Engineering</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>APMA</td>\n",
       "        <td>Applied Mathematics</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>APPH</td>\n",
       "        <td>Applied Physics</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>ARCH</td>\n",
       "        <td>Architecture</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('', ''),\n",
       " ('AHIS', 'Art History'),\n",
       " ('AMCS', 'Applied Math and Computer Science'),\n",
       " ('AMST', 'American Studies'),\n",
       " ('APAM', 'Applied Physics and Applied Math'),\n",
       " ('APBM', 'Applied Physics and Biomedical Engineering'),\n",
       " ('APCH', 'Applied Physics and Chemical Engineering'),\n",
       " ('APMA', 'Applied Mathematics'),\n",
       " ('APPH', 'Applied Physics'),\n",
       " ('ARCH', 'Architecture')]"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from w4111f19.cu_dept_codes limit 10;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- __Note to Instructor:__ Demo the steps I went through to build this table:\n",
    "    1. Web search.\n",
    "    2. Copy data from page into CSV.\n",
    "    3. Use table data import wizard to load the data.\n",
    "    4. Cleanup the schema:\n",
    "        - ```NOT NULL```\n",
    "        - Primary Key\n",
    "        - ```Varchar()```\n",
    "\n",
    "\n",
    "- These are common tasks in database scenarios."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- What does the current course information table look like?\n",
    "\n",
    "```\n",
    "CREATE TABLE `cw_courses` (\n",
    "  `id` varchar(8) NOT NULL,\n",
    "  `name` varchar(128) NOT NULL,\n",
    "  `uuid` varchar(128) NOT NULL,\n",
    "  `course_code_full` varchar(128) NOT NULL,\n",
    "  `course_no` varchar(12) NOT NULL,\n",
    "  `section` varchar(4) NOT NULL,\n",
    "  `year` char(4) NOT NULL,\n",
    "  `semester` char(2) NOT NULL,\n",
    "  PRIMARY KEY (`id`)\n",
    ") ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci;\n",
    "\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "0 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%%sql\n",
    "use w4111f19;"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>id</th>\n",
       "        <th>name</th>\n",
       "        <th>uuid</th>\n",
       "        <th>course_code_full</th>\n",
       "        <th>course_no</th>\n",
       "        <th>section</th>\n",
       "        <th>year</th>\n",
       "        <th>semester</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>11912</td>\n",
       "        <td>COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg</td>\n",
       "        <td>COMSE6998_010_2016_3</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>010</td>\n",
       "        <td>2016</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>34758</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>006</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47421</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>014</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47468</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53309</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53496</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59651</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59653</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>61720</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>69174</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications</td>\n",
       "        <td>DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('11912', 'COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE', 'Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg', 'COMSE6998_010_2016_3', 'COMSE6998', '010', '2016', '3'),\n",
       " ('34758', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '006', '2017', '1'),\n",
       " ('47421', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '014', '2017', '3'),\n",
       " ('47468', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2017', '3'),\n",
       " ('53309', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2018', '1'),\n",
       " ('53496', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'ENGIE1006', '001', '2018', '1'),\n",
       " ('59651', 'COMSW3999_063_2018_3 - FIELDWORK', 'EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ', 'COMSW3999_063_2018_3 - FIELDWORK', 'COMSW3999', '063', '2018', '3'),\n",
       " ('59653', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '001', '2018', '3'),\n",
       " ('61720', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'ENGIE1102', '001', '2018', '3'),\n",
       " ('69174', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications', 'DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING', 'COMSE6156', '001', '2018', '3')]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from cw_courses limit 10"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- The first thing we will do is make a copy of the table. We will clean up the new table but keep the old table in cases we make a mistake or need the original data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "15 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql create table cu_cw_courses as select * from cw_courses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>id</th>\n",
       "        <th>name</th>\n",
       "        <th>uuid</th>\n",
       "        <th>course_code_full</th>\n",
       "        <th>course_no</th>\n",
       "        <th>section</th>\n",
       "        <th>year</th>\n",
       "        <th>semester</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>11912</td>\n",
       "        <td>COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg</td>\n",
       "        <td>COMSE6998_010_2016_3</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>010</td>\n",
       "        <td>2016</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>34758</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>006</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47421</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>014</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47468</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53309</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53496</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59651</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59653</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>61720</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>69174</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications</td>\n",
       "        <td>DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('11912', 'COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE', 'Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg', 'COMSE6998_010_2016_3', 'COMSE6998', '010', '2016', '3'),\n",
       " ('34758', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '006', '2017', '1'),\n",
       " ('47421', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '014', '2017', '3'),\n",
       " ('47468', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2017', '3'),\n",
       " ('53309', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2018', '1'),\n",
       " ('53496', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'ENGIE1006', '001', '2018', '1'),\n",
       " ('59651', 'COMSW3999_063_2018_3 - FIELDWORK', 'EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ', 'COMSW3999_063_2018_3 - FIELDWORK', 'COMSW3999', '063', '2018', '3'),\n",
       " ('59653', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '001', '2018', '3'),\n",
       " ('61720', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'ENGIE1102', '001', '2018', '3'),\n",
       " ('69174', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications', 'DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING', 'COMSE6156', '001', '2018', '3')]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from cu_cw_courses limit 10"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- There are several variations of the ```SELECT``` statement. \n",
    "    - ```CREATE TABLE new_tbl [AS] SELECT * FROM orig_tbl;``` [CREATE TBALE SELECT](https://dev.mysql.com/doc/refman/8.0/en/create-table-select.html)\n",
    "        - Create a new table.\n",
    "        - Create matching columns.\n",
    "        - Copy the data.\n",
    "        - Does not copy the various constraints, e.g. keys.\n",
    "    - ```CREATE TABLE new_tbl LIKE orig_tbl;``` \"Use [CREATE TABLE ... LIKE](https://dev.mysql.com/doc/refman/8.0/en/create-table-like.html) to create an empty table based on the definition of another table, including any column attributes and indexes defined in the original table.\" \n",
    "    - [SELECT INTO](https://www.w3schools.com/sql/sql_select_into.asp)\n",
    "        ```\n",
    "        SELECT column1, column2, column3, ...\n",
    "            INTO newtable [IN externaldb]\n",
    "            FROM oldtable\n",
    "            WHERE condition;\n",
    "        ```\n",
    "\n",
    "- These are very useful statements. Some of the details of the syntax vary between RDBs."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- We need to add a column that will hold the department ID. This requires a data definition language operation.\n",
    "    - We have seen ```CREATE TABLE```\n",
    "    - There is also ```ALTER TABLE```\n",
    "    \n",
    "    ```\n",
    "    ALTER TABLE `w4111f19`.`cu_cw_courses` \n",
    "    ADD COLUMN `dept_code` VARCHAR(4) NULL AFTER `semester`;\n",
    "    ```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- We now need to extract the code from the string that concatenates all of the fields together.\n",
    "\n",
    "\n",
    "- This is __very__ tricky in SQL. Writing a little snippet of code is easier.\n",
    "\n",
    "\n",
    "- How long are the department codes?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "2 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>length(dept_code)</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[(0,), (4,)]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select distinct length(dept_code) from cu_dept_codes;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- What happened here? Well, I clearly loaded an invalid row somehow. I need to get rid of it."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql delete from cu_dept_codes where length(dept_code) = 0;"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "1 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>length(dept_code)</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>4</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[(4,)]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select distinct length(dept_code) from cu_dept_codes;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- What was that weird ```SELECT``` statement?\n",
    "    - The selection operator filters out rows that do not match the condition.\n",
    "    - The projection operator defines a subset of the columns.\n",
    "    - The result MAY have duplicate row values, even if the original table did not contain duplicates.\n",
    "    - ```DISTINCT``` gets rid of duplicates.\n",
    "    \n",
    "    ```\n",
    "    SELECT DISTINCT column1, column2, ...\n",
    "        FROM table_name WHERE condition;\n",
    "    ```\n",
    "    \n",
    "- And the ```length()?``` \"Returns the length of the string, in bytes.\" (https://www.w3schools.com/sql/func_mysql_length.asp)\n",
    "\n",
    "\n",
    "- We now need to break apart the composite class numbers to get department codes. This is a two step process:\n",
    "    - Load the department codes into a list.\n",
    "    - Go through the course numbers and ensure that the department code we extract is in the list of valid codes.\n",
    "    \n",
    "    \n",
    "- __Step 1: Load he data:__"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "def get_dept_codes():\n",
    "    \n",
    "    sql = \"select * from w4111f19.cu_dept_codes\"\n",
    "    \n",
    "    # A better solution would pass connection into function or make an API call.\n",
    "    cnx = default_cnx\n",
    "    cur = cnx.cursor()\n",
    "    res = cur.execute(sql)\n",
    "    dept_info = cur.fetchall()\n",
    "    \n",
    "    result = {}\n",
    "    for d in dept_info:\n",
    "        result[d['dept_code']] = d['dept_name']\n",
    "        \n",
    "    return result\n",
    "    \n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "codes = get_dept_codes()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "A sample code = { 'COMS': 'Computer Science'}\n",
      "A sample code = { 'MATH': 'Mathematics'}\n"
     ]
    }
   ],
   "source": [
    "print(\"A sample code = { 'COMS': '\" + codes[\"COMS\"] + \"'}\")\n",
    "print(\"A sample code = { 'MATH': '\" + codes[\"MATH\"] + \"'}\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "__Step 2:__ Given a string, extract the department code."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "def explode_to_dept_code(in_s, codes):\n",
    "    \n",
    "    dept_code = in_s[0:4]\n",
    "    the_rest = in_s[4:-1]\n",
    "    \n",
    "    dept_name = codes.get(dept_code, None)\n",
    "    \n",
    "    if dept_name is not None:\n",
    "        result = dept_code, the_rest\n",
    "    else:\n",
    "        result = None, None\n",
    "        \n",
    "    return result"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The exploded string =  ('COMS', 'W399')\n"
     ]
    }
   ],
   "source": [
    "test_s = \"COMSW3999\"\n",
    "dept_code_and_rest = explode_to_dept_code(test_s, codes)\n",
    "print(\"The exploded string = \", dept_code_and_rest)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "test_s = \"COMSW3999\"\n",
    "dept_code_and_rest = explode_to_dept_code(test_s, codes)\n",
    "print(\"The exploded string = \", dept_code_and_rest)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The exploded string =  ('ENGI', 'E1102_001_2018_3 - THE ART OF ENGINEERIN')\n"
     ]
    }
   ],
   "source": [
    "test_s = \"ENGIE1102_001_2018_3 - THE ART OF ENGINEERING\"\n",
    "dept_code_and_rest = explode_to_dept_code(test_s, codes)\n",
    "print(\"The exploded string = \", dept_code_and_rest)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- What does the new table where are building look like?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>id</th>\n",
       "        <th>name</th>\n",
       "        <th>uuid</th>\n",
       "        <th>course_code_full</th>\n",
       "        <th>course_no</th>\n",
       "        <th>section</th>\n",
       "        <th>year</th>\n",
       "        <th>semester</th>\n",
       "        <th>dept_code</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>11912</td>\n",
       "        <td>COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg</td>\n",
       "        <td>COMSE6998_010_2016_3</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>010</td>\n",
       "        <td>2016</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>34758</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>006</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47421</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>014</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47468</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53309</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53496</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59651</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59653</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>61720</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>69174</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications</td>\n",
       "        <td>DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>None</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('11912', 'COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE', 'Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg', 'COMSE6998_010_2016_3', 'COMSE6998', '010', '2016', '3', None),\n",
       " ('34758', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '006', '2017', '1', None),\n",
       " ('47421', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '014', '2017', '3', None),\n",
       " ('47468', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2017', '3', None),\n",
       " ('53309', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2018', '1', None),\n",
       " ('53496', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'ENGIE1006', '001', '2018', '1', None),\n",
       " ('59651', 'COMSW3999_063_2018_3 - FIELDWORK', 'EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ', 'COMSW3999_063_2018_3 - FIELDWORK', 'COMSW3999', '063', '2018', '3', None),\n",
       " ('59653', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '001', '2018', '3', None),\n",
       " ('61720', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'ENGIE1102', '001', '2018', '3', None),\n",
       " ('69174', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications', 'DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING', 'COMSE6156', '001', '2018', '3', None)]"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from w4111f19.cu_cw_courses limit 10;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- Note that the department code is None.\n",
    "\n",
    "\n",
    "- We should set it. This is an update statement."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [],
   "source": [
    "def set_dept_codes(codes):\n",
    "    \n",
    "    sql = \"select * from w4111f19.cu_cw_courses\"\n",
    "    cnx = default_cnx\n",
    "    cur = default_cnx.cursor()\n",
    "    res = cur.execute(sql)\n",
    "    courses = cur.fetchall()\n",
    "    \n",
    "    for c in courses:\n",
    "        dept_code = explode_to_dept_code(c['name'], codes)\n",
    "        cid = c['id']\n",
    "        \n",
    "        u_sql = \"update w4111f19.cu_cw_courses set dept_code=%s where id=%s\"\n",
    "        args = (dept_code[0], int(cid))\n",
    "        mogrified = cur.mogrify(u_sql, args)\n",
    "        print(\"Mogrfied = \", mogrified)\n",
    "        res = cur.execute(u_sql,args=args)\n",
    "        \n",
    "        if res != 1:\n",
    "            print(\"Some bad happened with statement = \" + mogrified)\n",
    "            \n",
    "        cnx.commit()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=11912\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=34758\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=47421\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=47468\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=53309\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='ENGI' where id=53496\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=59651\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=59653\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='ENGI' where id=61720\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=69174\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=79571\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=82004\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=85777\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=87722\n",
      "Mogrfied =  update w4111f19.cu_cw_courses set dept_code='COMS' where id=91884\n"
     ]
    }
   ],
   "source": [
    "set_dept_codes(codes)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- What do we have?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " * mysql+pymysql://dbuser:***@localhost/lahman2019raw\n",
      "10 rows affected.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "    <tr>\n",
       "        <th>id</th>\n",
       "        <th>name</th>\n",
       "        <th>uuid</th>\n",
       "        <th>course_code_full</th>\n",
       "        <th>course_no</th>\n",
       "        <th>section</th>\n",
       "        <th>year</th>\n",
       "        <th>semester</th>\n",
       "        <th>dept_code</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>11912</td>\n",
       "        <td>COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg</td>\n",
       "        <td>COMSE6998_010_2016_3</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>010</td>\n",
       "        <td>2016</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>34758</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB</td>\n",
       "        <td>COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>006</td>\n",
       "        <td>2017</td>\n",
       "        <td>1</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47421</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02</td>\n",
       "        <td>COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE</td>\n",
       "        <td>COMSE6998</td>\n",
       "        <td>014</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>47468</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos</td>\n",
       "        <td>COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>003</td>\n",
       "        <td>2017</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53309</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS</td>\n",
       "        <td>COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>002</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>53496</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn</td>\n",
       "        <td>ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI</td>\n",
       "        <td>ENGIE1006</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>1</td>\n",
       "        <td>ENGI</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59651</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ</td>\n",
       "        <td>COMSW3999_063_2018_3 - FIELDWORK</td>\n",
       "        <td>COMSW3999</td>\n",
       "        <td>063</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>59653</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO</td>\n",
       "        <td>COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES</td>\n",
       "        <td>COMSW4111</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>61720</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b</td>\n",
       "        <td>ENGIE1102_001_2018_3 - THE ART OF ENGINEERING</td>\n",
       "        <td>ENGIE1102</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>ENGI</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "        <td>69174</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications</td>\n",
       "        <td>DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO</td>\n",
       "        <td>COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING</td>\n",
       "        <td>COMSE6156</td>\n",
       "        <td>001</td>\n",
       "        <td>2018</td>\n",
       "        <td>3</td>\n",
       "        <td>COMS</td>\n",
       "    </tr>\n",
       "</table>"
      ],
      "text/plain": [
       "[('11912', 'COMSE6998_010_2016_3 - TOPICS IN COMPUTER SCIENCE', 'Y3XcZ9J82EDh9kkg0kt39sfJqk8CICel87pFpqOg', 'COMSE6998_010_2016_3', 'COMSE6998', '010', '2016', '3', 'COMS'),\n",
       " ('34758', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'fYjLmtqww7kCS6JSdUfsE8RXJrXw72HFYpnNaFaB', 'COMSE6998_006_2017_1 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '006', '2017', '1', 'COMS'),\n",
       " ('47421', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'IvQbt4Mdx4C1bRlPEUjDfStnDQo9igKlAQZt6I02', 'COMSE6998_014_2017_3 - TOPICS IN COMPUTER SCIENCE', 'COMSE6998', '014', '2017', '3', 'COMS'),\n",
       " ('47468', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'u1whFR4fbAzA2TvcHrvyO3JsPNuQYnKDp4aMLFos', 'COMSW4111_003_2017_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '003', '2017', '3', 'COMS'),\n",
       " ('53309', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'hw9PXeLFcEAMHu6IaxPIf9MwrpCqAzqHv38SunnS', 'COMSW4111_002_2018_1 - INTRODUCTION TO DATABASES', 'COMSW4111', '002', '2018', '1', 'COMS'),\n",
       " ('53496', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'zCBPPwUJPvvB7X6XqiKdMQXM40ZZNCcu0y0vvoOn', 'ENGIE1006_001_2018_1 - INTRO TO COMP FOR ENG/APP SCI', 'ENGIE1006', '001', '2018', '1', 'ENGI'),\n",
       " ('59651', 'COMSW3999_063_2018_3 - FIELDWORK', 'EoVhsA5Yr82hIdiIgOnqZKywOAhOsDOoUMuV7mSJ', 'COMSW3999_063_2018_3 - FIELDWORK', 'COMSW3999', '063', '2018', '3', 'COMS'),\n",
       " ('59653', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'BcVGotSt8dHZD6QgSvifqLb3fQmCreb4WYoJcCPO', 'COMSW4111_001_2018_3 - INTRODUCTION TO DATABASES', 'COMSW4111', '001', '2018', '3', 'COMS'),\n",
       " ('61720', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'O0b726Sg9tnO74tP4Fua8ngL2lJgpOQ6BGjTCk4b', 'ENGIE1102_001_2018_3 - THE ART OF ENGINEERING', 'ENGIE1102', '001', '2018', '3', 'ENGI'),\n",
       " ('69174', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING: Cloud and Microservice Applications', 'DO57H1uh7HiQ3fyx9F9Ag9Bxjnsxe42QWO2BmzFO', 'COMSE6156_001_2018_3 - TOPICS IN SOFTWARE ENGINEERING', 'COMSE6156', '001', '2018', '3', 'COMS')]"
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "%sql select * from w4111f19.cu_cw_courses limit 10;"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "- And, we can do a couple of more things:\n",
    "    - Mark the department code ```NOT NULL``` $\\Rightarrow$ Cannot enter data in the future without setting code.\n",
    "    - Define a foreign key onto the valid dept_codes $\\Rightarrow$ Cannot insert a code that is not valid.\n",
    "    \n",
    "    ```\n",
    "    ALTER TABLE `w4111f19`.`cu_cw_courses` \n",
    "    CHANGE COLUMN `dept_code` `dept_code` VARCHAR(4) NOT NULL ,\n",
    "    ADD INDEX `dept_fk_rel_idx` (`dept_code` ASC) VISIBLE;\n",
    "    ;\n",
    "    ALTER TABLE `w4111f19`.`cu_cw_courses` \n",
    "    ADD CONSTRAINT `dept_fk_rel`\n",
    "      FOREIGN KEY (`dept_code`)\n",
    "      REFERENCES `w4111f19`.`cu_dept_codes` (`dept_code`)\n",
    "      ON DELETE NO ACTION\n",
    "      ON UPDATE NO ACTION;\n",
    "    \n",
    "    ```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Learning Impact\n",
    "\n",
    "- That was a little confusing, but more importantly, \"Why did you bore us with that?\"\n",
    "\n",
    "\n",
    "- There are a few reasons:\n",
    "    1. I am inherently boring. Get used to it.\n",
    "    2. Data cleanup is a common task in almost any database application, even scenarios that are just running queries for analytics or accessing from Jupyter notebooks.\n",
    "    3. You have seen an example of a little task that would have been hard to do just in SQL because it used looping, operations inside loops, if statements, ... This is one reason why people write DB applications.\n",
    "    4. This is an example of a cleanup problem of a problem I might assign on a take home exam.\n",
    "    5. You got an introduction to core concepts in the relational model:\n",
    "        - Atomic attributes versus composite attributes.\n",
    "        - An example of two integrity constraints."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  },
  "toc": {
   "base_numbering": 1,
   "nav_menu": {},
   "number_sections": true,
   "sideBar": true,
   "skip_h1_title": false,
   "title_cell": "Table of Contents",
   "title_sidebar": "Contents",
   "toc_cell": false,
   "toc_position": {
    "height": "calc(100% - 180px)",
    "left": "10px",
    "top": "150px",
    "width": "286px"
   },
   "toc_section_display": true,
   "toc_window_display": false
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}