Docs Revamp: Datasets docs (#146)

Add documentation for Datasets

Author: NimaBoscarino

docs/assets/hub/datasets-gated.png

@@ -9,3 +9,6 @@
 
 - local: spaces-main
   title: Spaces
+
+- local: datasets-main
+  title: Datasets

docs/assets/hub/datasets-main.png

@@ -0,0 +1,17 @@
+---
+title: Adding New Datasets
+---
+
+<h1>Adding new datasets</h1>
+
+Any Hugging Face user can create a dataset! You can start by [creating your dataset repository](https://huggingface.co/new-dataset) and choosing one of the following methods to upload your dataset:
+
+* [Add files manually to the repository through the UI](https://huggingface.co/docs/datasets/upload_dataset#upload-your-files)
+* [Push files with the `push_to_hub` method from 🤗 Datasets](https://huggingface.co/docs/datasets/upload_dataset#upload-from-python)
+* [Use Git to commit and push your dataset files](https://huggingface.co/docs/datasets/share#clone-the-repository)
+
+While it's possible to add raw data to your dataset repo in a number of formats (JSON, CSV, Parquet, text, and images), for large datasets you may want to [create a loading script](https://huggingface.co/docs/datasets/dataset_script#create-a-dataset-loading-script). This script defines the different configurations and splits of your dataset, as well as how to download and process the data.
+
+## Datasets outside a namespace
+
+Datasets outside a namspace are maintained by the Hugging Face team on GitHub. Unlike the naming convention used for community datasets (`username/dataset_name` or `org/dataset_name`), datasets outside a namespace can be referenced directly by their name (e.g. [`glue`](https://huggingface.co/datasets/glue)). If you find that an improvement is needed, refer to the [🤗 Datasets documentation](https://huggingface.co/docs/datasets/master/en/share#datasets-on-github-legacy) for an explanation on how to submit a PR on GitHub to propose edits.

docs/hub/_sections.yml

@@ -0,0 +1,11 @@
+---
+title: Dataset Cards
+---
+
+<h1>Dataset Cards</h1>
+
+Each dataset may be documented by the `README.md` file in the repository. This file is called a **dataset card**, and the Hugging Face Hub will render its contents on the dataset's main page. To inform users about how to responsibly use the data, it's a good idea to include information about any potential biases within the dataset. Generally, dataset cards help users understand the contents of the dataset and give context for how the dataset should be used.
+
+The [Dataset Card Creation Guide](https://github.com/huggingface/datasets/blob/master/templates/README_guide.md) gives an overview of what components are found in a dataset card. The process for creating a new dataset card is outlined in the [Create a dataset card](https://huggingface.co/docs/datasets/dataset_card) guide.
+
+Reading through existing dataset cards, such as the [ELI5 dataset card](https://github.com/huggingface/datasets/blob/master/datasets/eli5/README.md), is a great way to familiarize yourself with the common conventions. There is also an [interactive dataset card builder](https://huggingface.co/datasets/card-creator/) that can guide you through creating your card.

docs/hub/datasets-adding.md

@@ -0,0 +1,23 @@
+---
+title: Gated datasets
+---
+
+<h1>Gated datasets</h1>
+
+To give dataset creators more control over how their datasets are used, the Hub allows users to enable **User Access requests** through a dataset's **Settings** tab. Enabling this setting requires users to agree to share their contact information with Hugging Face in order to access the dataset. The contact information is stored in a database, and dataset owners are able to download a copy of the user access report.
+
+The User Access request dialog can be modified to include additional text and checkbox fields in the prompt. To do this, add a YAML section to the dataset's `README.md` file (create one if it does not already exist) and add an `extra_gated_fields` property. Within this property, you'll be able to add as many custom fields as you like and whether they are a `text` or `checkbox` field. An `extra_gated_prompt` property can also be included to add a customized text message.
+
+```
+---
+extra_gated_prompt: "You agree to not attempt to determine the identity of individuals in this dataset"
+extra_gated_fields:
+ Company: text
+ Country: text
+ I agree to use this model for non-commerical use ONLY: checkbox
+---
+```
+
+![A gated Dataset showing the User Access request dialog](/docs/assets/hub/datasets-gated.png)
+
+The `README.md` file for a dataset is called a [Dataset Card](./datasets-cards). Visit the documentation to learn more about how to use it and to see the properties that you can configure.

docs/hub/datasets-cards.md

@@ -0,0 +1,16 @@
+---
+title: Datasets
+---
+
+<h1>Datasets</h1>
+
+The Hugging Face Hub is home to a growing collection of datasets that span a variety of domains and tasks. These docs will guide you through interacting with the datasets on the Hub, uploading new datasets, and using datasets in your projects.
+
+This documentation focuses on the datasets functionality in the Hugging Face Hub instead of the 🤗 Datasets library. For detailed information about 🤗 Datasets, visit the [🤗 Datasets documentation](https://huggingface.co/docs/datasets/index).
+## Contents
+
+- [Datasets Overview](./datasets-overview)
+- [Dataset Cards](./datasets-cards)
+- [Gated Datasets](./datasets-gated)
+- [Using Datasets](./datasets-usage)
+- [Adding New Datasets](./datasets-adding)

docs/hub/datasets-gated.md

@@ -0,0 +1,21 @@
+---
+title: Datasets Overview
+---
+
+<h1>Datasets Overview</h1>
+
+## Datasets on the Hub
+
+The Hugging Face Hub hosts a [large number of community-curated datasets](https://huggingface.co/datasets) for a diverse range of tasks such as translation, automatic speech recognition, and image classification. Alongside the information contained in the [dataset card](./datasets-cards), many datasets, such as [GLUE](https://huggingface.co/datasets/glue), include a Dataset Preview to showcase the data. There is also a handy [Datasets Viewer](https://huggingface.co/datasets/viewer/) which also displays the features of a dataset in addition to the preview.
+
+Each dataset is a [Git repository](./repositories-main), equipped with the necessary scripts to download the data and generate splits for training, evaluation, and testing. For information on how a dataset repository is structured, refer to the [Structure your repository guide](https://huggingface.co/docs/datasets/repository_structure).
+
+## Search for datasets
+
+Like models and Spaces, you can search the Hub for datasets using the search bar in the top navigation or on the [main datasets page](https://huggingface.co/datasets). There's a large number of languages, tasks, and licenses that you can use to filter your results to find a dataset that's right for you.
+
+![Datasets search page on the Hugging Face Hub](/docs/assets/hub/datasets-main.png)
+
+## Privacy
+
+Since datasets are repositories, you can [toggle their visibility between private and public](./repositories-best-practices) through the Settings tab. If a dataset is owned by an [organization](TODO), the privacy settings apply to all the members of the organization.

docs/hub/datasets-main.md

@@ -0,0 +1,9 @@
+---
+title: Using 🤗 Datasets
+---
+
+<h1>Using 🤗 Datasets</h1>
+
+Once you've found an interesting dataset on the Hugging Face Hub, you can load the dataset using 🤗 Datasets. You can click on the **Use in dataset library** button to copy the code to load a dataset. Many datasets on the Hub contain a [loading script](https://huggingface.co/docs/datasets/dataset_script), which allows you to easily [load the dataset when you need it](https://huggingface.co/docs/datasets/load_hub).
+
+Some datasets might not include a loading script, in which case the data might be stored directly in the repository, in formats such as CSV, JSON and Parquet. 🤗 Datasets can [load those kinds of datasets](https://huggingface.co/docs/datasets/loading#hugging-face-hub) as well. For more information about using 🤗 Datasets, check out the [tutorials](https://huggingface.co/docs/datasets/tutorial) and [how-to guides](https://huggingface.co/docs/datasets/how_to) available in the 🤗 Datasets documentation.