chapter06

[Mandeepumra]

chapter record:

chapter06 directory

a narrative for the chapter

README.md file

environment and origins:

macOS
python version 3.8.0
docanalysis version 0.2.0
py4ami version 0.0.45

What we started with and our environment.

software used: py4ami docanalysis

How we set up the software:

1. Install Anaconda
2. open Anaconda
3. Create venv
4. setup python version 3.8.0
5. run
   pip install docanalysis
docanalysis --help

creation of raw HTML:

created pdf to html:
python -m py4ami.ami_pdf --inpath fulltext.pdf --outdir / --maxpage 110

tools used, comments on result.

py4ami
docanalysis

creation of sections

• dict: this section contains two types of dictionaries
  • ip_3_6_energy_man.xml
  • ip_3_6_energy_abb.xml

extraction of dictionaries

1. ip_3_6_energy_man.xml: created manually by reading the chapter.
2. ip_3_6_energy_abb.xml: automated created by docanalysis using spacy

manual

1. ip_3_6_energy_man.xml: Manually created by the chapter champions from chapter reading having most of the terms that are important for chapter and difficult to understand. It's in .XML format

abbreviation

2. ip_3_6_energy_abb.xml: automated created by docanalysis using spacy.

method:

• mkdir wiki_hackathon

• wiki_hackathon

• mkdir Chapter06

• cd Chapter06

• mkdir sections

• cd sections

• mkdir 0_main_body

• Place the html of your chapter inside the 0_main_body directory.

docanalysis --project_name wiki_hackathon --output dict_search_5.csv --make_json dict_search_5.json --make_ami_dict entities --extract_abb ip_3_6_energy_abb

where,

--project name – the name of the project (here, wiki_hackathon)

--output - a csv for dictionary search (not of our use, but required to be created)

--make_json - just enter this. Not of current use, but required.

--make_ami_dict – uses the entities created in the above command

--extract_abb - the abbreviation dictionary that is the output.

keyword/phrase: keyword are extracted by the help of gensim method

introduction.md

table of centents.md

FAQs.md

annotation of HTML using dictionaries:

• html is annotated with dict. by the help of py4ami method:

   py4ami HTML\
 --annotate --dict \
/Users/Mandeep/Desktop/PROJECT/CLIMATE/semanticClimate/ipcc/ar6/wg3/Chapter06/dict/energy_abb.xml \
--inpath /Users/Mandeep/Desktop/PROJECT/CLIMATE/semanticClimate/ipcc/ar6/wg3/Chapter06/fulltext.html \
--outpath /Users/Mandeep/Desktop/PROJECT/CLIMATE/semanticClimate/ipcc/ar6/wg3/Chapter06/annotated_fulltext_chapter06.html--color YELLOW```

where,

--dict – the path of the dictionary to be annotated with the dictionary name as well

--inpath – the path of the full text html with the name of the html file as well

--outpath – the path of the output, with the name of the output html file

--color - the colour in which the annotated words should be highlighted in the annotated html