Download nltk's punkt_tab in align_score Dockerfile

[yonromai]

Description

Fixes an issue where alignscore-server (defined in nemoguardrails/library/factchecking/align_score/Dockerfile) throws a runtime LookupError(resource_not_found) error. This error seems to be due to a breaking change in nltk. Please see steps below to reproduce.

cc: @drazvan

Steps to reproduce the error

Build alignscore-server Docker Image:

# from the root of NeMo-Guardrails
cd nemoguardrails/library/factchecking/align_score
docker build -t alignscore-server .

Run alignscore-server:

docker run -p 5123:5000 alignscore-server
# ...
# INFO:     Uvicorn running on http://0.0.0.0:5000 (Press CTRL+C to quit)

Send a request to alignscore-server (executed from a local notebook):

from nemoguardrails.library.factchecking.align_score.request import alignscore_request

await alignscore_request(
	api_url="http://localhost:5123/alignscore_base",
	evidence="Hello, world!",
	response="Hello, world!",
)
# Output: "AlignScore API request failed with status 500"

• Note: I get a similar behavior when LLMRails invokes the alignscore_check_facts action; which is how I encountered this issue in the first place.

Logs from alignscore-server:

INFO:     172.17.0.1:60146 - "POST /alignscore_base HTTP/1.1" 500 Internal Server Error
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  [...]
  File "/usr/local/lib/python3.10/site-packages/nltk/tokenize/punkt.py", line 1749, in load_lang
    lang_dir = find(f"tokenizers/punkt_tab/{lang}/")
  File "/usr/local/lib/python3.10/site-packages/nltk/data.py", line 579, in find
    raise LookupError(resource_not_found)
LookupError:
**********************************************************************
  Resource punkt_tab not found.
  Please use the NLTK Downloader to obtain the resource:

  >>> import nltk
  >>> nltk.download('punkt_tab')

  For more information see: https://www.nltk.org/data.html

  Attempted to load tokenizers/punkt_tab/english/

  Searched in:
    - '/root/nltk_data'
    - '/usr/local/nltk_data'
    - '/usr/local/share/nltk_data'
    - '/usr/local/lib/nltk_data'
    - '/usr/share/nltk_data'
    - '/usr/local/share/nltk_data'
    - '/usr/lib/nltk_data'
    - '/usr/local/lib/nltk_data'
**********************************************************************

After this commit

Re-build and re-run container:

docker build -t alignscore-server .
docker run -p 5123:5000 alignscore-server

Request:

await alignscore_request(
	api_url="http://localhost:5123/alignscore_base",
	evidence="Hello, world!",
	response="Hello, world!",
)
# Output: 0.9991656541824341

Logs from alignscore-server:

INFO:     172.17.0.1:61214 - "POST /alignscore_base HTTP/1.1" 200 OK

Related Issue(s)

nltk/nltk#3293

Checklist

• I've read the CONTRIBUTING guidelines.
• I've updated the documentation if applicable.
• I've added tests if applicable.
• @mentions of the person or team responsible for reviewing proposed changes.

[Pouyanpi]

Thank you @yonromai for catching this 👍🏻 LGTM!

[Pouyanpi]

reference to the issue nltk/nltk#3293

[Pouyanpi]

@yonromai would you please gpg sign your commits per CONTRIBUTING.md?

[yonromai]

@yonromai would you please gpg sign your commits per CONTRIBUTING.md?

Thank you for taking a look @Pouyanpi

I thought I signed the previous commit; wondering if something went wrong when rebasing/force-pushing. Anyway, I re-pushed and it should be good now:

[Pouyanpi]

@yonromai would you please gpg sign your commits per CONTRIBUTING.md?

Thank you for taking a look @Pouyanpi

I thought I signed the previous commit; wondering if something went wrong when rebasing/force-pushing. Anyway, I re-pushed and it should be good now:

My bad, you are right, the auto update branch removed the signature! Thanks for signing it again.