Skip to content

Commit

Permalink
added back the retro documents (#7033)
Browse files Browse the repository at this point in the history 
Signed-off-by: Yi Dong <yidong@nvidia.com>
  • Loading branch information
@yidong72
yidong72 authored Jul 18, 2023
1 parent 8b4b382 commit 9051440
Showing 1 changed file with 444 additions and 2 deletions.
Loading

1 comment on commit 9051440

@yaroslavvb
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW, running the example in code gives

hydra.errors.ConfigCompositionException: Could not override 'retrieval_service.sentence_bert.devices'.
To append to your config use +retrieval_service.sentence_bert.devices='0,1,2,3,4,5,6,7'

All examples I found of megatron_retro_eval.py use several fields which are not present in megatron_retro_inference.yaml so I get errors like Could not override 'retrieval_service.services.0.faiss_devices'.

retrieval_service.sentence_bert
retrieval_service.faiss_devices
retrieval_service.faiss_devices
retrieval_service.faiss_index

Instead I see these fields defined in static_retrieval_service.yaml and dynamic_retrieval_service.yaml.

Is retro eval meant to be runnable as a standalone command-line call?

@yidong72

Please sign in to comment.