Skip to content

Steps for pre-trained REALM models #208

Description

@hahazhar

I have a question regarding the demo which was also mentioned in issue #67 . I have executed the following lines.

git clone https://github.com/google-research/language cd language

conda create --name orqa python=3.7 source activate orqa pip install -r language/orqa/requirements.txt

conda create --name orqa python=3.7 source activate orqa pip install -r language/orqa/requirements.txt

python -m language.orqa.utils.scann_utils_test

git clone https://github.com/facebookresearch/DrQA.git cd DrQA export DRQA_PATH=$(pwd) sh download.sh

After installing the gsutil, do I have to execute the following lines?

mkdir original_nq gsutil -m cp -R gs://natural_questions/v1.0 original_nq cd original_nq export ORIG_NQ_PATH=$(pwd)

The data is 45Gb and I do not have the space.
Or do i change it to "gsutil -m cp -R gs://realm-data/orqa_nq_model_from_realm" ?

or simply will suffice ?

python -m language.orqa.predict.orqa_demo \ --model_dir=gs://orqa-data/orqa_nq_model \ --port=8080

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions