Getting started with BB3

[galleon]

Hi here

I used to work with bb2 some months ago, and my new end goal is to fine tune bb3. As a starter, I want just to try the 3b model. According to the doc, it should be as simple as:

pyenv virtualenv 3.8.13 bb3 # Installing python 3.8
pyenv local bb3
pip install parlai transformers spacy

and then

parlai interactive --model-file zoo:bb3/bb3_3B/model --init-opt gen/r2c2_bb3

or

parlai interactive --model-file zoo:bb3/bb3_3B/model -o gen/r2c2_bb3

By doing so, the 5.36G bb3 model is downloaded but then I got the following error message:

FileNotFoundError: Could not find filename 'gen/r2c2_bb3.opt or opt preset 'gen/r2c2_bb3.opt.opt'. Please check https://parl.ai/docs/opt_presets.html for a list of available opt presets.

According to the doc, those opt presets are bundled with ParlAI and may be used by simply invoking the -o options but that does not work.

What did I miss ?

[galleon]

Here what I finally did to get it running:

git clone https://github.com/facebookresearch/ParlAI.git
cd ParlAI
pyenv virtualenv 3.8.13 bb3
pyenv local bb3
pip3 install --upgrade pip
pip install scikit-build # To avoid ModuleNotFoundError: No module named 'skbuild'
python setup.py develop 
pip install -r requirements.txt
pip install transformers
parlai interactive --model-file zoo:bb3/bb3_3B/model --init-opt gen/r2c2_bb3