[ECS 289G-Project] Constructing Compelling Narratives: A Multimodal Framework for Story Generation

How to run?

After cloning the repository

Client

Install and check that the client compiles:

cd client
npm i
npm run build

Backend

Install and activate the environment (conda provided):

conda env create -f environment.yml
conda activate MultiModalStory

Install environment globally in the directory:

pip install -e .
pip install git+https://github.com/openai/CLIP.git

After installation run:

python -m spacy download en_core_web_sm

In python terminal:

nltk.download('wordnet')
nltk.download('sentiwordnet')
nltk.download('averaged_perceptron_tagger')

Large Data Management

dvc pull -f

Which will pull:

• backend/outputs (five preset stories)
• backend/story_generator/downloaded (transformers)
• client/public/unsplash25k (styled images)

Running the framework during development

Client:

cd client
npm run devw

Backend (with server auto reload):

uvicorn backend.server:app --reload --reload-dir backend

Open the uvicorn server localhost:8000 in your web browser