This project is purely educational and was developed during the 3rd year of education at HSE. SQuAD allows researchers to train strong answering neural models performing even better than human. In this work we tried to combine two strong networks in one model and build a cloud service which is aimed to answer user open-domain questions.
We used pretrained BERT-base model as a feature extractor and U-Net as a main network with slight modifications made. We generate predictions for true answer span start/end, plausible answer span start/end and whether the question is answerable. Cloud service offers two options for the user: either to provide a document where to search for answers or to use Wikipedia for searching. As for the second option, we use Google API for searching among Wikipedia pages for the most relevant, followed by the model predictions generating.
Cloud application has microservice architecture. One distinct component uses aitohttp and aiowiki for downloading and parsing Wikipedia pages. Another component is a simple Flask server with GPU-enabled neural network set in inference mode.
Finally, we used Redis for caching previously computed answers to improve service latency.
The overview of the architecture:
