Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Web URLs in RAG Pipeline #38

Merged
merged 20 commits into from
Jul 30, 2024
Merged

Add support for Web URLs in RAG Pipeline #38

merged 20 commits into from
Jul 30, 2024

Commits on Jul 24, 2024

  1. code for processing websites for RAG pipeline

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    549021f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into web_links

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    edf2a92 View commit details
    Browse the repository at this point in the history

  3. logging statement for HTML tags

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    f7ac81a View commit details
    Browse the repository at this point in the history

  4. modify unittests for data processing module

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    76fdeca View commit details
    Browse the repository at this point in the history

  5. add unittest for bs extractor

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    76fe5f0 View commit details
    Browse the repository at this point in the history

  6. add beautiful soup requirement

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    3df658b View commit details
    Browse the repository at this point in the history

  7. move to kwargs

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    15826d7 View commit details
    Browse the repository at this point in the history

  8. kwargs + README

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    6ac9b42 View commit details
    Browse the repository at this point in the history

  9. update README

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    b0fa2fa View commit details
    Browse the repository at this point in the history

  10. fix unittest

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    50104e4 View commit details
    Browse the repository at this point in the history

  11. update README

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    64e8efd View commit details
    Browse the repository at this point in the history

  12. add provided URL to list

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    86f5bf4 View commit details
    Browse the repository at this point in the history

  13. add option to parse urls recursively

    @shreyash2106
    shreyash2106 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    4888842 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. modify main code example usage

    @shreyash2106
    shreyash2106 committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    6aee1b7 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2024

  1. support more html tags

    @shreyash2106
    shreyash2106 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    ed78d12 View commit details
    Browse the repository at this point in the history

  2. add support for websites with login

    @shreyash2106
    shreyash2106 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    bda059e View commit details
    Browse the repository at this point in the history

  3. add login support in batching

    @shreyash2106
    shreyash2106 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    30109eb View commit details
    Browse the repository at this point in the history

  4. update README

    @shreyash2106
    shreyash2106 committed Jul 29, 2024
    Configuration menu
    Copy the full SHA
    1f60eb2 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Merge branch 'main' into web_links

    @shreyash2106
    shreyash2106 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    ff4e1c9 View commit details
    Browse the repository at this point in the history

  2. update README

    @shreyash2106
    shreyash2106 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    9344c2c View commit details
    Browse the repository at this point in the history