Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[kedro-datasets ] Add Polars.CSVDataSet #95

Merged
merged 13 commits into from
Feb 9, 2023
Merged

[kedro-datasets ] Add Polars.CSVDataSet #95

merged 13 commits into from
Feb 9, 2023

Commits on Jan 23, 2023

  1. polars csvdataset 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    37d81eb View commit details
    Browse the repository at this point in the history

  2. Polars setup.py 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    d7ddf5d View commit details
    Browse the repository at this point in the history

  3. workaoround since boto3 cant store encoded bytesio or .encode Body 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    56fa6f5 View commit details
    Browse the repository at this point in the history

  4. updated docstrings and polars version 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    c603f22 View commit details
    Browse the repository at this point in the history

  5. bump package version and release 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    235122a View commit details
    Browse the repository at this point in the history

  6. Bump version and update release notes (#96) 

    Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
Signed-off-by: wmoreiraa <walber3@gmail.com>
    @merelcht @wmoreiraa
    merelcht authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    e941b85 View commit details
    Browse the repository at this point in the history

  7. Fix an error in docstring of MetricsDataSet (#98) 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @pn11 @wmoreiraa
    pn11 authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    863c456 View commit details
    Browse the repository at this point in the history

  8. Bump relax pyarrow version to work the same way as Pandas (#100) 

    * Bump relax pyarrow version to work the same way as Pandas

We only use PyArrow for `pandas.ParquetDataSet` as such I suggest we keep our versions pinned to the same range as [Pandas does](https://github.com/pandas-dev/pandas/blob/96fc51f5ec678394373e2c779ccff37ddb966e75/pyproject.toml#L100) for the same reason.

As such I suggest we remove the upper bound as we have users requesting later versions in [support channels](https://kedro-org.slack.com/archives/C03RKP2LW64/p1674040509133529)

* Updated release notes

Signed-off-by: wmoreiraa <walber3@gmail.com>
    @datajoely @wmoreiraa
    datajoely authored and wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    15408b6 View commit details
    Browse the repository at this point in the history

  9. Fixing release notes, package version and docstring 

    Signed-off-by: wmoreiraa <walber3@gmail.com>
    @wmoreiraa
    wmoreiraa committed Jan 23, 2023
    Configuration menu
    Copy the full SHA
    264189d View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2023

  1. Update kedro-datasets/RELEASE.md 

    Add dataset headers
Signed-off by: wmoreiraa <walber3@gmail.com>

Co-authored-by: Merel Theisen <49397448+merelcht@users.noreply.github.com>
    @wmoreiraa @merelcht
    wmoreiraa and merelcht authored Jan 24, 2023
    Configuration menu
    Copy the full SHA
    6feec66 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2023

  1. Fix docs 

    Changing equals to frame_equal

Co-authored-by: Ahdra Merali <90615669+AhdraMeraliQB@users.noreply.github.com>
    @wmoreiraa @AhdraMeraliQB
    wmoreiraa and AhdraMeraliQB authored Feb 8, 2023
    Configuration menu
    Copy the full SHA
    a501082 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2023

  1. Merge branch 'main' into main

    @merelcht
    merelcht authored Feb 9, 2023
    Configuration menu
    Copy the full SHA
    2698418 View commit details
    Browse the repository at this point in the history

  2. Fix linting 

    Signed-off-by: Merel Theisen <merel.theisen@quantumblack.com>
    @merelcht
    merelcht committed Feb 9, 2023
    Configuration menu
    Copy the full SHA
    cb023e0 View commit details
    Browse the repository at this point in the history