Skip to content
@delta-incubator

Delta Incubator

Incubation for the Delta Lake project

delta logo

Welcome to Delta Lake Incubator!

The Delta Lake project aims to unlock the power of the Delta Lake for as many users and projects as possible by providing native low-level APIs aimed at developers and integrators, as well as a high-level operations API that lets you query, inspect, and operate your Delta Lake with ease. The Delta Lake Incubator org provides a location to collaborate on projects which want to enter the Delta Lake project.

Please join the Delta Lake Slack for discussions; we also have a specific Incubator channel.

Incubator Inclusion Policy and Requirements

  • Project should extend or enrich Delta Lake or the Delta Lake ecosystem
  • Project should be open source or have a clear timeline to become open source
  • Project must have a license of MIT or Apache Software License 2.0
  • Project must be maintained by the person(s) proposing its inclusion in incubator. I.e. you cannot propose a project that's not "yours" to include
  • Project must adhere to a code of conduct similar to the one used for delta itself contributor covenant

How to join your project to Delta Incubator

If you are interested in submitting your project to delta-incubator, please start a conversation in the contributors channel pointing to your personal github repo. It is recommended that your project:

  • Refer to existing delta github issue (e.g., delta, delta-rs, etc.)
  • Project has an existing PIP (Project Improvement Proposal) document
  • Project is an already working project though early incubations will be reviewed on a case-by-case basis.

Incubation Project Graduation

Project can graduate to the Delta Lake org following similar voting procedures.

  • In general, the incubation project has been developed within delta-incubator for at least six (6) months to sort out any license issues, access controls, and find a groove working together to produce releases
  • Ensure that all developers have adopted the use of Developer Certificate of Origin or DCO as we have adopted this for the Delta Lake project with guidance from Linux Foundation AI & Data.
  • Ensure there are multiple contributors to the project as this is a good signal of a community with potential. Community is highly important since contributors can and should come and go as our interests shift over time. We strive to keep delta-io projects vibrant and continually improving. The contributor structure would ideally be more than 2 people with merge and release access for the incubating project.
  • Trademark compliance: one of our big shared assets is the Delta Lake trademark held by the Linux Foundation. Before elevation into delta-io, it is important that incubating projects should be correctly using the trademark for development, documentation, and releases.

Incubation Project Archival

We adopt a practice of marking unmaintained projects as public archived (with a notice soliciting new maintainers in the README) if there is no maintainer for the incubation project for 6 months. We will follow the same voting procedures.

Voting Procedures

  • A Delta maintainer will call a vote for at least 72h on the Incubator channel.
  • The voting is open to the Delta community
  • There must be at least three maintainers +1 votes with no -1 votes.
    • Note, as this is Slack, the +1 votes can be represented by green checkbox.

Popular repositories Loading

  1. delta-sharing-rs delta-sharing-rs Public

    A Minimalistic Rust Implementation of Delta Sharing Server.

    Rust 81 10

  2. deltatorch deltatorch Public

    Python 54 7

  3. deltaray deltaray Public

    Delta reader for the Ray open-source toolkit for building ML applications

    Python 43 11

  4. delta-dotnet delta-dotnet Public

    DeltaLake bindings for dotnet based on delta-rs

    C# 27 6

  5. dat dat Public

    Delta Acceptance Testing

    Python 18 7

  6. delta-lake-definitive-guide delta-lake-definitive-guide Public

    Jupyter Notebook 13 6

Repositories

Showing 10 of 13 repositories
  • delta-dotnet Public

    DeltaLake bindings for dotnet based on delta-rs

    delta-incubator/delta-dotnet’s past year of commit activity
    C# 27 Apache-2.0 6 0 1 Updated Nov 18, 2024
  • .github Public
    delta-incubator/.github’s past year of commit activity
    0 1 0 0 Updated Nov 16, 2024
  • delta-incubator/delta-lake-definitive-guide’s past year of commit activity
    Jupyter Notebook 13 6 5 0 Updated Oct 24, 2024
  • delta-sharing-rs Public

    A Minimalistic Rust Implementation of Delta Sharing Server.

    delta-incubator/delta-sharing-rs’s past year of commit activity
    Rust 81 MIT 10 15 4 Updated Jul 28, 2024
  • dat Public

    Delta Acceptance Testing

    delta-incubator/dat’s past year of commit activity
    Python 18 7 20 (5 issues need help) 5 Updated Jul 23, 2024
  • locking-object-store Public archive
    delta-incubator/locking-object-store’s past year of commit activity
    Rust 0 Apache-2.0 0 0 2 Updated Feb 17, 2024
  • deltaray Public

    Delta reader for the Ray open-source toolkit for building ML applications

    delta-incubator/deltaray’s past year of commit activity
    Python 43 Apache-2.0 11 5 2 Updated Jan 27, 2024
  • delta-incubator/deltatorch’s past year of commit activity
    Python 54 Apache-2.0 7 17 0 Updated Jan 3, 2024
  • dynamodb-lock-rs Public

    Distributed lock backed by Dynamodb

    delta-incubator/dynamodb-lock-rs’s past year of commit activity
    Rust 9 3 0 1 Updated Dec 7, 2023
  • delta-sharing-connectors Public

    Connectors for Delta Sharing project

    delta-incubator/delta-sharing-connectors’s past year of commit activity
    JavaScript 1 Apache-2.0 2 0 0 Updated Nov 29, 2023

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…