Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kedro incremental starter #2054

Closed
merelcht opened this issue Nov 23, 2022 · 2 comments
Closed

Kedro incremental starter #2054

merelcht opened this issue Nov 23, 2022 · 2 comments
Labels
Stage: User Research 🔬 Ticket needs to undergo user research before implementation

Comments

@merelcht
Copy link
Member

merelcht commented Nov 23, 2022

Description

Kedro starters are used to create projects that contain code to run as-is, or to adapt and extend. They provide pre-defined example code and configuration that can be reused. Some of these starters are also used as part of the Kedro tutorials to teach new users about Kedro.

It's often been said that Kedro has a steep learning curve. The idea of the incremental starter is to have a new starter that gradually brings in more and more components to the Kedro project. The final version of the starter would include all advanced features as well as a full setup for linting, testing and other software engineering best practice tools.

Details

  • It should be possible for a user to use the starter at different phases that are increasingly more difficult. So essentially you end up "building" a complex Kedro project through a starter. This could look something like kedro new starter=incremental, kedro starter add step_one etc. We'll need tech design to flesh this out more.
  • I think a starter would be suitable for this learning journey because it would enable a user to go back and forth between their own code and the starter code and check it's the same in case of errors.

Questions

  • What features should each step/level bring? Complex topics should at least include:
    1. Modular pipelines
    2. Experiment Tracking
    3. Linting
    4. Testing
@merelcht merelcht added Stage: Technical Design 🎨 Ticket needs to undergo technical design before implementation Stage: User Research 🔬 Ticket needs to undergo user research before implementation labels Nov 23, 2022
@datajoely
Copy link
Contributor

I'm interested to see if this library can help https://github.com/cruft/cruft

A related point - I've also seen people ask if they can define the structure of kedro pipeline create themselves.

@merelcht merelcht removed the Stage: Technical Design 🎨 Ticket needs to undergo technical design before implementation label Apr 14, 2023
@yetudada yetudada moved this from Discovery or Research - Later 🧪 to Discovery or Research - Now ⏳ in Roadmap May 3, 2023
@yetudada yetudada moved this from Discovery or Research - Now ⏳ to Discovery or Research - Later 🧪 in Roadmap May 3, 2023
@yetudada
Copy link
Contributor

yetudada commented Aug 7, 2023

I'll close this ticket because this is largely handled by #2388

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Stage: User Research 🔬 Ticket needs to undergo user research before implementation
Projects
Status: Discovery or Research - Later 🧪
Development

No branches or pull requests

3 participants