Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated cherry pick of #2334: Feature/pipeline queue manager #2420

Conversation

erda-bot
Copy link
Member

Cherry pick of #2334 on release/1.3.

Squashed commit message:

commit cff8b6d4e8de7c7ca3ae257e198267effa8cae8f
Author: chengjoey <30427474+chengjoey@users.noreply.github.com>
Date:   Mon Oct 18 10:32:28 2021 +0800

    Feature/pipeline queue manager (#2334)
    
    * annotate backup throttler func
    
    * query, update queue usage to etcd
    
    * use protobuf marshal unmarshal queue usage
    
    * watch etcd to update queue instead of in memory

What type of this PR

Add one of the following kinds:
/kind feature

What this PR does / why we need it:

update queue usage to etcd for multiple pipeline

Which issue(s) this PR fixes:

Specified Reviewers:

/assign @your-reviewer

ChangeLog

Language Changelog
🇺🇸 English pipeline queue manager
🇨🇳 中文 queue manager 调整

Need cherry-pick to release versions?

Add comment like /cherry-pick release/1.0 when this PR is merged.

For details on the cherry pick process, see the cherry pick requests section under CONTRIBUTING.md.

* annotate backup throttler func

* query, update queue usage to etcd

* use protobuf marshal unmarshal queue usage

* watch etcd to update queue instead of in memory
@codecov
Copy link

codecov bot commented Oct 18, 2021

Codecov Report

Merging #2420 (cff8b6d) into release/1.3 (cb7aafe) will increase coverage by 0.00%.
The diff coverage is 19.62%.

Impacted file tree graph

@@              Coverage Diff              @@
##           release/1.3    #2420    +/-   ##
=============================================
  Coverage        15.83%   15.83%            
=============================================
  Files             1195     1196     +1     
  Lines           120335   120495   +160     
=============================================
+ Hits             19052    19083    +31     
- Misses           99346    99467   +121     
- Partials          1937     1945     +8     
Impacted Files Coverage Δ
modules/pipeline/endpoints/queue_management.go 0.00% <0.00%> (ø)
...les/pipeline/pipengine/reconciler/before_listen.go 0.00% <0.00%> (ø)
modules/pipeline/pipengine/reconciler/define.go 0.00% <ø> (ø)
...pengine/reconciler/queuemanage/manager/snapshot.go 0.00% <0.00%> (ø)
.../pipengine/reconciler/queuemanage/manager/usage.go 0.00% <0.00%> (ø)
modules/pipeline/pipengine/reconciler/throttler.go 40.54% <ø> (+1.06%) ⬆️
.../pipengine/reconciler/queuemanage/manager/queue.go 10.20% <12.34%> (+10.20%) ⬆️
modules/pipeline/pipengine/reconciler/queue.go 43.58% <47.22%> (+43.58%) ⬆️
...pipengine/reconciler/queuemanage/manager/define.go 42.30% <57.14%> (+3.41%) ⬆️
... and 5 more

@johnlanni johnlanni merged commit bee0684 into erda-project:release/1.3 Oct 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

4 participants