Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ManagedLedger] Make 'StatsPeroidSeconds' configurable #11584

Merged

Conversation

Technoboy-
Copy link
Contributor

Motivation

Make StatsPeroidSeconds configurable.

Modifications

  • Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
  • Add config managedLedgerStatsPeriodSeconds.

###Documentation
I think it's no need to update doc.

Technoboy- added a commit to Technoboy-/pulsar that referenced this pull request Aug 6, 2021
@Technoboy- Technoboy- force-pushed the make-stats-period-seconds-configurable branch from 1e79cee to a6e06c3 Compare August 6, 2021 09:19
@Technoboy- Technoboy- force-pushed the make-stats-period-seconds-configurable branch from a6e06c3 to f984f2a Compare August 6, 2021 09:20
@Technoboy- Technoboy- changed the title Make 'StatsPeroidSeconds' configurable [ManagedLedger] Make 'StatsPeroidSeconds' configurable Aug 6, 2021
conf/broker.conf Outdated Show resolved Hide resolved
@codelipenghui codelipenghui added this to the 2.9.0 milestone Aug 7, 2021
@codelipenghui codelipenghui added the type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages label Aug 7, 2021
Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall is good
I left one comment PTAL

@hangc0276
Copy link
Contributor

In which case, we should change the metric stats refresh frequency?

Copy link
Contributor

@eolivelli eolivelli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@Anonymitaet Anonymitaet added the doc-not-needed Your PR changes do not impact docs label Aug 9, 2021
@Technoboy-
Copy link
Contributor Author

/pulsarbot run-failure-checks

@codelipenghui codelipenghui merged commit ddeae65 into apache:master Aug 9, 2021
LeBW pushed a commit to LeBW/pulsar that referenced this pull request Aug 9, 2021
### Motivation
Make `StatsPeroidSeconds` configurable.

### Modifications
- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.
bharanic-dev pushed a commit to bharanic-dev/pulsar that referenced this pull request Mar 18, 2022
### Motivation
Make `StatsPeroidSeconds` configurable.

### Modifications
- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.
dlg99 pushed a commit to dlg99/pulsar that referenced this pull request May 11, 2022
Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.

(cherry picked from commit ddeae65)
dlg99 pushed a commit to dlg99/pulsar that referenced this pull request May 11, 2022
Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.
dlg99 pushed a commit to dlg99/pulsar that referenced this pull request May 12, 2022
Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.

(cherry picked from commit ddeae65)
dlg99 pushed a commit to dlg99/pulsar that referenced this pull request May 12, 2022
Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.
nicoloboschi pushed a commit to datastax/pulsar that referenced this pull request May 12, 2022
* [ManagedLedger] Make 'StatsPeroidSeconds' configurable (apache#11584)

Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.

* Offloader metrics (apache#13833)

Currently, there is no offload metrics for tiered storage, so it is very hard for us to debug the performance issues. For example , we can not find why offload is slow or why read offload is slow. For above reasons. we need to add some offload metrics for monitoring.

Add metrics during offload procedure and read offload data procedure. Including offloadTime, offloadError, offloadRate, readLedgerLatency, writeStoreLatency, writeStoreError, readOffloadIndexLatency, readOffloadDataLatency, readOffloadRate, readOffloadError.

(cherry picked from commit 732049f)

Co-authored-by: GuoJiwei <technoboy@apache.org>
Co-authored-by: Tao Jiuming <95597048+tjiuming@users.noreply.github.com>
nicoloboschi pushed a commit to datastax/pulsar that referenced this pull request May 12, 2022
* [ManagedLedger] Make 'StatsPeroidSeconds' configurable (apache#11584)

Make `StatsPeroidSeconds` configurable.

- Move ‘StatsPeriodSeconds’ from ManagedLedgerFactoryImpl to ManagedLedgerFactoryConfig.
- Add config `managedLedgerStatsPeriodSeconds`.

(cherry picked from commit ddeae65)

* Offloader metrics (apache#13833)

Currently, there is no offload metrics for tiered storage, so it is very hard for us to debug the performance issues. For example , we can not find why offload is slow or why read offload is slow. For above reasons. we need to add some offload metrics for monitoring.

Add metrics during offload procedure and read offload data procedure. Including offloadTime, offloadError, offloadRate, readLedgerLatency, writeStoreLatency, writeStoreError, readOffloadIndexLatency, readOffloadDataLatency, readOffloadRate, readOffloadError.

(cherry picked from commit 732049f)

Co-authored-by: GuoJiwei <technoboy@apache.org>
Co-authored-by: Tao Jiuming <95597048+tjiuming@users.noreply.github.com>
@Technoboy- Technoboy- deleted the make-stats-period-seconds-configurable branch August 10, 2022 05:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc-not-needed Your PR changes do not impact docs type/enhancement The enhancements for the existing features or docs. e.g. reduce memory usage of the delayed messages
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants