Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

In-memory Exporter: Buffer log scopes #3360

Merged

Conversation

CodeBlanch
Copy link
Member

@CodeBlanch CodeBlanch commented Jun 13, 2022

[Goal is to pare down the amount of changes on #3305]

Changes

  • Adds a delegate for the Export callback instead of using Func

  • Buffer log scopes when using in-memory log exporter

  • Appropriate CHANGELOG.md updated for non-trivial changes

@CodeBlanch CodeBlanch requested a review from a team June 13, 2022 19:27
@CodeBlanch
Copy link
Member Author

@utpilla FYI I think this will help your test cases for GenevaExporter in contrib.

@codecov
Copy link

codecov bot commented Jun 13, 2022

Codecov Report

Merging #3360 (069c6c2) into main (8b1521f) will decrease coverage by 0.04%.
The diff coverage is 91.66%.

❗ Current head 069c6c2 differs from pull request most recent head 7f6e544. Consider uploading reports for the commit 7f6e544 to get more accurate results

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #3360      +/-   ##
==========================================
- Coverage   85.80%   85.75%   -0.05%     
==========================================
  Files         268      268              
  Lines        9444     9452       +8     
==========================================
+ Hits         8103     8106       +3     
- Misses       1341     1346       +5     
Impacted Files Coverage Δ
...rter.InMemory/InMemoryExporterLoggingExtensions.cs 90.90% <88.88%> (-9.10%) ⬇️
...penTelemetry.Exporter.InMemory/InMemoryExporter.cs 92.30% <100.00%> (ø)
...rter.InMemory/InMemoryExporterMetricsExtensions.cs 97.50% <100.00%> (ø)
...tation/OpenTelemetryProtocolExporterEventSource.cs 75.00% <0.00%> (-10.00%) ⬇️
...ZPages/Implementation/ZPagesExporterEventSource.cs 56.25% <0.00%> (-6.25%) ⬇️
...nTelemetry/Internal/OpenTelemetrySdkEventSource.cs 73.72% <0.00%> (-0.85%) ⬇️

Copy link
Contributor

@utpilla utpilla left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should probably add a unit test to confirm that InMemoryExporter indeed retains the LogRecord scopes.

@CodeBlanch
Copy link
Member Author

@utpilla

We should probably add a unit test to confirm that InMemoryExporter indeed retains the LogRecord scopes.

I looked, it doesn't seem we have a unit test project for InMemoryExporter? I thought about spinning one up but since it is primarily used for tests itself it didn't seem totally worthwhile 🤷

How about I just add a test in the log suite using in-memory exporter which verifies availability of scopes?

@CodeBlanch
Copy link
Member Author

Updated the tests to use the new behavior. Previously we had a special processor which was doing the buffering, it is no longer needed!

@CodeBlanch CodeBlanch merged commit b680ec6 into open-telemetry:main Jun 15, 2022
@CodeBlanch CodeBlanch deleted the inmemory-log-exporter-buffer branch June 15, 2022 17:02
alanwest added a commit that referenced this pull request Jun 27, 2022
* Added Jaeger Propagator to Opentelemetry.Extensions.Propagators (#3309)

* Remove unnecessary bullet in CHANGELOG.md (#3352)

Co-authored-by: Cijo Thomas <cithomas@microsoft.com>

* Fix OTLP test (#3357)

* Show that test is not doing what you might think it does

* More asserts the merrier

* Show this little test that it has potential

* improve test coverage: InMemoryExporter & IDeferredMeterProviderBuilder (#3345)

* [SDK] Circular buffer tweaks + cpu pressure test (#3349)

* CircularBuffer tweaks and cpu pressure test.

* Switch to Volatile.Read.

* Perf tweaks.

* Remove race check in debug after doing more testing.

Co-authored-by: Cijo Thomas <cithomas@microsoft.com>

* Fix event name logic + support null categoryname. (#3359)

* In-memory Exporter: Buffer log scopes (#3360)

* Buffer log scopes when using in-memory exporter.

* CHANGELOG update.

* Code review.

* Tests.

* CHANGELOG tweak.

* SDK: Forward SetParentProvider to children of CompositeProcessor (#3368)

* Examples: Fix ParentProvider not being set on MyFilteringProcessor (#3370)

* Fix ParentProvider not being set on MyFilteringProcessor example.

* Added XML comments.

* Tweak.

* Typo.

* Logs: Add helper ctors & forceflush on OpenTelemetryLoggerProvider (#3364)

* Add helper ctors & forceflush on OpenTelemetryLoggerProvider.

* CHANGELOG update.

* Unit tests.

* Code review.

* Code review.

* Tweak.

* SDK: Nullable annotations for base classes & batch + shims to enable compiler features (#3374)

* Nullable annotations and shims for SDK base classes & batch.

* Target updates.

* Remove System.Collections.Immutable ref.

* ApiCompat attribute exclusions.

* ASPNETCore instrumentation to populate httpflavor tag (#3372)

* improve test coverage: InMemoryExporter SnapshotMetric (#3344)

* Fix AspNetCore metrics to use correct value for http.flavor (#3379)

* Fix AspNetCore metrics to use correct value for http.flavor

* word better

* Logs: Add LogRecordData (#3378)

* Add LogRecordData and hook up to LogRecord.

* CHANGELOG update.

* Code review.

* Remove SetHttpFlavor from Http instrumentations (#3381)

* Asp.Net Core trace instrumentation to populate http schema tag (#3392)

* Try asp.net core tests with inproc server (#3394)

* Dedupe IsPackable (#3398)

* Remove AspNet and AspNet.TelemetryHttpModule instrumentation projects (#3397)

* Handle possible exception when initializing the default service name (#3405)

* HttpClient: Invoke Enrich when SocketException = HostNotFound (#3407)

* Add & use ConfigureResource API. (#3307)

Co-authored-by: tyler jago <ty_bone11@hotmail.com>
Co-authored-by: Robert Pająk <rpajak@splunk.com>
Co-authored-by: Cijo Thomas <cithomas@microsoft.com>
Co-authored-by: Timothy Mothra <tilee@microsoft.com>
Co-authored-by: Mikel Blanchard <mblanchard@macrosssoftware.com>
Co-authored-by: Reiley Yang <reyang@microsoft.com>
Co-authored-by: Utkarsh Umesan Pillai <utpilla@microsoft.com>
Co-authored-by: Christian Neumüller <christian.neumueller@dynatrace.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants