Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#430 FIx data delivery steps not injecting smallrye when running test-data-delivery-spark-model #446

Merged
merged 1 commit into from
Oct 31, 2024

Conversation

jaebchoi
Copy link
Contributor

We have disabled some data delivery steps as those steps are not injecting smallrye reactive messaging correctly.

It seems like any step with asynchronous type, no inbound messaging , and messaging outbound is having issue with running step execution.

Issue #430

@@ -26,7 +26,7 @@ import org.reactivestreams.Subscription;
#if (${step.outbound})
import org.eclipse.microprofile.reactive.messaging.Outgoing;
#end
#if ((${step.hasMessagingOutbound()} && ${step.hasNativeInbound()}))
#if ((${step.hasMessagingOutbound()} && (${step.hasNativeInbound()} || ${step.hasVoidInbound()} )))
Copy link
Contributor Author

@jaebchoi jaebchoi Oct 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I: I tried emitter instead of directly putting outgoing channel in method by referring this test OutOnlyTestStep

upon changing, aissemble build seems to pass, also ran downstream project with problematic metamodel, seems to pass build as well as inspection of spark pipeline to make sure it succeeded.

Screenshot 2024-10-30 at 9 55 58 AM
Screenshot 2024-10-30 at 9 56 11 AM

@ewilkins-csi
Copy link
Contributor

Do we know when this started to fail? Prior to 1.7, we were running the tests and this wasn't an issue. I mainly ask because the changes made here are things I would have expected to be around for awhile. So curious what changed since 1.7 that would require the new checks.

@jaebchoi
Copy link
Contributor Author

jaebchoi commented Oct 30, 2024

@ewilkins-csi

Good callout on testing prior tags to see what causes this issue. Didn't think about that. Upon incremental testing of releases, I noticed that we don't have this issue up until 1.9.4. Which means 1.10 milestone caused this issue to fail.

I suspect this is due to java 17 upgrade issue. (I couldn't pinpoint exactly what specific module thou but most likely messaging) or even version upgrade of smallrye reactive message from 3.15 to 4.24

Given that you pointed out there are several bugs exists in the alerting and messaging, I think once those bugs are fixed, this issue might also be fixed as well.

I think we can send this as we know it is workaround and we can revisit on this issue once any messaging bug is finished to see if it fixes or not.

@jaebchoi jaebchoi force-pushed the 430-test-data-delivery-spark-model branch from 7d99b45 to a9081b0 Compare October 31, 2024 14:51
@jaebchoi jaebchoi force-pushed the 430-test-data-delivery-spark-model branch from a9081b0 to 874c0fb Compare October 31, 2024 15:09
@jaebchoi jaebchoi merged commit c603056 into dev Oct 31, 2024
@jaebchoi jaebchoi deleted the 430-test-data-delivery-spark-model branch October 31, 2024 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants