Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[HOLD for payment 2024-01-31] predeploy.yml Github Action is broken in main #34108

Closed
blimpich opened this issue Jan 8, 2024 · 25 comments
Closed
Assignees
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Daily KSv2

Comments

@blimpich
Copy link
Contributor

blimpich commented Jan 8, 2024

Problem

The e2ePerformanceTests / Build apk from latest release as a baseline step of the predeploy.yml has been failing consistently for about 25 runs (as of writing this issue). This appears to be happening since #33645 was merged into main. Looking at one of the failed runs it appears to be Android related (link).

Solution

Investigate why the GH Action is failing consistently and provide a solution for it.

@blimpich blimpich added Daily KSv2 Bug Something is broken. Auto assigns a BugZero manager. labels Jan 8, 2024
Copy link

melvin-bot bot commented Jan 8, 2024

Triggered auto assignment to @greg-schroeder (Bug), see https://stackoverflow.com/c/expensify/questions/14418 for more details.

Copy link

melvin-bot bot commented Jan 8, 2024

Bug0 Triage Checklist (Main S/O)

  • This "bug" occurs on a supported platform (ensure Platforms in OP are ✅)
  • This bug is not a duplicate report (check E/App issues and #expensify-bugs)
    • If it is, comment with a link to the original report, close the issue and add any novel details to the original issue instead
  • This bug is reproducible using the reproduction steps in the OP. S/O
    • If the reproduction steps are clear and you're unable to reproduce the bug, check with the reporter and QA first, then close the issue.
    • If the reproduction steps aren't clear and you determine the correct steps, please update the OP.
  • This issue is filled out as thoroughly and clearly as possible
    • Pay special attention to the title, results, platforms where the bug occurs, and if the bug happens on staging/production.
  • I have reviewed and subscribed to the linked Slack conversation to ensure Slack/Github stay in sync

@hannojg
Copy link
Contributor

hannojg commented Jan 9, 2024

I don't think the issue is related to that specific PR, but it's a problem people are having at the moment in general when building react native from source.
The issue is with boost and is reported here:

@hannojg
Copy link
Contributor

hannojg commented Jan 9, 2024

I am investigating if we can patch react native for a fix - but it might be that the boost archives are just broken on their servers - lets see.

@melvin-bot melvin-bot bot added the Overdue label Jan 11, 2024
@greg-schroeder
Copy link
Contributor

Where did you land on this @hannojg?

@melvin-bot melvin-bot bot removed the Overdue label Jan 11, 2024
@hannojg
Copy link
Contributor

hannojg commented Jan 12, 2024

Sorry, forgot to update here!
This was a bug in react-native and should be fixed with this PR:

(As per this and this thread)

@blimpich
Copy link
Contributor Author

Huh, I'm still seeing the process new code merged to main workflow failing with what I think is the same error.

@blimpich
Copy link
Contributor Author

blimpich commented Jan 12, 2024

@melvin-bot melvin-bot bot added the Overdue label Jan 13, 2024
Copy link

melvin-bot bot commented Jan 15, 2024

@greg-schroeder Whoops! This issue is 2 days overdue. Let's get this updated quick!

@hannojg
Copy link
Contributor

hannojg commented Jan 17, 2024

So it seems like there is a new issue now with the build step:

* What went wrong:
A problem occurred evaluating project ':app'.
> Failed to apply plugin 'com.android.internal.application'.
   > Android Gradle plugin requires Java 17 to run. You are currently using Java 11.
      Your current JDK is located in /usr/lib/jvm/temurin-11-jdk-amd64
      You can try some of the following options:
       - changing the IDE settings.
       - changing the JAVA_HOME environment variable.
       - changing `org.gradle.java.home` in `gradle.properties`.

Copy link

melvin-bot bot commented Jan 17, 2024

@greg-schroeder Huh... This is 4 days overdue. Who can take care of this?

@blimpich
Copy link
Contributor Author

Huh, weird. @Julesssss @AndrewGable are you aware of any changes that might have caused the gradle issue that @hannojg mentioned?

@hannojg
Copy link
Contributor

hannojg commented Jan 17, 2024

d541723#diff-9526ccfd1d1813ed49c39f8c54dbeb512607376a007d824b905bc8b4e4d202d9 I think this commit may caused the issue.

I can look into it more detail tomorrow if no one is working on that already?
(Can't open the slack link unfortunately for some reason)

@blimpich
Copy link
Contributor Author

@hannojg that sounds good. I don't think anyone else is looking into this right now. And sorry I don't know what happened with that slack link but I think this one should work: https://expensify.slack.com/archives/C05LX9D6E07/p1704755329727759

@blimpich blimpich removed the Overdue label Jan 17, 2024
@melvin-bot melvin-bot bot added the Overdue label Jan 17, 2024
@blimpich
Copy link
Contributor Author

Assigning to you @hannojg so that Melvin will count your updates and stop saying that this issue is overdue.

@Julesssss
Copy link
Contributor

I don't see what change could have caused this, but if we're to take logs at face value we might need to set the JDK version that github Actions run against. Though again I'm confused as to why this would occur out of nowhere 😕

@hannojg
Copy link
Contributor

hannojg commented Jan 18, 2024

Yeah same @Julesssss the fix is probably quite simple but weird that it randomly happened. Didn't find the time today to push a PR - will do tmrw!

@melvin-bot melvin-bot bot added Weekly KSv2 and removed Daily KSv2 labels Jan 19, 2024
@hannojg
Copy link
Contributor

hannojg commented Jan 19, 2024

@hannojg
Copy link
Contributor

hannojg commented Jan 22, 2024

We just merged the PR. Seems like the issue is fixed:

CleanShot 2024-01-22 at 15 33 54@2x

However, right now, we check out the latest release version for the baseline app. This release currently doesn't include the new build action. So we have to wait for a new release for the pipeline to work again:

CleanShot 2024-01-22 at 15 34 04@2x

@blimpich
Copy link
Contributor Author

Sounds good, we can wait ⏳

@melvin-bot melvin-bot bot added Weekly KSv2 Awaiting Payment Auto-added when associated PR is deployed to production and removed Weekly KSv2 labels Jan 24, 2024
@melvin-bot melvin-bot bot changed the title predeploy.yml Github Action is broken in main [HOLD for payment 2024-01-31] predeploy.yml Github Action is broken in main Jan 24, 2024
Copy link

melvin-bot bot commented Jan 24, 2024

Reviewing label has been removed, please complete the "BugZero Checklist".

@melvin-bot melvin-bot bot removed the Reviewing Has a PR in review label Jan 24, 2024
Copy link

melvin-bot bot commented Jan 24, 2024

The solution for this issue has been 🚀 deployed to production 🚀 in version 1.4.30-1 and is now subject to a 7-day regression period 📆. Here is the list of pull requests that resolve this issue:

If no regressions arise, payment will be issued on 2024-01-31. 🎊

For reference, here are some details about the assignees on this issue:

  • @hannojg does not require payment (Contractor)

Copy link

melvin-bot bot commented Jan 24, 2024

BugZero Checklist: The PR fixing this issue has been merged! The following checklist (instructions) will need to be completed before the issue can be closed:

  • [] The PR that introduced the bug has been identified. Link to the PR:
  • [] The offending PR has been commented on, pointing out the bug it caused and why, so the author and reviewers can learn from the mistake. Link to comment:
  • [] A discussion in #expensify-bugs has been started about whether any other steps should be taken (e.g. updating the PR review checklist) in order to catch this type of bug sooner. Link to discussion:
  • [@hannojg] Determine if we should create a regression test for this bug.
  • [@hannojg] If we decide to create a regression test for the bug, please propose the regression test steps to ensure the same bug will not reach production again.
  • [@greg-schroeder] Link the GH issue for creating/updating the regression test once above steps have been agreed upon:

@melvin-bot melvin-bot bot added Daily KSv2 and removed Weekly KSv2 labels Jan 30, 2024
Copy link

melvin-bot bot commented Jan 31, 2024

Skipping the payment summary for this issue since all the assignees are employees or vendors. If this is incorrect, please manually add the payment summary SO.

@greg-schroeder
Copy link
Contributor

No payments required - Margelo + internal reviews

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Awaiting Payment Auto-added when associated PR is deployed to production Bug Something is broken. Auto assigns a BugZero manager. Daily KSv2
Projects
None yet
Development

No branches or pull requests

4 participants