hdiutil failures when creating DMGs on macOS 13 runner #7522

wkiefer · 2023-05-02T21:56:38Z

Description

We use https://github.com/create-dmg/create-dmg as a small script wrapper around hdiutil to create and notarize DMG files from our macOS applications.

However, when switching to the macos-13 runner, we get the following error when calling hdiutil create

hdiutil: create: returning 49168
hdiutil: create failed - Resource busy

Platforms affected

Azure DevOps
GitHub Actions - Standard Runners
GitHub Actions - Larger Runners

Runner images affected

Image version and build link

Image: macos-13
Version: 20230426.3
Included Software: https://github.com/actions/runner-images/blob/macOS-13/20230426.3/images/macos/macos-13-Readme.md
Image Release: https://github.com/actions/runner-images/releases/tag/macOS-13%2F20230426.3

Is it regression?

https://github.com/actions/runner-images/releases/tag/macOS-12%2F20230425.1

Expected behavior

hdiutil create should not return error 49168, resource busy

Actual behavior

hdiutil create consistently returns error 49168, resource busy

Repro steps

I will try to make a public repo sample repro — right now steps are to build with Xcode 14.3 on the macOS 13 image, then run

create-dmg \
  --app-drop-link 240 332 \
  --icon "Sample.app" 240 108 \
  --icon-size 128 \
  --volname "Sample" \
  --window-pos 100 100 \
  --window-size 480 582 \
  --codesign "Your Developer ID Application" \
  "/output/path/Sample.dmg" \
  "/input/folderWithApp/"

Or simply try to run any hdiutil create command in the context of a macOS 13 runner

The text was updated successfully, but these errors were encountered:

Alexey-Ayupov · 2023-05-03T07:18:38Z

Hello @wkiefer, we will take a look, however, please remember macOS 13 is still in beta version.

vpolikarpov-akvelon · 2023-05-04T12:02:19Z

Hi @wkiefer. I didn't succeed reproducing the issue. Both hdiutil and create-dmg work flawlessly for me. Could you provide more detailed repro steps or share a link to the failing workflow?

geoffthemedio · 2023-05-06T19:33:38Z

I think we have hit the same issue.
https://github.com/freeorion/freeorion/tree/MacOS_action_versions
https://github.com/freeorion/freeorion/actions/runs/4902807369/jobs/8755515334?pr=4509#step:9:426

CPack Error: Error executing: /usr/bin/hdiutil create -ov -srcfolder "/Users/runner/work/freeorion/freeorion/build/_CPack_Packages/MacOSX/DragNDrop/FreeOrion_2023-05-06.ba56d96_Test_MacOSX_10.15" -volname "FreeOrion" -fs "HFS+" -format UDZO "/Users/runner/work/freeorion/freeorion/build/_CPack_Packages/MacOSX/DragNDrop/temp.dmg"
CPack Error: Error generating temporary disk image.
hdiutil: create failed - Resource busy

CPack Error: Problem compressing the directory
CPack Error: Error when generating package: FreeOrion
Command PhaseScriptExecution failed with a nonzero exit code

** BUILD FAILED **


The following build commands failed:
	PhaseScriptExecution CMake\ PostBuild\ Rules /Users/runner/work/freeorion/freeorion/build/build/FreeOrion.build/Release/package.build/Script-571234464C2A5D0D43F1AB42.sh (in target 'package' from project 'FreeOrion')

vpolikarpov-akvelon · 2023-05-12T07:33:28Z

Hey @geoffthemedio, @wkiefer. Looks like the issue is gone as an image version 20230509.4 have been rolled out. Could you try to run your workflow again?

geoffthemedio · 2023-05-12T08:28:43Z

I reran the action and it completed successfully. I'm not sure that nothing else changed and that it's doing the exact same thing, but at least I can reproduce the issue now.

Neverous · 2023-05-15T21:50:16Z

I think I'm hitting similar issues or at least issues with hdiutil: hdiutil: create failed - No child processes and the newest image didn't help really 😢

Runner image:

  Image: macos-13
  Version: 20230509.4
  Included Software: https://github.com/actions/runner-images/blob/macOS-13/20230509.4/images/macos/macos-13-Readme.md
  Image Release: https://github.com/actions/runner-images/releases/tag/macOS-13%2F20230509.4

vpolikarpov-akvelon · 2023-05-16T16:16:15Z

Hi @Neverous. It looks similar indeed. But I suppose you might get this error because of the failure on the previous step:

error: /Applications/Xcode_14.2.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/install_name_tool: no LC_RPATH load command with path: /Users/runner/work/efibooteditor/Qt/6.5.0/macos/lib found in: /Users/runner/work/efibooteditor/efibooteditor/build/dist/_CPack_Packages/Darwin/DragNDrop/EFIBootEditor-v0.0.0-3f25f4b38b30f8575f17628808319e6017e44bc7-macos-13-qt-6.5.0/dist/efibooteditor.app/Contents/MacOS/efibooteditor (for architecture x86_64), required for specified option "-delete_rpath /Users/runner/work/efibooteditor/Qt/6.5.0/macos/lib"

Could you ensure that it doesn't affect packaging?

Neverous · 2023-05-16T17:22:29Z

I get the same thing in macos 12: https://github.com/Neverous/efibooteditor/actions/runs/4908677336/jobs/8925056030#step:12:232 and 11: https://github.com/Neverous/efibooteditor/actions/runs/4908677336/jobs/8925056236#step:12:232 and they go through fine so I would guess that it doesn't, but Ill see If I can do anything about it maybe it will help.

Neverous · 2023-05-16T23:59:37Z

Yeah, the rpath error is just that both macdeployqt and CPack generator that I use to make the final package are trying to adjust rpaths, and both have no option to skip it from what I can tell... I think its harmless, at least for hdiutil.

Anyway, I got to very simple reproduction steps I think: https://github.com/Neverous/efibooteditor/actions/runs/4997753556/jobs/8952437874 (the issue seems to be somewhat random as just restarting the job sometimes succeeds and sometimes not 🤔 https://github.com/Neverous/efibooteditor/actions/runs/4997791581)

vpolikarpov-akvelon · 2023-05-22T08:24:18Z

Hey. I finally realized what causes this issue. Looks like it's XProtectBehaviorService that was introduced in macOS 13 Ventura. If you are not lucky enough it may lock your newly created dmg and hdiutil will fail. I can suggest implementing retry in you workflow to workaround this.

Another option may be shutting aforementioned service down (or just killing the process). You may use something like this:

echo killing...; sudo pkill -9 XProtect >/dev/null || true;
echo waiting...; while pgrep XProtect; do sleep 3; done;

I can't recommend doing that because it may cause issues in the future that we can't predict and avoid. Also it may have security related consequences. Use it on your own risk.

Neverous · 2023-05-22T21:26:55Z

Tried both, neither works for me, I must be hitting something slightly different then 🤔 (hdiutil: create failed - No child processes seems not to be so random like the Resource busy one, but so far I wasn't able to create simple reproduction steps than running the whole build)

retrying 20 times
killing XProtect

vpolikarpov-akvelon · 2023-05-23T08:20:41Z

You a right, Maciej, this is something different. Killing XProtect only helps when you get "Resource busy". I still suspect that previous error may somehow cause failure of hdiutil. I understand that it didn't matter on macOS 11 & 12, but something else may have changed so now it's important. Could you try to get rid of "install_name_tool" error? Just to be sure that it's really nothing.

Neverous · 2023-05-23T08:36:41Z

Ah should've mentioned that with macdeployqt vs CPack comment, did that (disabled macdeployqt for tests, leaving only cpack dmg generation): Neverous/efibooteditor@e7ec720#diff-1e7de1ae2d059d21e1dd75d5812d5a34b0222cef273b7c3a2af62eb747f9d20aL410 , https://github.com/Neverous/efibooteditor/actions/runs/4997683758/jobs/8952293026#step:12:234

vpolikarpov-akvelon · 2023-05-23T10:13:27Z

Did you try enabling debug output for hdiutil?
I suppose it may be done by setting CPACK_COMMAND_HDIUTIL option to /path/to/hdiutil -debug

Neverous · 2023-05-25T17:38:13Z

Don't see anything interesting unfortunately, just that diskimages-helper died 😞 logs

2023-05-25 17:08:25.255 hdiutil[11275:37357] [DIHelperProxy watchForHelperDeath] helper exited early
2023-05-25 17:08:25.255 hdiutil[11275:37357] helper died
2023-05-25 17:08:25.255 hdiutil[11275:37357] setHelperDoneWithResult: _helperDone = YES, _threadResultsError = 10

vpolikarpov-akvelon · 2023-05-26T14:17:43Z

Hey @Neverous. Looks like your issue may be resolved by running hdiutil using sudo.

I added this line to CMakeLists.txt and packaging works flawlessly:

set(CPACK_COMMAND_HDIUTIL "/usr/bin/sudo /usr/bin/hdiutil")

Neverous · 2023-05-26T16:33:44Z

Yes, thank you! It works indeed. Interesting, some permissions changed with macOS 13?, not sure why it would now require elevated access 🤔 but it packages successfully now with sudo 🙇 .

vpolikarpov-akvelon · 2023-05-29T08:20:02Z

Glad to hear! Well, looks like problems have been solved so i'm closing this issue for now. Feel free to reopen it if problems return.

To sum up:

If hdiutil create fails on macOS 13 with No child processes then try running it with sudo;
If it fails on macOS 13 with Resource busy sometimes then try killing XProtectBehaviorService.

…hread regarding this problem: actions/runner-images#7522 apparently running the process as root is one path to a fix. Reverted from e9f03d2 to HEAD.

…nd an issue thread regarding this problem: actions/runner-images#7522 apparently running the process as root is one path to a fix. Reverted from e9f03d2 to HEAD." This reverts commit bd268a1.

c.f. actions/runner-images#7522

jcelerier · 2024-08-24T21:47:34Z

Still getting some intermittent failures with --filesystem APFS. For instance: hdiutil: resize: failed. No child processes (10)

sarathrajsrinivasan · 2024-08-24T22:27:36Z

Hi @jcelerier,

Could you please share some of the failed workflows for validation. Also what percentage of jobs are failing now?

jcelerier · 2024-08-24T23:29:37Z

@sarathrajsrinivasan here's some workflows : relevant job is macOS build :

this one worked: https://dev.azure.com/ossia/libossia/_build/results?buildId=3995&view=results
this one worked: https://dev.azure.com/ossia/libossia/_build/results?buildId=3997&view=results (upload failure is unrelated)
this one failed: https://dev.azure.com/ossia/libossia/_build/results?buildId=3998&view=logs&j=7bab896a-24f8-544f-51eb-43745367a332&t=0a75dee1-c6f9-5e3c-8b1c-a50cc807cb5c

so, the failure ratio right now is ~1/3 but there's not much data

sarathrajsrinivasan · 2024-08-25T01:50:30Z

Thanks @jcelerier .

hdiutil: resize: failed error is different from the earlier resource busy error we were facing. Will check on it.
Could you please retry few more times and let us know if it is persistent.

jcelerier · 2024-08-25T15:22:15Z

@sarathrajsrinivasan still getting some of the previous failures:

https://dev.azure.com/ossia/libossia/_build/results?buildId=4003&view=logs&j=7bab896a-24f8-544f-51eb-43745367a332&t=0a75dee1-c6f9-5e3c-8b1c-a50cc807cb5c&l=139

Unmounting disk image...
hdiutil: couldn't eject "disk2" - Resource busy
Wait a moment...
Unmounting disk image...
hdiutil: couldn't eject "disk2" - Resource busy
Wait a moment...
Unmounting disk image...
hdiutil: couldn't eject "disk2" - Resource busy

Galkon · 2024-08-26T22:03:15Z

Started getting issues on macos-14 runner today:

  ⨯ Exit code: 6. Command failed: hdiutil resize -size 1753905584.2 /private/var/folders/4d/0gnh84wj53j7wyk695q0tc_80000gn/T/t-qPw43P/0.dmg\n' +
    'hdiutil: resize: failed. Device not configured (6)\n' +
    '\n' +
    'hdiutil: resize: failed. Device not configured (6)\n' +
    '  failedTask=build stackTrace=Error: Exit code: 6. Command failed: hdiutil resize -size 1753905584.2 /private/var/folders/4d/0gnh84wj53j7wyk695q0tc_80000gn/T/t-qPw43P/0.dmg\n' +
    'hdiutil: resize: failed. Device not configured (6)\n' +
    '                                                                                                                                                                                                                                                       hdiutil: resize: failed. Device not configured (6)

c.f. actions/runner-images#7522

jcelerier · 2024-09-07T17:03:43Z

Another spurious issue:

killing...
waiting...
Creating disk image...
created: /Users/runner/work/1/s/install/rw.25997.score.dmg
hdiutil: resize: failed. No child processes (10)

https://dev.azure.com/ossia/libossia/_build/results?buildId=4024&view=logs&j=7bab896a-24f8-544f-51eb-43745367a332&t=0a75dee1-c6f9-5e3c-8b1c-a50cc807cb5c

aaneeley · 2024-09-07T21:47:02Z

Been having this issue (inconsistently) while using electron-builder

⨯ Exit code: 1. Command failed: hdiutil attach -noverify -noautoopen -readwrite /private/var/folders/py/lcjn3y352g1106vf1rqk521r0000gn/T/t-XlxQaO/0.dmg
hdiutil: attach failed - Device not configured

hdiutil: attach failed - Device not configured
  failedTask=build stackTrace=Error: Exit code: 1. Command failed: hdiutil attach -noverify -noautoopen -readwrite /private/var/folders/py/lcjn3y352g1106vf1rqk521r0000gn/T/t-XlxQaO/0.dmg
hdiutil: attach failed - Device not configured

hdiutil: attach failed - Device not configured

On runner:

Current runner version: '2.319.1'
Operating System
  macOS
  14.6.1
Runner Image
  Image: macos-14-arm64

Galkon · 2024-09-10T23:07:32Z

Been having this issue (inconsistently) while using electron-builder

⨯ Exit code: 1. Command failed: hdiutil attach -noverify -noautoopen -readwrite /private/var/folders/py/lcjn3y352g1106vf1rqk521r0000gn/T/t-XlxQaO/0.dmg
hdiutil: attach failed - Device not configured

hdiutil: attach failed - Device not configured
  failedTask=build stackTrace=Error: Exit code: 1. Command failed: hdiutil attach -noverify -noautoopen -readwrite /private/var/folders/py/lcjn3y352g1106vf1rqk521r0000gn/T/t-XlxQaO/0.dmg
hdiutil: attach failed - Device not configured

hdiutil: attach failed - Device not configured

On runner:

Current runner version: '2.319.1'
Operating System
  macOS
  14.6.1
Runner Image
  Image: macos-14-arm64

I was having a lot of issues with macos-14 runners in general, they have gone away since I found the things mentioned in this thread and implemented them:
#10511 (comment)

actions/runner-images#7522 (comment)

Kill XProtect if running, as per: actions/runner-images#7522 (comment) Signed-off-by: Geoff Hutchison <geoff.hutchison@gmail.com>

nuttyartist · 2024-10-01T14:30:43Z

We're having the same issue at: nuttyartist/notes#700 (comment)

actions/runner-images#7522 (comment)

Let CPack use sudo when invoking hdiutil to ensure that it succeeds. This mitigates an issue that causes hdiutil to fail very often for MacOS versions beyond 12. The cause of the issue is unknown. See actions/runner-images#7522

Let CPack use sudo when invoking hdiutil to ensure that it succeeds. This mitigates an issue that causes hdiutil to fail very often for MacOS versions beyond 12. The cause of the issue is unknown. See actions/runner-images#7522 (comment)

wkiefer added bug report needs triage labels May 2, 2023

Alexey-Ayupov added OS: macOS and removed needs triage labels May 3, 2023

vpolikarpov-akvelon self-assigned this May 3, 2023

geoffthemedio mentioned this issue May 6, 2023

Remove MacOS 10.15 build action and add MacOS 13 build action freeorion/freeorion#4509

Merged

vpolikarpov-akvelon closed this as completed May 29, 2023

roryabraham mentioned this issue Jun 6, 2023

Desktop deploys are flaky Expensify/App#20283

Closed

othyn mentioned this issue Jul 14, 2023

Builds on macOS 13 are randomly failing on all channels othyn/macos-auto-clicker#69

Closed

grzegorzkrukowski mentioned this issue Jul 26, 2023

Occasionnal hdiutil: create failed - Resource busy create-dmg/create-dmg#143

Open

jcelerier added a commit to ossia/score that referenced this issue Aug 22, 2024

[ci] Try to fix intermittent macOS CI failures

d11b521

c.f. actions/runner-images#7522

shamil-mubarakshin assigned sarathrajsrinivasan and unassigned vpolikarpov-akvelon Aug 22, 2024

jcelerier added a commit to ossia/score that referenced this issue Aug 23, 2024

[ci] Try to fix intermittent macOS CI failures

58b26b1

c.f. actions/runner-images#7522

tothxa mentioned this issue Aug 30, 2024

WIP: include more macOS versions to the build script widelands/widelands#6447

Draft

samamou pushed a commit to ossia/score that referenced this issue Sep 4, 2024

[ci] Try to fix intermittent macOS CI failures

a4a3bd0

c.f. actions/runner-images#7522

petersteneteg pushed a commit to inviwo/inviwo that referenced this issue Sep 11, 2024

MacOS packaging fix

545984f

actions/runner-images#7522 (comment)

ghutchis added a commit to ghutchis/avogadrolibs that referenced this issue Sep 12, 2024

Try to build Mac DMG more reliably

11d4d5a

Kill XProtect if running, as per: actions/runner-images#7522 (comment) Signed-off-by: Geoff Hutchison <geoff.hutchison@gmail.com>

ghutchis mentioned this issue Sep 12, 2024

Try to build Mac DMG more reliably OpenChemistry/avogadrolibs#1711

Merged

Galkon mentioned this issue Sep 24, 2024

Miserable reliability with macos-14 runners #10680

Open

13 tasks

guihkx mentioned this issue Sep 29, 2024

CI/macOS: Update to macOS 13 nuttyartist/notes#700

Merged

petersteneteg pushed a commit to inviwo/inviwo that referenced this issue Oct 15, 2024

MacOS packaging fix

b2c2e81

actions/runner-images#7522 (comment)

andeon mentioned this issue Oct 17, 2024

Update macOS workflow opentoonz/opentoonz#5617

Open

guihkx mentioned this issue Oct 20, 2024

Do something about flaky macOS builds nuttyartist/notes#711

Closed

karliss mentioned this issue Oct 20, 2024

ci macos-x86_64: Upgrade to the macos-13 image rizinorg/cutter#3387

Merged

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

hdiutil failures when creating DMGs on macOS 13 runner #7522

hdiutil failures when creating DMGs on macOS 13 runner #7522

wkiefer commented May 2, 2023 •

edited

Loading

Alexey-Ayupov commented May 3, 2023

vpolikarpov-akvelon commented May 4, 2023

geoffthemedio commented May 6, 2023

vpolikarpov-akvelon commented May 12, 2023

geoffthemedio commented May 12, 2023

Neverous commented May 15, 2023

vpolikarpov-akvelon commented May 16, 2023

Neverous commented May 16, 2023

Neverous commented May 16, 2023 •

edited

Loading

vpolikarpov-akvelon commented May 22, 2023

Neverous commented May 22, 2023

vpolikarpov-akvelon commented May 23, 2023

Neverous commented May 23, 2023

vpolikarpov-akvelon commented May 23, 2023

Neverous commented May 25, 2023

vpolikarpov-akvelon commented May 26, 2023

Neverous commented May 26, 2023

vpolikarpov-akvelon commented May 29, 2023 •

edited

Loading

jcelerier commented Aug 24, 2024

sarathrajsrinivasan commented Aug 24, 2024

jcelerier commented Aug 24, 2024

sarathrajsrinivasan commented Aug 25, 2024

jcelerier commented Aug 25, 2024

Galkon commented Aug 26, 2024

jcelerier commented Sep 7, 2024

aaneeley commented Sep 7, 2024

Galkon commented Sep 10, 2024

nuttyartist commented Oct 1, 2024

hdiutil failures when creating DMGs on macOS 13 runner #7522

hdiutil failures when creating DMGs on macOS 13 runner #7522

Comments

wkiefer commented May 2, 2023 • edited Loading

Description

Platforms affected

Runner images affected

Image version and build link

Is it regression?

Expected behavior

Actual behavior

Repro steps

Alexey-Ayupov commented May 3, 2023

vpolikarpov-akvelon commented May 4, 2023

geoffthemedio commented May 6, 2023

vpolikarpov-akvelon commented May 12, 2023

geoffthemedio commented May 12, 2023

Neverous commented May 15, 2023

vpolikarpov-akvelon commented May 16, 2023

Neverous commented May 16, 2023

Neverous commented May 16, 2023 • edited Loading

vpolikarpov-akvelon commented May 22, 2023

Neverous commented May 22, 2023

vpolikarpov-akvelon commented May 23, 2023

Neverous commented May 23, 2023

vpolikarpov-akvelon commented May 23, 2023

Neverous commented May 25, 2023

vpolikarpov-akvelon commented May 26, 2023

Neverous commented May 26, 2023

vpolikarpov-akvelon commented May 29, 2023 • edited Loading

jcelerier commented Aug 24, 2024

sarathrajsrinivasan commented Aug 24, 2024

jcelerier commented Aug 24, 2024

sarathrajsrinivasan commented Aug 25, 2024

jcelerier commented Aug 25, 2024

Galkon commented Aug 26, 2024

jcelerier commented Sep 7, 2024

aaneeley commented Sep 7, 2024

Galkon commented Sep 10, 2024

nuttyartist commented Oct 1, 2024

wkiefer commented May 2, 2023 •

edited

Loading

Neverous commented May 16, 2023 •

edited

Loading

vpolikarpov-akvelon commented May 29, 2023 •

edited

Loading