Introduce quarkus.datasource.devservices.init-script-path

[gastaldi]

• This enables specifying a SQL initialization script for Dev Services Databases

Added tests

[gastaldi]

This may be interesting for #29756

[Sanne]

nice!

[Sanne]

My only concern would be that this adds yet-another-way to do such things; we already have the Hibernate import scripts and also the liquibase/flyway migration tools.
I suppose that's overkill for most such uses cases? Also they don't play well with the reactive extensions.

It would be really nice if someone could dedicate some time to unify the experience; e.g. having the power of the migration tools but presented in a super-simple and light way. Until that day comes, I'm ok to have this.

[gastaldi]

@Sanne those are valid concerns, but this use case is specifically to allow creating additional users in the DB that would then be consumed by Flyway, which should happen before the app initializes

[Sanne]

@gastaldi right, not meaning to block this - not at all. Just thinking out loud :)

[gastaldi]

Disabling test in Windows because it seems that Docker isn't properly configured there:

2023-01-18T21:05:40.4908354Z [INFO] Running io.quarkus.it.jdbc.postgresql.DevServicesTest
2023-01-18T21:05:47.2255532Z 2023-01-18 21:05:47,086 WARN  [org.tes.uti.TestcontainersConfiguration] (build-76) Attempted to read Testcontainers configuration file at file:/C:/Users/runneradmin/.testcontainers.properties but the file was not found. Exception message: FileNotFoundException: C:\Users\runneradmin\.testcontainers.properties (The system cannot find the file specified)
2023-01-18T21:05:48.5759881Z 2023-01-18 21:05:48,497 INFO  [org.tes.doc.DockerClientProviderStrategy] (build-76) Found Docker environment with local Npipe socket (npipe:////./pipe/docker_engine)
2023-01-18T21:05:48.5761371Z 2023-01-18 21:05:48,497 WARN  [org.tes.doc.DockerClientProviderStrategy] (build-76) windows is currently not supported
2023-01-18T21:05:48.5767640Z 2023-01-18 21:05:48,512 INFO  [org.tes.doc.DockerMachineClientProviderStrategy] (build-76) docker-machine executable was not found on PATH ([C:\Program Files\Git\mingw64\bin, C:\Program Files\Git\usr\bin, C:\Users\runneradmin\bin, C:\hostedtoolcache\windows\Java_Temurin-Hotspot_jdk\11.0.17-8\x64\bin, C:\Program Files\MongoDB\Server\5.0\bin, C:\aliyun-cli, C:\vcpkg, C:\Program Files (x86)\NSIS, C:\tools\zstd, C:\Program Files\Mercurial, C:\hostedtoolcache\windows\stack\2.9.3\x64, C:\cabal\bin, C:\ghcup\bin, C:\tools\ghc-9.4.4\bin, C:\Program Files\dotnet, C:\mysql\bin, C:\Program Files\R\R-4.2.2\bin\x64, C:\SeleniumWebDrivers\GeckoDriver, C:\Program Files (x86)\sbt\bin, C:\Program Files (x86)\GitHub CLI, C:\Program Files\Git\usr\bin, C:\Program Files (x86)\pipx_bin, C:\npm\prefix, C:\hostedtoolcache\windows\go\1.17.13\x64\bin, C:\hostedtoolcache\windows\Python\3.9.13\x64\Scripts, C:\hostedtoolcache\windows\Python\3.9.13\x64, C:\hostedtoolcache\windows\Ruby\3.0.5\x64\bin, C:\tools\kotlinc\bin, C:\hostedtoolcache\windows\Java_Temurin-Hotspot_jdk\8.0.352-8\x64\bin, C:\Program Files\ImageMagick-7.1.0-Q16-HDRI, C:\Program Files (x86)\Microsoft SDKs\Azure\CLI2\wbin, C:\ProgramData\kind, C:\Program Files\Microsoft\jdk-11.0.12.7-hotspot\bin, C:\Windows\system32, C:\Windows, C:\Windows\System32\Wbem, C:\Windows\System32\WindowsPowerShell\v1.0, C:\Windows\System32\OpenSSH, C:\Program Files\dotnet, C:\ProgramData\Chocolatey\bin, C:\Program Files\PowerShell\7, C:\Program Files\Microsoft\Web Platform Installer, C:\Program Files\Microsoft SQL Server\Client SDK\ODBC\170\Tools\Binn, C:\Program Files\Microsoft SQL Server\150\Tools\Binn, C:\Program Files\OpenSSL\bin, C:\Strawberry\c\bin, C:\Strawberry\perl\site\bin, C:\Strawberry\perl\bin, C:\ProgramData\chocolatey\lib\pulumi\tools\Pulumi\bin, C:\Program Files\TortoiseSVN\bin, C:\Program Files\CMake\bin, C:\ProgramData\chocolatey\lib\maven\apache-maven-3.8.7\bin, C:\Program Files\Microsoft Service Fabric\bin\Fabric\Fabric.Code, C:\Program Files\Microsoft SDKs\Service Fabric\Tools\ServiceFabricLocalClusterManager, C:\Program Files\nodejs, C:\Program Files\Git\cmd, C:\Program Files\Git\mingw64\bin, C:\Program Files\Git\usr\bin, C:\Program Files\GitHub CLI, C:\tools\php, C:\Program Files (x86)\sbt\bin, C:\SeleniumWebDrivers\ChromeDriver, C:\SeleniumWebDrivers\EdgeDriver, C:\Program Files\Amazon\AWSCLIV2, C:\Program Files\Amazon\SessionManagerPlugin\bin, C:\Program Files\Amazon\AWSSAMCLI\bin, C:\Program Files\Microsoft SQL Server\130\Tools\Binn, C:\Program Files\LLVM\bin, C:\Users\runneradmin\.dotnet\tools, C:\Users\runneradmin\.cargo\bin, C:\Users\runneradmin\AppData\Local\Microsoft\WindowsApps])
2023-01-18T21:05:48.5772560Z 2023-01-18 21:05:48,512 ERROR [org.tes.doc.DockerClientProviderStrategy] (build-76) Could not find a valid Docker environment. Please check configuration. Attempted configurations were:
2023-01-18T21:05:48.5773421Z    NpipeSocketClientProviderStrategy: failed with exception InvalidConfigurationException (windows containers are currently not supported)As no valid configuration was found, execution cannot continue.
2023-01-18T21:05:48.5774079Z See https://www.testcontainers.org/on_failure.html for more details.
2023-01-18T21:05:51.7591436Z 2023-01-18 21:05:51,741 WARN  [io.qua.dep.IsDockerWorking] (build-76) 'docker -v' returned an error code. Make sure your Docker binary is correct

[quarkus-bot]

Failing Jobs - Building 6b4baf2

Status	Name	Step	Failures	Logs	Raw logs
✔️	JVM Tests - JDK 11
✖	JVM Tests - JDK 11 Windows	Build	Failures	Logs	Raw logs
✔️	JVM Tests - JDK 17
✔️	JVM Tests - JDK 18

Full information is available in the Build summary check run.

Failures

⚙️ JVM Tests - JDK 11 Windows #

- Failing: extensions/opentelemetry/deployment 
! Skipped: extensions/micrometer-registry-prometheus/deployment extensions/micrometer/deployment extensions/quartz/deployment and 26 more

📦 extensions/opentelemetry/deployment

✖ io.quarkus.opentelemetry.deployment.instrumentation.GrpcOpenTelemetryTest.streamingBlocking line 225 - More details - Source on GitHub

io.smallrye.mutiny.TimeoutException
	at io.smallrye.mutiny.operators.uni.UniBlockingAwait.await(UniBlockingAwait.java:64)
	at io.smallrye.mutiny.groups.UniAwait.atMost(UniAwait.java:65)

✖ io.quarkus.opentelemetry.deployment.instrumentation.GrpcOpenTelemetryTest.streaming line 188 - More details - Source on GitHub

io.smallrye.mutiny.TimeoutException
	at io.smallrye.mutiny.operators.uni.UniBlockingAwait.await(UniBlockingAwait.java:64)
	at io.smallrye.mutiny.groups.UniAwait.atMost(UniAwait.java:65)

✖ io.quarkus.opentelemetry.deployment.instrumentation.GrpcOpenTelemetryTest.grpc line 101 - More details - Source on GitHub

io.smallrye.mutiny.TimeoutException
	at io.smallrye.mutiny.operators.uni.UniBlockingAwait.await(UniBlockingAwait.java:64)
	at io.smallrye.mutiny.groups.UniAwait.atMost(UniAwait.java:65)

✖ io.quarkus.opentelemetry.deployment.instrumentation.GrpcOpenTelemetryTest.error line 144 - More details - Source on GitHub

org.awaitility.core.ConditionTimeoutException: Assertion condition defined as a lambda expression in io.quarkus.opentelemetry.deployment.common.TestSpanExporter expected: <2> but was: <9> within 30 seconds.
	at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:167)
	at org.awaitility.core.AssertionCondition.await(AssertionCondition.java:119)

[Serkan80]

Cool ! I was looking for something like this.

And does it also work for multi datasources ?

quarkus.datasource.datasource1.devservices.init-script-path=script1.sql
quarkus.datasource.datasource2.devservices.init-script-path=script2.sql

[gastaldi]

@Serkan80 yes, it should work for that scenario too

[viniciusvasti]

It is not working for me.
I'm getting org.postgresql.util.PSQLException: ERROR: relation "<table>" does not exist
Does the defined script run before Flyway migrations?
I'd like to have my migrations ran then populate the database for dev and test profiles only.
Shouldn't this property allow that?

[gastaldi]

No, the init-script-path script is executed before Flyway executes