Error occured after packaging to jar #1428

UESTCkevin · 2021-12-22T10:37:35Z

I was trying to load a Onnx model by using ModelZoo.loadModel(). Here is my code:

123

    public static void main(String[] args) throws MalformedURLException {
        LoadDll loadDll = new LoadDll();
        loadDll.loadOpenCV();
        Translator<Image, DetectedObjects> yoloV5Translator = YoloV5Translator.builder().optSynsetArtifactName("person.names").build();
        Criteria<Image, DetectedObjects> criteria =
                Criteria.builder()
                        .setTypes(Image.class, DetectedObjects.class)
                        .optDevice(Device.cpu())
                        .optModelPath(Paths.get("src/main/resources/yolov5s/person.onnx"))
                        .optTranslator(yoloV5Translator)
                        .optEngine("OnnxRuntime")
                        .build();
        try (ZooModel<Image, DetectedObjects> model = ModelZoo.loadModel(criteria)) {
            FFmpegFrameGrabber fFmpegFrameGrabber = FFmpegFrameGrabber.createDefault("src/main/resources/video/person.mp4");
            fFmpegFrameGrabber.start();
            int videoLength = fFmpegFrameGrabber.getLengthInFrames();
            Frame f;
            int i = 0;
            while (i < videoLength) {
                f = fFmpegFrameGrabber.grabImage();
                Java2DFrameConverter converter = new Java2DFrameConverter();
                BufferedImage bi = converter.getBufferedImage(f);
                Mat oldFrame = BufImg2Mat(bi, BufferedImage.TYPE_3BYTE_BGR, CvType.CV_8UC3);
                Mat frame = new Mat();
                Imgproc.resize(oldFrame, frame, new Size(640, 640));
                detect(frame, model);
                HighGui.imshow("yolov5", frame);
                HighGui.waitKey(10);
                i++;
            }
            fFmpegFrameGrabber.stop();
        } catch (RuntimeException | ModelException | TranslateException | IOException e) {
            e.printStackTrace();
        }
    }

Code runs perfectly fine on IDE but after I packaged it to jar and try 'java -jar PersonDetect.jar', an error occured as below: Any suggestions on this issue?

UESTCkevin · 2021-12-22T10:38:41Z

Image is here.

frankfliu · 2021-12-22T18:17:49Z

@UESTCkevin

You might hit this issue: #940

Can you share your dependencies and build script file?

And aslo share the file names in your .jar file:

jar tvf PersonDetect.jar

UESTCkevin · 2021-12-23T09:38:09Z

@frankfliu Here is my pom.xml:

pom.xml

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>org.example</groupId>
    <artifactId>PersonDetect</artifactId>
    <version>1.0-SNAPSHOT</version>

    <properties>
        <maven.compiler.source>8</maven.compiler.source>
        <maven.compiler.target>8</maven.compiler.target>
        <djl.version>0.11.0</djl.version>
    </properties>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-assembly-plugin</artifactId>
                <configuration>
                    <archive>
                        <manifest>
                            <mainClass>PersonDetect</mainClass>
                        </manifest>
                    </archive>
                    <descriptorRefs>
                        <descriptorRef>
                            jar-with-dependencies
                        </descriptorRef>
                    </descriptorRefs>
                </configuration>
            </plugin>
        </plugins>
    </build>

    <dependencies>
        <dependency>
            <groupId>org.slf4j</groupId>
            <artifactId>slf4j-nop</artifactId>
            <version>1.7.2</version>
        </dependency>
        <dependency>
            <groupId>ai.djl</groupId>
            <artifactId>api</artifactId>
            <version>${djl.version}</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-model-zoo</artifactId>
            <version>${djl.version}</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-engine</artifactId>
            <version>${djl.version}</version>
            <scope>runtime</scope>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-native-auto</artifactId>
            <version>1.8.1</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.onnxruntime</groupId>
            <artifactId>onnxruntime-engine</artifactId>
            <version>0.12.0</version>
        </dependency>
        <dependency>
            <groupId>org.bytedeco</groupId>
            <artifactId>javacv-platform</artifactId>
            <version>1.5.6</version>
        </dependency>
    </dependencies>
</project>

I packaged my project to jar by command 'mvn assembly:assembly' and then I got two .jar file in the 'target' folder which are 'PersonDetect-1.0-SNAPSHOT.jar' and 'PersonDetect-1.0-SNAPSHOT-jar-with-dependencies.jar'.

I ran 'java -jar PersonDetect-1.0-SNAPSHOT-jar-with-dependencies.jar' and here is what I got:

Error

PS E:\JavaProject\PersonDetect\target> java -jar PersonDetect-1.0-SNAPSHOT-jar-with-dependencies.jar
Windows 10 64 bit load success!
ai.djl.repository.zoo.ModelNotFoundException: ModelZoo doesn't support specified with engine: OnnxRuntime
        at ai.djl.repository.zoo.ModelZoo.loadModel(ModelZoo.java:136)
        at PersonDetect.main(PersonDetect.java:70)

Thank you for any advice.

frankfliu · 2021-12-23T17:54:08Z

@UESTCkevin
You run into the same issue as: #940

We use ServiceLoader to load model zoo and engines. maven assembly removes the duplicate serviceloader files in the uber jar, you should consider use maven-shade-plugin to keep all duplicate files in your jar.

Or you can consider use gradle to build project. In gradle it's pretty straight-forward, see example: https://github.com/deepjavalibrary/djl/blob/master/engines/mxnet/jnarator/build.gradle#L28

UESTCkevin · 2021-12-28T07:58:03Z

@frankfliu Thanks for replying. I switched maven-assembly-plugin to maven-shade-plugin. This is my new pom.xml:

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
         xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>org.example</groupId>
    <artifactId>PersonDetect</artifactId>
    <version>1.0-SNAPSHOT</version>

    <properties>
        <maven.compiler.source>8</maven.compiler.source>
        <maven.compiler.target>8</maven.compiler.target>
        <djl.version>0.11.0</djl.version>
    </properties>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <version>3.2.4</version>
                <configuration>
                    <transformers>
                        <transformer
                            implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer" />
                        <transformer
                            implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer">
                            <mainClass>PersonDetect</mainClass>
                        </transformer>
                    </transformers>
                </configuration>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                        <configuration>
                            <filters>
                                <filter>
                                    <artifact>*:*</artifact>
                                    <excludes>
                                        <exclude>PamModel/*.*</exclude>  
                                        <exclude>META-INF/*.SF</exclude> 
                                        <exclude>META-INF/*.DSA</exclude>
                                        <exclude>META-INF/*.RSA</exclude>
                                    </excludes>
                                </filter>
                            </filters>
                        </configuration>
                    </execution>
                </executions>
            </plugin>
        </plugins>
    </build>

    <dependencies>
        <dependency>
            <groupId>org.slf4j</groupId>
            <artifactId>slf4j-nop</artifactId>
            <version>1.7.2</version>
        </dependency>
        <dependency>
            <groupId>ai.djl</groupId>
            <artifactId>api</artifactId>
            <version>${djl.version}</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-model-zoo</artifactId>
            <version>${djl.version}</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-engine</artifactId>
            <version>${djl.version}</version>
            <scope>runtime</scope>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-native-auto</artifactId>
            <version>1.8.1</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.onnxruntime</groupId>
            <artifactId>onnxruntime-engine</artifactId>
            <version>0.12.0</version>
        </dependency>
        <dependency>
            <groupId>org.bytedeco</groupId>
            <artifactId>javacv-platform</artifactId>
            <version>1.5.6</version>
        </dependency>
    </dependencies>
</project>

After I executed mvn clean package I got two .jar files in the 'target' folder which are 'PersonDetect-1.0-SNAPSHOT.jar' and 'original-PersonDetect-1.0-SNAPSHOT.jar'. I executed java -jar PersonDetect-1.0-SNAPSHOT.jar but I still got the same error as below:

PS E:\JavaProject\PersonDetect\target> java -jar PersonDetect-1.0-SNAPSHOT.jar 
Windows 10 64 bit load success!
ai.djl.repository.zoo.ModelNotFoundException: No matching model with specified Input/Output type found.
        at ai.djl.repository.zoo.ModelZoo.loadModel(ModelZoo.java:202)
        at PersonDetect.main(PersonDetect.java:70)

Do you have any other advice?

frankfliu · 2021-12-28T19:21:22Z

@UESTCkevin
The error message is different from your last error. Can you share the complete project so I can reproduce it?

You might want to enable debug log level, so you can see the detail about model loading:

https://docs.djl.ai/master/docs/development/configure_logging.html#configure-logging-level

UESTCkevin · 2021-12-29T08:29:32Z

@frankfliu Thanks for replying. This is my project address:https://github.com/UESTCkevin/PersonDetect
Opencv resources is located in 'src/main/resources/opencv' folder.
Thanks again for helping.

frankfliu · 2021-12-29T21:29:31Z

@UESTCkevin

I tried your project on Windows, it's working fine in both IntelliJ and command line:

cd PersonDetect
java -jar target/PersonDetect-1.0-SNAPSHOT.jar

The error most likely is because you are running in target folder. In your code you use relative file path src/main/resources/yolov5s/person.onnx, this path doesn't exists in target folder

UESTCkevin · 2021-12-30T08:20:39Z

@frankfliu
It works after I run java -jar target/PersonDetect-1.0-SNAPSHOT.jar.
Thanks for your help!

UESTCkevin added the enhancement New feature or request label Dec 22, 2021

UESTCkevin closed this as completed Dec 30, 2021

WabbyWabbo mentioned this issue Nov 28, 2022

About the progress bar output stream #2180

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Error occured after packaging to jar #1428

Error occured after packaging to jar #1428

UESTCkevin commented Dec 22, 2021 •

edited

Loading

UESTCkevin commented Dec 22, 2021

frankfliu commented Dec 22, 2021

UESTCkevin commented Dec 23, 2021 •

edited

Loading

frankfliu commented Dec 23, 2021 •

edited

Loading

UESTCkevin commented Dec 28, 2021

frankfliu commented Dec 28, 2021 •

edited

Loading

UESTCkevin commented Dec 29, 2021

frankfliu commented Dec 29, 2021

UESTCkevin commented Dec 30, 2021

Error occured after packaging to jar #1428

Error occured after packaging to jar #1428

Comments

UESTCkevin commented Dec 22, 2021 • edited Loading

UESTCkevin commented Dec 22, 2021

frankfliu commented Dec 22, 2021

UESTCkevin commented Dec 23, 2021 • edited Loading

frankfliu commented Dec 23, 2021 • edited Loading

UESTCkevin commented Dec 28, 2021

frankfliu commented Dec 28, 2021 • edited Loading

UESTCkevin commented Dec 29, 2021

frankfliu commented Dec 29, 2021

UESTCkevin commented Dec 30, 2021

UESTCkevin commented Dec 22, 2021 •

edited

Loading

UESTCkevin commented Dec 23, 2021 •

edited

Loading

frankfliu commented Dec 23, 2021 •

edited

Loading

frankfliu commented Dec 28, 2021 •

edited

Loading