Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Kafka versions #17819

Merged

Conversation

ycombinator
Copy link
Contributor

What does this PR do?

Updates the version of Kafka we use in our tests.

Why is it important?

The libbeat CI job has been failing the past few days with this error:


[2020-04-19T19:37:28.974Z] Step 9/15 : RUN mkdir -p ${KAFKA_LOGS_DIR} && mkdir -p ${KAFKA_HOME} && curl -s -o $INSTALL_DIR/kafka.tgz     "http://mirror.easyname.ch/apache/kafka/${KAFKA_VERSION}/kafka_2.11-${KAFKA_VERSION}.tgz" &&     tar xzf ${INSTALL_DIR}/kafka.tgz -C ${KAFKA_HOME} --strip-components 1

[2020-04-19T19:37:28.975Z]  ---> Running in 3dc3dbc4603f

[2020-04-19T19:37:29.914Z] 

[2020-04-19T19:37:29.915Z] gzip: stdin: not in gzip format

[2020-04-19T19:37:29.915Z] tar: Child returned status 1

[2020-04-19T19:37:29.915Z] tar: Error is not recoverable: exiting now

[2020-04-19T19:37:29.915Z] Removing intermediate container 3dc3dbc4603f

[2020-04-19T19:37:29.915Z] Service 'kafka' failed to build: The command '/bin/sh -c mkdir -p ${KAFKA_LOGS_DIR} && mkdir -p ${KAFKA_HOME} && curl -s -o $INSTALL_DIR/kafka.tgz     "http://mirror.easyname.ch/apache/kafka/${KAFKA_VERSION}/kafka_2.11-${KAFKA_VERSION}.tgz" &&     tar xzf ${INSTALL_DIR}/kafka.tgz -C ${KAFKA_HOME} --strip-components 1' returned a non-zero code: 2

[2020-04-19T19:37:29.915Z] scripts/Makefile:405: recipe for target 'build-image' failed

[2020-04-19T19:37:29.915Z] make[1]: *** [build-image] Error 1

[2020-04-19T19:37:29.915Z] make[1]: Leaving directory '/var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-17381/src/github.com/elastic/beats/libbeat'

[2020-04-19T19:37:29.915Z] scripts/Makefile:305: recipe for target 'testsuite' failed

[2020-04-19T19:37:29.915Z] make: *** [testsuite] Error 2

Visiting http://mirror.easyname.ch/apache/kafka/ shows that the 2.1.1 sub-folder is no longer available, which is causing the failure seen in the CI logs. The next version available is 2.2.2 so this PR updates the Kafka version in our codebase to 2.2.2.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc

@ycombinator ycombinator added [zube]: In Review Team:Services (Deprecated) Label for the former Integrations-Services team labels Apr 20, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

@ycombinator ycombinator added needs_backport PR is waiting to be backported to other branches. v7.7.1 v7.8.0 v8.0.0 labels Apr 20, 2020
Copy link
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI is still red but doesn't seem to be related to kafka version anymore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs_backport PR is waiting to be backported to other branches. Team:Services (Deprecated) Label for the former Integrations-Services team v7.7.1 v7.8.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants