Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update GKE installation and chart values to work with 0.4.3 #434

Merged
merged 1 commit into from
Jan 18, 2020

Conversation

lgvital
Copy link
Contributor

@lgvital lgvital commented Jan 17, 2020

What this PR does / why we need it: GKE docs and charts are outdated and do not work end-to-end. This PR should do the minimum to fix it. Mostly thanks to @woop who helped me debug the issues and find holes in current docs/charts.

  • Makes core, online-serving, batch-serving, kafka, and redis externally accessible using NodePorts in the example values.yaml.
  • Updates relevant docs in installation guide to reflect nodeport changes.
  • Adds instructions in exposing node ports in your gcloud firewall.

The end result is anybody should be able to follow these docs + values.yaml to create a feast cluster in GKE and have ingestion, online serving, and batch serving deployed on a publicly accessible IP.

Which issue(s) this PR fixes:
Fixes #427
Fixes #349

Does this PR introduce a user-facing change?:

NONE

@feast-ci-bot
Copy link
Collaborator

Hi @lgvital. Thanks for your PR.

I'm waiting for a gojek member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@lgvital
Copy link
Contributor Author

lgvital commented Jan 17, 2020

/assign @woop

@khorshuheng
Copy link
Collaborator

/ok-to-test

# jvmOptions are options that will be passed to the Java Virtual Machine (JVM)
# Specify what image tag to use. Keep this consistent for all components
image:
tag: "0.4.3"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we also need to remove the existing image tag from the helm charts. I believe it is currently hardcoded.

@woop
Copy link
Member

woop commented Jan 18, 2020

Thanks so much for this @lgvital. I just had a quick look and it looks great. I think we can safely merge this in for the time being, I will add more content a bit later.

@woop
Copy link
Member

woop commented Jan 18, 2020

/approve
/lgtm

@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: lgvital, woop

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@feast-ci-bot feast-ci-bot merged commit 5fcc30f into feast-dev:master Jan 18, 2020
@lgvital
Copy link
Contributor Author

lgvital commented Jan 18, 2020

Thanks so much for this @lgvital. I just had a quick look and it looks great. I think we can safely merge this in for the time being, I will add more content a bit later.

No prob, thanks for the help and quick review!

khorshuheng pushed a commit to khorshuheng/feast that referenced this pull request Feb 13, 2020
davidheryanto pushed a commit that referenced this pull request Feb 13, 2020
* Update Changelog (#423)

* Initial commit of changelog up to 0.4.3

* Remove unreleased changes on master

* Add missing changelog manually

Co-authored-by: Khor Shu Heng <32997938+khorshuheng@users.noreply.github.com>

* Introduce datatypes/java module for proto generation (#391)

Rather than the Maven protobuf plugin running on the same symlinked
definitions in several Java modules, localize this process into one
module that the others depend on.

This provides a single module that can be depended on by third-party
extensions with the bare minimum of dependencies.

Also removes proto files that are no longer used.

* Update basic Feast example to Feast 0.4 (#424)

* Add documentation for bigquery batch retrieval (#428)

* Add documentation for bigquery batch retrieval

* Fix formatting for multiline comments

* Bump hibernate-validator from 6.0.13.Final to 6.1.0.Final in /ingestion (#421)

Bumps [hibernate-validator](https://github.com/hibernate/hibernate-validator) from 6.0.13.Final to 6.1.0.Final.
- [Release notes](https://github.com/hibernate/hibernate-validator/releases)
- [Changelog](https://github.com/hibernate/hibernate-validator/blob/master/changelog.txt)
- [Commits](hibernate/hibernate-validator@6.0.13.Final...6.1.0.Final)

Signed-off-by: dependabot[bot] <support@github.com>

* Publish datatypes/java along with sdk/java (#426)

This forward-ports a straggling commit from #407: it was missed when
initially creating the datatypes module because Sonatype publishing
setup was added concurrently.

* Remove "resource" concept and the need to specify a kind in feature sets (#432)

* Update GKE installation and chart values to work with 0.4.3 (#434)

* Fix logging (#430)

Allow log level to be set via environmental variable.
Add ability to set appender type in serving.
Remove logback-classic from ingestion as it is a library so should not bring its own impl.
Upgrade log4j to 2.12.1 to support objectMessageAsJsonObject.
Fix logger config targeting feast package in serving an add same concept for core.

* Bump chart version

* Update Changelog (#447)

* Update Changelog

* Remove closed issues

Co-authored-by: Willem Pienaar <6728866+woop@users.noreply.github.com>
Co-authored-by: Ches Martin <ches@whiskeyandgrits.net>
Co-authored-by: Chen Zhiling <chnzhlng@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Lionel Vital <lgvital@gmail.com>
Co-authored-by: Iain Rauch <Yanson@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

GKE Ingestion Jobs Failing Cant ping internal IP on GKE node - But am i really supposed to?
4 participants