-
Notifications
You must be signed in to change notification settings - Fork 260
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[release v1.2] Backport v1.6 #1645
Commits on May 16, 2023
-
Signed-off-by: Ketan Umare <ketan.umare@gmail.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4555578 - Browse repository at this point
Copy the full SHA 4555578View commit details -
Pluck retry from flytekit and into sagemaker (#1411)
* Remove retry from flytekit's setup.py and regenerate requirements Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Add to sagemaker Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Remove retry from sagemaker plugin requirements file Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> * Restore doc-requirements.txt Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * Fix bad merge Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> --------- Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com> Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f6331ca - Browse repository at this point
Copy the full SHA f6331caView commit details -
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2731766 - Browse repository at this point
Copy the full SHA 2731766View commit details -
Stream Directories and Files using Flyte (#1512)
Signed-off-by: Ketan Umare <ketan.umare@gmail.com> Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0c47d46 - Browse repository at this point
Copy the full SHA 0c47d46View commit details -
Make
FlyteFile
compatible withAnnotated[..., HashMethod]
(#1544)* fix: Make FlyteFile compatible with Annotated[..., HashMethod] See issue #3424 Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com> * tests: Add test case for FlyteFile with HashMethod annotation Issue: #3424 Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com> * fix: Use typing_extensions.Annotated for py3.8 compatibility Issue: #3424 Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com> * fix: Use `get_args` and `get_origin` from typing_extensions for py3.8 compatibility Issue: #3424 Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com> * fix(tests): Use fixture for local dummy file Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com> --------- Signed-off-by: Adrian Rumpold <a.rumpold@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 1f7f510 - Browse repository at this point
Copy the full SHA 1f7f510View commit details -
move FlyteSchema deprecation warning to initialization method (#1558)
* move FlyteSchema deprecation warning to initialization method Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * update Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> --------- Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 236309a - Browse repository at this point
Copy the full SHA 236309aView commit details -
add pod_template and pod_template_name arguments for ContainerTask (#…
…1515) * add pod_template and pod_template_name arguments for ContainerTask Signed-off-by: Felix Ruess <felix.ruess@roboception.de> * factor out _serialize_pod_spec into separate util function Signed-off-by: Felix Ruess <felix.ruess@roboception.de> * model file changes, couple other changes Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * minor cleanup Signed-off-by: Felix Ruess <felix.ruess@roboception.de> * add unit test for container_task pod_template Signed-off-by: Felix Ruess <felix.ruess@roboception.de> * bump min version of flyteidl to 1.3.12 for pod template data config support Signed-off-by: Felix Ruess <felix.ruess@roboception.de> * require flyteidl==1.3.12 in doc-requirements.txt Signed-off-by: Felix Ruess <felix.ruess@roboception.de> --------- Signed-off-by: Felix Ruess <felix.ruess@roboception.de> Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 756148b - Browse repository at this point
Copy the full SHA 756148bView commit details -
Pass locally defined scopes to RemoteClientConfigStore (#1553)
Signed-off-by: franco-bocci <franco.bocci@wolt.com>
Configuration menu - View commit details
-
Copy full SHA for b22e5e3 - Browse repository at this point
Copy the full SHA b22e5e3View commit details -
TypeTransformer for TensorFlow model (#1562)
* TypeTransformer for TensorFlow model Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * clean up Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * clean up Signed-off-by: Samhita Alla <aallasamhita@gmail.com> * fix lint Signed-off-by: Samhita Alla <aallasamhita@gmail.com> --------- Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for f0abcc9 - Browse repository at this point
Copy the full SHA f0abcc9View commit details -
Remove fsspec flytekit plugin from main Dockerfile (#1561)
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for bd6a7e5 - Browse repository at this point
Copy the full SHA bd6a7e5View commit details -
Device auth flow / Headless auth (#1552)
* Device auth flow Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Device AuthFlow is now available in flytekit Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * unit tests Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * test added Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * updated Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Fixed test Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Fixed unit test Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Fixed lint errors Signed-off-by: Ketan Umare <ketan.umare@gmail.com> --------- Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for b757306 - Browse repository at this point
Copy the full SHA b757306View commit details -
url encode secret in client credentials flow (#1566)
* url encode secret first Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> * nit Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com> --------- Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 7e76d4b - Browse repository at this point
Copy the full SHA 7e76d4bView commit details -
Python run multiple files (#1559)
* wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * update comment Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 19a0367 - Browse repository at this point
Copy the full SHA 19a0367View commit details -
General Partial support in flytekit and multi-list support in flytekit (
#1556) Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 9a31a01 - Browse repository at this point
Copy the full SHA 9a31a01View commit details -
fix: Silence keyring warnings by changing to debug (#1568)
Co-authored-by: ggydush-fn <greg.gydush@freenome.com>
Configuration menu - View commit details
-
Copy full SHA for d8c10c6 - Browse repository at this point
Copy the full SHA d8c10c6View commit details -
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 06ea83b - Browse repository at this point
Copy the full SHA 06ea83bView commit details -
Automatically remove unused import (#1574)
* Automatically remove unused import Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 57e21c2 - Browse repository at this point
Copy the full SHA 57e21c2View commit details -
Disallow partial lists in map tasks (#1577)
* Disallow partial lists in map tasks Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * Lint Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> --------- Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 082f8fb - Browse repository at this point
Copy the full SHA 082f8fbView commit details -
Remove duplicate reporting logic (#1578)
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0c0c2ac - Browse repository at this point
Copy the full SHA 0c0c2acView commit details -
[Core feature] Convert List[Any] to a single pickle file (#1535)
* Convert List[Any] to a single pickle file * remove redundant code * keep batchSize only if type contain flytePickle * fix error * add batch support to translate_inputs_to_literals * add ci test Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve comment Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * add more ci test Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * handle HashMethod case Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve format Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * improve Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * add test_is_batchable Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * Add BatchSize Signed-off-by: Kevin Su <pingsutw@apache.org> * test_batch_size Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> Signed-off-by: Kevin Su <pingsutw@apache.org> Co-authored-by: root <root@ip-172-31-10-58.ec2.internal> Co-authored-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 3ed7f83 - Browse repository at this point
Copy the full SHA 3ed7f83View commit details -
Improve authoring structure documentation (#1572)
Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 8941718 - Browse repository at this point
Copy the full SHA 8941718View commit details -
Unify sqlalchemy Dockerfiles (#1585)
* Unify sqlalchemy Dockerfiles Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * Simplifyte sqlalchemy Dockerfile Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * Set pythonpath to /root Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> --------- Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3be7f50 - Browse repository at this point
Copy the full SHA 3be7f50View commit details -
Pyflyte build imageSpec (#1555)
* wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * pyflyte build Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * Support serialize and package Signed-off-by: Kevin Su <pingsutw@apache.org> * more tests Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * move to plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tested Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tested Signed-off-by: Kevin Su <pingsutw@apache.org> * more tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Add support passing yaml in pyflyte run Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for a591b7d - Browse repository at this point
Copy the full SHA a591b7dView commit details -
Feature/3506: Improve Type Conversion errors, use rich to prettify er…
…ror messages (#1582) * improve input type conversion error Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * fix lint Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * fix Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * add tests Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * add tests Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * add rich Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * fix lint Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * remove prototyping script, update loggers Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * update __init__.py Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * update logger Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * update logger Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * fix GE and pandera tests Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> * fix lint Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com> --------- Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 915ea43 - Browse repository at this point
Copy the full SHA 915ea43View commit details -
Add support nested FlyteFile in pyflyte run (#1587)
* Add support nested FlyteFile in pyflyte run Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for f8cc630 - Browse repository at this point
Copy the full SHA f8cc630View commit details -
Set cache_regions=True in the case of s3fs (#1592)
* Set cache_regions=True in the case of s3fs * Linting Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * Fix tests Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> * More linting Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> --------- Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8e26a59 - Browse repository at this point
Copy the full SHA 8e26a59View commit details -
Set default ComSpec when running on Windows (#1595)
* set default ComSpec when running on Windows Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for b60fe84 - Browse repository at this point
Copy the full SHA b60fe84View commit details -
Feature: add activate-launchplan command to pyflyte (#1588)
* add activate-launchplan command to pyflyte Signed-off-by: Artem Petrov <58334441+wckdman@users.noreply.github.com> * fix linting Signed-off-by: Artem Petrov <58334441+wckdman@users.noreply.github.com> * rework launchplan command Signed-off-by: Artem Petrov <58334441+wckdman@users.noreply.github.com> * fix linting Signed-off-by: Artem Petrov <58334441+wckdman@users.noreply.github.com> --------- Signed-off-by: Artem Petrov <58334441+wckdman@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ec61f34 - Browse repository at this point
Copy the full SHA ec61f34View commit details -
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 34ea031 - Browse repository at this point
Copy the full SHA 34ea031View commit details -
Add log streaming to papermill plugin (#1129)
* checkpoint Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Experimental implementation works well. Instead of messing with the class, we utilize the interpolation and context to dynamically generate a wrapper around the desired script. In the wrapper, we cd to the ctx.working_directory, export the env variables (handled by an additional method to convert dict to str), and then pass the arguments to the script Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fix spacing Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * remove breakpoint Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Output ctx.working_directory as single output Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * more doc strings Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * more comments Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Added comments Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Add tests and test files from other branch Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * minor fix, have function return the instance rather than create. It seems to get registered when flyte packages your project Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fix tests Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * remove set flags not supported by sh Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fix spellcheck lint errors Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * don't have a windows equivalent test script so bypassing those tests for now Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Add typing to make_export_string_from_env_dict params Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fixup doc string Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Refactored the new behavior out into a new class. Did not change implementation details at all Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Address linter issues and up test cov Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Skip test on windows, no equivalent script Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Run black and isort, address SC2236 Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Refactored class name to remove _, make utility function require name so multiple uses in a workflow don't break Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fix utility function Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * fix utility function call in tests Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * Fix isort on test_shell.py Signed-off-by: Mike Zhong <mzhong@embarkvet.com> * adding logging settings to papermill plugin Signed-off-by: Calvin Leather <cleather@embarkvet.com> * set level to info logging * improved comments/docs --------- Signed-off-by: Mike Zhong <mzhong@embarkvet.com> Signed-off-by: Calvin Leather <cleather@embarkvet.com> Co-authored-by: Mike Zhong <mzhong@embarkvet.com> Co-authored-by: Mike Zhong <mike.zhong89@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 34326ca - Browse repository at this point
Copy the full SHA 34326caView commit details -
Set lower bound for s3fs (#1598)
* set lower bound for s3fs Signed-off-by: Kevin Su <pingsutw@apache.org> * update doc-requirements.txt Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for a545e9e - Browse repository at this point
Copy the full SHA a545e9eView commit details -
Implement horovod task in mpi plugin (#1575)
* Add horovod task to mpi plugin Signed-off-by: byhsu <byhsu@linkedin.com> * Remove unused Signed-off-by: byhsu <byhsu@linkedin.com> * add test Signed-off-by: byhsu <byhsu@linkedin.com> * inherit from mpifunctiontask Signed-off-by: byhsu <byhsu@linkedin.com> * fix format Signed-off-by: byhsu <byhsu@linkedin.com> * fix format Signed-off-by: byhsu <byhsu@linkedin.com> --------- Signed-off-by: byhsu <byhsu@linkedin.com> Co-authored-by: byhsu <byhsu@linkedin.com>
Configuration menu - View commit details
-
Copy full SHA for 083b16b - Browse repository at this point
Copy the full SHA 083b16bView commit details -
add ImageRender class for Flyte Decks (#1599)
Signed-off-by: esad <esad@peridotml.io>
Configuration menu - View commit details
-
Copy full SHA for e3447ce - Browse repository at this point
Copy the full SHA e3447ceView commit details -
Bump tensorflow from 2.10.0 to 2.11.1 in /plugins/flytekit-mlflow (#1586
) Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.10.0 to 2.11.1. - [Release notes](https://github.com/tensorflow/tensorflow/releases) - [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md) - [Commits](tensorflow/tensorflow@v2.10.0...v2.11.1) --- updated-dependencies: - dependency-name: tensorflow dependency-type: direct:development ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2d6aaa5 - Browse repository at this point
Copy the full SHA 2d6aaa5View commit details -
Handle batchable lists of length 0 (#1600)
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com> Co-authored-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5d4da60 - Browse repository at this point
Copy the full SHA 5d4da60View commit details -
pyflyte run imperative workflow (#1597)
* pyflyte run imperative workflow Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 5097ee7 - Browse repository at this point
Copy the full SHA 5097ee7View commit details -
Backfill should fill in the right input vars (#1593)
* Backfill fix - Backfill was using incorrect arguments - backfill should use the argument that user provides or none at all Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * Updated code Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * fixed unit test Signed-off-by: Ketan Umare <ketan.umare@gmail.com> --------- Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for ac92ce6 - Browse repository at this point
Copy the full SHA ac92ce6View commit details -
* Pyflyte prettified Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * added dependency Signed-off-by: Ketan Umare <ketan.umare@gmail.com> --------- Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 66a3ee6 - Browse repository at this point
Copy the full SHA 66a3ee6View commit details -
pyflyte run now supports json/yaml files (#1606)
* pyflyte run now supports json files Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * added yaml support Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * fixed parsing Signed-off-by: Ketan Umare <ketan.umare@gmail.com> * fixed windows test Signed-off-by: Ketan Umare <ketan.umare@gmail.com> --------- Signed-off-by: Ketan Umare <ketan.umare@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 21bd0a7 - Browse repository at this point
Copy the full SHA 21bd0a7View commit details -
Add is_inside func to ImageSpec (#1601)
* Add is_inside func to ImageSpec Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * Add is_inside func to ImageSpec Signed-off-by: Kevin Su <pingsutw@apache.org> * Add tests Signed-off-by: Kevin Su <pingsutw@apache.org> * rename Signed-off-by: Kevin Su <pingsutw@apache.org> * rename Signed-off-by: Kevin Su <pingsutw@apache.org> * check execution mode Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 93179b1 - Browse repository at this point
Copy the full SHA 93179b1View commit details -
Measuring the time taken for each component when executing a task (#1581
) * add time measurement framework Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * add time measurement framework Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * nit Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * nit Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * nit Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * nit Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> * nit Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com> --------- Signed-off-by: Yicheng-Lu-llll <luyc58576@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 3eaca9c - Browse repository at this point
Copy the full SHA 3eaca9cView commit details -
Skip the image building process if the check for its existence fails (#…
…1614) * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * add lru cache Signed-off-by: Kevin Su <pingsutw@apache.org> * update Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 1df828f - Browse repository at this point
Copy the full SHA 1df828fView commit details -
Enable torch elastic training (torchrun) (#1603)
Signed-off-by: Ketan Umare <ketan.umare@gmail.com> Signed-off-by: Fabio Graetz <fabiograetz@googlemail.com> This PR brings [torch elastic training (`torchrun`)](https://pytorch.org/docs/stable/elastic/run.html) to the pytorch plugin: ```python from flytekitplugins.kfpytorch import Elastic @task( task_config=Elastic( replicas=4, nproc_per_node=4, ... ), ... ) def train(...): ... ``` flyteorg/flyte#3614
Configuration menu - View commit details
-
Copy full SHA for c7f20e6 - Browse repository at this point
Copy the full SHA c7f20e6View commit details -
update sphinx youtube plugin (#1619)
* update sphinx youtube plugin Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 33a2f32 - Browse repository at this point
Copy the full SHA 33a2f32View commit details -
Read polar dataframe without copying to local (#1618)
Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for b2fb4bf - Browse repository at this point
Copy the full SHA b2fb4bfView commit details -
Add default spark image (#1616)
* Add default spark image Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for d778232 - Browse repository at this point
Copy the full SHA d778232View commit details -
* lazy load module Signed-off-by: Kevin Su <pingsutw@apache.org> * lazy load module Signed-off-by: Kevin Su <pingsutw@apache.org> * import Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * keep structured dataset in flytekit init Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tess Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * move import pandas to __init__ Signed-off-by: Kevin Su <pingsutw@apache.org> * use lazy import loader instead Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * regular import Signed-off-by: Kevin Su <pingsutw@apache.org> * fixed tests Signed-off-by: Kevin Su <pingsutw@apache.org> * test Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 5a66411 - Browse repository at this point
Copy the full SHA 5a66411View commit details -
Override node name with a name containing underscore (#1608)
* override node_name with a name containing underscore Signed-off-by: Kevin Su <pingsutw@apache.org> * add comment Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 7c64c8d - Browse repository at this point
Copy the full SHA 7c64c8dView commit details -
External Plugin Service (grpc) (#1524)
External Plugin Service
Configuration menu - View commit details
-
Copy full SHA for a04a128 - Browse repository at this point
Copy the full SHA a04a128View commit details -
Include traceback in errors from admin (#1621)
Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d9174fd - Browse repository at this point
Copy the full SHA d9174fdView commit details -
Add support for copying all the files in source root (#1622)
* Add support for copying all the files in source root Signed-off-by: Kevin Su <pingsutw@apache.org> * Add tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 6577c61 - Browse repository at this point
Copy the full SHA 6577c61View commit details -
fix PipelineModel transformer issue 3648 (#1623)
Signed-off-by: esad <esad@peridotml.io>
Configuration menu - View commit details
-
Copy full SHA for 4c23c91 - Browse repository at this point
Copy the full SHA 4c23c91View commit details -
update GH workflow for external plugin service (#1624)
Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for a7391c9 - Browse repository at this point
Copy the full SHA a7391c9View commit details -
[Issue-3617] Enables FlyteFiles, FlyteDirectors, and StructuredDatase…
…ts inputs in papermill plugin (#1612)
Configuration menu - View commit details
-
Copy full SHA for 7409889 - Browse repository at this point
Copy the full SHA 7409889View commit details -
Add support for using a list as an input for a subworkflow (#1605)
Signed-off-by: Kevin Su <pingsutw@apache.org>
Configuration menu - View commit details
-
Copy full SHA for 396080c - Browse repository at this point
Copy the full SHA 396080cView commit details -
Improve task decorator type hints with overload (#1631)
Without the overload, the decorated function does not have the proper type of PythonFunctionTask, leading to spurious type errors when attempting to register the task on a FlyteRemote object Signed-off-by: Matthew Hoffman <matthew@protopia.ai>
Configuration menu - View commit details
-
Copy full SHA for 2fab5db - Browse repository at this point
Copy the full SHA 2fab5dbView commit details -
add annotation option for serialization (#1615)
* add annotation option for serialization * add support for guessing type * formatting * test both directions * remove guessing for annotated types * clarify usage in test * Update tests/flytekit/unit/core/test_type_engine.py --------- Co-authored-by: Eli Bixby <eli@cradle.bio> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for af17385 - Browse repository at this point
Copy the full SHA af17385View commit details -
Delete removed data persistence classes from docs (#1633)
Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for fc065db - Browse repository at this point
Copy the full SHA fc065dbView commit details -
Improve workflow decorator type hints with overload (#1635)
Previously, the workflow decorator is hinted as always returning a WorkflowBase, which is not true when _workflow_function is None; similar to #1631, we propose using typing.overload to differentiate the return type of workflow based on the value of _workflow_function Signed-off-by: Matthew Hoffman <matthew@protopia.ai>
Configuration menu - View commit details
-
Copy full SHA for ded15a8 - Browse repository at this point
Copy the full SHA ded15a8View commit details -
* wip Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix mypy errors Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix mypy errors Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * wip Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * fix test Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * Update type Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * Fix tests Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * update dev-requirements.txt Signed-off-by: Kevin Su <pingsutw@apache.org> * Address comment Signed-off-by: Kevin Su <pingsutw@apache.org> * upgrade torch Signed-off-by: Kevin Su <pingsutw@apache.org> * nit Signed-off-by: Kevin Su <pingsutw@apache.org> * lint Signed-off-by: Kevin Su <pingsutw@apache.org> --------- Signed-off-by: Kevin Su <pingsutw@apache.org> Signed-off-by: Kevin Su <pingsutw@gmail.com> Co-authored-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for af49155 - Browse repository at this point
Copy the full SHA af49155View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 725cdb7 - Browse repository at this point
Copy the full SHA 725cdb7View commit details
Commits on May 17, 2023
-
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 02f7830 - Browse repository at this point
Copy the full SHA 02f7830View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6836d62 - Browse repository at this point
Copy the full SHA 6836d62View commit details -
Configuration menu - View commit details
-
Copy full SHA for bbda9ad - Browse repository at this point
Copy the full SHA bbda9adView commit details -
Add maxsize=128 to @lru_cache to cover python 3.7
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8914849 - Browse repository at this point
Copy the full SHA 8914849View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2178128 - Browse repository at this point
Copy the full SHA 2178128View commit details -
Regenerate doc-requirements.txt
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 6059a60 - Browse repository at this point
Copy the full SHA 6059a60View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f5e4ae5 - Browse repository at this point
Copy the full SHA f5e4ae5View commit details -
Bump version and regenerate requirements in a few plugins
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f24f261 - Browse repository at this point
Copy the full SHA f24f261View commit details -
Revert "Fix mypy errors (#1313)"
This reverts commit af49155. Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 14fb5b5 - Browse repository at this point
Copy the full SHA 14fb5b5View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 184b173 - Browse repository at this point
Copy the full SHA 184b173View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 61d0afc - Browse repository at this point
Copy the full SHA 61d0afcView commit details -
Fix type of get_type_for_output_var
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 5ee2067 - Browse repository at this point
Copy the full SHA 5ee2067View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2fd8094 - Browse repository at this point
Copy the full SHA 2fd8094View commit details -
Replace use of shutil.copytree
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a947a45 - Browse repository at this point
Copy the full SHA a947a45View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e36e4f6 - Browse repository at this point
Copy the full SHA e36e4f6View commit details -
Stringify paths in test_script_mode
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d5547e7 - Browse repository at this point
Copy the full SHA d5547e7View commit details -
os.path.isfile instead in imagespec
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 7a01c0a - Browse repository at this point
Copy the full SHA 7a01c0aView commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for f1c71bb - Browse repository at this point
Copy the full SHA f1c71bbView commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for d10cac7 - Browse repository at this point
Copy the full SHA d10cac7View commit details -
Signed-off-by: eduardo apolinario <eapolinario@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 1540d1c - Browse repository at this point
Copy the full SHA 1540d1cView commit details