v1.15.2

What's Changed

• Deprecate increase_shared_mem flag in flytekitplugins-kf-pytorch in favor of new native @task argument by @fg91 in #3181
• (flytekit-spark): Update flytekit version requirement by @pingsutw in #3183
• Use digest as file_name to get signed url by @pingsutw in #3173
• Do not set group or group_version when secret_requires_group=False by @thomasjpfan in #3184

Full Changelog: v1.15.1...v1.15.2

v1.15.1

What's Changed

• Update actions/cache to v4 by @eapolinario in #3139
• wrap agent outputs in a literalmap by @samhita-alla in #3143
• Exclude python_history from the Ray runtime environment. by @pingsutw in #3140
• Update qemu in gh workflows by @eapolinario in #3138
• Add unit test for ray with an existing cluster and fix nil pointer by @Sovietaced in #3142
• fix a bug where sync_execution is not calling itself recursively by @bz38 in #3132
• Fix test_invalid_ge_schema_batchrequest_pandas_config by @pingsutw in #3145
• Add module loading support to pyflyte serve by @pingsutw in #3147
• Webhook tasks using FlyteAgents by @kumare3 in #3058
• feat: support positional args for ref entity by @machichima in #3104
• fix sync for map task in dynamic by @troychiu in #3141
• Slurm agent fn task by @JiangJiaWei1103 in #3150
• Enable using positional args for workflow with default value by @machichima in #3149
• don't override timeout on with_overrides if not specified by @pvditt in #3097
• Fix sync node execution for map over lp by @troychiu in #3151
• Use flyteremote to access subnodes information of array nodes by @troychiu in #3152
• fix(script_mode): Use UTC timestamp for tar file attributes by @pingsutw in #3154
• fix sync for map over lp in dynamic by @troychiu in #3155
• Adding missing fields to FlyteTask remote entity by @UmerAhmad in #3093
• add httpx dependency for webhook agent in flytekit dependency by @Future-Outlier in #3158
• update array node model by @pvditt in #3156
• Use uv in all docker images by @eapolinario in #3137
• Bump virtualenv from 20.26.2 to 20.26.6 by @dependabot in #3053
• Eager cleanup by @wild-endeavor in #3148
• Jan/dx 1324 add execution metrics endpoint in flyteremote by @fiedlerNr9 in #3126
• don't transform bound inputs to list for remote entities by @pvditt in #3168
• Add get metrics for flyteRemote and add helper method explain/dump by @troychiu in #3166
• Compile byte code during ImageSpec install by @thomasjpfan in #3175
• Slurm agent shell task by @JiangJiaWei1103 in #3159
• Worker queue to publish deck by @wild-endeavor in #3174
• Adds metadata to FlyteFile by @thomasjpfan in #3160
• check execution phase before access outputs by @troychiu in #3179
• Install the dependencies in the default venv in the spark base image by @pingsutw in #3178

New Contributors

• @bz38 made their first contribution in #3132
• @UmerAhmad made their first contribution in #3093

Full Changelog: v1.15.0...v1.15.1

v1.15.1b0

What's Changed

• Update actions/cache to v4 by @eapolinario in #3139
• wrap agent outputs in a literalmap by @samhita-alla in #3143
• Exclude python_history from the Ray runtime environment. by @pingsutw in #3140
• Update qemu in gh workflows by @eapolinario in #3138
• Add unit test for ray with an existing cluster and fix nil pointer by @Sovietaced in #3142
• fix a bug where sync_execution is not calling itself recursively by @bz38 in #3132
• Fix test_invalid_ge_schema_batchrequest_pandas_config by @pingsutw in #3145
• Add module loading support to pyflyte serve by @pingsutw in #3147
• Webhook tasks using FlyteAgents by @kumare3 in #3058
• feat: support positional args for ref entity by @machichima in #3104
• fix sync for map task in dynamic by @troychiu in #3141
• Slurm agent fn task by @JiangJiaWei1103 in #3150
• Enable using positional args for workflow with default value by @machichima in #3149
• don't override timeout on with_overrides if not specified by @pvditt in #3097
• Fix sync node execution for map over lp by @troychiu in #3151
• Use flyteremote to access subnodes information of array nodes by @troychiu in #3152
• fix(script_mode): Use UTC timestamp for tar file attributes by @pingsutw in #3154
• fix sync for map over lp in dynamic by @troychiu in #3155
• Adding missing fields to FlyteTask remote entity by @UmerAhmad in #3093
• add httpx dependency for webhook agent in flytekit dependency by @Future-Outlier in #3158
• update array node model by @pvditt in #3156
• Use uv in all docker images by @eapolinario in #3137
• Bump virtualenv from 20.26.2 to 20.26.6 by @dependabot in #3053

New Contributors

• @bz38 made their first contribution in #3132
• @UmerAhmad made their first contribution in #3093

Full Changelog: v1.15.0...v1.15.1b0

v1.14.7

What's Changed

• silence union warning by @wild-endeavor in #3092
• Adds secret env_var to the v1.14 branch by @thomasjpfan in #3100
• [v1.14] fix(script_mode): Use UTC timestamp for tar file attributes by @pingsutw in #3157

Full Changelog: v1.14.6...v1.14.7

v1.15.0

What's Changed

• Fix lazy import by @pingsutw in #2987
• fix: dbt-test by @taieeuu in #2989
• Async tasks and eager revamp by @wild-endeavor in #2927
• GH-5989: Fix task registration with node_dependency_hints by @Tom-Newton in #2992
• Remove eager exception doc by @wild-endeavor in #2995
• Introduce pod_spec_from_resources()ray helper function by @fiedlerNr9 in #2943
• pin ollama version by @samhita-alla in #2997
• Remove open_async usage in put raw data by @wild-endeavor in #2998
• Specify minio env vars in integration tests by @eapolinario in #3001
• Correct links that end up surfacing in docs by @ppiegaze in #3000
• Unify dependencies in agent image by @eapolinario in #3008
• Faster GitIgnore directory check by @fellhorn in #3007
• Use the same source of time in flaky test by @eapolinario in #3009
• Use correct name in flyteagent test by @eapolinario in #3011
• vscode decorator for the dynamic task by @pingsutw in #2994
• fix: Improve error details and logging config handling by @pingsutw in #3012
• Add python interpreter into vscode settings by @thomasjpfan in #3014
• add support for toggling data mode for array node by @pvditt in #2940
• Store protos in local cache by @eapolinario in #3022
• Bump aiohttp from 3.9.5 to 3.10.11 by @dependabot in #3018
• Fix bug in FlyteDirectory.listdir on local files by @pimdh in #2926
• Fix unit tests in airflow plugin by @pingsutw in #3024
• fix: Fix resource meta typos for async agent by @JiangJiaWei1103 in #3023
• fix: format commands output by @vincent0426 in #3026
• Fix pydantic basemodel default input by @Future-Outlier in #3013
• [BUG] Open FlyteFile from remote path by @JiangJiaWei1103 in #2991
• vllm inference plugin by @dansola in #2967
• Add poetry to image spec by @thomasjpfan in #3025
• [test] Add integration test for accessing sd sttr in dc by @JiangJiaWei1103 in #2969
• [BUG] Map task logging level fixed at 30 for default logger by @pvditt in #3032
• add Optuna plugin by @granthamtaylor in #3035
• add managed environment POC by @granthamtaylor in #3021
• Make launch plan registrable by removing requirement for name by @wild-endeavor in #3043
• Make FlyteFile and FlyteDirectory pickleable by @cosmicBboy in #3030
• fix: set asyncio_default_fixture_loop_scope by @machichima in #3034
• Bump jinja2 from 3.1.3 to 3.1.5 in /plugins/flytekit-onnx-pytorch by @dependabot in #3044
• pin grpcio and grpcio-status <= 1.68.0 by @cosmicBboy in #3046
• Prevent register_launch_plan from re-registering already registered workflow by @wild-endeavor in #3049
• Remove Pydantic V1 plugin by @Future-Outlier in #3040
• Add advanced Optuna plugin authoring methods by @granthamtaylor in #3051
• Place venv in /root when using uv.lock as well by @thomasjpfan in #3062
• Make FlyteUserRuntimeException to return error_code in Container Error by @RRap0so in #3059
• Improve Type Engine Error Msg by @Future-Outlier in #3063
• [Flytekit] Separate remote signal functions by @mao3267 in #2933
• Only copy over cat-certificates.crt if it does not exist in base image by @thomasjpfan in #3067
• Update eager task launching & monitoring by @wild-endeavor in #3042
• Support with_overrides setting metadata for map_task subnode instead of parent node by @pvditt in #2982
• fix: remove duplication log when execute by @vincent0426 in #3052
• Fix: Always propagate pytorch task worker process exception timestamp to task exception by @fg91 in #3057
• Eager deck name by @wild-endeavor in #3072
• Allow user-defined dataclass type transformer (again) by @eapolinario in #3075
• [flyteagent][CLI] Make agent prometheus port configurable by @Future-Outlier in #3064
• Adds python_exec into ImageSpec by @thomasjpfan in #3069
• Add a test for union/dc by @wild-endeavor in #3074
• Add the Flyte agent to provision and manage K8s (data) service for deep learning (GNN) use cases by @shuyingliang in #3004
• Bugfix Omegaconf plugin: Properly deal with NoneType values by @adrianloy in #3056
• Adds secret env_var by @thomasjpfan in #3048
• Fix async coroutine limit not respected and add s3/gcs chunk size by @wild-endeavor in #3080
• Structured datasets in containers (dc/pydantic) by @wild-endeavor in #3086
• Add pip_extra_args by @amitani in #3081
• Enable pydoclint by @eapolinario in #3077
• Also run unit tests on arm64 by @eapolinario in #3085
• Regenerate baseline by @eapolinario in #3090
• Silence union warning by @wild-endeavor in #3091
• Add request and limit to ray config by @pingsutw in #3087
• [BUG] Fix StructuredDataset empty-str file_format in dc attr access by @JiangJiaWei1103 in #3027
• Gatenode local execution, was parsing the input twice by @kumare3 in #3101
• prevent compile err for ReferenceWorkflow by @machichima in #3102
• Improve Union Transformer Ambiguous Error Message by @Future-Outlier in #3076
• add ReferenceWorkflow into return type hint by @machichima in #3103
• Tracks progress for package creation, upload and kickoff by @kumare3 in #2935
• Support overriding task pod_template via with_overrides by @arbaobao in #2981
• add project & domain endpoint for FlyteRemote by @fiedlerNr9 in #3108
• [flyte deck] Streaming Decks by @Future-Outlier in #2779
• Fixed type hint by @pimdh in #3110
• Upgrade flyteidl version to 1.14.3 by @arbaobao in #3112
• Bump snowflake-connector-python from 3.12.3 to 3.13.1 by @dependabot in #3113
• Adds validation to Secrets.env_var by @thomasjpfan in #3114
• Fix for keyring errors when initializing Flyte for_sandbox config client by @taieeuu in #2962
• fix: keyring refresh twice by @taieeuu in #3119
• Support mounting secrets by default builder. by @amitani in #3082
• prevent compile err for all reference entities by @machichima in #3122
• Fix dict annotations by @wild-endeavor in #3123
• Attempt to use more specific transformer when executing remote entities by @wild-endeavor in #3111
• Support FlyteRemote.execute interruptible flag override by @redartera in #2885
• Improve podtemplate override logic by @arbaobao in #3117
• Bug when calling wf in eager task with thread by @wild-endeavor in #3125
• Bump certifi from 2023.7.22 to 2024.7.4 in /plugins/flytekit-onnx-pytorch by @dependabot in #3127
• Skip test_get_container_error_timestamp on windows by @eapolinario in #3128
• [Flytekit][Test] Stru...

v1.15.0b5

What's Changed

• [Flytekit][Test] Structured dataset pickleable test by @mao3267 in #3121
• Flytekit remote updates for notebooks and versions by @kumare3 in #3109
• Execute launchplans declared locally and automatically adjust input params based on fixed and default values by @kumare3 in #3115
• Do not import kubernetes in flytekit core by @thomasjpfan in #3118
• Cache polish work - including the introduction of cache policies to the new top level Cache object by @eapolinario in #3129

Full Changelog: v1.15.0b4...v1.15.0b5

v1.15.0b4 Flyte remote fixes, eager, pod template override

What's Changed

• Attempt to use more specific transformer when executing remote entities by @wild-endeavor in #3111
• Support FlyteRemote.execute interruptible flag override by @redartera in #2885
• Improve podtemplate override logic by @arbaobao in #3117
• Bug when calling wf in eager task with thread by @wild-endeavor in #3125
• Bump certifi from 2023.7.22 to 2024.7.4 in /plugins/flytekit-onnx-pytorch by @dependabot in #3127
• Skip test_get_container_error_timestamp on windows by @eapolinario in #3128

Full Changelog: v1.15.0b3...v1.15.0b4

v1.15.0b3 Fixes for dict annotations, keyring

What's Changed

• Upgrade flyteidl version to 1.14.3 by @arbaobao in #3112
• Bump snowflake-connector-python from 3.12.3 to 3.13.1 by @dependabot in #3113
• Adds validation to Secrets.env_var by @thomasjpfan in #3114
• Fix for keyring errors when initializing Flyte for_sandbox config client by @taieeuu in #2962
• fix: keyring refresh twice by @taieeuu in #3119
• Support mounting secrets by default builder. by @amitani in #3082
• prevent compile err for all reference entities by @machichima in #3122
• Fix dict annotations by @wild-endeavor in #3123

Full Changelog: v1.15.0b2...v1.15.0b3

v1.15.0b2

What's Changed

• Adds secret env_var by @thomasjpfan in #3048
• Fix async coroutine limit not respected and add s3/gcs chunk size by @wild-endeavor in #3080
• Structured datasets in containers (dc/pydantic) by @wild-endeavor in #3086
• Add pip_extra_args by @amitani in #3081
• Enable pydoclint by @eapolinario in #3077
• Also run unit tests on arm64 by @eapolinario in #3085
• Regenerate baseline by @eapolinario in #3090
• Silence union warning by @wild-endeavor in #3091
• Add request and limit to ray config by @pingsutw in #3087
• [BUG] Fix StructuredDataset empty-str file_format in dc attr access by @JiangJiaWei1103 in #3027
• Gatenode local execution, was parsing the input twice by @kumare3 in #3101
• prevent compile err for ReferenceWorkflow by @machichima in #3102
• Improve Union Transformer Ambiguous Error Message by @Future-Outlier in #3076
• add ReferenceWorkflow into return type hint by @machichima in #3103
• Tracks progress for package creation, upload and kickoff by @kumare3 in #2935
• Support overriding task pod_template via with_overrides by @arbaobao in #2981
• add project & domain endpoint for FlyteRemote by @fiedlerNr9 in #3108
• [flyte deck] Streaming Decks by @Future-Outlier in #2779
• Fixed type hint by @pimdh in #3110

New Contributors

• @amitani made their first contribution in #3081

Full Changelog: v1.15.0b1...v1.15.0b2

v1.14.6 - Pydantic/dataclass fixes

What's Changed

• Backport for pydantic basemodel CLI input by @Future-Outlier in #3084
• v1.14 Backport 3086 - StructuredDatasets inside dc/pydantic by @wild-endeavor in #3088
• Format imports better by @wild-endeavor in #3089

Full Changelog: v1.14.5...v1.14.6