You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/en/docs/components/pipelines/user-guides/core-functions/execute-kfp-pipelines-locally.md
+38Lines changed: 38 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -23,6 +23,7 @@ Local execution comes with several limitations:
23
23
- Local execution does not feature optimizations and additional features such as caching, retry, etc. While these feature are important for production pipelines, they are less critical for a local testing environment. You will find that task methods like `.set_retry`, `.set_caching_options`, etc. have no effect locally.
24
24
- Local execution makes simple assumptions about the resources available on your machine. Local execution does not support specifying resource requests/limits/affinities related to memory, cores, accelerators, etc. You will find that task methods like `.set_memory_limit`, `.set_memory_request`, `.set_accelerator_type` etc. have no effect locally.
25
25
- Local execution doesn't support authentication mechanisms. If your component interacts with cloud resources or requires other privileged actions, you must test your pipeline in the cloud.
26
+
- Exception: Note that the `SubprocessRunner` component does support Google Cloud authentication.
26
27
- While local pipeline execution has full support for sequential and nested pipelines, it does not yet support `dsl.Condition`, `dsl.ParallelFor`, or `dsl.ExitHandler`.
27
28
28
29
## Basic Example
@@ -93,6 +94,43 @@ local.init(runner=...,
93
94
pipeline_root='~/my/component/outputs')
94
95
```
95
96
97
+
## Google Cloud Example
98
+
99
+
In the following example, we use `SubprocessRunner` to interact with Google Cloud services from the local machine.
100
+
Before executing this script, you must authenticate with [Application Default Credentials](https://cloud.google.com/docs/authentication/provide-credentials-adc). You can use the following command: `gcloud auth application-default login`
101
+
102
+
```python
103
+
# Before running this script setup Application Default Credentials
0 commit comments