-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Open
Labels
Description
Feature Area
/area sdk
What feature would you like to see?
The KubeFlow pipeline SDK is missing a method to download the logs from components of a pipeline run.
Somethink like:
from kfp.client import Client
client = Client()
client.get_logs(run_id="5d08dd3d-58d9-4d02-9ff2-f2cee8dbfda8", component_name="foo2")@dsl.container_component
def foo1():
return dsl.ContainerSpec()
@dsl.component()
def foo2():
pass
@dsl.pipeline()
def pipeline():
f1 = foo1()
f2 = foo2()
What is the use case or pain point?
It is possible to access the logs of a component via the UI and also via kubectl logs. Access through the UI does not allow automatic retrieval of logs and kubectl logs assumes K8s knowledge, access to the cluster and also there is no easy matching between pipeline runs and the corresponding pod ID so one has to manually look for the correct pod.
Is there a workaround currently?
No
Love this idea? Give it a 👍.