Compilation of Elyra-Pipelines to Tekton based Kubeflow fails

Question

I've installed a kubernetes cluster running kubeflow pipelines based on tekton on top of KIND using the following instructions

Now I'm getting the following error message from the Elyra pipelines editor. Running against an argo based kfp cluster works fine.

Is the kfp compiler somehow not supporting tekton? Can someone please shine some light on this?

HTTP response body:

{"error_message":"Error creating pipeline: Create pipeline failed: 
Failed to get parameters from the pipelineRun: Invalid input error: 
Unsupported argo version. 
Expected: tekton.dev/v1beta1.
Received: argoproj.io/v1alpha1",
"error_details":"Error creating pipeline: Create pipeline failed: 
Failed to get parameters from the pipelineRun: Invalid input error: 
Unsupported argo version. Expected: tekton.dev/v1beta1. 
Received: argoproj.io/v1alpha1"}

Answer 1

There are different aspects to consider here:

There is a need to perform a custom deployment to enable Kubeflow Pipelines to integrate/use a Tekton environment. As you mentioned the steps are described here.

As for Elyra support, Elyra recent releases starting with Elyra 2.x has incorporated support for KFP using Tekton and further documentation is available in the Elyra user guide

If you are still using Elyra 1.x or lower, the below still applies:

Now, related to compiling and executing the Kubeflow Pipeline on a Tekton environment, Elyra is currently using the KFP SDK python package and the regular compiler to compile and generate the default ARGO YAML (see code here). In order to support Tekton, we will need to use a different python package (kfp-tekton==0.3.0) and there is also a need for a different code path during compilation (see example).

Another aspect is that it seems that there are some incompatibilities between the two pipelines as described in the migration path.

Regarding support, the Elyra project would welcome contributions.