Overview

Metaflow 2.12, released on September 15, 2024, adds the @trigger decorator and improves Argo Workflows integration.

Main Features

@trigger and Argo

The @trigger decorator enables automatic flow triggering. Argo integration is improved for Kubernetes orchestration.

python
from metaflow import FlowSpec, step, trigger

@trigger(event='data_ready')
class MyFlow(FlowSpec):
    @step
    def start(self):
        print('Starting flow')
        self.next(self.processing)

    @step
    def processing(self):
        print('Processing data')
        self.next(self.end)

    @step
    def end(self):
        print('Done')

Sources