Apache Flink with Swift Java Support

Hi all,

Apache Flink is awesome! But it only supports Java natively and its official Python support only supports it through Py4J. Is anyone here interested in some contract work to bring Swift support to Apache Flink using Swift Java and @ktoso mentioning FFM will make it quite performant.

Let me know!

2 Likes

Flink is really nice, so that would be a nice project to pick up–especially if you’re willing to sponsor/fund the work :+1:

I’m not sure how much this would rely on native calls or how much of it is just wrapping a binary launched and feeding protos/json/something to the process… avoiding crossing process boundary would be quite be efficient and could use the ffm APIs. If it’s just replicating the python setup and being able to run binaries that’s a different kind of work…

There probably also is work in Swift to be able to access Tables etc.

First step here would be to clarify what we mean by Swift support and what it would need to be successful. If someone picks up that work that’d be quite exciting and I’m happy to support from the swift-java side of things.

1 Like

Hi,
I have worked extensively with FFM and have bridged Swift with Java in previous data pipeline projects.
Adding Swift support to Flink is doable and I can help architect and implement it cleanly.
Familiar with Flink internals and how to avoid bottlenecks when crossing language boundaries.
Happy to take this on.

You can reach out to me on my email here

Colin

1 Like