Apache Flink is awesome! But it only supports Java natively and its official Python support only supports it through Py4J. Is anyone here interested in some contract work to bring Swift support to Apache Flink using Swift Java and @ktoso mentioning FFM will make it quite performant.
Flink is really nice, so that would be a nice project to pick upāespecially if youāre willing to sponsor/fund the work
Iām not sure how much this would rely on native calls or how much of it is just wrapping a binary launched and feeding protos/json/something to the process⦠avoiding crossing process boundary would be quite be efficient and could use the ffm APIs. If itās just replicating the python setup and being able to run binaries thatās a different kind of workā¦
There probably also is work in Swift to be able to access Tables etc.
First step here would be to clarify what we mean by Swift support and what it would need to be successful. If someone picks up that work thatād be quite exciting and Iām happy to support from the swift-java side of things.
Hi,
I have worked extensively with FFM and have bridged Swift with Java in previous data pipeline projects.
Adding Swift support to Flink is doable and I can help architect and implement it cleanly.
Familiar with Flink internals and how to avoid bottlenecks when crossing language boundaries.
Happy to take this on.