Twitter processes billions of events in real time every day using a variety of technologies including Hadoop, Kafka, and of course Finagle.
In 2018, we open sourced Finatra Kafka Streams , which we had already been using in production at Twitter for some time, and have continued to maintain it as part of Finatra core library.
Internally at Twitter, we have begun to consolidate and refactor our own Kafka client code in incompatible ways, and have moved away from using Finatra Kafka Streams. As a result, we will be moving Finatra Kafka out of the core Finatra repository and no longer directly supporting it.
The codebase of kafka libraries under finatra repo will be completely deprecated starting from our next release.
Any services that has dependencies on libraries of finatra/kafka and finatra/kafka-streams
In order to minimize the potential effects on our valuable users of finatra/kafka and finatra/kafka-streams. We published an open sourced stand-alone finagle/finatra-kafka client library to serve as an alternative pathway.
You can complete this migration by simply changing the groupId of your dependency namespace from “com.twitter” to “com.github.finagle”. Below are examples of changing the groupId for two artifacts:
Change the namespace of maven coordinates in your build file