If you have worked with stream processing you have probably heard of Kafka. Kafka is a very useful software that many companies are using and it’s very well tested even with millions of messages per second. But, it is not the most trivial software to install, manage and use, and it has some quirks deploying it at very large scale.
Redis is another software you probably have heard or used and was designed as an in-memory database. Over the years Redis has added a lot of different features and data structures. I have always appreciated the fact that the founder and main contributor have always focused on keeping everything simple and easily understandable for a computer scientist.
Now the founder is working on implementing stream processing also on Redis, and in this article, he is writing a detailed explanation on why he decided to move in this direction, what was the thinking process behind the current (work in progress) application and how it could be used. At the end of the article, there is also a link to a youtube video where he demonstrates in practice how to use it.