Java | BigData | Nodejs | Cloud

We have used AWS Kinesis stream in nodejs project. It is very easy to get started with Kinesis. You can setup Kinesis to handle any amount of traffic. For every queue you  create stream in Kinesis. Each stream has many shards. One shard can handle 1000 req/sec. To handle more traffic you can create many shards. Every shard cost money and unused shards are waste of money. Only problem with Kinesis is that there are not automatic way where AWS itself create and destroy shards as per current traffic. To handle this scenario we have created one nodejs module which continuously monitor traffic and create/destroy shards. I have proposed that since this is very common requirement we can contribute this code to open source. We have used many open source framework and this is one of the way to give something back to community. With permission from client i have created nodejs module and publish it on github and npm. You can find source code at https://github.com/xaxis-open-sou...