Are you using Hadoop? Are you using Cassandra? Are you using Kafka? Are you sure your problem is at the scale of Google/Amazon/Linkedin that can not be solved by another (way simpler) tool?
This is the topic of this article, and a problem I see very often in the industry. This is a very good article for anyone who is using all of these fancy software, to think if they actually need such complex software to solve their problem.
Don’t even start considering solutions until you Understand the problem. Your goal should be to “solve” the problem mostly within the problem domain, not the solution domain.
This is a very crucial quote. Do you understand the problem you want to solve? Or are you using some software just because you think (or heard of from others) that software is going to help you solve the problem?
Every time you want to solve a problem, think about all the possible solutions, study them and understand their limitations, and then figure out if that solution is good for you. Don’t pick a solution just because a company like Google is using it, you most certainly have a different scale than Google.