View profile

ArchiTECHt Daily: Yahoo Engineering keeps on keepin' on

Yahoo might be the world's slowest sinking ship, but don't blame the engineers. They're still doing e
ArchiTECHt Daily: Yahoo Engineering keeps on keepin' on
By ARCHITECHT • Issue #17 • View online
Yahoo might be the world’s slowest sinking ship, but don’t blame the engineers. They’re still doing everything they can to keep it afloat. Or, at least, to maintain whatever reputation it has left as a home of innovation and useful products.
On Monday, for example, Yahoo Engineering open sourced a deep learning framework called TensorFlowOnSpark. In terms of utility for organizations with a big data pipeline already in place, this is hard to beat. It lets users train deep learning models using Google’s popular TensorFlow framework, using the even more popular Apache Spark as the compute layer, using the even more popular Hadoop Distributed File System as a unified storage layer.
Never forget: Yahoo is the reason we have Hadoop, which created a whole ecosystem of new big data technologies (including Spark) and helped companies such as Facebook scale into giants.
TensorFlowOnSpark is not Hadoop, but that doesn’t mean it can’t also be useful. It’s the kind of creation only possible by a company with robust enough traffic to identify some edge cases, but also with enough legacy infrastructure in place (and, let’s assume, a constrained enough budget) that building out an entirely new system seems like overkill. Especially with regard to the latter point, thanks in part to Hadoop’s considerable footprint, there are a lot of those companies around. 
Also on Monday, Yahoo detailed its new backend architecture for Flickr, called Tripod. It represents a move away from Flickr’s monolithic legacy and into microservices, utilizing lots of Yahoo-developed databases, big data technologies and computer vision algorithms in the process. 
Yahoo will never again be anywhere near Google, Facebook or even Twitter, probably, but you have to hand it to the company’s engineering team. They’re still building, still committed to open sources and, possibly, making it easier for some mere mortal companies to keep up with ceaseless infrastructure innovation.

Around the web: Cloud and infrastructure
The results of the DeepMind study (below)
The results of the DeepMind study (below)
Around the web: Artificial intelligence
Around the web: All things data
Did you enjoy this issue?

ARCHITECHT delivers the most interesting news and information about the business impacts of cloud computing, artificial intelligence, and other trends reshaping enterprise IT. Curated by Derrick Harris.

Check out the Architecht site at

If you don't want these updates anymore, please unsubscribe here.
If you were forwarded this newsletter and you like it, you can subscribe here.
Powered by Revue