[Article] On Demand Hadoop Processing by Google (a.k.a. “one way of dealing with lots of people writing shitty queries”)

Blog Post: https://cloud.google.com/blog/big-data/2017/06/fastest-track-to-apache-hadoop-and-spark-success-using-job-scoped-clusters-on-cloud-native-architecture HN: https://news.ycombinator.com/item?id=14499170 This is a pretty interesting trend – as lots of processing becomes compute bottlenecked by shitty queries,…

Continue Reading →