Inside-Opensource.org

Google today announced that it has made a proposal to submit its Dataflow data processing technology to the Apache Software Foundation (ASF) in order to make Dataflow an Apache incubator project and thereby introduce broader governance and transparency around the software. Dataflow is interesting because it can handle both batch and stream processing of large data sets. It goes far...Go To Article

Guest blog post by Randall V Shane We are all very fortunate to be alive during this exciting time in history. Some truly disruptive technologies are on the verge of exploding into reality and it is difficult to imagine what the future holds. With these new technologies, however, we must not ignore the technically sound practices that allowed us to...Go To Article

The year 2015 started out with people recognizing that the Hadoop ecosystem is here to stay. As was stated by Gartner, Hadoop was in the “trough of disillusionment,” meaning that the hype was at an end. Some people were disillusioned because they were beyond proof-of-concept and were actively frustrated by solving real problems. Other earlier adopters had already moved beyond...Go To Article

2015 was the year Apache Spark caught fire. Technologies in the Big Data and distributed computing space are all really old and expensive or really new and relatively immature. I always feel like I’m leaning on people to push the envelope and make good use of newer technology. However, with Spark I spent a good part of the year trying...Go To Article