Featured Post

Direction Uncertainty

Chaos and Confusion

I have worked as an IT consultant for nearly 20 years and at the beginning of my career a mentor said to me “Chaos and Confusion is the environment we work in”.  Our job is to bring sane practical perspectives to address the hype surrounding new IT tools and projects.  This practical perspective sometimes conflicts with marketers or sales teams. Recently a colleague shared a WSJ report about Hadoop.  The report spoke about the hype surrounding Big Data and tools like Hadoop which process massive amounts of data.  The article stated that 60% of Hadoop projects fail, and many other projects never deliver valuable results or insights.  Every couple of years we witness this type of hype cycle.  It reminds me of the ‘90s and the dotcom bust or AI or self-driving cars.  We have been here before.  A hyped new technology and the opportunity to build new Information Systems that companies leverage for business advantages.  When new technology is introduced and media stories promote the … [Read More...]

Other Recent Posts

Screen Shot 2015-01-29 at 11.20.07 AM

Getting Started with Giraph

Apache Hadoop's core analytical tools (e.g. MapReduce, Hive, Pig) are great for performing batch analytics over large, unstructured data sets.  However, a myriad of data sets are comprised of a more graph-like structure. Examples of such data sets … [Read More...]


MarkLogic Gets JavaScript

Six months ago, I was down at the MarkLogic World San Francisco conference just south of SFO, listening to the opening speeches. I was there primarily to hear more about what would end up being in the second phase of their Semantics offering, when a mention … [Read More...]

Flexible Metadata

DAM and Flexible Data Models Using Document Databases

In my last post, I demonstrated a "flexible" way to store digital asset metadata inside a relational database. The results were not perfect. Relational databases require a strict data schema so that all information fits into pre-defined two-dimensional tables. … [Read More...]

HDP 2.2 Components

Hadoop Ecosystem Cheat Sheet

For someone evaluating Hadoop, the considerably large list of components in the Hadoop ecosystem can be overwhelming.  Below you’ll find a reference table with keywords you may have heard in discussions concerning Hadoop as well as a brief description. Image … [Read More...]

Hope amid life challenge.

Big Data takes a back seat to Big Dreams

It’s easy to find oneself lost in the mad rush to compete and conquer in business. That is certainly the case in the fast-paced and competitive world of IT.  Particularly in the hyper-fast world of Enterprise IT consulting. Against that backdrop we brought … [Read More...]