Series – Part 3: Serverless Architecture – a practical implementation: Serverless REST API

Photo Credit: Torkild Retvedt on Flickr

In part two of this series I discussed creating a serverless data collection and processing fabric for an IoT deployment. To recap, we’ve now reviewed the local devices and controller/gateway pattern for the security cameras deployed. We’ve also discussed the Amazon Web Services infrastructure deployed to collect, process and catalog the data generated by the… Continue reading Series – Part 3: Serverless Architecture – a practical implementation: Serverless REST API

Series – Part 2: Serverless Architecture – a practical implementation: IoT Device data collection, processing and user interface.

Photo Credit: Torkild Retvedt on Flickr

In part one of this series I briefly discussed the purpose of the application to be built and reviewed the IoT local controller & gateway pattern I’ve deployed. To recap, I have a series of IP cameras deployed and configured to send (via FTP) images and videos to a central controller (RaspberryPI 3 Model B).… Continue reading Series – Part 2: Serverless Architecture – a practical implementation: IoT Device data collection, processing and user interface.

The future of data is still Polyglot…

… but vendors will fight you every step of the way. Remember – every vendor wants to get as much of your data in their database as possible. And every data approach (Relational, Document, Key/Value Store and Graph) can be forced to do just about anything; and given the opportunity the vendor will tell you… Continue reading The future of data is still Polyglot…

Series – Part 1: Serverless Architecture – a practical implementation: IoT Device data collection, processing and user interface.

Photo Credit: Torkild Retvedt on Flickr

Serverless architectures are getting a lot of attention lately – and for good reason. I won’t rehash the definition of the architecture because Mike Roberts did a fine (and exhaustive) job over at MartinFowler.com. However, practical illustrations of patterns and implementations are exceptionally hard to find. This series of posts will attempt to close that gap… Continue reading Series – Part 1: Serverless Architecture – a practical implementation: IoT Device data collection, processing and user interface.

The time for consolidation in the DB market has come; RethinkDB to shut down.

Photo Credit - cafecredit.com

Too many databases with too little differentiation. The time has come for consolidation – including more news like RethinkDB shutting down: Document oriented databases will be first – but expect additional consolidation in other segments. To be clear – we are not heading back to the bad old days of one database (vendor) to rule… Continue reading The time for consolidation in the DB market has come; RethinkDB to shut down.

Upping your data game with Graph Databases

Photo Credit: fdecomite on Flickr

Since the late-2000’s there has been an explosion of non-relational (NoSQL if you must) data persistence technology. The industry buzz has focused around the derivatives of the seminal work done at Google – i.e., BigTable – and Amazon – i.e., Dynamo. We’ve seen massive adoption of simple document stores and key-value based stores – which… Continue reading Upping your data game with Graph Databases

Key to Big Data Success – Data Driven Culture

Photo Credit: Sean Ellis @ Flickr

I’m not always sure people always know what they mean when they talk about Big Data – and even when they do know, I’m not sure they can contrast this new Big Data thing from Data’s previous incarnation. So let’s see if we can clear it up. Prior to big data the amount and content… Continue reading Key to Big Data Success – Data Driven Culture

Polyglot Persistence – Benefits and Barriers

Photo Credit: Anselm Hook on Flikr

Polyglot persistence is simply the notion that one should leverage multiple data storage technologies chosen based upon the way the data will be used by the application. In short, use the best tool for the job. Benefits Attempting to make a single data store (or database if you prefer) encapsulate all your application contexts breeds… Continue reading Polyglot Persistence – Benefits and Barriers