lestermartin

hive acid transactions with partitions (a behind the scenes perspective)

let’s take a deeper look at what happens under the hood of hive on these “acid” activities such as insert, update and delete — including look at the actual directories and orc files created

viewing the content of ORC files (using the Java ORC tool jar)

a quick tutorial about finding and using the orc java tool jar for peering into the contents of the otherwise non humanly readable orc file format

topology supervision features of streaming frameworks (or lack thereof)

a smackdown of sort pitting kafka streams, spark streaming, and storm against each other — not for the features they give developers, but for the features they offer the operations side of the devops formula

presenting at hadoop summit (archiving evolving databases in hive)

overview of, and links to related artifacts for, my presentation at hadoop summit about strategies to handle changing data in hive’s immutable architecture

small files and hadoop’s hdfs (bonus: an inode formula)

a walk-thru of the infamous small files problem for hadoop coupled with a unique problem with inodes usage for mass quantities of extremely small files on hdfs

how do i load a fixed-width formatted file into hive? (with a little help from pig)

presents a couple of options for converting a fixed-width formatted file a a delimited one to prepare it to be exposed as a hive table

visiting the computer history museum (yes, i’m a geek)

pictures and observations from my visit to the computer history museum in palo alto, ca

fruITion and recrEAtion (a double-header book review)

a sobering couple of books aimed at challenging many of the believes IT workers have about their role in the organization and exactly who is in charge of strategy — and enterprise architecture

generalizing specialists (or is it specializing generalists?)

There are a ton of different beliefs of what it takes to be successful in the software development profession. Some folks out there would tell you to become the very best “Xyz” developer you can possibly be. While I’m not against be very competent at any particular skill, I’d sure advocate being very good atContinue reading “generalizing specialists (or is it specializing generalists?)”

are you a mort, elvis or einstein (or are these labels nonsense)?

a few simple personas represent the vast majority of software developers — which one are you?