Plots, Subterfuge & Data Multiculturalism

Tolerance and enlightenment needed in solving today’s data management and governance problems …

And Yet it Moves…

Two thousand and fifteen marks the 400th anniversary of Galileo’s investigation by the Roman Inquisition at the instigation of the Pope Paul V for publishing his theory that the earth orbited the sun and not the other way around.

Galileo’s observations fundamentally changed the science of astronomy – but at the time they were considered so heretical to the teaching of the church that he was forced to “abjure, curse and detest” them on oath – he is rumoured to have muttered E pur si muove in Italian when placed under house arrest. We are now seeing a similar realization in corporate IT that most of the data that needs to be managed has at best an ever evolving schema and that the bulk of it is largely unstructured textual emails and chat.

Remember, remember! The 5th of November…

Nobody Expects the Spanish Inquisition!

Recently I was invited by a solutions integrator partner to visit a prospect who had blindly followed its enterprise architecture standards for a NoSQL database. Unfortunately, the design review process had not considered the need to have ACID transactions and bitemporal schema evolution to deliver accurate trading positions and account balances — which the chosen platform did not support — so the whole process had to go back to square one.

Step Forward the Real Enterprise Architects

It is noteworthy that no internal enterprise architecture groups in financial services have ever affected significant organizational redesign. That distinction always goes to one of the major strategic consulting houses McKinsey, Bain, etc., that have been brought in by a new CEO to define the strategy and supporting KPIs.

McKinsey’s solutions are typically

• Fact-based
• Rigidly structured
• Hypothesis-driven

A former partner once described their modus operandi as, “When you strip away a lot of the high-minded language with which McKinsey dresses up its problem-solving process, it comes down to very careful, high-quality analysis of the components of the problem combined with an aggressive attitude toward fact gathering.” — The McKinsey Way 1999

In its 2015 Annual Global Banking review, McKinsey & Company recommended that banks must “Radically innovate data technology and architecture” in order to achieve “common data aggregation and reporting procedures.”

The firm surmised that

Indeed, McKinsey then went on to detail the features of the technology platform that we already provide at MarkLogic where “all kinds of data, structured and unstructured, internal and external, are gathered,” and that “the user of data defines the rules when extracting data…”

Beware the Organizational Zealots…

Clearly at MarkLogic we are flattered and heartily endorse McKinsey’s analysis of what needs to be done to innovate and enable flexible data architecture at enterprise scale. However, organizations need to beware the dogma that some consulting groups follow that treat IT only as a series of cost objects rather than being critical to business innovation and optimization.

The notion that technologists can be pigeonholed solely on their technical skills without taking into account their accumulated business knowledge is a very dangerous one and has been shown to be deeply flawed in a number of banks that find themselves overrun by a posse of offshore SI’s in a race to the bottom.

Don’t Get Hung Drawn & Quartered

As well as being forced to abjure his beliefs, Galileo was placed under house arrest by the Pope for most of the rest of his life. Guy Fawkes was tortured on the rack to extract his confession before being hung drawn and quartered. Don’t let these two gents be harbingers of your fate.

When your local enterprise architects come to perform their inquisition on your beliefs make sure you book the room with the “comfy chair until lunchtime,” the soft cushions and ideally “a cup of coffee at eleven” as they will probably not be aware of McKinsey’s recommendations above and they usually focus solely on functional or SOA type models — so be ready to challenge that orthodoxy.

Whilst we should not forget that Guy Fawkes was the quartermaster and executor of a major terrorist plot, in the modern world of political spin and policy wonks he is now often toasted in the UK as “the last man to enter Parliament with honest intentions” — he at least rolled up his sleeves and tried to get something done.

Across most of the UK, there is still a tradition of putting an effigy of Guy Fawkes on the bonfire to try and reinforce maintenance of the status quo – except at St Peter’s School York where it is a school rule to spare him that ignominy.

In Galileo’s case, on 31 October 1992, Pope John Paul II expressed regret for how the Galileo affair was handled and issued a declaration acknowledging the errors committed by the Catholic Church tribunal that judged Galileo’s papers. However plans to erect a statue of him within the Vatican as a final admission of error were quietly shelved by Pope Benedict XVI in 2009 presumably because it suggested an example of papal fallibility.

Need for Science & Enlightenment

The IT profession is often (and rightly) castigated for chasing the latest technology or process fad rather than focussing on what is really necessary for the business it has to support.

This dogma usually arises out of fear and ignorance – I know of no major corporation that knows

1. What technology types, hardware/software physical or virtual and the licenses it owns
2. How they are combined to form stacks and environments
3. How they change when new instances are spun up or shut down
4. How many database servers and the various patch levels they have
5. Where data comes from and goes to both within the corporation and its trading partners

Without dogma, both technologists and their management resort to the village gossip cycle of opinions, rumours and ultimately splinter into blinkered religious sects. My former colleague at BAML John O’Hara (also ex-JPMC) has regularly referred to Monty Python’s sketch in the film Life of Brian about the People’s Front of Judea as the other “splitters” sat around in a Roman amphitheatre as the best illustration of how technology architectural factions really behave in a corporation.

CIOs often speak of trying to innovate and drive cultural change – this can never happen until we have consistent + accurate ways of capturing and analyzing the structure and evolution of IT architectures we construct — and the supporting facts that McKinsey & Co. love to analyze.

At MarkLogic we stand ready and able to provide the data management capabilities to finally crack the nut of enterprise infrastructure architecture topology and standards capture – both along the complexity axis and the event-based update/dependency pipeline that is often forgotten.

Remember, remember! The fifth of November, The Gunpowder treason and plot; I know of no reason Why the Gunpowder treason Should ever be forgot!