MarkLogic in Defense & Intelligence – Use Case #4: Coping with the Data Deluge

Our customers tell us, “The scale of information we collect is mind blowing. From all over the web we collate information, along with our own internal data sources and reports. We’re struggling to manage all of this.”

Here’s how MarkLogic can help. Traditional systems like those built on relational databases (e.g. Oracle, SQL Server, etc.) are designed to handle a set of known data, with a format (or “schema”) that rarely changes. If you get new data that you want to add, that’s in a new format, then you need to update the schema that your system is based on – and that can take a while. With the accelerating pace of data creation in new sources – such as those on the Internet – designing (and updating) a system or schema only after information has been identified means you’re constantly behind the curve. MarkLogic’s Enterprise NoSQL database allows organizations to handle content without having to know the internal schema up front. This provides great flexibility in handling emerging data sources. And, from a data volume perspective, deployments built on MarkLogic can be scaled horizontally across many systems to handle an ever increasing data load – because massive scalability was built in from the start. MarkLogic can be deployed either as a common repository for data unification, or as a metadata-centric data virtualization layer to consolidate high-value information across data silos. Either way, with MarkLogic organizations can funnel that data deluge into a single search application to make their users’ lives easier.