Streamline data jobs for every workload to fuel any use case with a single data movement application.
The MarkLogic Flux application is a single, extensible data movement application that simplifies importing, exporting, copying and processing data in your MarkLogic platform. With Flux, all your data sources talk to the MarkLogic platform so your data teams can build scalable, reliable and cost-effective production data pipelines.
Easily migrate data between databases and legacy systems with no upfront modeling.
Simplify large-scale data ingest operations by importing all your multi-structured information from applications, databases, cloud storage and filesystems into your MarkLogic platform.
Easily read, process and transform data in bulk via custom JavaScript or XQuery code without slowing down your production environment. Split and vectorize text and documents iteratively for retrieval-augmented generation (RAG).
Seamlessly integrate with your larger data ecosystem so data services and applications can consume your curated data and metadata. You can easily export rows or documents to your target destination.
Import documents, Parquet files, graph data, rows and more.
Create reusable REST transforms in JavaScript or XQuery.
Leverage readily available, intuitive commands with inline help.
Flexibly define, configure and automate high-volume import, transform and export jobs.
Tap into the vast Apache Spark connectors ecosystem.
Run locally or embed in your enterprise JVM-based application.
Get real-time access to relational data for insight. Flux allows you to funnel relational data from SQL sources into analytics and business intelligence tools like Tableau and Power BI through a JDBC driver, with no complex aggregations and grouping.
Build a robust AI pipeline to enhance RAG systems. Flux packs out-of-the-box functionality to split the text in your documents and store vector embeddings during import and copy operations, providing targeted input to LLMs while reducing operational complexity and costs.
Rely on high throughput for powering critical enterprise applications and services. Flux can import and export billions of documents and process high-volume, high-velocity data transactions within a second.
Any data source is within a Spark connector or Progress DataDirect driver's reach.
Get Flux for MarkLogic Server.