Skip to content
Karel Hübl edited this page Mar 30, 2017 · 5 revisions

Welcome to the disl wiki!

DISL is ELT MDA framework which enables implementation of data integration solutions using DSL (domain specific language) implemented in Groovy.

Core requirements and features:

  • Enable agile, high productivity development and maintenance of data integration projects
  • Easy to learn for SQL developers
  • One tool for modeling, testing, deployment and execution
  • Data integration models represented by concise DSL code
  • Enable configuration management using standard version control systems
  • Support unit testing of data transfrmation logic
  • Support embedding of test data within unit tests to prevent maintenance of test data in database.
  • Open to integrate with open source and commercial data integration tools
  • Ready for Continuos integration and continuos delivery
  • Licensed under GNU General Public License

Getting started guide

ELT

Extraction Load Transform. Way of implementing data integration processes by using relational database as data transformation engine. Source data are loaded into target (or staging) database and later transformed and loaded into target tables using SQL queries.

MDA

Model driven architecture. Software development approach where business logic is defined by model, which is hiding implementation and technical details. Modelling tool or other piece of software is used to generate output based on model and patterns. Patterns define logic used to transform model into target artifacts - source code, documentation, deployment scripts etc. Power users and analysts are developing model. Geeks and gurus are developing patterns. Once patterns are fixed, gurus are no more required to develop software. Well, sometimes things are little bit complicated ;-). Software tools are required for modelling. Many tools provide great model visualizations. But for data mapping one needs specialized and expensive tools. And there is no support for unit testing, shared libraries, syntax highlighting, impact analysis, refactoring and other great features available to geeks in theirs IDEs for free.

DISL

Data integration specific language. DISL is domain specific language implemented in Groovy. It enables definition of data model and data mapping by concise code. Every SQL developer should be able to understand DISL code after reading the getting started guide. Model consists of text files which may be managed by git or your favourite source code management system. Any IDE supporting Groovy may be used for modelling. Free continuous integration servers may help you implement continuos delivery and schedule execution of data integration processes.

Clone this wiki locally