EasyFlinkCEP: A Complex Event Processing Operator Using FlinkCEP

 

Collaborators

E. Kougioumtzi, N. Giatrakos, A. Kontaxakis, A. Deligiannakis, Y. Kotidis

 

About

FlinkCEP is the Complex Event Processing (CEP) API of the Flink Big Data platform. The high expressive power of the language of FlinkCEP comes at the cost of cumbersome parameterization of the queried patterns, acting as a barrier for FlinkCEP’s adoption. Moreover, properly configuring a FlinkCEP program to run over a computer cluster requires advanced skills on modern hardware administration which non-expert programmers do not possess. In this work (i) we build a novel, logical CEP operator that receives CEP pattern queries in the form of extended regular expressions and seamlessly re-writes them to FlinkCEP programs, (ii) we build a CEP Optimizer that automatically decides good job configurations for these FlinkCEP programs.

 

Architecture

Publications

[1] EasyFlinkCEP: Big Event Data Analytics for Everyone. N. Giatrakos, E. Kougioumtzi, A. Kontaxakis, A. Deligiannakis, Y. Kotidis. In Proceedings of the 30th ACM International Conference on Information and Knowledge Management (CIKM 2021), November 1-5, Gold Coast, Queensland, Australia, 2021.

[2] Towards Creating a Generalized Complex Event Processing Operator Using FlinkCEP: Architecture & Benchmark. E. Kougioumtzi, A. Kontaxakis, A. Deligiannakis, Y. Kotidis. In Proceedings of 15th ACM International Conference on Distributed and Event-Based Systems (DEBS 2021), Milan, Italy, 2021.

 

Code

https://github.com/eleniKougiou/Flink-cep-automation