Big Data, Cloud, DevOps

- Management of large-scale, multi-tenant and secure, highly-available Hadoop
infrastructure supporting rapid data growth for a wide spectrum of innovative
customers
- Pre-sales: onboarding of new customers
- Providing architectural guidance, planning, estimating cluster capacity,
and creating roadmaps for Hadoop cluster deployments
- Design, implemention and maintainance of enterprise-level security Hadoop
environments(Kerberos, LDAP/AD, Sentry, encryption-in-motion, encryptionat-rest)

- Install and configuration of Hadoop multi-tenant environments, updates,
patches, version upgrades
- Creating run books for troubleshooting, cluster recovery and routine cluster
maintenance
- Troubleshooting Hadoop-related applications, components and infrastructure
issues at large scale
- 3rd-Level-Support (DevOps) for business-critical applications and use cases
- Evaluation and proposals of new tools and technologies to meet the needs
of the global organization (Allianz Group)
- Work closely with infrastructure, network, database, application, business
intelligence and data science units
- Developer in Fraud Detection projects including machine learning
- Design and setup of a Microsoft Revolution(Microsoft R Open) data science
model training platform on Microsoft Azure and on premise for Fraud
Detection using Docker and Terraform
- Developer in Supply Chain Analytics projects(e.g. GraphServer that allows
to execute graph queries on data stored on HDFS)
- Transformation of team's internal processes according to Agile/SCRUM
framework
- Developer of Kafka-based use cases

- ClickStream
- Producer: aggregator for streamed URLs clicked on webpages
with a REST API or other sources(e.g. Oracle)
- Consumer: Flink job that after pre-processing(sanity check, extraction
of time information) put data on HDFS in XML files
- Used stack: Java, Kafka, Cloudera, SASL, TLS/SSL, Sentry,
YARN, Flink, Cassandra
- Classification of documents
- Producer: custom written producer that reads documents from
a shared file system and writes them into Kafka




- Consumer: Spark streaming job that after pre-processing sends
documents to UIMA platform for classification of documents.
After classification data will be stored on HDFS for further batch
processing
- Used stack: Java, Kafka, Spark(streaming), Cloudera, SASL,
TLS/SSL, Sentry, YARN, UIMA
- Graph database(PoC): manage graphs via Kafka interface
- Producer: twitter, news agents sites, etc
- Consumer: converted articles and messages into graph queries
and executed them on graphs using Gremlin
- Used stack: Java, Python, Kafka, Cassandra, Germlin, Keylines(for
visualization of graphs; JavaScript), Google Cloud

Operations Company GmbH

- Development and implementation of precise scalable IT solutions for Big
Data and Web projects as DevOps
- Development and implementation of security and operational concepts for
major Hadoop distributions MapR, Hortonworks and Cloudera including
data analysis, development of models, data governance, data protection
and data integration. Advanced Big Data Know-Hows
- Installation and testing of multi-tenant Kafka clusters
- Planing and design of Big Data platforms. Implementation of high performance
Hadoop applications
- Consulting by customers who would like to migrate to Hadoop environments

- Administration, automatization, performance tuning and securing Linux
servers
- Planing, optimization, administration and monitoring of dynamic routing:
BGP, OSPF, MPLS, peering
- Operating of network components: firewalls, loadbalancers, routers, switches
- Operating of mass-storage systems
- Provisioning of systems with Puppet and Cobbler
- Consulting of the management in technical questions
- Monitoring and project documentation
- Software error analysis, identification of bottlenecks and finding solutions
- 24x7 on-call service
- Migration of clients services to AWS:

- Provisioning and setup of VMs and software packages(Apache HTTP,
NGINX)




- Setup of VPNs
- Evalation and performance tests of DynamoDB

- Development of architecture, implementation and setup of monitoring for
an HDInsight analytics platform on Microsoft Azure:

- Containerization and orchestration with Docker and Terraform
- Used Hadoop components: Hortonworks, Spark with MLlib, Hive,
Kafka
- Storage: Azure Storage
- Monitoring: NAGIOS, Kibana, Grafana

- System administration one of the biggest social networks in Germany werkennt-wen.de.
The network had more than 9 million users and was a
daughter of RTL Interactive
- Operating, maintenance, extension and monitoring of the platform( 500
server of Hewlett Packard) and the following services: MySQL, memcached,
Postfix, SSL, Scality(mass-storage), search engines ElasticSeach
and Sphinx, Apache, NGINX
- Development and implementation of data consolidation initially spread
over 120 MySQL servers
- Optimization of the mass-storage system based on Scality to reduce latency
and to achieve better load distribution
- Development and implementation of informational infrastructure database(which
server, which rack, which IP, etc) inclusive frontend
- Automatization of server installation process with Full Automatic Installaton(FAI)

- Automatization of package management with Puppet
- Development of MySQL backup tool based on Percona Xtrabackup
- Development and implementation of mass-storage backups: full and incremental

- Virtualization of services with KVM, XEN and VMware
- Support for the IT-infrastructure in office
- Monitoring with Cacti, Munin, NAGIOS. Development of NAGIOS checks
- 24x7 on-call service

Wuppertal

- ATLAS experiment at CERN(Geneva, Switzerland): Grid Computing und
top-quark physics
- Statistic-based separation of singal from background: statistical tests, estimation
of statistical and systematical errors, data unfolding, likelihood,
Monte Carlo simulation. Improvement of measured results using multivariate
methods: neural networks, genetic algorithms and support vector
machines. Used programming languagues: C++, python
- ATLAS note "A search for ttbar resonances in the lepton plus jets channel
in 35 pb-1 of pp collisions at 7 TeV"
- Operating, maintenance, monitoring and extension of a WLCG-cluster in
Wuppertal(1500 cores, 1 PB storage)
- Installation and perfromace optimization of MySQL server for the CREAM-
CE service
- Entwicklung, Implementierung und Leitung des Webapplications "Accounting
f"ur Netzwerk-Filesystem": PostGRESQL Datenbank, Python-API,
JavaScript, Apache. Datenbank-Optimierung
- Development, implementation and project management of a web application
"Accounting for the mass-storage system dCache"
- Vergleich verschiedener Netzwerk-Protokollen und Mass-Storage-Systemen:
dCache, GPFS, Panasas
- Evaluation of performance of different mass-storage systems and network
protocols: dCache, GPFS, Panasas
- Administration of the cluster infrastructure with focus on performance,
high availability and security
- Virtualization with XEN, VMware
- Installation, administration und optimization of batch-systems: Oracle
Grid Engine, Portable Batch System
- Evaluation of Amazon EC2 services for high energy physics: scalability,
storage
- Technical support for other ATLAS Tier-2 centers worldwide
- Developer of Job Execution Monitor: remote debugger for jobs on Grid
- Organization and project management of dCache tutorials
- WissGrid projekt: extraction and validation of meta-data of data formats
used in high enegry physics. Longtime archiving
- Software quality assirance and tests
- Lectures on distributed computing
- Talks at conferences "Computing in High Energy Physics 2012", dCache
Wokrshops, Deutsche Physikalische Gesellschaft

Technische Hochschule

- CMS experiment at CERN: Grid Computing and top-quark physics
- Development of software tools to simulation top-quark processes based on
Monte Carlo technique
- Pattern recognition in physics processes
- Support and administration of the Tier-2 cluster in Aachen
- Virtualization with VMware
- Automatization of OS provisioning
- Performance optimization of the Lustre network filesystem
- Software quality assurance and tests
- Lectures on elementary particle physics
- Publications and talks