Jenkins World 2017

Free Workshop during registration

Data-Driven Continuous Delivery Pipeline
There is hidden value in the data produced by your Continous Delivery Pipeline that could help
you achieve more efficient processing. The main objective of this workshop is to show you how to
extract that value and benefit from it.
We will introduce you to how to configure and improve your Continuous Delivery Pipeline using
data. After an overview of a Continuous Delivery Pipeline setup using Gerrit Code Review,
Jenkins, and Docker, we will go through the steps on how to extract and analyze data across all
the pipeline stages of the delivery chain.

1. Jenkins Pipeline, Gerrit and Docker 101
You will learn the basic of setting up a code review, build and deploy pipeline:
- Overview of the Code, Build, Review and Deploy workflow
- Gerrit Code Review
- Jenkins Pipeline to fetch and validate changes
- Continuous deploy to Docker Swarm

2. Logs and Events flowing through the pipeline
You will learn what data and events are generated and available during each stage of the pipeline:
- Data available in Git commits
- Gerrit Code Review events
- Jenkins jobs events and pipeline logs
- Docker events
- Application logs

3. Event-sourced data extraction
You will learn how to collect data from all the different sources of the Continuous Delivery
pipeline:
- Gerrit Code Review stream events
- Gerrit metrics plugin
- Jenkins Logstash and RabbitMQ collector
- Docker logs
- Logback logstash collectors
- Apache Flume

4. Data crunching and correlation
You will learn how to crunch and correlate data coming from different sources, using Apache
Spark:
- Basics of an event-sourcing BigData stream processing
- Overview of Spark SQL
- Example of correlating Code changes, building logs and runtime logs

5. Grafana 101 for data visualisation
You will learn how data can be graphed using Grafana
- Definition of Grafana metrics
- Graph visualisation options
- Dashboard configuration and alerts

6. Rich data-analysis dashboards with Kibana
You will learn how to create custom dashboards of your Continuous Delivery Pipeline KPI:
- Publishing to Elastic Search
- Index format definition
- Identification of the Data KPI for Continous Delivery
- Define dashboards and drill-down to data components

7. Data-analysis on the Cloud
You will learn how to leverage GerritForge's services to process and provide data insights on the
cloud:
- Extracting and masking data for GerritForge's processing
- Sending logs for batch and near real-time analysis
- Data insights and improvements