DTO Hack Day 08/11/2011

Length : 2 Days

Location: TBD

Scope: To build a fully automated and monitored application life cycle pipeline (i.e., a #devops pipeline).

Link to HackDay TODO List...

DTO Hack Day 08/11/2011/ToDo

Description:

The plan is to build a a fully functional Java application lifecycle pipeline based on a loosely chained reference model.

• Source Version Control
• Build Management
• Artifact Management
• Release Management
• Configuration Management
• Deployment Management

The project will also include underlying instrumentation to collect data along the pipeline and also include an infrastructure for data storage and analysis.

Candidate Strategies:

• Source Control - GIT
• Build - Jenkins
• Artifacts - Nexus
• Release - Rundeck
• Configuration - Chef
• Deployment - AWS, (CloudFoundry or CloudFormation or just Chef)
• Data Collection: ganglia, collectd, graphite, maybe esper

The ideal application would be “Apache DayTrader Benchmark Sample” application..

Apache Day Trader

We will also be using a simplistic Kanban implementation for workflow and visualization. Basically, what that means is we will create a board of stickies in three buckets (ToDo, Doing, Done). We will then break off in groups of two and “Just do it”. Side note, at xxx we spent one day with their team doing this kind of hack-a-thon and they created more work in one day than they did in three months. I know I have put a lot on the plate for this; however, lets push ourselves and see how good we really are...

Architecture

File:HackDayArchitecture.pdf

To Do

Miscellaneous

• IRC Channel w/a bot .. a.logging b.controlling control
• Cloud Instances (rackspace or EC2) -- Can run ganglia on EC2 w/o Multicast.. config option
• Day Trader application build
• Create a Hackday Repository
• Ganglia Graphite integration
• CloudFoundry Application Distribution
• Provision, Deploy, Configure Rundeck jobs
• Dyninc Account

Servers

• GIT Master Server setup...
• Jenkins Server
• Rundeck Serve
• Jira (get free OSS version)
• Rundeck Jenkins plugin
• Nexus Server
• Chef Server
• Cloudfoundy Server
• Ganglia Server
• Nagios Server
• Graphite Server

Metrics

• Jenkins metrics to ganglia
• Nexus metrics to ganglia
• Chef Metrics to ganglia
• Rundeck metrics to ganglia
• Git Server metrics to ganglia
• Day Trader JMX data to ganglia
• Day Trader soft data to ganglia
• Mysql ganglia and nagios plugins