Duke's Bank J2EE Jenkins/Rundeck example

From DTO Labs Knowledge Base
Jump to: navigation, search

This example combines Jenkins and Rundeck to implement automated build and release.

The basic notion is one of continuous build and deployment: each commit to the source repository (Subversion in this case) automatically triggers Jenkins to rebuild one or other of the application's deployable artifacts (the Duke's Bank ear file and a configuration package), after which Jenkins calls a Rundeck job to deploy to a JBoss instance running on one or more target nodes.

Contents

Setup

This section describes how to setup the example from scratch.

System

While the example no doubt works on any recent release of CentOS, it has been tested on releases 5.4, 5.5, and 5.7 (64-bit).

System requirements are reasonably modest with testing being completed on a single AWS EC2 instances (10GB EBS file system, and 8GB RAM). Note that it's quite straightforward to spread all the services out across individual system instances too.

The example includes:

No matter how many system instances you end up with, it pays to get DNS sorted out upfront since host names get configured all over the place! This documentation was tested using the following set of names (all resolving to "dukesbank.dtolabs.com") :

So, that being said, step one after the VM is running is to set up your hosts file and hostname. Log in as root and run the following: 

hostname dukesbank.dtolabs.com
cat >> /etc/hosts <<EOH
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1               dukesbank.dtolabs.com dukesbank sources.dukesbank.dtolabs.com build.dukesbank.dtolabs.com deploy.dukesbank.dtolabs.com app.dukesbank.dtolabs.com db.dukesbank.dtolabs.com localhost.localdomain localhost
::1             localhost6.localdomain6 localhost6
EOH

Note that this kind of role-base system naming offers a great degree of flexibility since the aliases that represent the role can be easily be switched from one canonical domain name to another. Better still, they provide a human-readable mnemonic!

Beyond a basic system image, the example requires the following tools to be installed:

Tool-chain

Subversion

Jenkins

Install JBoss first 

cd /opt
wget -q http://sourceforge.net/projects/jboss/files/JBoss/JBoss-4.0.3SP1/jboss-4.0.3SP1.zip/download
unzip -q jboss-4.0.3SP1.zip 
cp jboss-4.0.3SP1.zip /root/
ls jboss-4.0.3SP1

And the output of your ls should be: 

bin  client  docs  jar-versions.xml  lib  readme.html  readme_j2ee.html  server

JenkinsConfigure.png

JenkinsConfigureRundeck.png

Rundeck

Platform

Duke's Bank is a two-tier application requiring both an application and database server.

JBoss 

JBoss needs to be pre-setup since this example does not demonstrate automating application server installation itself.

wget -q http://www.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.17.zip/from/http://mysql.mirrors.pair.com/
unzip mysql-connector-java-5.1.17.zip
cp mysql-connector-java-5.1.17/mysql-connector-java-5.1.17-bin.jar jboss-4.0.3SP1/server/default/lib


MySQL 



# mysql 
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.0.77 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql> create database dukesbank;
Query OK, 1 row affected (0.01 sec)

# mysql 
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 5
Server version: 5.0.77 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql> CREATE USER 'dukesbank'@'locahost' IDENTIFIED BY 'dukesbank';
Query OK, 0 rows affected (0.00 sec)

mysql> CREATE USER 'dukesbank'@'%' IDENTIFIED BY 'dukesbank';
Query OK, 0 rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON dukesbank.* TO 'dukesbank'@'localhost';  
Query OK, 0 rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON dukesbank.* TO 'dukesbank'@'%';
Query OK, 0 rows affected (0.00 sec)

mysql> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)

mysql> Bye

# mysql -D dukesbank -P 3306 -h db.dukesbank.dtolabs.com -u dukesbank --password=dukesbank
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.0.77 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql> create table foo(bar int);
Query OK, 0 rows affected (0.09 sec)

mysql> select * from foo;
Empty set (0.08 sec)

mysql> drop table foo;
Query OK, 0 rows affected (0.09 sec)

mysql> Bye

Application

Setup a "developer" account 

useradd anthony
usermod -G rundeck anthony
su - anthony
id

Output: 

uid=502(anthony) gid=502(anthony) groups=500(rundeck),502(anthony)

Get example source code

The Duke's Bank application source code and data as well as other files to support this example are kept in the dtolabs/dukesbank repository on GitHub. 

cd ~
mkdir src
cd src
git clone git://github.com/dtolabs/dukesbank.git

Output: 

Initialized empty Git repository in /home/anthony/src/dukesbank/.git/
remote: Counting objects: 1865, done.
remote: Compressing objects: 100% (956/956), done.
remote: Total 1865 (delta 816), reused 1865 (delta 816)
Receiving objects: 100% (1865/1865), 29.66 MiB | 1959 KiB/s, done.
Resolving deltas: 100% (816/816), done.

ls dukesbank

Output: 

README  data  examples  src

Setup the database

Since this example is not concerned with formally managing the release of the application's database schema and data, it's OK just to load the sample data that makes Duke's Bank work directly to MySQL! 

mysql -D dukesbank -h db.dukesbank.dtolabs.com -P 3306 -u dukesbank --password=dukesbank < dukesbank/data/mysql/dukesbank.sql 

$ mysql -D dukesbank -h db.dukesbank.dtolabs.com -P 3306 -u dukesbank --password=dukesbank
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 7
Server version: 5.0.77 Source distribution

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql> show tables;
+-----------------------+
| Tables_in_dukesbank   |
+-----------------------+
| ACCOUNT               | 
| CUSTOMER              | 
| CUSTOMER_ACCOUNT_XREF | 
| NEXT_ID               | 
| TX                    | 
+-----------------------+
5 rows in set (0.00 sec)

mysql> Bye

Populate the Subversion repository

The example source is included in the GitHub repository, so it's trivial to import it into the Subversion repository. 

export EDITOR=vi
cd /home/anthony/src/dukesbank
svn import src http://sources.dukesbank.dtolabs.com/repos/dukesbank/trunk/src

Output: 

Adding  (bin)  src/j2eetutorial14.zip
.
.
.
Adding         src/j2eetutorial14/examples/saaj/headers/src
Adding         src/j2eetutorial14/examples/saaj/headers/src/HeaderExample.java
Adding         src/j2eetutorial14/examples/saaj/headers/build.xml

Committed revision 5.

$ svn import examples/example1/jboss http://sources.dukesbank.dtolabs.com/repos/dukesbank/trunk/examples/example1/jboss

Adding         examples/example1/jboss/server
Adding         examples/example1/jboss/server/default
Adding         examples/example1/jboss/server/default/conf
Adding         examples/example1/jboss/server/default/conf/bindings.xml
Adding         examples/example1/jboss/server/default/conf/jboss-service.xml
Adding         examples/example1/jboss/server/default/deploy
Adding         examples/example1/jboss/server/default/deploy/mysql-ds.xml

Committed revision 8.

Setup Rundeck resources

Since this example does not formally manage the Rundeck resources, its OK just to add the application server node directly to the project. 

vi /var/rundeck/projects/DukesBank/etc/resources.xml

It should look like this: 

<?xml version="1.0" encoding="UTF-8"?>

<project>
  <node name="localhost" description="Rundeck server node" tags="" hostname="localhost" osArch="amd64" osFamily="unix" osName="Linux" osVersion="2.6.21.7-2.fc8xen" username="rundeck"/>
  <node name="jboss@app.dukesbank.dtolabs.com" description="Duke's Bank JBoss account" tags="DukesBank,Example1,JBoss" hostname="app.dukesbank.dtolabs.com" osArch="amd64" osFamily="unix" osName="Linux" osVersion="2.6.21.7-2.fc8xen" username="jboss"/>
</project>

fgrep framework.ssh.keypath /etc/rundeck/framework.properties

Output: 

framework.ssh.keypath = /home/rundeck/.ssh/rundeck.id_rsa

Now, we can use that information: 

mkdir ~jboss/.ssh
cp /home/rundeck/.ssh/rundeck.id_rsa.pub ~jboss/.ssh/authorized_keys
chown -R jboss:jboss ~jboss/.ssh
chmod 700 ~jboss/.ssh
chmod 600 ~jboss/.ssh/authorized_keys

TestRundeck.png

Load Rundeck jobs

The example source includes a set of Rundeck jobs design to manage the JBoss server running the application server system(s). 

cd ~/src
rd-jobs load --file dukesbank/examples/example1/rundeck/jobs.xml

Output: 

# Total Jobs Uploaded: 5 jobs
# Succeeded creating/updating 5  Jobs:
succeeded:
- Example1/JBoss/Configure
- Example1/JBoss/Deploy
- Example1/JBoss/Install
- Example1/JBoss/Start
- Example1/JBoss/Stop

Example1Jobs.png


Template:Mbox

Load Jenkins jobs 

cd ~/src/dukesbank
curl -S -H "Content-Type: text/xml" -s --data-binary "@examples/example1/jenkins/Example1Conf/config.xml" "http://build.dukesbank.dtolabs.com:8080/createItem?name=Example1Conf"

cd ~/src/dukesbank
curl -S -f -H "Content-Type: text/xml" -s --data-binary "@examples/example1/jenkins/Example1Code/config.xml" "http://build.dukesbank.dtolabs.com:8080/createItem?name=Example1Code"


Where do we go from here?

Retrieved from "http://kb.dtosolutions.com/wiki/Duke%27s_Bank_J2EE_Jenkins/Rundeck_example"
Personal tools
Namespaces
Variants
Actions
Navigation
Toolbox
Print/export