CI Tools and Best Practices in the Cloud

Continuous Integration

Subscribe to Continuous Integration: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get Continuous Integration: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Continuous Integration Authors: Stackify Blog, Aruna Ravichandran, Plutora Blog, Dalibor Siroky, PagerDuty Blog

Related Topics: Continuous Integration

Blog Feed Post

DevOps and the DBA: Best Practices in XL Deploy

4nhttps://blog.xebialabs.com/wp-content/uploads/2016/10/4N-768x512.jpeg 768w, https://blog.xebialabs.com/wp-content/uploads/2016/10/4N.jpeg 800w" sizes="(max-width: 489px) 100vw, 489px" />

As Agile practices and the DevOps movement transform delivery pipelines throughout the world, let’s take a moment to reflect on the database administrator’s role in pushing the latest features out the door. Here are six best practices for users of XL Deploy:

 

1. Remember that the DBA is part of the application development team(s).

The DBA coaches the developers on database architecture, proper SQL standards, Explains, etc. as they design, build, and test their code.  All team members operate under Agile principles.

 

2. Standard environments that include the database should be able to be stood up quickly for testing the latest build.

In XL Deploy:  Include a dedicated database in every Environment to which the application is deployed

 

3. Database configuration (DDL, SQL) is developed and saved as version-controlled code.

To paraphrase Gene Kim, Infrastructure-as-Code allows modern development practices to applied to the entire development stream to enable fast deployment, continuous integration, continuous delivery, and continuous deployment.

 

4. Database changes are aligned with the application changes that need them.

In XL Deploy, an Application Package is a complete and environment-independent package, able to be deployed to any environment.  By complete, we mean that It includes all the binary artifacts, configuration settings, startup commands, etc. to get the application properly configured and running.  A dictionary/placeholder scheme is used to substitute environment-dependent values (port numbers, credentials, etc.) at deployment time.

For example, an application needs a new index on a table, so the DDL for the index is part of the application change package to ensure that both are always deployed together.

In XL Deploy:  Include sql.SqlScripts element in the application package.  This element is simply a zip file of lexicographically ordered scripts.  See below for an example.

Database configurations used by more than one application can be managed by using XL Deploy’s application dependencies set at the udm.DeploymentPackage object.  See https://docs.xebialabs.com/xl-deploy/concept/application-dependencies-in....

 

5. Database configuration changes are accumulated in new versions of the sql.SqlScripts object as they are developed.

At any point in time, the object can be deployed to a new or old environment and bring the database up to the state necessary for that version of the application.  So, in a brand new environment with just the DBMS software, XL Deploy would run all the scripts.  In an environment with a previous deployment(s), XL Deploy runs only scripts not run previously.

Here is a simple example of the evolution of the scripts in sql.Scripts.

Version 1 — this version configures a database from the bare metal:

01-create-tables.sql
02-create-indexes.sql
03-grant-user-permissions.sql

Version 2: — this version of the application requires a new table and its index

01-create-tables.sql
02-create-indexes.sql
03-grant-user-permissions.sql
04-create-new-table.sql
05-create-new-index.sql

Version 3: — oops, the new index wasn’t working, the app needs new-index-2 instead

01-create-tables.sql
02-create-indexes.sql
03-grant-user-permissions.sql
04-create-new-table.sql
05-create-new-index.sql
06-create-new-index-2.sql

Version 4: — this iteration drop the bad index.  It may seem redundant to create and drop the index in the same set of scripts, but remember that this package may update an Environment whose current state is at Version 2 and we want to make we drop the bad index.

01-create-tables.sql
02-create-indexes.sql
03-grant-user-permissions.sql
04-create-new-table.sql
05-create-new-index.sql
06-create-new-index-2.sql
07-drop-new-index.sql

6. Rollback scripts are included to allow backout and undeployment.

XL Deploy uses a regex pattern to recognize which rollback script corresponds to which forward-going script.  Developers and DBAs should include these as they build the package of change.  Each one undoes the forward-going action, e.g. the first one drops the tables created by the first script.  With the rollbacks included, the package should look like this:

01-create-tables.sql
01-create-tables-rollback.sql 
02-create-indexes.sql
02-create-indexes-rollback.sql
03-grant-user-permissions.sql
03-grant-user-permissions-rollback.sql
04-create-new-table.sql
04-create-new-table-rollback.sql
05-create-new-index.sql
05-create-new-index-rollback.sql
06-create-new-index-2-rollback.sql
07-drop-new-index-rollback.sql
07-drop-new-index-rollback.sql


References

http://agilemanifesto.org/principles.html

https://www.toadworld.com/platforms/oracle/w/wiki/11486.devops-as-an-agi...

https://docs.xebialabs.com/xl-deploy/5.5.x/databasePluginManual.html

https://docs.xebialabs.com/xl-deploy/concept/database-plugin.html

The DevOps Handbook, Gene Kim, Jez Humble, Patrick Debois, & John Willis, IT Revolution Press, LLC, 2016

 

The post DevOps and the DBA: Best Practices in XL Deploy appeared first on XebiaLabs.

Read the original blog entry...

More Stories By XebiaLabs Blog

XebiaLabs is the technology leader for automation software for DevOps and Continuous Delivery. It focuses on helping companies accelerate the delivery of new software in the most efficient manner. Its products are simple to use, quick to implement, and provide robust enterprise technology.