CI Tools and Best Practices in the Cloud

Continuous Integration

Subscribe to Continuous Integration: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get Continuous Integration: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Continuous Integration Authors: Stackify Blog, Aruna Ravichandran, Plutora Blog, Dalibor Siroky, PagerDuty Blog

Related Topics: Continuous Integration, Application Performance Management (APM), DevOps Journal

Blog Feed Post

How to Learn from Failure in DevOps | @DevOpsSummit #Agile #DevOps #Serverless

DevOps failure is a touchy subject with some, because DevOps is typically perceived as a way to avoid failure

How to Learn from Failure in DevOps
By Eric Bruno

DevOps failure is a touchy subject with some, because DevOps is typically perceived as a way to avoid failure. As a result, when you fail in a DevOps practice, the situation can seem almost hopeless. However, just as a fail-fast business approach, or the "fail and adjust sooner" methodology of Agile often proves, DevOps failures are actually a step in the right direction. They're the first step toward learning from failures and turning your DevOps practice into one that will lead you toward even greater success, sooner rather than later.

DevOps has its roots in Agile, where shorter development cycles with frequent feedback loops guide you quickly, over a period of time, toward product delivery that is more aligned with customer needs. The point of the feedback loop is to learn from your actions through customer feedback, then measure what went right and what can be improved.

The feedback loops are effective because frequent change and failure provide opportunities to learn in a way that actually reduces risk. There are many types of failures that can strike a DevOps practice, and your reaction matters. Let's examine some now.

Incident Reaction Failure
When software issues occur - whether they're deployment-related or bugs - your reaction to them is often more important than the fact that they occurred in the first place. Failure here can occur in multiple forms, including:

  • Overreaction: Spending too much time or too many resources fixing or trying to avoid repeat failure
  • Incorrect reaction: Misdiagnosing a problem or assuming the wrong problem, potentially due to lack of information
  • Lack of reaction: Not fixing the problem soon enough, or effectively enough, and the issue arises again soon after

Incident management and appraising its success through KPIs are important parts of measurement that are critical ingredients in DevOps success. Quickly assess and resolve incidents by surfacing relevant information and recruiting other team members to help, and looking at the system as a whole instead of pointing at individual components (and the people behind them) as the cause.

The takeaways here include a holistic approach to incident response, spreading knowledge, learning from failure and past incidents to prevent future issues, and automating responses to solve issues more quickly.

Creating Too Much Process
Some think DevOps is simply a process or a tool and go about setting up rigid, formal sets of procedures to follow. But imposing too much formality, being too strict about process, and mandating certain toolsets can limit your organization's flexibility when it comes to change. Instead, DevOps should include tools and procedures that enhance your organization's nimbleness.

For example, tools that measure your overall software development and deployment efficiency will help provide feedback to improve that efficiency. How? By pointing out where changes need to be made and the bottlenecks that need to be removed. With too much rigidity, your organization may not be able to change quickly enough to improve or meet the needs of a changing user base or market.

Limiting the Scope of DevOps
The work of a DevOps practice doesn't fall on a single person or even a team within your organization. I've witnessed situations where individuals were specifically hired as "The DevOps Person" who would magically do "DevOps stuff" to fix all of the existing software deployment and maintenance problems. But here's the short of it: That approach will fail.

Similarly, I've also seen situations where customer service and support personnel have received calls from customers about a new feature that was installed over the weekend that they had no prior knowledge of. When key support people learn about changes to your software from your customers, you have a DevOps failure.

DevOps is an organizational practice that takes what was learned from Agile development and applies it end-to-end throughout software delivery. It's a practice that should be extended into other functions across the business. This means development work is aligned with customer value, not projects, and product teams work not only with IT staff, but also with the folks who answer the phones, write the technical documentation, advertise and market the application, and serve as business sponsors - including the executives who plan for the future. There's something for everyone to learn when feedback loops are expanded to comprise everyone in the organization.

The takeaways here include expanding feedback loops, communication, and key measurement activities to all parts of your organization. Additionally, don't ignore third-party vendors, suppliers, or components. Remember to include validation, auditing, and monitoring for external components as well.

The Blame Game and Competition
Given that Agile often uncovers bottlenecks in an organization's software delivery pipeline, it's easy to point the finger at people or activities that are perceived to slow things down. When this occurs, DevOps can drive an even greater wedge between teams-which is the polar opposite of what was intended.

Instead, remove the silos (teams or people who tend to work in a vacuum) and tear down the walls between teams before identifying bottlenecks and improvements. With everyone working together first, with a shared set of responsibilities, improvements will occur as a unified team rather than as a result of competition between them.

Keeping a Silo or Two
It's not unusual for organizations - even those that have seen actual success with Agile and DevOps - to create exceptions within the company when it comes to the practice. Perhaps it's a legacy application, a proven team, or even a veteran employee. However, excluding a single person or team from the DevOps practice can be troublesome.

Silos have a way of multiplying and becoming toxic to an organization's software delivery practice. Even if the silo includes a company co-founder, no one should be exempt from the processes and collaboration that your organization's DevOps practice encourages. In a nutshell: DevOps means removing silos and bottlenecks. No exceptions.

Ignoring the Development Environment
DevOps applies to more than the production environment and deployments. Even when Agile development sprints are successful, production deployments are automated, and testing is continuous, failing to extend those practices into the development environment creates its own problems. For example, if development and test environments aren't managed using the same tools, approaches, and people that manage your production environment, you risk production problems the first time your software encounters potentially unique configurations, which often leads to unexpected failure.

Know how the development work is done, where it's being done, and where it's going to end up in production. If any one of those three is an unknown at development time, the risk of failure will grow to a near certainty at release time. It's absolutely crucial to orchestrate and control your development workflows and environments in the same way they'll likely exist in production.

Too Much Team Access
The increased teamwork that results from DevOps is a good thing, and so is the growing capability team members achieve as they're exposed to newer procedures or components in your software. However, forgetting the added responsibility that comes along with this can lead to critical failure. For example, while it's generally good that DevOps might help a UI developer become familiar with an application's database - and empower that UI developer to even roll out DB changes self-service - it's not good when changes are made to a production database accidentally. While bottlenecks are removed, controls also need to be in place to avoid catastrophe.

The takeaways here are to monitor and report unexpected access to critical production systems, and to put procedures in place to roll back (or even roll forward) damaging changes made, unintended or not.

Conclusion: It's About People
The goal isn't successful DevOps in and of itself - it's neither a process nor an activity. Instead, the goal is to use the tenets of DevOps to improve your software, customer experience, and organization. In fact, if any one of these is missing, life might prove difficult, even if you think you're succeeding at DevOps.

It's important to remember that all of these ingredients involve actual people. Regardless of how DevOps helps you get there, learning from failure, instilling a culture of constant improvement, making customers happy, and having fun while doing it are what's truly important. Every day as you work to accomplish your goals, keep in mind what really matters.

The post How to Learn From Failure in DevOps appeared first on PagerDuty.

CloudExpo | DXWorldEXPO have announced the conference tracks for Cloud Expo 2018, introducing DXWorldEXPO.

DXWordEXPO, colocated with Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA.

Digital Transformation (DX) is a major focus with the introduction of DXWorld Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.

A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throughout enterprises of all sizes.

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

DX World EXPO, LLC., a Lighthouse Point, Florida-based startup trade show producer and the creator of DXWorldEXPO® - Digital Transformation Conference & Expo has announced its conference agenda, with three major themes:

* Technology - The Revolution Continues
* Economy - The 21st Century Emerges
* Society - The Big Issues

"DX encompasses the continuing technology revolution, and is addressing society's most important issues throughout the entire $78 trillion 21st-century global economy," said Roger Strukhoff, Conference Chair. "DXWorldExpo has organized these issues along 10 tracks with more than 500 of the world's top speakers coming to Istanbul to help change the world."

There are 10 tracks running throughout the event and following the major themes. More than 500 breakout sessions will be featured, along with keynotes and general sessions from some of the world's top technology, business, and societal leaders. The event will be held over five days in Istanbul, reflecting the global nature of Digital Transformation and the city's long and historic role as a key business and intellectual center and linchpin between East and West.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

DX World Expo's Global Themes and Tracks are as follows:

Technology - The Revolution Continues

DX Tech: Data-Driven Global 2000
DX Tech: The Blockchain Challenge
DX Tech: AI and Cognitive
DX Tech: The Global Cloud

Economy - The 21st Century Emerges

DX Econ: Software is Rewriting the World
DX Econ: Smart Cities, Nations, and Regions
DX Econ: FinTech and the Token Economy
DX Econ: The Industrial Internet and Industrie 4.0

Society - The Big Issues

DX Society: Environment
DX Society: Education
DX Society: Agriculture
DX Society: Health Care

Call for Papers -speaking opportunities- as well as sponsorship and exhibit opportunities will open on November 1, 2017.

World's Most Important Tech Event
DXWorldEXPO® will be the world's most important tech event with 1,000 exhibitors in its first year and 2,000 exhibitors in its second year, as it guides Global 2000 companies through their Digital Transformation journey for the next two decades. The global event is set to launch September 17-20, 2018 in Istanbul. It will be sponsored by Fortune 50 companies, and more than 30 international banks will be among sponsors of its FinTech/InsurTech track.

Gaining a better understanding of customers and acting upon this information is the foundation of Digital Transformation (DX) in the enterprise. Applying the latest technologies in this area is the key to driving new topline revenue opportunities.

Global 2000 companies have more than US$40 trillion in annual revenue - more than 50% of the world's entire GDP. The Global 2000 spends a total of US$2.4 trillion annually on enterprise IT. The average Global 2000 company has US$11 billion in annual revenue. The average Global 2000 company spends more than $600 million annually on enterprise IT.

Governments throughout the world spend another US$500 billion on IT - much of it dedicated to new Smart City initiatives. There are more than a dozen Global 2000 companies in Turkey, including Isbank, Garanti Bank, other financial institutions, Turk Telecom, Turkcell, Turkish Airlines, and ENKA.

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

More Management Quotes
"For the past 10 years at Cloud Expo, we've helped drive the migration to modern enterprise IT infrastructures, built upon the foundation of cloud computing. Today's hybrid, multiple cloud IT infrastructures integrate Big Data, analytics, blockchain, the IoT, mobile devices, and the latest in cryptography and enterprise-grade security," said Fuat Kircaali, Chairman and founder of DX World Expo, LLC.

"As a report from the World Economic Forum and Accenture recently stated, 'Companies need to fundamentally change the way they identify, develop and launch new business ventures.' We agree," said Carmen Gonzalez, president of DX World Expo, LLC.

"Digital Transformation is the key issue driving the global enterprise IT business," said Roger Strukhoff, Conference Chair and Executive Director of the Tau Institute for Global ICT Studies. "DX is most prominent among Global 2000 enterprises and government institutions. Our new event in Istanbul brings together the top companies and delegates from around the world, who are transforming the world."

2018 Conference Agenda and Tracks, June 5-7, Javits Center

Track 1 | Cloud Expo - Enterprise Cloud
Track 2 | DXWorld Expo - Digital Transformation (DX)
Track 3 | The API Enterprise | Mobility & Security
Track 4 | DevOps | Containers & Microservices
Track 5 | Cognitive Computing | AI, ML, DL
Track 6 | Big Data | Analytics
Track 7 | IoT | IIoT | Smart Cities
Track 8 | Hot Topics | FinTech | WebRTC

Cloud Expo covers all of these tools, with the most comprehensive program and more than 120 top world-class speakers throughout our Industry presenting Keynotes, General Sessions, Breakout Sessions along eight focused tracks, as well as our signature Power Panels. Our expo floor brings together the world's leading companies throughout the world of Cloud Computing, DX, and all they entail.

As your enterprise creates a vision and strategy that enables you to create your own unique, long-term success, learning about all the technologies involved is essential. Companies today not only form multi-cloud and hybrid cloud architectures, but create them with built-in cognitive capabilities. Cloud-native thinking is now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector.

Cloud Expo is the world's most important, independent event where technology buyers and vendors meet to experience and discuss the big picture of Digital Tranformation and all of the strategies, tactics, and tools they need to realize their goals.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Only Cloud Expo brings together all this in a single location:

  • Cloud Computing
  • Big Data & Analytics
  • Software-Defined Infrastructure
  • Industrial IoT
  • Industry 4.0
  • Artificial Intelligence
  • Cognitive Computing
  • Microservices
  • Machine Learning
  • DevOps
  • WebRTC
  • FinTech
  • Digital Transformation

Attend Cloud Expo. Build your own custom experience. Learn about the world's latest technologies and chart your course to Digital Transformation.

21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world.

Download Show Prospectus ▸ Here

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS - software, platform, and infrastructure as a service.

With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo, October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.

2018 Conference Agenda and Tracks, June 5-7, Javits Center

Track 1 | Cloud Expo - Enterprise Cloud
Track 2 | DXWorld Expo - Digital Transformation (DX)
Track 3 | The API Enterprise | Mobility & Security
Track 4 | DevOps | Containers & Microservices
Track 5 | Cognitive Computing | AI, ML, DL
Track 6 | Big Data | Analytics
Track 7 | IoT | IIoT | Smart Cities
Track 8 | Hot Topics | FinTech | WebRTC

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Download Show ProspectusHere

Every Global 2000 enterprise in the world is now integrating cloud computing in some form into its IT development and operations. Midsize and small businesses are also migrating to the cloud in increasing numbers.

Companies are each developing their unique mix of cloud technologies and services, forming multi-cloud and hybrid cloud architectures and deployments across all major industries. Cloud-driven thinking has become the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, and the public sector.

Cloud Expo is the single show where technology buyers and vendors can meet to experience and discus cloud computing and all that it entails. Sponsors of Cloud Expo will benefit from unmatched branding, profile building and lead generation opportunities through:

  • Featured on-site presentation and ongoing on-demand webcast exposure to a captive audience of industry decision-makers.
  • Showcase exhibition during our new extended dedicated expo hours
  • Breakout Session Priority scheduling for Sponsors that have been guaranteed a 35-minute technical session
  • Online advertising in SYS-CON's i-Technology Publications
  • Capitalize on our Comprehensive Marketing efforts leading up to the show with print mailings, e-newsletters and extensive online media coverage.
  • Unprecedented PR Coverage: Editorial Coverage on Cloud Computing Journal.
  • Tweetup to over 75,000 plus followers
  • Press releases sent on major wire services to over 500 industry analysts.

For more information on sponsorship, exhibit, and keynote opportunities, contact Carmen Gonzalez by email at events (at) sys-con.com, or by phone 201 802-3021.

The World's Largest "Cloud Digital Transformation" Event

@CloudExpo | @ThingsExpo 2017 Silicon Valley
(Oct. 31 - Nov. 2, 2017, Santa Clara Convention Center, CA)

@CloudExpo | @ThingsExpo 2018 New York
(June 12-14, 2018, Javits Center, Manhattan)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Sponsorship Opportunities

Sponsors of Cloud Expo | @ThingsExpo will benefit from unmatched branding, profile building and lead generation opportunities through:

  • Featured on-site presentation and ongoing on-demand webcast exposure to a captive audience of industry decision-makers
  • Showcase exhibition during our new extended dedicated expo hours
  • Breakout Session Priority scheduling for Sponsors that have been guaranteed a 35 minute technical session
  • Online targeted advertising in SYS-CON's i-Technology Publications
  • Capitalize on our Comprehensive Marketing efforts leading up to the show with print mailings, e-newsletters and extensive online media coverage
  • Unprecedented Marketing Coverage: Editorial Coverage on ITweetup to over 100,000 plus followers, press releases sent on major wire services to over 500 industry analysts

For more information on sponsorship, exhibit, and keynote opportunities, contact Carmen Gonzalez (@GonzalezCarmen) today by email at events (at) sys-con.com, or by phone 201 802-3021.

Secrets of Sponsors and ExhibitorsHere
Secrets of Cloud Expo SpeakersHere

All major researchers estimate there will be tens of billions devices - computers, smartphones, tablets, and sensors - connected to the Internet by 2020. This number will continue to grow at a rapid pace for the next several decades.

With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-4, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.

Delegates to Cloud Expo | @ThingsExpo will be able to attend 8 simultaneous, information-packed education tracks.

There are over 120 breakout sessions in all, with Keynotes, General Sessions, and Power Panels adding to three days of incredibly rich presentations and content.

Join Cloud Expo | @ThingsExpo conference chair Roger Strukhoff (@IoT2040), October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, for three days of intense Enterprise Cloud and 'Digital Transformation' discussion and focus, including Big Data's indispensable role in IoT, Smart Grids and (IIoT) Industrial Internet of Things, Wearables and Consumer IoT, as well as (new) Digital Transformation in Vertical Markets.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Financial Technology - or FinTech - Is Now Part of the @CloudExpo Program!

Accordingly, attendees at the upcoming 21st Cloud Expo | @ThingsExpo October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, will find fresh new content in a new track called FinTech, which will incorporate machine learning, artificial intelligence, deep learning, and blockchain into one track.

Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expensive intermediate processes from their businesses.

FinTech brings efficiency as well as the ability to deliver new services and a much improved customer experience throughout the global financial services industry. FinTech is a natural fit with cloud computing, as new services are quickly developed, deployed, and scaled on public, private, and hybrid clouds.

More than US$20 billion in venture capital is being invested in FinTech this year. @CloudExpo is pleased to bring you the latest FinTech developments as an integral part of our program, starting at the 21st International Cloud Expo October 31 - November 2, 2017 in Silicon Valley, and June 12-14, 2018, in New York City.

@CloudExpo is accepting submissions for this new track, so please visit www.CloudComputingExpo.com for the latest information.

Speaking Opportunities

The upcoming 21st International @CloudExpo | @ThingsExpo, October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY announces that its Call For Papers for speaking opportunities is open.

Submit your speaking proposal today! ▸ Here

About @CloudEXPO and @DXWorldEXPO
SYS-CON Media (www.sys-con.com) has since 1994 been connecting technology companies and customers through a comprehensive content stream - featuring over forty focused subject areas, from Cloud Computing to Web Security - interwoven with market-leading full-scale conferences. The company's internationally recognized brands include among others Cloud Expo® (@CloudExpo), Big Data Expo® (@BigDataExpo), DevOps Summit (@DevOpsSummit), @ThingsExpo® (@ThingsExpo), and DXWorldEXPO® (@ExpoDX).

@CloudExpo® and @ThingsExpo® are registered trademarks of CLOUD EXPO INC.

DXWorldEXPO® is a registered trademark of DX WORLD EXPO LLC.

Read the original blog entry...

More Stories By PagerDuty Blog

PagerDuty’s operations performance platform helps companies increase reliability. By connecting people, systems and data in a single view, PagerDuty delivers visibility and actionable intelligence across global operations for effective incident resolution management. PagerDuty has over 100 platform partners, and is trusted by Fortune 500 companies and startups alike, including Microsoft, National Instruments, Electronic Arts, Adobe, Rackspace, Etsy, Square and Github.