Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Microsoft BizTalk ESB Toolkit 2.1
Microsoft BizTalk ESB Toolkit 2.1

Microsoft BizTalk ESB Toolkit 2.1: Discover innovative ways to solve your mission-critical integration problems with the ESB Toolkit

eBook
€8.99 €16.99
Paperback
€20.99
Subscription
Free Trial
Renews at €18.99p/m

What do you get with a Packt Subscription?

Free for first 7 days. €18.99 p/m after that. Cancel any time!
Product feature icon Unlimited ad-free access to the largest independent learning library in tech. Access this title and thousands more!
Product feature icon 50+ new titles added per month, including many first-to-market concepts and exclusive early access to books as they are being written.
Product feature icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Product feature icon Thousands of reference materials covering every tech concept you need to stay up to date.
Subscribe now
View plans & pricing
Table of content icon View table of contents Preview book icon Preview Book

Microsoft BizTalk ESB Toolkit 2.1

Chapter 1. ESB Toolkit, Architecture, and Features

BizTalk Server has been around for quite a long time, evolving over the years and becoming one of the most complete and powerful middleware products in the market, helping thousands of companies to fulfill their requirements in terms of Systems Integration.

With such a powerful product and the flexibility it provides to implement integration solutions, it's more than useful to have at hand a set of architectural patterns and re-usable components. These will support our design and help us to reach the most successful result possible. And here's where the ESB Toolkit comes into the picture.

In this chapter, we will have an overview of:

  • What is Enterprise Service Bus (ESB)

  • What are the architectural principles that define an ESB

  • How the ESB Toolkit helps to build better integration solutions

  • What are the ESB Toolkit features and components

The content within this book is not meant to be a long dissertation about the different architectural terms and acronyms coined over time that lead into the definition of what an ESB is about. We will save you some time by going straight to the point of defining the basics of ESB so you can spend that extra time on enjoying a good BBQ.

Understanding the basics


An Enterprise Service Bus (ESB) is an architectural model that defines the patterns to integrate IT systems by interconnecting an ecosystem of loosely coupled and interoperable business services and components in an elastic way. The ultimate goal is to provide a flexible implementation of the enterprise business processes in such a flexible way that those processes can be efficiently adapted to the ever-changing circumstances of the enterprise.

In the following figure, we can see different example business processes that could be run within our ESB, as a set of decoupled business services or stages:

The VETRO pattern

In most cases, a business process is all about how information travels through the process and how it is handled along the way, and thus the ESB model predicates the integration of such business processes in terms of the five basic steps that conform to the VETRO pattern:

  • Validate: This is usually the very first step of the information processing, where we ensure that the information received is in the format expected, although there can be other validation steps along the process. This validation against the mutually agreed service/data contracts ensures that the information flowing through the ESB is legitimate and compliant with the expectations of any system connected to the bus.

  • Enrich: During this step, the information is enriched so it contains all the data required to continue its journey and provide a meaningful input to the target system.

  • Transform: The information is transformed to the format the target system expects and understands. This step could happen as the information arrives at the ESB (where in this case the target system is the ESB itself) where the information would be transformed into a canonical format (quite often defined by the company's Enterprise Data Model), as well as when the information leaves the ESB, transforming it from the canonical format to the format expected by the target system.

  • Route: In systems integration, the information intrinsically has to travel from one place to the other, and that is what happens during this stage. The next step the information needs to take is identified and the route is applied so the process can continue as expected.

  • Operate: The business processes are all about triggering actions within the enterprise that achieve the mission the process is designed for. In this stage, the target system is delivered the input information so any required actions are taken and any expected outcomes are produced. In essence, the Operate step is the invocation of a target service or even an interaction with the target service.

The ESB receives messages from the systems connected to it and performs one or more of the steps mentioned previously. All those steps that define how a message needs to be handled by the ESB are defined as itineraries, that are a set of decoupled processing steps that doesn't necessarily know about the whole process the message just went through or is going to go through afterwards, but they just know what they have to do with the message they just received for processing.

This doesn't sound like rocket science or anything very new, but what the ESB adds to the pattern is the means to make all these stages along the process as decoupled and configurable as possible, so once a process is in place any further changes can be made with the smaller effort and the smallest impact possible on existing systems.

ESB capabilities

An ESB has different features and capabilities that support one or many of the elements of the VETRO pattern.

The main capabilities that support this model in the ESB are listed in the following table:

Capability

Mapping to VETRO

Description

Message Routing

---RO

Dynamic and configurable message routing allows flexible processes to be changed even at runtime

Connectivity

---RO

Adapters and other protocol transformation components facilitate the connections between heterogeneous systems

Exchange Patterns

---RO

Business processes usually require different message exchange patterns, such as synchronous/asynchronous, pub-sub, and so on

Transformation

--T-O

Systems that understand different data formats and structures require a man in the middle to help them talk to each other

Service Directory

--TRO

Loosely coupled service architectures require a centralized directory where consumers can find the service they need to use

Rules Dynamic Resolution

VETRO

The configurable and elastic behavior ESB predicates require a rule system that provides flexibility to the other capabilities of the system

Validation

V-T--

Information needs to be validated to ensure it complies with the definition of the business processes

Aggregation

-ET-O

The business processes are usually composed of multiple subprocesses that will be invoked to enrich and transform the information as the overall process runs

Service Orchestration

---RO

 

Assured Delivery

---RO

Some features such as message queuing or assured delivery are required to ensure reliable and predictable execution of business processes

Management and Governance

-----

We need to be able to configure and monitor the behavior of the processes so we are always on top of what is happening in our business

Security

-----

The execution of our business processes needs to rely on a security system that ensures that all the parties involved are who they claim to be and are allowed to take the actions they want to perform

If you have been working with BizTalk Server for some time or have some basic knowledge about its architecture and features, you will find that most of those cover these capabilities any ESB system is required to have, but you will also appreciate that some of them could be implemented in different ways, requiring some extra effort from your architecture team to decide the best way of doing so.

Here is where the ESB Toolkit comes to help. Based on the years of experience of architects and IT teams building integrations solutions with BizTalk, these patterns and capabilities have been packaged as a set of guidelines and re-usable components that will help you to build an ESB solution with a more predictable and efficient result.

The ESB Toolkit


In this section, we will get to know what the ESB Toolkit is all about, why it was created, and the benefits it brings to any BizTalk solution, especially to build ESB architectures.

We all need a bit of guidance

As we saw in the previous section, ESB is an architectural model that can bring huge benefits to the integration architecture of a company, but there would be potentially many ways to achieve the same goal.

Around 2007, a group of talented architects and developers from the Microsoft BizTalk product group and the Patterns and Practices team came up with the idea of the ESB Guidance, as a set of architectural guidelines and re-usable components that would help us to build an ESB based in Microsoft BizTalk Server 2006 R2. This ESB Guidance was renamed later on to ESB Toolkit with its 2.0 version along with BizTalk 2009. The latest versions of it are the 2.1 that came with BizTalk 2010 (the one that we will cover in this book) and the latest one (2.2) that comes with BizTalk 2013.

Note

The main difference between ESB Toolkit 2.1 and 2.2 versions is that the ESB Toolkit 2.2 can be installed directly from the BizTalk installer splash screen, but the rest remain the same, so the contents described in this book apply to both versions.

Most of the current technologies and IT development platforms nowadays provide huge flexibility and power in terms of implementing solutions, but that flexibility and power sometimes make it difficult to know the better way to implement some common patterns.

In the old days of .NET, we all needed to implement common patterns such as aspect oriented programming, error handling libraries, logging, and so on, and there were teams around the world implementing the same things on and on, each of them on their own flavor. But then the Enterprise Library came along to make our life a bit easier.

The ESB Toolkit is to BizTalk the same as the Enterprise Library is to any .NET application. It just helps to implement common architectural and development practices in a reliable and proven way. Whether you are building an ESB or not, some of the ESB Toolkit principles and re-usable components will be really useful to build high quality BizTalk solutions.

ESB Toolkit features

The aim of the ESB Toolkit is to cover all of the capabilities required by a proper ESB by leveraging existing features in BizTalk Server, introducing new re-usable components and documenting it all together so we don't get lost along the way.

We can map the main ESB capabilities we listed in previous sections to the BizTalk and ESB Toolkit features like:

ESB Capability

Mapping to BizTalk and ESB Toolkit

Message Routing

BizTalk content-based routing and ESB Toolkit itineraries

Connectivity

BizTalk Adapters and ESB Toolkit ramps

Exchange Patterns

BizTalk Adapters and existing architecture

Transformation

BizTalk maps and ESB Toolkit components

Service Directory

BizTalk UDDI Services and ESB Toolkit itineraries

Rules Dynamic Resolution

BizTalk Business Rules and ESB Toolkit dynamic resolution

Validation

BizTalk Schemas and ESB Toolkit components

Aggregation

BizTalk orchestrations and ESB Toolkit itineraries

Service Orchestration

BizTalk orchestrations and ESB Toolkit itineraries

Assured Delivery

BizTalk Adapters and ESB Toolkit Exception Handling

Management and Governance

BizTalk management console, ESB Toolkit management portal, and Business Activity Monitoring (BAM)

Security

BizTalk Security and SSO

As we mentioned earlier, all these capabilities are pretty much required to build a full-blown ESB architecture and they should be interoperable and decoupled enough to provide the flexibility and scalability that we need.

All this can be very well represented with the representation of the ESB Toolkit architecture and main components shown in the following figure.

Itineraries

The itinerary is one of the core concepts on the implementation of an ESB solution. It's the definition of the flow of certain piece of information or message must follow, through the ESB to fulfill one specific business process or interface.

The itinerary is composed of a set of steps or processing units that pretty much can be mapped to one or more of the stages defined by the VETRO pattern. Those steps or processing units are called Itinerary Services. They can be either the standard itinerary service components that come with the ESB Toolkit (the Transformation and Routing Services) or our own custom developed itinerary services.

We will get to know the itineraries more in detail in the next chapter of this book.

Ramps and web services

The ramps are the connection points where the systems can connect to send messages to the ESB and receive messages from it. Those are respectively the On-Ramps and the Off-Ramps and are implemented as WCF web services and BizTalk send ports, although we could build our own ramps based on other types of BizTalk adapters.

The ESB Toolkit also provides a set of web services that expose the functionality of some ESB features to any external systems. Those services are:

  • Itinerary processing

  • Exception management

  • Endpoints and maps resolution

  • Messages transformation

  • BizTalk Server operations

  • BAM services

  • UDDI services

We will cover these in detail in Chapter 2, Itinerary Services and Chapter 4, Understanding the ESB Web Services.

Services directory

The services directory is provided in BizTalk and the ESB Toolkit by means of the Universal Description, Discovery, and Integration (UDDI) services. These services provide a centralized registry of the services available across an organization, either for internal or external consumers, exposing all of the required information to categorize, organize, discover, and manage those services' definitions.

We will talk more about it in Chapter 4, Understanding the ESB Web Services.

Exception Management framework

Exception Management framework is a set of components and APIs that provide a standardized approach to handle, notify, and process any exceptional situations that might occur during the processing of a message. It's pretty much like the counterpart of the exception handling in the Enterprise Library.

We will dedicate a whole chapter to this topic later on in this book.

ESB Management Portal


The ESB Toolkit includes a web portal built on ASP.NET that provides:

  • Insight to the status of our ESB processes' health with detailed reporting of any issues that might have happened in any of our ESB applications (with a basic implementation of failed messages reprocessing)

  • Alerting features to create notifications for the ESB administrators of any errors that might happen

  • Features to manage the new services registry requests users can create

  • Different management consoles to configure certain features of the system

We will get into the details of the portal on the last chapter of the book.

Note

The ESB Management Portal and Service are provided as samples. These will work fine for a development environment.

Other components and utilities


There are many other re-usable components and tools within the ESB Toolkit that are really helpful during the design, development, and operation of our ESB, as well as components that could be easily re-used in other non-ESB implementations, such as certain pipeline components and libraries. One example of those are the Add/Remove Namespace pipeline components.

Those could come in handy in many BizTalk solutions where we need to deal with systems that are not that careful with how they set the namespaces on the messages submitted to BizTalk. We can use them to:

  • Add a namespace when the incoming message doesn't have a root namespace

  • Replace the incoming root namespace when the difference between the external system schema and our canonical schemas just differ in their namespace (so we could avoid the implementation and execution of a ridiculously simple map)

  • When the type of the inbound message is defined by some data included within the message itself

Summary


In this chapter, we have learned about the main architectural principles that define an Enterprise Service Bus, why the ESB Toolkit was something very much needed to help us to build high quality BizTalk solutions, and what are the main features of the ESB Toolkit.

In the next chapter, we will deep dive on the itineraries concept and how it rules the processing of messages within our ESB.

Left arrow icon Right arrow icon

Key benefits

  • A comprehensive guide to implementing quality integration solutions
  • Instructs you about the best practices for the ESB and also advises you on what not to do with this tool
  • A sneak view of what's new in the ESB Toolkit 2.2

Description

An Enterprise Service Bus (ESB) is an architectural pattern and a key enabler in implementing the infrastructure for a service-oriented architecture (SOA). The BizTalk ESB Toolkit is a collection of tools and libraries that extend the BizTalk Server capabilities of supporting a loosely coupled and dynamic messaging architecture. It functions as middleware that provides tools for rapid mediation between services and their consumers. Enabling maximum flexibility at runtime, the BizTalk ESB Toolkit simplifies loosely coupled composition of service endpoints and management of service interactions. The thing about the technology that gets most readers excited is how easy it is to quickly implement flexible and well-architected ESB solutions. "Microsoft BizTalk Server 2010 ESB Toolkit 2.1" provides you with an easy-to-follow view of the tools and services that make up the toolkit. The content is packed with practical examples on how to utilize the technology, which will be appealing to the readers. This book provides you with all the information you need in one publication. The content is based on practical examples on how to use the technology to make it easier for readers to follow. This book starts off with a quick, high level introduction to ESB architectural principles, how these principles map into the ESB toolkit features, and an introduction to the different components that provide those features. The book then reveals the ins and outs of Itineraries. Next, you'll get engaged in the different ways errors can be handled and monitored by means of the ESB Toolkit features. There will be a hands-on sample on building a custom Repair and Resubmit solution to reprocess failed messages. Get to know the different web services that expose the ESB Toolkit features to external applications and how to use them with quick samples. The book ends with a preview to the new version of the toolkit.

Who is this book for?

This book is for experienced BizTalk developers, administrators, and architects, as well as IT managers and BizTalk business analysts. Knowledge and experience with the Toolkit is not a requirement.

What you will learn

  • Acquire knowledge about the architecture behind the ESB Toolkit
  • Engage yourself in the ESB Toolkit¬¥s components and features
  • Create Itinerary components and apply them within an Itinerary process
  • Learn about the different concepts and components that build up the error handling features within the ESB Toolkit and implement them in real-life scenarios
  • Employ the interesting web services that are included in the ESB Toolkit
  • Recognize the different features that comprise the ESB Management Portal
  • Configure the registry, fault, and email notification settings of the ESB Management Portal

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Jul 26, 2013
Length: 130 pages
Edition : 1st
Language : English
ISBN-13 : 9781849688642
Vendor :
Microsoft
Category :

What do you get with a Packt Subscription?

Free for first 7 days. €18.99 p/m after that. Cancel any time!
Product feature icon Unlimited ad-free access to the largest independent learning library in tech. Access this title and thousands more!
Product feature icon 50+ new titles added per month, including many first-to-market concepts and exclusive early access to books as they are being written.
Product feature icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Product feature icon Thousands of reference materials covering every tech concept you need to stay up to date.
Subscribe now
View plans & pricing

Product Details

Publication date : Jul 26, 2013
Length: 130 pages
Edition : 1st
Language : English
ISBN-13 : 9781849688642
Vendor :
Microsoft
Category :

Packt Subscriptions

See our plans and pricing
Modal Close icon
€18.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
€189.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts
€264.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 82.97
Microsoft BizTalk ESB Toolkit 2.1
€20.99
Getting Started with BizTalk Services
€24.99
SOA Patterns with BizTalk 2013, Second Edition
€36.99
Total 82.97 Stars icon
Banner background image

Table of Contents

6 Chapters
ESB Toolkit, Architecture, and Features Chevron down icon Chevron up icon
Itinerary Services Chevron down icon Chevron up icon
ESB Exception Handling Chevron down icon Chevron up icon
Understanding the ESB Web Services Chevron down icon Chevron up icon
The ESB Management Portal Chevron down icon Chevron up icon
ESB Toolkit Version 2.2 for BizTalk 2013 Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Half star icon Empty star icon Empty star icon 2.8
(5 Ratings)
5 star 0%
4 star 40%
3 star 20%
2 star 20%
1 star 20%
Marc Weber Sep 21, 2014
Full star icon Full star icon Full star icon Full star icon Empty star icon 4
Perfect starting book
Amazon Verified review Amazon
Applied-Intelligence Feb 11, 2015
Full star icon Full star icon Full star icon Full star icon Empty star icon 4
A quite good introduction to the ESB Toolkit. It is written a bit unstructured and are a bit all over. The language is not the best and I needed to reread the book to get all out of it. It is not a beginners book as it assumes high level of BizTalk knowledge and not genereal ESB knowledge.
Amazon Verified review Amazon
Mayur Macwan Sep 26, 2014
Full star icon Full star icon Full star icon Empty star icon Empty star icon 3
this is good for the beginner, but if you know biztalk even a little bit, you can almost skip all the pages
Amazon Verified review Amazon
GP Feb 18, 2014
Full star icon Full star icon Empty star icon Empty star icon Empty star icon 2
I purchased this book to see if i can start working on ESB after reading this book, but i was disappointed. This book has very generic theory information that you find on msdn sites and blogs online. I won't recommend buying this book and wasting money.
Amazon Verified review Amazon
Samuel Amin Apr 23, 2015
Full star icon Empty star icon Empty star icon Empty star icon Empty star icon 1
I have good Biztalk knowledge and needed a book to introduce me to the ESB. This book does a much worse job of that than MSDN which is free. It doesn't describe the structure he will use to teach you the topic, and basically just lists all the configurations you can do on everything with out having you work with him on a step by step live sample as most books would do. So your eyes glaze over and it feels like reading a vacuum cleaner manual. Useless, returned it after the first few chapters
Amazon Verified review Amazon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

What is included in a Packt subscription? Chevron down icon Chevron up icon

A subscription provides you with full access to view all Packt and licnesed content online, this includes exclusive access to Early Access titles. Depending on the tier chosen you can also earn credits and discounts to use for owning content

How can I cancel my subscription? Chevron down icon Chevron up icon

To cancel your subscription with us simply go to the account page - found in the top right of the page or at https://subscription.packtpub.com/my-account/subscription - From here you will see the ‘cancel subscription’ button in the grey box with your subscription information in.

What are credits? Chevron down icon Chevron up icon

Credits can be earned from reading 40 section of any title within the payment cycle - a month starting from the day of subscription payment. You also earn a Credit every month if you subscribe to our annual or 18 month plans. Credits can be used to buy books DRM free, the same way that you would pay for a book. Your credits can be found in the subscription homepage - subscription.packtpub.com - clicking on ‘the my’ library dropdown and selecting ‘credits’.

What happens if an Early Access Course is cancelled? Chevron down icon Chevron up icon

Projects are rarely cancelled, but sometimes it's unavoidable. If an Early Access course is cancelled or excessively delayed, you can exchange your purchase for another course. For further details, please contact us here.

Where can I send feedback about an Early Access title? Chevron down icon Chevron up icon

If you have any feedback about the product you're reading, or Early Access in general, then please fill out a contact form here and we'll make sure the feedback gets to the right team. 

Can I download the code files for Early Access titles? Chevron down icon Chevron up icon

We try to ensure that all books in Early Access have code available to use, download, and fork on GitHub. This helps us be more agile in the development of the book, and helps keep the often changing code base of new versions and new technologies as up to date as possible. Unfortunately, however, there will be rare cases when it is not possible for us to have downloadable code samples available until publication.

When we publish the book, the code files will also be available to download from the Packt website.

How accurate is the publication date? Chevron down icon Chevron up icon

The publication date is as accurate as we can be at any point in the project. Unfortunately, delays can happen. Often those delays are out of our control, such as changes to the technology code base or delays in the tech release. We do our best to give you an accurate estimate of the publication date at any given time, and as more chapters are delivered, the more accurate the delivery date will become.

How will I know when new chapters are ready? Chevron down icon Chevron up icon

We'll let you know every time there has been an update to a course that you've bought in Early Access. You'll get an email to let you know there has been a new chapter, or a change to a previous chapter. The new chapters are automatically added to your account, so you can also check back there any time you're ready and download or read them online.

I am a Packt subscriber, do I get Early Access? Chevron down icon Chevron up icon

Yes, all Early Access content is fully available through your subscription. You will need to have a paid for or active trial subscription in order to access all titles.

How is Early Access delivered? Chevron down icon Chevron up icon

Early Access is currently only available as a PDF or through our online reader. As we make changes or add new chapters, the files in your Packt account will be updated so you can download them again or view them online immediately.

How do I buy Early Access content? Chevron down icon Chevron up icon

Early Access is a way of us getting our content to you quicker, but the method of buying the Early Access course is still the same. Just find the course you want to buy, go through the check-out steps, and you’ll get a confirmation email from us with information and a link to the relevant Early Access courses.

What is Early Access? Chevron down icon Chevron up icon

Keeping up to date with the latest technology is difficult; new versions, new frameworks, new techniques. This feature gives you a head-start to our content, as it's being created. With Early Access you'll receive each chapter as it's written, and get regular updates throughout the product's development, as well as the final course as soon as it's ready.We created Early Access as a means of giving you the information you need, as soon as it's available. As we go through the process of developing a course, 99% of it can be ready but we can't publish until that last 1% falls in to place. Early Access helps to unlock the potential of our content early, to help you start your learning when you need it most. You not only get access to every chapter as it's delivered, edited, and updated, but you'll also get the finalized, DRM-free product to download in any format you want when it's published. As a member of Packt, you'll also be eligible for our exclusive offers, including a free course every day, and discounts on new and popular titles.