SQL SERVER – Brief Note about StreamInsight – What is StreamInsight

StreamInsight is a new event processing platform introduced in upcoming version SQL Server 2008 R2. Similar to other components such as SSIS, SSAS or Service Broker, it also needs to be installed along with the SQL Server.

Up to SQL Server 2005, Microsoft’s main focus on SQL Server was to build a platform to efficiently store, manage, and retrieve data. However, now, Microsoft enhanced SQL Server to accept, monitor, and respond to complex and high number of events in near zero latency. For this, Microsoft introduced StreamInsight using the following approaches:

  1. Continuous and incremental processing of unending sequences of events.
  2. Lightweight streaming architecture that supports highly parallel execution of continuous queries over high-speed data.
  3. The use of in-memory caches and incremental result computation provide excellent performance with high data throughout and low latency.
  4. Low latency is achieved because the events are processed without costly data load or storage operations in the critical processing path.
  5. All processing is automatically triggered by incoming events. In particular, applications do not have to incur any overhead for event polling.
  6. Static reference or historical data can be accessed and included in the low-latency analysis.

In StreamInsight, the events are processed by a CEP (complex event processing) Server. CEP Server has its own optimizer and standing queries to handle events optimally in real time. In simple terms, we can understand it as given below:

SQL SERVER - Brief Note about StreamInsight - What is StreamInsight streamlight

This architecture is designed to process up to 100,000 or even more events per second.

Following are few areas where this new platform would help in monitoring, mining, and analyzing the data in motion and in providing significantly more informed business decisions in real-time:

  • Manufacturing process monitoring and control
  • Clickstream analysis
  • Financial services
  • Power utilities
  • Health care
  • IT monitoring
  • Logistics
  • Telecom

Another important thing about StreamInsight is that the developers do not have to learn any new language to implement it. Its CEP Server (standing queries) can be created in LINQ (Language Integrated Queries), while the event Source application and Target application can be written in Microsoft .Net language. By using LINQ, developers familiar with SQL will be able to quickly write queries in a declarative fashion. Its deployment is also simple with flexible methods such as integrating in an application as a hosted DLL or running as a stand alone server through a wrapper such as an executable or windows service.

Reference: Pinal Dave (https://blog.sqlauthority.com)

DBA, SQL Documentation
Previous Post
SQL SERVER – Find the Size of Database File – Find the Size of Log File
Next Post
SQLAuthority News – Converting a Delimited String of Values into Columns

Related Posts

8 Comments. Leave new

  • its wonderful blog. i get extra knowledge. thanks….

  • Does anyone used this new feature at their work? If they share their practical experience will be a great contribute.

  • My Sincere thanks to Pinaldave. Great article. Nice to know about the new features of SQL Server 2008.

  • I was trying to get the RSS Feed for this website but it is not properly displaying in Google Chrome. Does anyone have any ideas?

  • Hi pinal,

    Thank you for giving This much of source

    Thank you


  • Every time a search something related to Databases or MS Sql Server or now StreamInsight I find your blog :).

    It’s great. Keep doing the good job!

  • Hi Pinal,

    We are in the process exploring Sql service notification service for Biztalk BAM alert, Can we use stream insight instead of notification service.



Leave a Reply