IBIS 2010 Beach view

This year’s InfoSol Business Intelligence Seminar (IBIS) was just packed with high quality and in-depth boot camps and seminars covering Xcelsius, Web Intelligence, Crystal Reports, Data Services, BO XI 3.1 Administration and lots more. It was also located at the beautiful Ritz Carlton, Dana Point on a bluff overlooking the Pacific Ocean which was the perfect remedy after a day of absorbing tons of knowledge.

The Welcome reception on Sunday night, entitled “Seeing Beyond Business Intelligence” was set in the Solutions Showcase area where sponsors demonstrated and discussed some of their latest business intelligence solutions.  I delivered the keynote the following morning on the same “Seeing Beyond” theme and highlighted some interesting business intelligence customer case studies.  The keynote on the Tuesday from Santiago Becerra, CEO of Mellmo, was quite fascinating as he took the audience through “the Evolution of Think” and cleverly demonstrated how putting fun into regular tasks can change people’s habits as well as their adoption of solutions. Showing Roambi, the latest business intelligence solution for the iPad, really brought the point home well.

The 2010 Best Xcelsius Awards demonstrated how far many companies have come in applying Xcelsius in very complex and powerful applications and inspired many others to go even further so I would watch out for next year’s awards.

I had the opportunity to meet with many people during the event and dive into some great discussions on both existing challenges in various BI implementations as well as future directions. In general, it appeared that most companies lag about 3 to 5 years behind the latest releases of SAP BusinessObjects and other BI solutions. Occasionally there is some critical new functionality that will compel a company to adopt a new release sooner but that tends to be the exception to the rule.  Many customers expressed that having reliability, stability and consistent performance are more important than most new functionality. Some of the newer solutions like Xcelsius dashboards and Roambi mobile business intelligence appear to circumnavigate this pattern since they can often be deployed and highly effective outside of the main business intelligence and production applications. A further big factor here is cost as many companies are more hesitant, due in part to the recent global recession, to spend large amounts of time and money on new software until they have conclusively proven a solid return on investment. For this reason incremental software purchases and pilot projects have become very popular in the BI space.

This was evident at IBIS as customers expressed a lot of interest in Xcelsius, XDM, Roambi, XWIS, GMaps, 360View, Version Manager and SAP BO EDGE solutions for very specific business issues and needs.

All in all, IBIS 2010 was a great BI gathering and information exchange and continues to grow in popularity. A couple of lucky attendees won iPads and a couple of not-so-lucky attendees dropped their phones in the ocean, but judging by the feedback everyone can’t wait to do it again.

Here are a few of the comments received back on IBIS 2010 :

“The IBIS conference was terrific this year.  I can’t wait to incorporate write-backs into our dashboards, and InfoBurst 2009 with dashboard bursting opens new doors for delivering customer information.  I also really enjoyed Aluchemie’s customer demo with all of their challenges they had to overcome!”

Kim Marshall, Waldinger Corporation

“I wanted to commend you and your team on the wonderful seminar.  My colleagues are very enthusiastic about their boot camp and the knowledgeable instructors they have met. You and your team have been wonderful throughout the past few days and everyone’s terrific attitudes have made the seminar a great success”

Melinda Dennis, Aluchemie

When asked, “What was the best part of the seminar for you?”, here are some of the responses :

“User Panel – excellent recognition of organizations with creative solutions”

“The class time. The first time I have ever been to a seminar where I was asked right from the beginning to reverse engineer an example”

“ The chance to talk and network with pros, find out what SAP doesn’t tell you about the product and get the best practices from people who have been in the trenches”

“…invaluable talking with other companies and knowledge sharing”

“… the workshops were excellent and very exercise intense so there was no boredom factor”

“Meeting with other users of the tools – It is a great way to get new ideas”

“The tips on real life best practices were extremely valuable – something that you cannot always get from other conferences”

“Size of the event led to good instruction and interaction”

“The training far surpasses any other training in the BI field. InfoSol has created a habitat for intensive training efforts at an economical price”

“The fact that I am learning things that are actually going to help me solve current problems – which also helps me sleep better at night”

In this blog I will discuss 2 methods, both of which are valid and are useful ways to organize dashboard data.  Deciding as an organization which approach you adopt can help with the process of taking up someone else’s project. 

 Some Xcelsius developers like to use a method of having all the data that is being used in the dashboard on one (or more) tab/s of the Excel spreadsheet, and then as you need to use data for display, using a series of vlookups or match & index functions for displaying data on charts, which they layout on other tabs of the spreadsheet.

My preferred method is to spread the layout in such a way that the names of the Excel tabs generally correspond to the functional area on the Xcelsius dashboard, perhaps even the same name of the Xcelsius  tab (Either the Tab Set Container or the Label based menu, is what I’m thinking of), so that all the data being expressed on that “page” of the dashboard is on one tab in the Excel spreadsheet behind the scenes. 

I like to have the data insert & any manipulations I have to do for expressing that data nearby the loaded data, so that it is all in one place & I can find it easily.  The only difficulty with this is when you have many components on one “page” or you have to create several aggregate levels to display.  Spreading it out & spacing it can become an issue, and this is where again, labeling the spreadsheet is so important.  (But aren’t we glad that if we move data around on the spreadsheet that the links follow, for those of you who have been using Xcelsius since the 4.5 days!). 

This approach, of course, assumes you have the aggregated data to work with!  Which leads back to my previous blog regarding data connectivity options.   If I have to use QaaWS, I end up having to do a lot of manipulation in the universe to get the data to look or be ordered the way I want to use it in Xcelsius.  I usually have to end up making many of what I call, “dimensionalized measures” when I want to end up with a crosstab result.  So I have a measure for Jan Sales, Feb Sales, etc.  Very tedious.  Sorting is another  issue that is often easier addressed in the universe, but also can be labor intensive.  

Live Office gives me the option to create crosstabs and sort the data in any way I wish and I can also have multiple tabs to aggregate the data at different levels (YTD, MTD,  past 30 days, etc).  The problem that I so often bump into with this approach is the amount of data when we get down to the detail level.  We have all experienced poor performance any time we go over the 512 row default and horrible performance when we approach 1000 rows. 

All of these are reasons why I enjoy using the InfoBurst XDS or XDM option, as it addresses all these issues, plus gives me many more options.  The Intelligent Cache syntax of this tool is by far the most exciting feature, in my opinion.  Using their syntax, I can pass parameters to the XML url call and only return the rows of data I wish to display.  For example, within my xml url call, I can add syntax that returns …. YEAR=2009;DIVISION=HPD;DEPT=23.  This ability to extract just the rows of data I want to display helps keep my dashboards very responsive, since I am not loading it down with too much data.  It also gives me the ability to go to a much more detailed level than I would have been able to with QaaWS or LiveOffice.

XDS or XDM also has syntax to return unique values of a particular column from an xml data set which I can use for  my selector.  My selector will always have accurate values, as it is loaded from the current xml cache, rather than from a hard-coded list in my Excel spreadsheet which may not be up-to-date.

And, I have the flexibility to create these large XML data sets from a Web Intelligence document or by writing a query, directly to the database, or even from an Excel spreadsheet, and any combination of all three!

This is a brief summary of the differences between these 3 options which may be helpful.

QaaWS is a BusinessObjects web service that access BusinessObjects universes (and only universes) to pull back data.  Each time a dashboard is opened and selections are made, a real-time query is launched against production data, which, depending on the amount of data requested, can take many long seconds or minutes.  I have not found it to be very effective, and the few companies that do use it, have highly summarized tables in their data warehouse to use for this purpose (i.e. lots of preparation work).  The only upside I see to this method is that security is already in place based on BO user ids, and, real-time data retrieval (if that is the requirement). Large amounts of data (i.e., more than 500 rows of data) returned by the web service will significantly slow down the performance of the dashboard.  

With Live Office you can access Web Intelligence or Crystal reports as your data source and use the functionality of these reporting tools to summarize, crosstab and format your data.  The advantage is that you can schedule these reports to refresh in BO (InfoView) and then use the latest instance of that report for your Xcelsius data source, without waiting for it to refresh.  The disadvantage is that it requires users to log into BusinessObjects every time they access the dashboard.  (Supposedly you can use single-sign-on with this, but I have not seen it working anywhere).  Obviously, if you want to deploy this solution outside of BusinessObjects, like hosting the SWF file on SharePoint or an Intranet, most companies do not like having to sign on again.  Also, it would not work if you want to deploy outside the network (outside a firewall).  There have been many posts on the forums about the “flakiness” of LiveOffice, often losing connections and unable to refresh reports.  Since Live Office has to hold the data in the Xcelsius spreadsheet, the amount of data returned will have a negative impact on dashboard performance.  This last item has been the biggest barrier to our customers, who often wish to show granular data in their dashboards, or a significant amount of historical data.

InfoBurst XDS and XDM were designed to overcome these obstacles.  XDS can use Web Intelligence or Desktop Intelligence reports as data sources for pulling data, which it can refresh overnight (based on a schedule) and convert this data to xml.  XML is the fastest way to load data into Xcelsius.  XDS does not require a BusinessObjects login.  XDS also has the option of accessing a database directly (any database that can be accessed via an ODBC connection) through SQL queries, which can also be scheduled and converted to XML.  XDS also provides options for distributing the dashboard (putting on a network share, an intranet site, or as an email attachment or embedded in an in-line html email).  The biggest advantage, though, is the Intelligent Cache feature which allows dashboard developers to “cache” a very large set of data (I am currently working on a data set of over 18,000 rows of data), and then pass parameters through the xml code, based on selections the user makes on the dashboard, which then returns the small data set needed for that particular chart.  (On the above example I am passing parameters, based on drop-down menus, for Division, Plant, Department, Day and Shift, which returns the 6 rows of data I need to display – shift hours per day per Department.)  Since the dashboard is only loading these 6 rows of data, obviously the performance is very fast.    We recently converted a QaaWS dashboard where the data loading time when changing customers went from 2 minutes or so to less than 10 seconds, using Intelligent Cache filtering.