Profilo di MichaelMichael's BI SpaceFotoBlogElenchiAltro Strumenti Guida

Blog


23 agosto

Random Flights of a Black Swan

I'm busy reading http://en.wikipedia.org/wiki/The_Black_Swan_(book) which is pretty interesting seeing that the author openly acknowledges that he makes his money from the trading game.
In summary - Nassim_Nicholas_Taleb promotes the idea that humans cannot predict the major / minor events which really impact our lives - that we focus too much on daily trivia - and that we look to 'experts' or glance backwards for understanding instead of existing closer to the chaos factor - where imagination is uber alles.
 
I agree with him - and yes, we've seen the emergence - and oft quiet decline of the 2012 theories (The Inca's and Terence McKenna's World Time Line), the Web Bot project, and some of the New Age postulations on the Reality Carnival site - and the flipside to that coin with conspiracy theory sites all providing positive proof on past events and how 'we should have known'.
Logic to me is like music - whatever seems to make sense and work for the moment, is a truth of sorts!
 
One has to note that Nassim_Nicholas_Taleb is not discounting event patterns or disputing certain cycles - just that any predictions, no matter how concise can, and oft do, get horribly skewed due to an unforseen event.
 
Statistics have been in existance almost as long as merchants started ocean trading prescious commodities and is typically based on a cover your ass/et method, by knowing all possible risks and upping the price accordingly so as to spread a very possible loss.
Predictive Analysis is the holy grail of most BI projects, but if it were such a precise science, we'd be living in another dimension where the chaos factor would be non-existant and life would be pretty bland.    
                                                                                              -----------0101----------
Instant SOA anyone? http://www.tusc.com/oracle/technology/wbmcusdev.html          
 
21 agosto

Trends

Every once in a while I use http://trends.google.com/websites?q=www.cognos.com%2C+www.pentaho.com%2C+www.businessobjects.com%2C+www.sas.com&geo=all&date=all&sort=0 to have a quick look at the demographics of some random web patterns.
Sure - it's not a precise science, but the interesting metrics are the country activity graphs, and how the overall individual visits for each site all appear to follow a generic pattern with an increase in activity at the third quarter and then a total slump over December.
 
But - what's missing from the picture? China obviously, but that's not only due to it's www controls - but mostly related to the language barrier!!
 
The most common used tools from a western perspective are typically NOT used elsewhere where the language is different and/or the net savvy population is not closely aligned to the US re culture, software releases and time zones. Search engines and social networks in eastern europe have taken their own route and methinx I prefer the subcultures over there - I just wish I knew more languages.
There are black holes and alternate universes in this global net - and people exploit this http://www.friedlnet.com/product_info.php?cPath=29_22&products_id=5739&osCsid=28a6f22363adae386fdcaf37d7fda5d1 - nothing wrong with that, but I'm simply trying to prove that it's often what's lacking from the picture that counts. 

On average, Google is subjected to 100 million searches per day, which accounts for close to 50% of all internet search activity.  Google stores each and every search a user makes into its databases.  After a years worth of searches, this figure amounts to more than 33 trillion database entries.  Depending on the type of architecture of Google's databases, this figure could comprise hundreds of terabytes of information, so where is all the rest of the searching happening - and what kind of trends could be had if all the stats were combined ? No news on the Google / Panorama OLAP dance ... 

Unrelated Links:
MS SQL DBA Dashboard http://www.sql-server-performance.com/software/review/dba_dashboard_p1.aspx
Technology behind BO's Event Streaming: http://www.espertech.com/

 

20 agosto

SL (SecondLife - Virtual-ly BI)

Second Life - a virtual world - http://en.wikipedia.org/wiki/Second_Life - is a place I existed in from 2005 to a few months back as Zarn Zond - current access difficult from Kuwait!
Whilst I was there, the likes of IBM and b-eye-network purchased v-islands with which to attempt virtual collaborations and seminar's, along with attempts in creating customer support services - supposedly down to a technical level.
I was working for IBM at the time, but was more interested in 'playing' with a few groups I had joined that were running private businesses, along with the odd demonstration outside some government embassy who's global policies sux! Yup - we even got water cannoned - but, it is a facinating place and I did manage to get a 3 day ban for trolling the vampiric places with a mobile dental lab for oversized incisor extractions ... and made many a v-friend whilst spouting poetry from some stunning view point in SL (yeah - you get sunsets in there too ...). 
   
On learning that Linden Labs runs Business Objects for some of it's corporate reporting, I tried exchanging some free consulting for some virtual land - which didn't happen, but slowly we're seeing some mention in credible places as to taking collaboration to a new level. 
It will be interesting to see how this all pans out ...  
 
19 agosto

The Merovingian factor

The Merovingian's origins predate the Matrix, but some quotes from this movie have struck a cord on more than one occasion: 
 
Merovingian: Yes, of course. Who has time? Who has time? But then if we never *take* time, how can we have time?
Merovingian: Oh, yes. It is true. The Keymaker. Of course. But this is not a reason. This is not a "why". The Keymaker himself - his very nature is a means. It is not an end. And so to look for him is to be looking for a means to do... what?
Merovingian: You see there is only one constant. One universal. It is the only real truth. Causality. Action, reaction. Cause and effect.
 
Being a corporate entity aka Windows or Unix, doesn't stop me from casting the odd envious glance at the Mac world - and the only ownership I have in that realm is a recent purchase of a defunct iPod (30G) which I bought at a souk (market) to use a storage device. The only thing not working is the sound - but I now have a whole stack of 'free' songs, playlists and tv shows etc - and a handy mechanism for porting software and documents from work to home.
I recently joined http://ebookhood.com/catalog and now have a stack of converted books for reading on the bus - including an O'Reilly manual on Web Services,
I have now decided to buy a new functional model - mainly for Podcasts.
Me, like most - quick browse the net and typically either read a full article or download / try some software, but never seem to have enough *TIME* to watch some of the broad/pod/casts from Tech seminars.
                                                                                         http://www.jumpstarttv.com/ 
I was banking on waiting to get back to SA to hand over the soundless iPod and some printout's I downloaded on how to open and fix this known defect to my electronic wiz kid brother - but, why wait - the value of having information on hand - anywhere - is something we try to promote aka event and data streaming to mobiles etc so why do we not apply the same in a personal capacity?
                                                                                      ------------------------------------
 
 
 
18 agosto

Da-Data

Looks like Bill left - and black is back - I like the new decor with the latest 2008 Express release - which has no limit on the download re a time cap etc http://www.microsoft.com/express/sql/default.aspx
 
And where would we be without any modelling tools http://www.codebydesign.com/ and http://www.fabforce.net/dbdesigner4/ and for those requiring some modelling information, if you're just starting out http://www.kimballgroup.com/ and subscribe to the Kimball University subscriptions.
 
But the basic rules can be broken down into:

1» Get Business requirements.
2» Create High Level Conceptual Data Model.
3» Create Logical Data Model.
4» Select target DBMS where data modeling tool creates the physical schema.
5» Create standard abbreviation document according to business standard.
6» Create domain.
7» Create Entity and add definitions.
8» Create attribute and add definitions.
9» Based on the analysis, try to create surrogate keys, super types and sub types.
10» Assign datatype to attribute. If a domain is already present then the attribute should be attached to the domain.
11» Create primary or unique keys to attribute.
12» Create check constraint or default to attribute.
13» Create unique index or bitmap index to attribute.
14» Create foreign key relationship between entities.
15» Create Physical Data Model.
15» Add database properties to physical data model.
16» Create SQL Scripts from Physical Data Model and forward that to DBA.
17» Maintain Logical & Physical Data Model.
18» For each release (version of the data model), try to compare the present version with the previous version of the data model. Similarly, try to compare the data model with the database to find out the differences.
19» Create a change log document for differences between the current version and previous version of the data model.

 
Then for a very nice vendor independant SQL editor http://www.aquafold.com/
 
Portals - Liferay won the 2008 OS award http://www.liferay.com/web/guest/home 
 
15 agosto

BI-Can-D

Info Visualization aka Eye Candy is appearing everywhere these days with some amazing 'flash' technologies.
Most BI practisioners would question the practical applications of these 'pretty toys' and immediately ask: "Can you drill down into the data?".
That might be relevant to your average data churners, but one should acknowledge that 'BI' slid out of the confines of the big corporates quite some time ago to romp around with collaboration, open source, emerging technologies, marketing, crm, mobiles etc
There are no boundaries any more - just technical challenges in selecting the right mix of components and solutions to provide a stable core platform, as well as a possible edge to leverage information quicker and easier than every before - and the human eye is configured for info retrieval far beyond the usual nums and chars - colour and patterns provide a whole new realm to trigger decisons and responses - so it's about time we matured away from those icky green/yellow/red speedometers  
 
And just to appease the forrester wave riders - here's one from the 'big 5'
 
 
And the recent 'cloud' failures (skype ..) has people looking back at P2P when they should be looking forward to http://www.readwriteweb.com/archives/goodbye_p2p_p4p_is_coming.php whilst remembering that sure, Rome wasn't built in a day, but don't have anyone let you think that the eqyptians carved and dragged all those rocks over to stack them up into pyramids http://www.livescience.com/history/070518_bts_barsoum_pyramids.html
 
 
 
Aside - it's the Middle East - Friday is Saturday / Sunday is Monday - something you forget when working until midnight to kick some sense into a bunch of outdated installations that all packed up after applying a hot fix - and then waking up at 05h00 to bus into work only to discover that something is amiss when no one opens up the kitchen to make coffee .....  might as well stay and re-install then (i'm going to dye the blonde out one day !!)   
14 agosto

BI Reviews

The industry predictably swings between magic quadrants http://www.gartner.com/it/products/mq/mq_ms.jsp and waves http://www.forrester.com/Research/Document/Excerpt/0,7211,44724,00.html for a 'generic' review of the BI Industry re the leading vendors.
These reports - enlightening from a 'completeness' perspective are not free - and I wish they would have trend graphs displaying the amount of purchases and buyers as I strongly suspect that it's mainly tech sites / vendors and paid bloggers that make up their core customer list.
 
I'll reserve comments as to the classification process, and give the tech writers muchos credit for creating a rating system with leaders, whilst basically blowing trumpets for everyone.
 
Here's a free review if you also don't want to buy the pdf - or search - there are many 'reviews' from the 'buyers' hitting all the prime time sites lol.
 

Project Planning - Documents et al

We all hate it and most of us have to deal with MS Project at one stage or another.
A word of advice - get your organisation onto MS Project 2007 asap! It has some really good pre-packeged reports and, get this, it even generates it's own DATA CUBES to report off of.
The best trick one can learn with MS Project is how to use the '4 quadrant' view to sort out over allocation of resources - I'll see if I can add a snapshot tomorrow. 
 
Being an Open Source advocate, I've tried a few alternatives but the problem is that not many will feed off of, or translate to and from mpp's.
This http://open-source-project-management-tools.blogspot.com/ is a good idea - it just seems to have stalled -I know of, or have tried most of the solutions listed there and there are always emerging solutions worth keeping track of http://openproj.org/openproj .
 
I have my own template library that contains documents and proecdures for most IT activities as there is nothing more frustrating than having to design project documentation from scratch - and Bill - oops, isn't he giving up work to pursuit a Branson life style? - didn't put much effort into the Microsoft Templates - I just bought a bootlegged dvd of all of them and they are pathetic - you get what you pay for, so thank heavens I hit the black market in this instance.   
 
And then some projects need to extend beyond internal management into collaborative space - http://blog.pandion.be/2008/07/open-source-project-management.html
11 agosto

BI Galaxy

+3 years in a Marriott in the US got me addicted to http://www.ufc.com/ and here in Kuwait I once again have access to live broadcasts!
 
I grew up practising Judo - the usual Bruce Lee movie influence, but there was no Jeet Kune Do on the SCoast of Africa. I then encountered some practical self defense in the SA military with your usual hand to hand type of training, and then met some guys from a special unit that used to mix their various trained and untrained fighting backgrounds.
I learnt very quickly that if you are not naturally aggressive - you need training, so I joined a traditional style on leaving the military - JKA Shotokan.
Moving up to Johannesburg I was fortunate enough to meet some chinese guys - in IT - that were training in Kobujutsu and Tai Chi, as well as someone living close to me that was training in Kenjutsu and Ninjutsu. This was an amazing time as the martial arts world was still very much a PURIST institution and the only mixing of styles was happening in places that did not advertise to the general public, underground fight clubs and individuals on a quest for knowledge expansion. 
 
It took many years and the demise of the heavy Weight Boxing league(s) to get MMA, UFC etc to where it is now.
 
Why the martial arts blab - well, it struck me (sic) last night that there will always be the PURISTS who serve the general conservative population, and then the fringe groups of UNCONFORMIST dedicated practitioners who's heart and soul are committed to the pursuit of knowledge across any and all boundaries. 
 
There is always a place for both, and as someone that has his wallet in the sector that uses the most well known technologies, but his eye and a sliver of his soul out on the fringes of this rapidly expanding BI Galaxy, I hope to always be able to encounter those sites that are off the beaten track.
Some will stay where they are, some will move on, to either colonise a new place, or to continue reaching for those black holes out on the frontiers of thought .... and technology.
Never foget the basics and always look inward and outward to keep your balance ..
 
 
06 agosto

Best of Open Source Awards - BOSSIE

The list is out and it's gratifying to see the momentum behind something that the industry is severly lacking after all the big vendor consolidations.
 
Don't get me wrong - I don't see Open Source is an alternative for all the mainstream solutions that we see going though their own metamorphisis.
What's we're seeing is a long overdue separation of BI and Reporting. Many endeavors have used an unholy definition of BI to encompass all reportable entities via third party tool sets and it's created many misconceptions in our industry.
Real Time BI is simply reporting - and yes, it does form part of the overall view on corporate data, but it reminds me very much of my Cobol/CICS days of reporting off banking transaction systems - and it's operational reporting that we're seeing heading up the SOAP and Web Services outreach programs.
 
Where Open Source is really coming into play is for the two extreme ends of the BI spectrum - those that know exactly what they want and have had enough exposure to BI methodologies and tool sets, and those that are entering it with minimal experience and lots of excitement.       
04 agosto

Intelligent Documentation

I recently had a memory stick stolen that contained a Development Life Cycle word document that I had spent about 2 weeks creating.
This had me re-evaluate the task of recreating it and I decided to rather adopt a different approach - to use an alternative that I should have considered a long time ago.
 
 
This is actually amazing - you can create expandable tree nodes that can be used to logic branch out in a procedural path to define all the steps required for any number of processes - AND - you can have nodes link directly to a specific document / web site / send mail etc.
 
The absolute beauty with this is that you can collapse the entire process onto itself and then expand only those nodes that you need to i.e. a hell of alot more efficient than trying to wade through a 'top down' structured document.
Sure, there are content management systems out there - some expensive (MOSS) - others free ( http://drupal.org/ ) - but I've been itching for a valid reason to use FreeMind - or MindMap as it was when I first encountered it - and am really excited as to the practical application of this.
You can share it in browse mode via a web link - untried for me - but I hope to throw this on a server ASAP.
 
And - something that I have been bitchin about forever - here is a product suite that uses it's own technology to help you - the help document is RADICAL as it comes in a mind map format!! How many vendors do you know that actually use their own technology to deliver their solution?
 
Hint: File / Open to get to their mind map manual, and simply use that as your template - it contains almost all features in one mega map .......
 
--- I have a bunch of BOBJ ( http://www.forumtopics.com/busobj/index.php ) forum members that have been waiting for my XI 3.0 Dev Life Cycle document - they're gonna be a tad suprised re the format methinx lol
         
31 luglio

ED-BI & RT-DWH

There is a quantum shift about to happen with the realisation of Real Time DWH and Event Driven BI i.e. we're beyond generic SOAP discussions.
 
I just had a look at SAP/BussinessObjects Real Time 'Cloud' - http://labs.businessobjects.com/edbi/default.asp 

What really got me thinking was the fact that the underlying technology behind this is kinda buried half way done the blurb - and is only mentioned due to a license mention i.e. the Wiki link is fine for generic explanations of event clouds, but I would have thought that one would be far more interested in the technical data sheets from the company that developed the software? http://www.espertech.com/

There's more - Esper promotes BIRT for it's reporting lol ...

 
This was a response of mine to a question about traditional type reporting off large Transactional Databases:
 
For exteremely large 'Data Vaults' - look at Teradata - or alter your thinking re storing 'everything' in a typical ODS/DWH scenario.
i.e. this topic makes me think of two shopping scenario's - a bachelor walking down the aisles with a trolley grabbing what he thinks he might need, compared to a women with a basket and a list that knows exactly what she wants and how much each item should cost.

It all goes back to requirements and costs - anything is possible these days with the technology that's available and the old debates around ODS/DWH/EDH/ETL/Star Schema etc are busy being shaken up by architectural changes that are revamping DWH and BI as we know it.

"Real-time is anything that is too fast for your current ETL" - Ralph Kimball.

Newcomers to DWH should be discussing CTF, SOA (yeah I know - last years buzzword), MBETL, SETL, EII and Step Dimensions etc.
 
 
Enterprise Magazine sums it up:
"The real future of BI involves both historical and current data being deployed in operational process contexts. We'll have to deal with simultaneous query and loading, event-based as well as query-based access, and analytical workloads balanced against high concurrency low-latency queries."

But closer to reality is the DatAllegro purchase
http://www.dbms2.com/category/products-and-vendors/datallegro/
28 luglio

Monitoring Tomcat on Windows 2003 SP2 & BO XI3.0


Posted by MikeD on BOBJ: Thu Jul 24, 2008 12:29 pm 
Post subject: Tomcat - Java Heap & Monitoring
 

Windows 2003 SP2

I installed the latest BusinessObjects XI 3.0 but used a pre-installed version of Tomcat 5.5.
Encountered java heap memory issues after every 3 to 5 document refreshes. I tried both CATALINA_OPS and JAVA_OPS and a few other java options - the option below has only behaved for a while so we shall see.

Java Heap
Finally settled for just using the java console:
Right Click on the Apache Tomcat icon (right lower corner)
Select Configure..
Select Java tab
Enter Initial Memory Pool: leave blank
Enter Maximum Memory Pool : 1024

While here, scroll down in Java Options and Add
-Dcom.sun.management.jmxremote
(JMX memory monitoring from http://tomcat.apache.org/tomcat-5.5-doc/monitoring.html)

Monitoring
Download Probe Binary http://www.lambdaprobe.org/d/download.htm
Unzip into an XI war directory:
C:\Program Files\BusinessObjectsXI3\deployment\workdir\tomcat55\application
C:\Program Files\BusinessObjectsXI3\BusinessObjects Enterprise 12.0\java\applications

Open http://localhost:8080/
Click Tomcat Manager - apply admin id / password
Scroll to last option - War File To Deploy
Browse to probe.war in XI war directory
Click Deploy

Restart Tomcat and you now have a really cool application to use on Tomcat  as it has quite a few tab options and the memory graphs reload every few seconds - very clean / slick pages as well.
http://localhost:8080/probe/index.htm

I also have Server Performance Advisor installed with system scheduled snapshots running every 20 minutes whilst testing the system.
That way you have a record of ALL activity re the OS and memory etc.
Yup - if you have Tivoli or an efficient sys ops crowd you can get them to monitor these things, but I have to use what I can get my hands on.
ServPerfAdv is a Windows utility and can be downloaded from http://www.microsoft.com/downloads/details.aspx?familyid=61a41d78-e4aa-47b9-901b-cf85da075a73&displaylang=en
21 luglio

BI Impact - Migration Work Forces

This is a topic that most steer clear of, but it's always at the forefront of people's minds with respect to Outsourcing - specifically in the IT and BI industries.
I've had the experience of working with some of the major cultural groups that are expanding so rapidly across the planet, and have taken part in more than one initiative in training them up as my eventual replacements.
I've been fortunate enough to know quite a bit about their cultural histories as I grew up next to a Hindu community in South Africa and have also spent a number of years training and hanging around with some Chinese / Muyanese martial arts friends.
   
On an objective level - I don't have a problem with ousourcing as it is a market indicator as to the maturity of our sector. Gone are the days when a few generic or very specialised people had to stretch their skill sets from the deep dark well of technology, up to the neon lights of the business.
Business Analysts, Data Architects, Project Managers etc have all supped from the BI cup, so we are now seeing a return to organisations having enough skill sets on board to be able to segregate out the more repetitive, or one off development work that can be easily managed on a component level.
 
To my mind there are a few very obvious reasons why the west wil not be able to emulate or challenge these emerging cultural entities on the same premise.
Apart from the very obvious exchange rate factor in being able to accept far less, that still equates to a whole more, than everyone else back home, it's the sociological factor  that provides most of the underlying structure for them to be able to operate in foreign climes - oft at more of a disadvantage than the local, and/or other cultural groups.
TRIBAL - one of the first things relative freedom and independant wealth brings, is the break down of tribal structures. I won't get into a generic debate as to whether this is good or bad as we are currently living in a time where humanity has to take some serious steps to either, rectify or expand upon the intial utopia of said freedoms.
Emerging labour markets are driven by both desire and fear that far surpasses that of most established cultures and modern business communities. There is no comfort zone and anything goes with respect to skill, software or employment aqcuisition. I don't mean this in a negative context - it is what it is - and every industry goes through the same cycle(s).
The drive to succeed, sometimes in a hostile environment, is counterbalanced by the age old migration work force method of bonding - where migrant workers typically band together to share costs, knowledge and to generate a level of cultural comfort with fellow countrymen/women.
We see Europe battling to manage the cultural silo's (ghetto?) that sprang up from the importing of cheap labour forces - in many cases these communities did not integrate or embrace their new countries at a level that their hosts hoped for.
In the industry this should never really happen as it's all relative to FINANCIAL FREEDOM - and for many, it's not a case of fleeing tyranny or absolute poverty, but rather one of acquiring a monetary stake to bypass some of the lower rungs of the capitalistic ladder.
Something most of us have done at some stage of our careers.
 
Walking around a Kuwait City suburb last Saturday - known for it's relative 'freedom' with respect to copyright laws - and being a mainly pakistan and indian neighbourhood - I encountered groups of young men - gathered in small shops - around technology of every imaginable kind - and I marvelled at the enthusiasm and drive in being the only techies around at that time of the morning ....
 
I also saw a version of Crystal Reports - bootlegged for KWD3 .......
17 giugno

Migrations and Upgrades - Where to start

With the amount of documentation that most vendors dish out with new software releases, it's suprising that most don't provide a concise actionable checklist of all thinsg that need to be considered prior to just wading in.
Those that do - let it lie in the pdf swamp with all the other tomes.
Sitting here at another site that's tentatively started an upgrade, I started looking at the existing Development / Test platform and wondered how many consultants end up pondering who to ask, and what to read, to try and get a grip on things.
Stuff that - if there is no architecture document, or project plan - start from scratch with a document listing all possible enhancements and features in a matrix type format.
This can then be used to start eliminating questions and paths that have already been discussed and determined, as well as identifying area's not covered.
Those of us with a technical bent just LOVE to just start installing like crazy just to get it all up and running as quick as possible - understandable really as it's the only time it's ALL YOURS. No users, no activity - a virgin field of virsimillion flowers to caper around in - always wanted to use that word combo ...
But then we have to get dragged screaming back to getting it all ready for the real world - and it's never just about making it work - uh uh!
With new features getting thrown own in increasing rates, in many instances there is a new WORKING METHOD that has to be shoved down the users throat in order to effectively utilise the new beast.
Disregarding that is an effective way of just wasting money and demoralising everyone. Bad Habits are exactly the same as Daily Habits - hard to change and even harder to replace. The only way to effectively take on new functions is by warning and educating the business WAY UP FRONT when those dvd's arrive - or at least download the documentation before the software packs so you can start putting a hitlist together for them to see what's coming - oh yeah, project manager's can then start salivating at the actionable items in your list !!
 
Good Luck .....     
 
11 giugno

Consultants versus Specialists

I oft ask BI 'people' how they describe their profession - within and outside the organisation.
This illicits all sorts of responses, ranging from DWH developer, through to BI Consutant and beyond.
Throw in the company's job description, and you then have an interesting conversation that actually says alot about a person. 
 
I've even been chastised for raising this in a generic corporate mail, prior to a 'Consultants Day'. In this respect, I asked if people call themselves XYZ employee's, BI Consultants or 'Tool Set' Specialists. I did this to help determine the mindsets of the employee's, as ALL were permanent employee's, being used in a consulting capacity.
Nothing wrong with that, but the onus on a permanent salaried employee to deliver on a consultant level is oft disregarded by the company involved. I.e. earning a standard salary and being on the receiving end of a client that is being charged 2 to 3 times your hourly rate, oft and does, cause a number of issues re expecatations - from ALL parties!
 
So - how would you describe yourselves in this respect?
 
People that understand the limitations of tool sets vi sa vi solutions, will generally avoid being 'boxed in' by a specific lable, and rather try to describe themselves in more generic terms - as would people in a dead end choice re the technologies that they are using.
 
DWH and BI are pretty handy lables to throw around, but realistically, how many of us are actually focussed on providing ADVICE as to the best possible SERVICE to the client. Not many get the chance to keep abreast of the ever changing solutions on offer, and now with the vendor consolidation, we are slowly seeing a return back to pure SPECIALISTS.
Sad really - now that the vendors try to enforce a particular 'brand' of the 'one stop shop', we're seeing the demise of free thinking in the BI realm - or are we?!
Open Source is one avenue that still requires a lateral mentality and as much as the vendors would like to think that their solution is Uber Alles - I will onlty believe that when everyone finally throws Excel out ;-)
 
And Moi?
I starting using the term Architect - long before it became popular - it has a nice ring to it and I genuinely believe in trying to advise the client, as best as possible, as to the solutions available to them. Even if it means opening up an oppotunity for another vendor! 
 
That's not to say that you cannot offer an alternaive to 'your speciality' that does not require them contacting your competitor - Open Source anyone ? 
 
If you cannot be true to your profession - then rather use the 'Specialist' lable.           
    
 
01 giugno

Using BI Tools to Lubricate Wheels --- of War?

The BI Tool Set Industry has few competitors when looking around at glistening new paint jobs and shiny wrapping paper.
Sure, the new engine under the old carcass runs better, and the consolidation of functions and additional features are slick enough to have most convinced that we're a vital, evolving cornerstone of any business pyramid, but the sad reality is, that it's business as usual.
I will readily admit that there is a steady stream of excellent examples of 'BI in the real world', that provides some confirmation as to the success of BI Tool Sets, but seldom do I see a constant reminder that these successes were largely due to a commitment of money, people and time.
Tool Sets are a simple mechanism - and like any tool, or toy, they can be applied in a frantic manner to repair something - sometimes that something being totally unsuited to the tool, or even played with and discarded under the flashing lights of an annual ADD tree. Said tree, being the bearer of annual budgets and glowing promises - wo, ho, yo, oh, no. 
 
Be that as it may - I love downloading new versions of 'stuff' and realy wished that I had the aptitude to learn spanish (or is that portugese ...) that I oft see from the open source posters in www.biblogs.com - is Pentaho spanish for something ? (j/k)
 
I work mostly with Gartner's big 3 bunch, but have a sneaky suspicion that the REAL BI work is being done in trenches out in front of the EXCEL front lines.
Must be something to do with having to personally sharpen a trench tool prior to dashing out into the thick of things, that provides a different perspective - one very similar to comparing that of a mortar crew and a common grunt.
Simply throwing stuff out in front is a percentage game - but to win, mostly requires getting dirty and accepting a personal battering for any achievment of a real victory.
 
But - enough of me - here's an excerp from a collection of wisdoms that I compiled into a document some time back (possibly 5 years back.....).
I am NOT the author - and my cut & paste jobs were ruthless enough to omit humans, but it has served as a reality slap before and after those cute early in the year meetings when sparkly things and glowing intentions tend to set up the latter half of the year for a nasty wakeup call ...  enjoy ..
 
BI Tool Sets are used: 
 
To check that "everything" is okay 
Surprise! Nothing will be done with many, perhaps most, of the queries and reports created with decision support tools. They are run to confirm a person's usually not crisply defined notion  but intuitively felt notion of "okayness". If I were able to write the essay on "The Zen of Data Warehousing" (which I will not), I would say a primary function of decision support tools is to support non-action.
 
To confirm the "obvious" 
Most end users the reports and queries are ultimately being produced for have a pretty good gut feel for what is going on in their area of concern. Decision support tools do not tell these people anything amazing that the people don't already suspect. But the information produced with the tools gives them confidence their gut feel is okay. 
 
To figure out how something "works" 
Most people are not looking for some grand Unified Theory of how firm XYZ works. Rather, they want to understand some small aspect of an operation like Customer A always pays on time, Customer B usually pays late and still takes the early payment discount, etc.

To convey information in a more digestible manner 
These tools are often used to convey what a person or persons already know. These knowing people use the tools simply to present information to other people in a way that it is more easily read.

To compare information about customers, products, cost/profit centers, financial accounts
Sometimes this is side by side comparisons of a series of measures. Sometimes this is identification of the most, the least, the earliest, the latest, etc.
To compare the same type of information in different time periods This is simply the usual daily, weekly, monthly, quarterly, yearly comparisons.

To check performance versus formal and informal goals or constraints
That is, measures of what actually occurred are compared with budgets, forecasts, quotas, or some other types of goals.
To identify the out of the ordinary Usually the ultimate consumer of the tool's output has somewhat vague criteria of what is out of the ordinary. The decision support tools kind of do double duty in that they help refine the criteria of what is out of the ordinary and identify what fit the refined criteria of out of ordinariness.
 
To grab a little piece of information out of a large volume of information
These tools make picking that virtual needle out of that virtual haystack a lot simpler.

To get around an Information Technology department that does not have the time or the resources to write reports
Often end users use these tools out of impatience with the IT department. Or, the IT department gives the user these tools to relieve the pressure off of itself. The end users in these cases often write reports that could hardly be called analyses.
 
To provide a report "of record" 
For all kinds of reasons it is often necessary for people to agree that "these are the numbers". Note they do not have to agree on all the data - just some data whose credibility must be accepted for actions to be taken. Decision support tools often are used to produce this "official" information.
 
To confirm and sometimes to discover trends and relationships
With all respect to the people working hard on data mining, I think that most good businesspeople have an intuitive feeling of the most important trends and relationships between factors that are affecting their business. The decision support tools perform the function of confirming their intuition. Yes, the tools also can help discover trends and relationships but it is difficult (though potentially profitable) to sift out the meaningless and spurious trends.
 
To help advocate a position
These tools are not just for "objective" presentation of the facts. Often they are cleverly used to help bolster the case for doing (or not doing) something.

To provide data for a what if analysis or a forecast
That is, the tools are used to feed data into a spreadsheet where the actual what-if analysis or forecast will be done. The tools can do some of the what-if-ing and forecasting themselves but most business users are more comfortable doing this work in spreadsheets.
29 maggio

IMM - Information Maturity Model Levels

                                                                                                                                                                                                                                                          
                                                                                                                                                                                                                                                               
IMM Level Numbers - Function Type & Access Strategies Based on Presentation

  1. Make it Happen                     Transactions Primary Batch with Predefined Queries Data Hardcopy
  2. What Happened                     Reporting  Increase in Adhoc Queries and Electronic Information
  3. Why did it happen                 Analysing  Analytical Modelling Grows Analytics Desktop - Excell, Access
  4. What will happen                   Predictive Continuous Update & Time Sensitive Queries Gain Importance Data Warehouse & Data Marts
  5. What is Happening                 Operationalize Event Based Triggering, Trend Analysis, Data Mining, OLAP Exceptions, Trends Portals, Dashboards
  6. What do we want to happen   Collaborative Predictive Modelling Engines Portlets
  7. How do we do it                    Closed Loop
  8. What should we do next         Foresight Action

The Zen of a Regional BI STrategy

 

“When the rate of change outside exceeds the rate of change inside, the end is in sight.”  Jack Welch, CEO, GE 

 

 

The Rules

A strategic document, must define a strategy or process.
Do not attempt to elaborate on the sub components or try to educate or influence the audience with recognized industry principles or new technologies.

 

The following underlying principles should define your document.
The benefit(s) of this strategy to the recipients/organization.
I.e. there is a motivating principle or strategy that you want the organization to adopt.

The BI industry continues to provide strategies and methodologies that should be continuously reviewed, and where applicable, adopted to influence your orgs initiatives. The reason for these continually changing methods is based on the principles of experience feedback loops and the fact that globalization is breaking down industry silos and communities are becoming more hybrid by nature.

As author and representative of a local, or regional BICC (Business Intelligence Competency Centre), you advocate the ideas and principles in taking ownership of this strategic role.      
The BI Dpt wants the organization to understand the role of a BICC, and to acquire the responsibility of this pivotal role, be it within a global, regional or singular organization.
Make this YOUR objective of the document.
Provide a high level, draft strategy on how the organization is to accomplish the correct level of IMM (Information Maturity Model) with the use of a BICC.

The Next Steps will be the process of listing specific deliverables that require further detailed investigation and analys.

The primary discipline is to not let the enthusiasm FOR the endeavour, overshadow the benefit OF the strategy when dealing with the Enterprise or Organisation. 

”Once you attach your personality to a proposition, people start reacting to the personality and stop reacting to the proposition” - Harvey Mackay (Swim With The Sharks Without Being Eaten Alive)      

 

 

Strategic Goal
The creation of a strategic framework for implementing BI at a regional level, within a global enterprise.

BICC Responsibilities
Established entity for delivering strategic ways to measure the organisations use of data and business intelligence, and to use that information to help the Steering Committee determine the optimal next steps to enhance and improve the results.

 

The BICC is the hub that enables the INTEGRATION and ALIGNMENT of:

1.      Business Intelligence.

2.      Enterprise Business Intelligence Architecture.

3.      Delivery Approach.

4.      Governance.

Caveat: This department should not be overly technically staffed, as the focus is on the transformation of Data into Information:

  • Data can no longer be managed manually, data is not relevant unless you know how and where to find it.
  • Corporate data sources become an enormous asset, which increases competitiveness when developed and deployed correctly.
  • Corporate and market data represent an untapped corporate advantage.
  • Data needs to be viewed as a process moving through information creation to value creation.

The guiding principles of iterative development, phased approaches and proper planning of task deliverables will enable the department to tap into specific local or regional resources, as and when required.   
 

 

BI Strategy Objectives
The implications of Enterprise AND Regional endeavours should be considered. This will reduce or eliminate redundant and conflicting technologies, as well as ensuring that the correct business prioritisation and ROI is achieved.

The primary deliverable of this document will be the structure encompassing the following objectives:

  • Organizational Readiness
    Alignment to Visions and Strategies
    Organizational, cultural and political alignment
    (The implications of the above to remote and/or external organisational components such as Head Offices, Regional B2B & B2C etc)
  • Skills development and sharing (knowledge management, methodologies)
  • Technical Readiness
    Infrastructure
    Security
    Data
  • BI Readiness.
    IMM
    BI Index
    Analytic End User Profiling and Producer vs Consumer identification

 BICC Plan Components

  • BI Asset inventory.
    Detailed descriptions of the BI solutions currently implemented throughout the enterprise.
    Categorized according to Enterprise, Local and Regional.
    Include mention of additional solutions in the pipeline or those being considered or scoped for future consideration. Should include intended release dates.
  • BI Value Definition.
    An End user assessment of the value related to specific functions associated with BI solutions.
  • BI Deployment Map.
    A logical distribution of functionality by user constituency.
  • BI Measurement Criteria.
    A formal mechanism that can be used by IT to quantifiably gauge the success of individual solutions.
  • BI Enhancement Targets.
    The going forward timeline for next phase projects, technology consolidation, and new BI initiatives for the next 18 – 36 months.

By adhering to a simple clear approach, you should be able to keep the organisation focussed on a complete soluton.