• Home
  • Diver BI Group
    • Diver | BI
    • Customer Commendations
    • Videos
    • Case Studies
    • Documents and Brochures
    • Diver BI Group Privacy Policy
  • Articles
    • News
    • Accolades
    • Blog
    • Ask Anthony
  • The Team
    • Key Experts
    • Members
      • Dynamic Business Informatics
      • Envisage
      • Chartwell IT
      • Cloud-Works Solutions Ltd
      • Data Management Business Insight
      • Manitex
      • Equiniti ICS
      • Pharma IT
      • Pinnula
      • Formell
      • IBI
    • Partners
      • Dimensional Insight US
      • Dimensional Insight EU
      • Dimensional Insight Asia
      • DI Panama
      • ID Technology (Brazil)
      • Infotool (Nordic Countries)
      • BIMAXIS – DI France
      • Vision IT
      • KDE Group (Israel)
      • Zight -Partner for Transport
      • 24/7 Uptime
  • Applications
    • Property
      • Property Prices Portal
    • Supply Chain
      • Retail
      • Distributor
      • Wholesale
      • Manufacturing
      • Produce
      • Beverage Alcohol Suppliers
      • Beverage Alcohol Distributors
      • Autoparts
      • Transport
      • Public Transport
      • DI Program Advisor
    • Healthcare
      • Healthcare
      • DI Surgery Advisor
      • DI Physician Performance Advisor
      • Pharma BI Applications of Diver
    • Finance
      • Finance
      • DI GL Advisor
    • Mobile & SaaS
      • Diver BI SaaS
      • SaaS for Sales Gap Analysis
      • BI designed for Tablet
      • DiveTab – Mobile BI
    • Diversity
      • Travel & Tourism
      • Colleges & Universities
      • Waste Management
      • Parking
      • Telecom Brokerage
      • Economic Trends
      • Maps
      • Smart Meters
      • Carbon Emissions Management
  • Workbench
  • Contact
    • Free Consultation with One of Our Experts
    • Add a New Revenue Stream as a Partner

DiverBIGroup

Business Intelligence Experts

Diver BI Group Blog You Don’t Need Big Data to get Big Insights

You Don’t Need Big Data to get Big Insights

10th November 2015

Big data is the big focus of much of the current analytics press; huge volumes of unstructured or semi-structured data that can be mined to find those gems of information you didn’t know you had.

Sentiment analysis and remarketing algorithms may be all well and good for Facebook and Amazon, but if you only have relatively small volumes of highly structured data, and already have reports coming out of your ERP or MRP system, what added value can you get from adding a BI layer? Like people in many organisations without a real analysis tool, are you currently just seeing your information without getting insights from it?
man with bag obscuring vision

Why Have a BI Tool for Small Data?

Here are just some of the reasons why having a BI layer gives you a Return-On-Investment even with small data volumes:

1. Data Integrity Issues

However small your data set, you almost certainly have issues with the data: it may not be clean; or may not contain all the information you need. So you end up manually discounting certain records, working round them on spreadsheets, renaming fields, re-grouping them and adding in the missing pieces. All by hand: every week, every month or every quarter.
This all takes time – which costs money – and is open to error.
A BI Tool automatically takes care of the cleaning, regrouping, renaming and data joining, once and for all.

2. Business Rules

You all have them – business rules that you have to apply to the raw data to make sense of what is actually happening. The trouble is, however simple or small your data-set, business rules can be complex. Creating these algorithms for each different department, or scenario, may not be something that you want to set in stone within your ERP system.
You may want to vary the rules but still have them running automatically. So one department may want to see how sales people are performing against Sales Budget, whilst another department may want to know how they are performing against Scrap Rate Targets.
A BI Tool can be configured quickly and easily to take into account new business rules, and then apply them automatically to your data.

3. Automatic Date Comparisons

Even when your data volumes are small, the figures make no sense unless you analyse the data in context – this is generally some sort of time comparison. Knowing percentages of uplift on sales are just as critical on 100,000 rows of data to a small business, as they are on 100,000 million rows to a bigger one. Comparing any dimension by values measured in time-related intervals, and being able to dive into the details, allows you quickly to discover things like: which sales person is underperforming this month; which product isn’t selling as much as it was last week, and which customers and products are giving you the most profit this year.
A BI Tool gives you interfaces to change the date comparisons on any dimension automatically, so you can interrogate your data within a meaningful context every time.

ABC for Analysis on Sales Data

So let’s go from being data miners to insight divers. Here is one example of an algorithm you can apply even to small data sets, giving you a much more accurate understanding of your most profitable customers and products.

Revenue is Vanity, Margin is Sanity

To start we’re going to find our Gross Margin and Gross Margin % (simple enough to calculate if you have both the unit price and unit cost in your data – Gross Margin % = (Unit Price – Cost)/Unit Price). When applied across all the sales data – (Sales Value – Cost Value)/Sales Value), this measure alone unlocks a few areas for us: for example, it can give us a way of checking that none of our sales people are offering larger discounts than we are expecting.

To do this we can focus on a few key products, and view their sales over a chosen period by the “Salesperson” dimension. We can sort the field “Gross Margin %” low to high. If the first salesman on the list is reporting a much lower margin than the rest, we can dive into the customers he/she sold to and then the individual products, to pinpoint if it’s a general problem or specific to particular customers or products.

diver seeing clearly underwater

ABC Analysis

Sometimes we assume that we know which products and customers are our most profitable – but we can often be surprised and even shocked once we perform an “ABC Analysis”, as they’re not always the ones that we gain the most revenue from.

Step 1
Using our BI Tool’s integrator interface, which allows us to carry out any number of calculations on the data, we work out the following (separately for both Products and Customers):
• Total Gross Margin for say 6 months (this can be any desired time period) on all products and customers
• Gross Margin per Product/Customer for the same period
Step 2
Sort the Products/Customers high to low by Margin Value for that period then define the Classification Thresholds e.g:
• Class A = Products/Customers making up Top 20% of Profit
• Class B = Products/Customers making up Next 50% of Profit
• Class C = Products/Customers making up Bottom 30% of Profit
• Class Z = Products/Customers that didn’t give us any Profit in that period

The Z Class Products could either be seasonal or non-selling items which we need to put on promotion and help our cash flow. Z Class Customers are those that have stopped buying from us and may need a call or a visit.

We are now seeing real insights – an accurate list of our key Customers and Products in terms of profit, which is the healthiest way of looking at sales. Maybe we will discover something else about them, for example that we are discounting too heavily on certain unique items that have no real competition and are in high demand, or accounts that are drifting away.

Fine Tuning the ABC Analysis

If we had Customer Category or Product Group we could run our ABC analysis within these areas separately, so we wouldn’t end up comparing, for example, our sales of cars against our sales of car parts.

We could also run an extra analysis on new customers and new products, which would allow us to calculate dynamically how many customers we retain or lose when looking at the current month versus previous months; and how new products are doing when they haven’t had time to add much to the total Gross Margin over the selected ABC Analysis period.

From this post you can see just a few examples of the phenomenal amount of extra information that can be derived from smaller datasets. So even though you may not have Big Data, you can still achieve Big Insights if you know where to look. Maybe you didn’t realise you had that bag on your head?

For a case study that highlights this approach, see our case study, Kellett Group case study.

About Debbie Lonsdale

Debbie Lonsdale

Debbie Lonsdale has been working with the Diver Solution as a BI Consultant at Dynamic Business Informatics since 2008. Her previous experience includes computer programming, analytical and technical roles, team management, account management, sales and marketing in a variety of market sectors, including the Travel Industry and Distribution. She combines this experience as an all round ICT professional in the BI sector.

Tags: ABC Analysis, Big Data, Big insights, business rules, Customer Analysis, Data Insights, Product Analysis

Articles

  • News
  • Accolades
  • Blog
  • Ask Anthony
  • Diver | BI
  • Customer Commendations
  • Videos
  • Case Studies
  • Documents and Brochures
  • Diver BI Group Privacy Policy

Dynamic Business Informatics Ltd

Distributors of The Diver Solution & Diver Platform, providing business consultancy services, products and applications derived from the Diver Solution & Diver Platform.
14 Mellifont Avenue
Dun Laoghaire
Co. Dublin

+353 1 2302022

10 Kenyon Street
Nenagh
Co Tipperary

+353 67 43309

Contact Us

We would love to hear from you! Please submit your query and we will get in touch with you shortly.

Email addresses are never sold, rented, or shared. See our Privacy Policy.

  • This field is for validation purposes and should be left unchanged.

Accolades

  • Best in Klas Report 2023 – Straight A Grades for Dimensional Insight
  • Dimensional Insight Named an Overall Leader by Dresner Advisory Services in 2022 Industry Excellence Awards
  • Dresner Wisdom of Crowds 2022 – Best in Class Results
  • Klas 2022 – A Grades for Dimensional Insight
  • Dimensional Insight Earns Top Marks in 2021 Wisdom of Crowds Business Intelligence Market Study

Copyright © 2023 Diver BI Group · Privacy Policy · website by cubecolour

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Cookie settingsACCEPT
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.


What Are Cookies?


As is common practice with almost all professional websites this site uses cookies, which are tiny files that are downloaded to your computer, to improve your experience. This page describes what information they gather, how we use it and why we sometimes need to store these cookies. We will also share how you can prevent these cookies from being stored however this may downgrade or 'break' certain elements of the sites functionality.


For more general information on cookies, please read "What Are Cookies".


How We Use Cookies


We use cookies for a variety of reasons detailed below. Unfortunately in most cases there are no industry standard options for disabling cookies without completely disabling the functionality and features they add to this site. It is recommended that you leave on all cookies if you are not sure whether you need them or not in case they are used to provide a service that you use.


Disabling Cookies


You can prevent the setting of cookies by adjusting the settings on your browser (see your browser Help for how to do this). Be aware that disabling cookies will affect the functionality of this and many other websites that you visit. Disabling cookies will usually result in also disabling certain functionality and features of the this site. Therefore it is recommended that you do not disable cookies.


The Cookies We Set




  • Account related cookies


    If you create an account with us then we will use cookies for the management of the signup process and general administration. These cookies will usually be deleted when you log out however in some cases they may remain afterwards to remember your site preferences when logged out.




  • Login related cookies


    We use cookies when you are logged in so that we can remember this fact. This prevents you from having to log in every single time you visit a new page. These cookies are typically removed or cleared when you log out to ensure that you can only access restricted features and areas when logged in.




  • Forms related cookies


    When you submit data to through a form such as those found on contact pages or comment forms cookies may be set to remember your user details for future correspondence.




  • Site preferences cookies


    In order to provide you with a great experience on this site we provide the functionality to set your preferences for how this site runs when you use it. In order to remember your preferences we need to set cookies so that this information can be called whenever you interact with a page is affected by your preferences.




Third Party Cookies


In some special cases we also use cookies provided by trusted third parties. The following section details which third party cookies you might encounter through this site.




  • This site uses Google Analytics which is one of the most widespread and trusted analytics solution on the web for helping us to understand how you use the site and ways that we can improve your experience. These cookies may track things such as how long you spend on the site and the pages that you visit so we can continue to produce engaging content.


    For more information on Google Analytics cookies, see the official Google Analytics page.




More Information


Hopefully that has clarified things for you and as was previously mentioned if there is something that you aren't sure whether you need or not it's usually safer to leave cookies enabled in case it does interact with one of the features you use on our site.


However if you are still looking for more information then you can contact us through our contact page

Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT