Agility by Design - eprentise Blog

The Role of Automation in Managing Governance of Enterprise Data

PDFPrintE-mail

In a previous article, Losing Control: Controls, Risks, Governance, and Stewardship of Enterprise Data, we discussed the ramifications of failing to establish and maintain standards and change control mechanisms around the lifecycles of interrelated data objects. We began by describing a situation in which spreadsheets are used as the foundations of corporate reports and analytics. In such a scenario, the technology being used to store, retrieve, and manipulate the data—Microsoft Excel®—lacks the ability to validate and enforce data quality. A spreadsheet can’t verify that the formulas behind data extracts and transforms are correct (or that all of the relationships are maintained), and there are no standard procedures for data reconciliation using spreadsheets.

Forget the fact that maintaining 100+ related spreadsheets is a logistical nightmare. It is, but that’s not the real issue. The problem is that spreadsheets aren’t really connected. A formula in one cell that references another cell does not create a relationship between the two cells. This is not nit picking—there is a major difference between a reference and a relationship.

  • Reference: A source of information.
  • Relationship: A meaningful connection or association between two or more things.

In short, a database relationship goes both ways (and has meaning), making it vastly more important than a cell reference. Put another way, database objects can be connected to other objects without being referenced directly (foreign keys and other database constraints enable this—it is the lifeblood of the relational database as an effective enterprise tool).

A big problem with spreadsheet applications as the major component of most accounting and finance departments is that spreadsheets do not have the capability to enable the establishment of data governance—standards and change control mechanisms—of the sophistication required for running an enterprise. In fact, there is a rift in data quality even before the business user has used Excel to perform a single calculation with the numbers just spit out of the company’s ERP system. Once Excel has the data, with its inability to govern, the data may unsuspectingly change types, formats, or get truncated.

Enough about spreadsheets; Excel is a single tool in a world of technology players. There are new tech products that do embody the capacity of data governance. If you are in a position to evaluate such technology, keep in mind that effective tools must respect the following important caveat:

Once information leaves the database, it no longer embodies the purity and cleanliness that it once did while sitting in the table, with a defined (and standard) data type, minding its own business.

So, how should you keep your data clean? And stepping back, how do new technologies fit in to the enterprise resource planning (ERP) data quality picture?

Perspectives On Data Quality

The role of a data quality process is to make sure that business data – information, mostly digital today, that makes up a picture of a company’s time-sliced existence – is created cleanly and maintains a certain standard of cleanliness throughout its life cycle. But individuals’ viewpoints about the role of data quality technology (what data quality technology wants) are generally split between two opposing perspectives:

  • Technology enables a data quality process, but doesn’t obviate the need for people (data stewards) to remain actively involved and be held accountable for maintaining the quality of data.
  • Technology automates a data quality process, and a well-designed and properly implemented technical solution obviates the need for people to be actively involved after its implementation. [1]

Regardless of perspective, one must admit that time moves forward, new data is continually introduced to the system, and keeping the data clean requires that both the creation and maintenance of information adhere to defined and monitored processes that someone can be held accountable for.

“There is no point in monitoring data quality if no one within the business feels responsible for it.” – Thomas Ravn [2]

The importance of accountability to the data quality process implies that technology alone (or at least the same piece of technology) cannot both enable and automate data quality. In order to do so, it would need to be able to hold itself accountable for the quality of data that comes out of its own processes. The ability to generate an emotional response to potential consequences is at the heart of accountability—this is a problem for technology.

Master Data Management (MDM) is the technology framework for data governance initiatives. MDM addresses data quality, data architecture, and data security. Where data governance defines and standardizes master data definitions, MDM instantiates them into the business processes and propagates data fixes throughout the enterprise. Technology can help data governance initiatives by defining and communicating data policies, business rules, and data definitions by enabling cleansing, sharing, and consolidation of master data, and by tracking and fixing bad data.

Beyond the technology component of data governance, there is a human element to the data quality initiatives of your organization. A primary goal of a data governance strategy is to align the people, processes, and technologies to common objectives. The data governance structure outlines ownership, stewardship, and accountability by defining who has the authority to create, update, or retrieve enterprise data, and by identifying how the data is verified as being complete, consistent, and correct.

The success of an Oracle® E-Business Suite (EBS) project depends on the both the alignment of the people, processes, and technology, and an effective data governance strategy to manage the shared data assets of an ERP initiative. Within EBS, strong data governance is required to oversee cross-departmental data in a centralized place, to define master data policies, and to fix data issues. Within an ERP system like EBS, the quality of the data makes the system work (or not). Redundant or inconsistent data adversely affects operations, performance, and reporting—not only within EBS, but in the business intelligence systems and in the integration of outside systems.

Figure 1: Dependencies of ERP Project Success on Technology, People, and Process [3]

ERP Projects

Every ERP Project is a Data Quality Project

Which ERP projects should be considered data quality projects? All of them. If data governance takes a back seat on every project that is not focused on duplicate resolution or standardization, then by default you are going to create additional duplicate resolution and standardization projects for cleaning up the bad data introduced in all the others.

Not all ERP projects are initiated for the same reasons. The types of projects listed below differ in scope, but the purpose of each of them is to do something with enterprise data. In the case calling for a consolidation, the data from different and disparate systems are burdened with an extra dimension of metadata, namely which system—or source—it came from. Consolidation projects combine a variety of source systems into a single target system; a good consolidation project ensures that the target system embodies complete, consistent, and correct data throughout—it’s really a data quality project. This isn’t an easy thing to do—what, and where, are the fingerprints of multi-instance data?

Well, they’re in the database tables, of course. The complex webs of intra-instance connections—database DNA, so to speak—are comprised of relationships, not mere references, between the data molecules sitting in the tables. The molecules stay an objective course, minding their own business and behaving as they are told. They are great at following rules but lack the ability to create rules on their own, generating a desperate need for data governance at both the one-off project and long-term enterprise levels. As mentioned previously, people—not tools—will always be responsible for creating and administering data governance policies, procedures, and rules that the data and those who interact with it must obey in order to maintain enterprise information of the highest quality.

But a modern marriage of human intelligence and technology sheds light on the role of automation in enterprise data governance, namely:

The pieces of an organization’s data quality initiative that involve repeatable logic, Boolean truth, and measurable current- and future-state values are prime candidates for automation with capable technology.

From an MDM perspective, eprentise® software embodies this modern marriage. Using its patented methodology (including a deep-discovery Metadata Analysis process, a Knowledge Base of hundreds of thousands of data manipulation rules garnered from experience across all types of EBS instances, and the ability to automatically generate all of the code required for making changes to data), eprentise software automates the project-level data quality and standardization processes across consolidation projects as well as many other types of ERP projects:

  • Consolidation
    • Mergers & Acquisitions
    • Shared Service Center
    • Departmental Instances
  • Reorganization
    • Changes to EBS configurations
  • Upgrade
    • De-supporting of current install
    • Take advantage of new features (E-Business Suite R12)
  • Migration
  • ERP Extensions
    • Supply chain planning
    • Vendor relationship management

Within Oracle EBS, eprentise has taken the first step in broadening the scope of MDM to include all of the attributes of enterprise data – metadata, seed data, reference and configuration data, data structures, and even consistency among different E-Business Suite instances – driving toward the concept of a single, global source of truth that is complete, consistent, and correct. eprentise puts the power in the hands of the business, employing its collection of pre-defined business rules to formulate optimized intra- and inter-instance connections—the new DNA—from which it derives the automated mappings and sequences required to effect the desired changes. eprentise is not an extract, translate, and load tool—data changes happen inside EBS, which is exactly what we want in order to keep the data pure and clean (sitting in the table, minding its own business).

Technology such as eprentise software can play a pivotal role in automating large portions of repeatable data quality requirements that adhere to governance policies—delivering them repeatedly for quality maintenance purposes or as an integrated byproduct of other ERP projects like consolidations and reorganizations. While eprentise does have a software product specific to cleansing and standardizing data (see eprentise Data Quality), the same metadata engine, duplicate resolution, and standardization functions are built into all other eprentise products, enabling you to tackle the E-Business Suite projects you’ve budgeted for and increase the focus on complete, consistent, and correct data simultaneously.

Unlike Excel, eprentise does not prohibit data governance—it promotes it. Whether you need a data quality product to use on an ongoing basis to align enterprise data to changing corporate governance policies or you need to make a specific change (such as a functional currency change, a calendar change, or any of the other changes mentioned below), eprentise software is the tool to use if you need quality data—automatically.


eprentise knows quality data. Our software products for Oracle E-Business Suite include:

For other eprentise articles focusing on E-Business Suite topics, please see our blog.


1. Harris, Jim. What Data Quality Technology Wants, OCDQ Blog. Thursday, January 13, 2011. http://www.ocdqblog.com/home/what-data-quality-technology-wants.html

2. Moseley, Marty. Measuring What Matters, Mastering Data Management. May 20, 2010. http://masteringdatamanagement.com/index.php/2010/05/20/measuring-what-matters/

3. Keifer, Steve. ERP Projects and B2B E-Commerce, Hardlines Technology Forum. April 19, 2010. http://www.slideshare.net/gxsinc/erp-projects-create-b2b-ecommerce-opportunities

 

Losing Control: Controls, Risks, Governance, and Stewardship of Enterprise Data

PDFPrintE-mail

In large organizations, many different people are responsible for updating, creating, and deleting data in spreadsheets.  Each time a spreadsheet is changed, there is a risk of losing the integrity of the data because of the number of cell references and relationships between each data item in the spreadsheet (and among many different spreadsheets).   It is very difficult to maintain proper audit controls, change management, transparency, and accuracy when spreadsheets are used as the foundation for corporate reports and analytics.

We aren’t concerned about the spreadsheets that are used for a one-off project or to do some quick calculations.  The risk is when companies distribute a spreadsheet template to different departments or when each part of the organization manipulates the data that they get from their Oracle E-Business Suite (EBS) or any other enterprise system because the data coming from the system is not quite the way they want to report their operations.  Whenever data is extracted from a system and transformed or changed, there can be a loss of integrity.  There are no standards and change control mechanisms to validate that the formulas are correct or that all of the relationships are maintained, and there are no standard procedures for data reconciliation.  There is the same risk in writing scripts to migrate data into a new instance as is customary for a reimplementation.  In this article, we break down the risk factors and suggest safer, alternative methods for achieving data consistency and control over sensitive information.

Read more: Losing Control: Controls, Risks, Governance, and Stewardship of Enterprise Data

   

How Do You Calculate the Cost of a Spreadsheet?

PDFPrintE-mail

In this article, we take an insightful look into the cost of a single spreadsheet that is used for financial consolidation.  Many companies ignore the high cost of maintaining spreadsheets because they have already purchased Excel or another package, and there are not huge license fees.   Spreadsheets are great tools for short, small projects, but care should be taken when using them as an extensive resource, as is often done for financial consolidation.  Spreadsheets are good choices when you need to organize simple data in a fast and cost-effective manner.  It is easy to use Excel to save customer and prospect data when it is a small set to be used by a single person or a small group, but trouble arises when your data grows and more people need access to it.  The following is a list of ways that time can be easily wasted when spreadsheets are used to track and consolidate financials:

  1. Managing and maintaining group-related data.
  2. Retyping data from spreadsheet to spreadsheet.
  3. Maintaining references between multiple spreadsheets.
  4. Consolidating multiple spreadsheets.
  5. Cross-checking to make sure numbers agree across multiple spreadsheets.
  6. Maintaining gargantuan spreadsheets.
  7. Hard-coding data from reports to spreadsheets.
  8. Rearranging spreadsheets to show new perspectives on the data.
  9. Restructuring spreadsheet models to reflect changes in the company organization.
  10. Converting between different proprietary spreadsheet applications.

Look at this simple formula for figuring how much each spreadsheet costs your organization.

Read more: How Do You Calculate the Cost of a Spreadsheet?

   

Our Secret Sauce

PDFPrintE-mail

Everyone always asks us how we do what we do, and why, in over 20 years of Oracle E-Business Suite implementations, no one else has ever created software to automate the process of changing the underlying configurations or consolidating or separating data. eprentise software is built on a proprietary process called Metadata Analysis that is really the engine that drives the changes in an Oracle E-Business Suite. eprentise Metadata Analysis uses patterns and rules-based technology to discover everything about a particular database.

Read more: Our Secret Sauce

   

Page 1 of 3

Email Newsletter icon, E-mail Newsletter icon, Email List icon, E-mail List icon Enter your email address to sign up for our Newsletter

Sign up now

captcha
TEChanges - Agility by Design

May Puzzle

David is often referred to as Rainman due to his peculiar ability to effortlessly figure out a certain date's day of the week. He recently displayed this talent when I asked him if there was a conflict with the upcoming Fuzzy Dice Conference and our weekly court-ordered community service. He asked the date of the convention. It was April 20th, 2012.

"Oh, that’s a Friday," he said, effortlessly. "And your sentences have you committed for the next few dozen Wednesdays so you'll be able to go." And of course he was right.

One day a few weeks ago I asked out loud in the office about the date June 5th. And of all people, my brother Tommy piped up and said "Oh, that's a Tuesday."

"That's right," said David.

Well how about Otcober 3rd?

"That's a Wednesday," said Tommy. Then I asked about Christmas Day 2012.

"Oh, that's a Tuesday." David nodded in agreement.

Do we now have two rainmen? Or had Tommy figured something out?

Show solution...

Solution

Here's what was going on. Tommy was using something called anchor dates. And these dates apply to each and every year. April 4th, or 4/4 we’ll call it from now on, June 6th or 6/6, 8/8, 10/10, 12/12, are all the same day of the week, each and every year.

So too are 5/9 and 9/5, May 9th and September 5th. So too are 7/11 and 11/7, and all the above dates are the same day of the week, as is the last day in February, Leap Year or not. And they’re all the same day as January 4th, it would otherwise be January 3rd, but this was a leap year, and that’s changes the anchor day from January 3rd to January 4th.

Tommy also knew that New Year's Day was a Sunday. He was sobered up by then. And he knew it was a Sunday because Christmas was a Sunday in 2011, so New Year's Day is a Sunday, so the Anchor Day for 2012, January 4th, has to be a Wednesday!

So if that's a Wednesday, then 4/4, 6/6, 8/8, 10/10, 12/12, 5/9, 9/5, 7/11, 11/7, and February 29th are all the same day of the week, and they're all Wednesdays. So when I ask for example, about October 3rd, he knew October 10th was a Wednesday, 10/10. So 10/3 must also be a Wednesday. 12/12 is a Wednesday in 2012, so it’s 12/26, which is two weeks later. So 12/25, or Christmas Day, must be a Tuesday.

Success Tips for Oracle Project Management

  • Create a standard for documentation at the beginning of your project, and hold team members accountable for completing documentation requirements as well as keeping them at and above the standards required.
  • Before promulgating user documentation or training, it’s also a good idea to choose a representative from the among the business users base to review materials first.
  • If you are not sure about the resources and budget required, obtain several estimates from people that have experience with the same size and scope of your project.
  • Be explicit, before beginning the project, what internal resources are required for execution. This includes people, infrastructure, hardware, and software.
  • Help the project champion understand the impact your project will have on the organization and how its successful completion will make him or her an internal hero or heroine for supporting it.
  • Break up your project into smaller projects (try for projects that can be completed in 4-6 months, especially early on) to get success and demonstrate momentum.
  • Make sure that your testing includes reports, upstream and downstream interfaces, customizations, enhancements, and workflows.
  • Ensure that comprehensive transition reports and meetings between departing and incoming personnel are completed.
  • Instead of spending time and resources implementing third-party reporting, consider consolidating multiple instances, moving to a global chart of accounts (CoA), and/or standardizing on a consistent calendar.
  • Include governance, risk, and compliance management as part of the project plan.
  • Finally, celebrate the successes. Too many projects focus on defects, failures, or small cost over-runs without looking at the big picture and what was accomplished.

The Analyst Corner

John Van Decker, Research VP of Gartner, states:

"A single chart of accounts allows consistency in financial reporting across the enterprise by standardizing on common metrics and reporting structures, reduces dependencies on a separate financial consolidation system, and significantly reduces the costs incurred with ongoing, complex conversions and translations."