Do I still need to Archive my Historical JD Edwards Data?

Posted by Barry Yelverton | Dec 20, 2017

This thought will have occurred at some point to every owner of an Oracle JD Edwards application. Historically, holding data was extremely costly, the underlying storage was expensive and so was the further cost of backing it up and preserving it. In recent years, the cost of data storage has continually fallen and Solid State Disks (SSDs) are seen taking over from traditional hard disks offering better performance for a continually improving cost.

Storage costs are declining, should I leave my data where it is?

To answer that question we need to consider the drivers in today’s competitive and fast-moving business landscape. Anything that impacts a company’s ability to serve its customers will incur significant direct & indirect costs.

For those whose role makes them responsible for managing critical business applications there is an understandable focus on:

  • Improving Internal and external user experience
  • Eliminating planned & unplanned system downtime
  • Safeguarding the ability to manage, maintain & develop applications
  • Managing data securely and in line with external & internal policies

At the same time, evaluating the benefits of a transition from Oracle JD Edwards on-premise to a Cloud-based solution is a priority.


How does JDE data archiving help to manage risks?

Meeting these challenges requires having good JDE data archiving practices in place to underpin a robust reliable infrastructure. Implementing data archiving based on the data’s current business value delivers a positive impact in many areas.

Consider an organisation that has been running the same JD Edwards system for many years. For such organisations, a large and growing database can start to cause significant JDE data management challenges. The first and most visible issue is typically poor & declining application performance. Internal employee productivity and customer satisfaction are both directly linked to application performance as identified by many analysts including Gartner and from surveys by APM vendors. One such vendor, Riverbed Technologies found that 98% of executives agree that optimal enterprise application performance is essential to achieving optimal business performance, and can drive increased productivity, cost savings, and improved customer satisfaction.

Unless performance issues are remedied not only online transactions but also background processes run slower; everything from loading & validating data to closing accounting periods are impacted.

With large databases even the seemingly simple operation of backing up the database can prove challenging to achieve in an already congested schedule of jobs and if it overruns either availability of the system or its ability to recover will be compromised.

According to analysis including the annual IOUG Database Survey, between 50% and 75% of the data in application databases is not active. This creates a huge potential for more effective JD Edwards data management.


Business Users want to Retain their JDE Data 

We often discover that business users have a reluctance to delete JD Edwards data from an existing production database even when that data has not been accessed for an extended period of time. The solution to this concern is JD Edwards data archiving or data storage. By removing historical data to a separate database the original database is reduced in size which improves JDE performance and accelerates housekeeping operations. Total storage savings across all copies are a valuable offset to the initial costs.

To satisfy business users the archived data needs to remain accessible, ideally in its original form and available using the JDE application or standard off the shelf tools. The integrity of the remaining data in the production system is vital so any archiving solution must ensure it is maintained. For the internal security team the preferred solution would also maintain the original security model.

We should also question whether it is right to continue to hold some of the data. The EU General Data Protection Regulation (GDPR) will be enforced from 25th May 2018 and can involve hefty fines for those who fail to comply with its directives. These include the “right to be forgotten” and any store of data including archives will need to be considered.

Once data is no longer needed to satisfy legal & regulatory requirements and is outside individual company retention policies it potentially becomes a liability instead. Discovery costs in the event of an audit or litigation increase in line with the data volumes held. The recommendation would be that the final step in the JD Edwards data archiving process is to identify data that can be purged. 


Flexible JD Edwards Archiving Solution

There is no doubt that building a JDE archiving solution yourself from scratch is difficult and requires expert knowledge of the JD Edwards data model to avoid creating major data integrity issues.

Thankfully at Redwaire we have already created an Oracle JD Edwards Archiving solution which is successfully used by over 500 customers and is an Oracle Validated Integration award holder. 

If you’d like to know more, contact us at

< Back to Blog