Using Average Absolute Error to Uncover Tuning Issues

Average Absolute Error (AAE) Provides an Intuitive Alternative to Variance and Simplifies the Assessment of Changes in PID Controller Performance

Quite simply, things at a manufacturing facility can change for the better or they can change for the worse. When production staff are the agents of change, then more often than not those changes result in improvements to some aspect of production. On the flip side when they’re not involved in overseeing those changes, bad things are usually afoot.

Due to the size and complexity of most manufacturing environments change is a constant. Some of those changes can have a subtle impact like the use of a different feedstock or a shift in environmental factors (e.g. increased humidity due to rain). Other changes can be more profound like the sudden failure of mechanical equipment. Whether subtle or significant, change will impact production efficiency and throughput to one degree or another.

Due to the size and complexity of most manufacturing environments change is a constant. Some of those changes can have a subtle impact like the use of a different feedstock or a shift in environmental factors (e.g. increased humidity due to rain). Other changes can be more profound like the sudden failure of mechanical equipment. Whether subtle or significant, change will impact production efficiency and throughput to one degree or another.

Maintaining awareness of the different changes and assessing their potential impact on performance can present a challenge. Technologies like control loop performance monitoring (CLPM) keep a constant watch on a facility’s PID controllers, using various key performance indices (KPIs) to assess the health of regulatory control systems. Most CLPM systems utilize simple Variance to assess change. Average Absolute Error is an alternative that offers a simpler means of interpreting data and assessing the implication.

Consider the following:

  • Defining the Metric

Average Absolute Error is a metric for assessing change within a given PID control loop. It quantifies the difference between the loop’s Set Point and the corresponding measured Process Variable. As a measure of control loop performance, Average Absolute Error tracks how effective the loop is at maintaining Set Point.

  • Rating the Change

Some degree of variability should be expected within a PID loop as production processes are highly interactive and inherently dynamic. That said, any notable increase in the value for Average Absolute Error generally corresponds with a change that production staff should at least note if not investigate and address. While modest increases of 5%-10% generally correspond with everyday variability, increases greater than 10% point to an issue in need of attention.

  • Seeking a Solution

While tuning is not the answer to all controller issues it can resolve some increases in PID loop variability. An adjustment in feedstock, a load change, and even a shift in seasons are sources of change that can be accommodated with modified tuning parameters that are better suited for the process’ altered dynamics.

Two keys to managing change are awareness and analysis. Metrics like Average Absolute Error can provide timely awareness of changes in production conditions. As part of a plant-wide monitoring solution Average Absolute Error and other KPIs enable production staff to stay on top of their expansive environment. That said, analysis is equally important. More often than not it is determining the source of the change that provides the key to an effective corrective action.

 

These resources offer related content:

shutterstock_522777601

What is Variance? What Metrics are Useful in Identifying Process Change?

  Average Absolute Error (AAE): A Value-Added Metric that Puts Change Into Context Ever walk onto the production floor and just sense that something was different? Whether it was something you saw, heard or even felt, a certain sixth sense kicked in and triggered an...
Iconic-Mark_Inverted-Color

The Benefits of Feed Forward Control

By nature most people are reactive when it comes to dealing with life’s big expenditures.  Think of happy occasions such as graduations and weddings.  Then consider more somber milestones like retirement.  By most accounts the average worker is wholly unprepared to absorb the costs linked...
manufacturing plant control center receiving alert

What Should I Look for in Performance Monitoring Software?

You’ve probably heard it referred to as Control Loop Performance Monitoring, Loop Performance Monitoring, Controller Performance Monitoring, or even just Monitoring software.  The long list of names aside, the technology is relatively new and it addresses a need shared by most manufacturers.  That need is...

Still looking for more?

Now that you’ve gotten the basics, connect with our team to learn how our people, processes and technologies can help you optimize.