Blog

Author Archive

Implementing ISO 13485: Dealing with Delays

By Guest Blogger,  Brigid Glass

%name Implementing ISO 13485: Dealing with DelaysThe author provides tips, practical examples, and six steps to follow if your ISO 13485 implementation project falls behind schedule.

In the best-planned project, with plentiful, skilled resources and diligent monitoring, things can still go awry. We need to be watchful for signs of our plans falling behind schedule, and develop contingency plans to prevent delays.

Walk Around the Mountains

Identify major obstacles early and develop a plan to deal with them. The major obstacles are usually the tasks that take the longest—such as process validation. Specifically, name these tasks in your pitch to management for resources before you start. This approach will ensure that everyone is focused on the biggest challenges.

If your plan to climb over those mountains is failing, work out a route around them. Maybe your R&D Manager can’t yet accept that there will now be design controls. In this case, an alternate path might be to leave design controls for last purposely. If you write a concise procedure and release it as your last procedure, then you have a built-in excuse for why you have very few records to demonstrate an implementation of design controls. You will still need at least one design project plan and training records to demonstrate that the process is implemented.

If this plan is successful, your auditor will write in the report that “design controls are implemented, but there are limited records to demonstrate implementation at this time.” If this plan is unsuccessful, you will need to provide additional design control records before you can be recommended for ISO certification—typically within 90 days.

Another approach is to initiate a CAPA and implement some of the tasks after the audit. For example, you have more suppliers than you can audit before certification. In this case, qualify all your suppliers, and use a risk-based approach to help you prioritize which suppliers need to be audited first. In your plan, identify that you will start by auditing the three highest-risk suppliers. Lower risk suppliers can be scheduled for audits after certification.

Be Watchful

Keep a close eye on your project plan. One of the most critical factors for success is keeping the plan and progress against the plan in front of the key players and senior management. Do this in such a way that progress, or the lack of it, is very clearly visible. It’s a basic maxim of Quality that we act on what we measure.

ISO 13485 Implementation: If Your Project Falls Behind Schedule

If you find yourself lagging seriously behind in your project, the following steps will assist you in recovering sufficiently to still be able to attain certification.

  1. Enlist management support when you need it, especially if you need them to free up resources.
  2. Prioritize. Before the Stage 1 audit, ensure that those procedures which are required by ISO 13485 are released (there are 19). There’s always room for improvement, but leave some of it for the second revision, instead of delaying certification.
  3. Ensure that you have at least a few examples of all the required records. Your auditor will be unable to tick off his checklist if a record is absent. Make it easy for the auditor.
  4. If there is a sizeable gap that you won’t be able to close before certification (i.e., – you have a validation procedure, but validations have not been completed), write a CAPA outlining your action plan to address the gap. During the audit, act confidently when you are questioned about the gap. Many auditors will give you credit for identifying the problem yourself.
  5. Don’t panic. The worst the auditor can do is to identify a nonconformity you will have to address with a CAPA plan before you can be recommended for certification. At most, this will result in a delay of a few weeks.
  6. Throughout your certification preparations and during the certification audits, you will identify issues you may not have time to resolve before the certification process is complete. If you are planning to revise procedures and make other corrections, make sure you track these issues as CAPAs or with some other tool (e.g., – an action item list). You want to address each issue prior to the first surveillance audit (no more than 12 months from the date of the Stage 2 audit).

Best wishes for your project. Success is the result of good planning, good communication, and good monitoring.

This blog is part of a series of blogs that leads up to our Roadmap to Iso 13485 Certification Courses

Posted in: ISO Certification

Leave a Comment (0) →

Quality objectives for achieving your goals

This article, updated in 2020, describes two different approaches to establishing quality objectives to achieve your business goals.
BHAG JFK Quality objectives for achieving your goalsGoal setting and communicating a vision of the future is not just the responsibility of the company President. Every manager should be setting goals for the teams they manage, and you can set yourself apart from your peers by building a vision with clear benefits to employees, customers, and the bottom line. Establishing quality objectives, and monitoring the progress toward those objectives is one of the greatest tools you can use to achieve your business goals. There are two different approaches to setting quality objectives, and you should use both.

Two Types of Quality Objectives

The most popular type of quality objective is a visionary goal. The phrase that I think captures this idea is the “Big Hairy Audacious Goal” (BHAG). Jim Collins and Jerry Porras coined this phrase in Built to Last. Visionary goals are long-term quality objectives that will require many smaller, coordinated changes intended to “level up” your business.

The second type of quality objective is a short-term goal. Short-term goals are not nearly as “sexy,” but achieving short-term goals builds momentum and creates long-term habits that are crucial to success. The two books that capture this concept best are The Compound Effect by Darren Hardy and The Slight Edge by Jeff Olsen. Both books emphasize the importance of consistency and small improvements to achieve success. The secret to establishing short-term goals is to make sure that your short-term goals are aligned toward helping you achieve long-term goals.

In our quality system procedures, we include a section for monitoring, measurement, and data analysis. For every process in your quality system, you should have at least one defined quality metric that you consistently measure. Everyone involved in that process should be aware of the metric, and data analysis should be shared with everyone in the company. Some of those quality metrics will be more important than others, but everyone must expect to achieve the goals that are set. You can pick anything you want to measure for a process, but for the metric to be used as a quality objective, it must be measurable and consistent with your quality policy. I like to define measurable by saying, “You must be able to graph it.”

6 Steps to Achieving Big Hairy Audacious Goals (BHAG)

Not all quality objectives have to be small, dull, or easy. You are required to establish quality objectives. Both the QSR (21 CFR 820.20, management responsibility) and the ISO Standard (ISO 13485:2016, Clause 5.4.1, require that top management establish quality objectives. These objectives must also be reviewed during management reviews, and they should be established at all levels throughout your company. Some of these objectives will be small, but you should make at least one of your quality objectives big, exciting, and hard to achieve. If you want to set your first BHAG for your team, try following these six steps.

STEP 1: Involve your team in setting quality objectives

Weak managers dictate goals, but leaders get teams involved in the goal-setting process. Getting your team involved gives them ownership of the goal. If you’re unsure of how to get your team involved, you might try a brainstorming session. A good brainstorming session is relatively short (i.e., – < 1 hour). Everyone needs to understand the goal of the brainstorming session: to generate many ideas for a possible BHAG. Everyone needs to understand what a BHAG is. These examples might help:

  1. Reduce average monthly scrap by 80% with a Pareto Chart
  2. Reduce the average number of nonconforming material reports by 50%
  3. Increase the ratio of preventive actions to corrective actions to > 1.00

Finally, negative comments should not be tolerated. Bad, good, and silly ideas should all be encouraged because the purpose of brainstorming is to generate many ideas. After you have 100+ ideas, you and your team can schedule another meeting to select the best goal(s).

STEP 2: Predict the bottom-line impact of quality objectives

Top management’s perception of a BHAG will be directly proportional to the impact on the bottom line. If the impact is small, the “B” in BHAG is a “b.” You and your team should use the potential impact on the bottom line as the first selection criteria for picking the best BHAG from the brainstorming list. The accuracy of these estimates doesn’t matter initially. Still, once you choose the goal, you will need to verify the accuracy of the financial impact and define how that impact will be measured.

STEP 3: Look to the future, but focus on the next milestone

Picking a five and ten-year goals is appropriate for discussions with Human Resources about your career, but companies are measured on quarterly financials. Therefore, you will need to focus on the goals you can achieve in three to six quarters. The number of milestones you set should also be few, and you should focus on one at a time. If the goal is only three quarters away, you might have monthly targets, while longer projects need interim milestones.

STEP 4: Milestone momentum

Longer projects often become delayed because people will procrastinate, and teams will lose momentum. When you break your long-term goals into smaller chunks, everyone can focus on the next milestone and see the progress. Each piece should be a sound stage of the project, and completion of the stage must be clearly defined. To create momentum, you must achieve each milestone–always. The pattern of consistent milestone achievement builds confidence, and your team will gradually develop the habits needed to sustain your progress.

STEP 5: Assign the Skeptic to Report on Quality Objectives

A good statistician can make the numbers look any way you want, but skeptics in other departments (and within your team) will criticize your claims of success. One way to silence the skeptics on your team is to make them responsible for measuring and reporting the team’s progress. This approach ensures that progress reports are conservative and accurate, rather than inflated or unbelievable. Progress should also be reported publicly because public victories are something your team can be proud of.

STEP 6: Promise a Reward for Achieving Quality Objectives

Some managers believe that the reward for hard work should be a paycheck. That’s sort of like telling your children that they get to eat for doing something you’re proud of. Employees are not children, but you are responsible for developing them into more valuable employees so that they can be promoted. If there is no incentive, your team will not be engaged. Therefore, pick a reward that is proportional to the bottom-line impact. Five percent of the bottom-line impact is what I like to target, but you would be amazed at how effective a few small rewards at each milestone can be. If you have trouble getting management approval for rewards, remind your boss of the bottom-line impact and link the rewards closely to the impact.

Posted in: ISO Certification

Leave a Comment (1) →

Implementing the ISO 13485 Standard: Objectives

By Guest Blogger, Brigid Glass

The author discusses implementing the ISO 13485 standard, including seven questions to clarifying your objectives and six considerations in shaping your objectives.%name Implementing the ISO 13485 Standard: Objectives

Implementing ISO 13485 is such an enormous undertaking for an organization that it pays to approach the planning strategically to ensure that all objectives are met.  Often, some objectives are made explicit, and others are unspoken. It is worth taking the time to ensure that all objectives are clearly stated to achieve the outcomes you want. Begin with the end in mind. Then, ensure that you are taking the organization with you, and you are all headed to the same destination.

7 Questions to Clarify Your Objectives
  1. What are your regulatory drivers for ISO 13485 implementation? Are there dates associated with marketing plans that you need to take into account? Are there other regulatory requirements that need to be built into the QMS and the implementation plan, (e.g., incident reporting for Canada or a Technical File for CE marking?)
  2. What other regulatory requirements must you meet to get into international markets? ISO 13485 requires that you meet applicable regulations for each market, such as a training procedure to address 21 CFR 820.25, a post-market surveillance plan to address CE Marking requirements, and a Mandatory Problem Reporting Procedure for Canada.
  3. If you are a supplier to medical device manufacturers, what do your customers expect of your QMS? If they haven’t made this explicit already, ask them. Meeting their needs and their audits of your system may be as important to you as the certification audit.
  4. Do you want to achieve business improvements by implementing a QMS? If you include this in your stated objectives, and everyone “buys into” the program, then you will build procedures that deliver business improvements, rather than just being regulatory overhead.
  5. Do you have real buy-in from your CEO? You may have buy-in for certification, but if you don’t already have a regulated QMS, does she or he fully understand the cultural change that he or she must lead? If not, make this one of your unwritten objectives and keep it front of mind.
  6. Do you have organizational buy-in?  Ensure that it is clear who owns each process, and that those process owners have the ultimate responsibility for the compliance of their process and ownership of documentation that is created for those processes. Keep the project progress visible. Develop a communication plan with its objectives and targets, even if your organization is small.
  7. Do you want to align with other systems? If you already have a QMS, you will want to integrate ISO 13485 compliance with that. Do you also need to implement ISO 14971, the risk management standard? Since you are going to be doing this much work on your QMS, maybe you could take the opportunity to align it with your health and safety or environmental management systems.
Timeframes and Trade-offs

How long it takes to implement ISO 13485 will be covered in another blog soon.  Six months is a workable rule of thumb.

So what do you do if you don’t have that long, and have to meet a pressing deadline?  Or you don’t have the resources available to implement, as well as you want in the time available?  Compromises have to be made, and now it’s necessary to set short-term and long-term objectives.

6 Considerations in Shaping Your ISO 13485 Standard Implementation Objectives

If you are constrained from structuring the implementation project ideally, the following considerations below will assist you in shaping your objectives:

  1. Get a qualified consultant who understands your business. If you have a large company, find someone who spends more of their time working with corporates, and vice versa for a small company.
  2. Throw perfectionism out the window. The goal is not perfect procedures. The essence of a Quality System is documentation to explain the intent, records to capture reality, internal auditing, and monitoring to identify the gaps and CAPA to improve and maintain effectiveness. The Deming Plan-Do-Check-Act cycle assumes that you are never perfect.)
  3. Accept that you then have another round of work to do to improve procedures.
  4. Organizational buy-in is even more critical. Be very careful about setting expectations. Adjusting to the extra requirements of a regulated QMS is already tricky. In these circumstances, you may be asking people to live with procedures that are not as usable as they would like.
  5. Be especially careful to ensure that the auditor can tick off all the essential points, and find how you have fulfilled the requirements without hunting too hard. All the required procedures and records must be in place. It’s more important to address 100% of the requirements than to perfect 80% and skip the last 20%.
  6. Accept that there may be nonconformities that have to be dealt with after the certification audit. Set the organizational expectation around this and build time for it into your schedule. Ask your certification body early to tell you the timeframe for dealing with nonconformities.
Setting Expectations

Objectives need to be communicated clearly to everyone in the organization. For a project (and many other things in life),

Satisfaction (or Disappointment) = Actual Result – Expectation

The certification audit is not the end. You will still need people to align their effort into making the implementation succeed after the pressure and obvious deadline of the certification audit has passed.  Setting their expectations appropriately early in the project is essential to keeping their (and your) motivation going. This is especially important if you are building your QMS, short on time or resource, and therefore know that you need to do a lot of work in the year following certification to develop improved workable procedures and generate a recorded history of compliance.

 

This blog is part of a series of blogs that leads up to our Roadmap to Iso 13485 Certification Courses

Posted in: ISO Certification

Leave a Comment (0) →

Keeping Design Projects on Schedule: Using the CAPA Process

%name Keeping Design Projects on Schedule: Using the CAPA Process The author provides two steps to consider taking now and steps to take in the future that will help keep design projects on schedule using the CAPA process.

The ability to get new, high-quality products to market quickly is the most important core competency for a company to develop. What is your company doing to improve the performance of your design teams? If you have trouble answering the above question, you should consider performing a detailed internal audit of your design control process: http://bit.ly/AuditDesign.

The only significant change I would make to my recommendations from 2012 is to follow the GHTF guidance document for creating technical files using the STED format, instead of using NB-MED 2.5.1/Rec 5: http://bit.ly/GHTFSTEDGuidance. This approach to creating a technical file lends itself to meeting the Canadian Requirements for Medical Device Licensing, and this is the preferred format of Technical Files in Annex II of the proposed EU regulations.

At the end of the blog on how to audit design controls, Step 7 states that you should “Ask the process owner to identify some metrics or quality objectives they are using to monitor and improve the design and development process…If the process owner is tracking no metrics, you might review schedule compliance.” The two most common reasons why design projects are not able to keep pace with the design plan schedule are: 1) there are insufficient resources allocated for the project, and 2) the estimates of the duration for tasks in the schedule are too aggressive.

Step 1: Estimating the Duration of Tasks

Task duration is the easiest quality objective to track performance against. Whether you track design projects with an Excel spreadsheet or Microsoft Project, you can easily compare the actual duration of any project task with the estimated duration that was planned at the beginning of the project. It is important to measure the length of labor hours, rather than using the number of people because most design team members are multi-tasking. You can and should mine the data from previous design projects because this information is available now. As you go through historical data, you will also realize where there are weaknesses in how you capture data regarding labor hours.

Once you have the raw data, I recommend analyzing the data using % deviation and total hours. The % deviation will tell you which estimates were the least accurate, and the total hours will tell you which estimates have the most significant impact on the total project. Ideally, you will collect data from multiple projects, so that you can determine if the deviations are consistent from project-to-project.

This data analysis is important because the data analysis will help identify the root cause for inaccurate task duration estimates. You may also want to perform a Pareto Analysis of the data to prioritize which project tasks would benefit most from more accurate estimates. Once you have identified the root cause for inaccurate estimates, you can initiate Corrective And Preventive Actions (CAPA), where appropriate.

Step 2: Allocation of Resources

You may hear the phrase “Do more with less,” but I like to joke that design teams are expected to “Do everything with nothing.” If your design team is monitoring the accuracy of taking duration estimates for design projects, the accuracy of your project plans should improve. Your management team should also develop greater confidence in your teams’ ability to forecast product launch dates, thereby the estimates for resource needs. Managers frequently challenge you to achieve the impossible.

The most famous example of this is when Steve Jobs challenged Steve Wozniak to design the video game Breakout in just a few days. If you are the next Steve Jobs, and you have Woz on your team, keep aiming for the moon. If your team consists of mere mortals, you might need more resources. Your senior management may not have additional resources to provide, but it is critical to accurately estimate the resources needed for projects. If you can estimate accurately, you will have the following impact on your company:

  1. You will be able to estimate the amount of time to market that can be reduced by adding resources.
  2. You will be able to estimate the cost impact of unrealistic management timelines—instead of saying, “I can’t push it any faster, Captain.” (my favorite Star Trek quote).
Future Steps: Preventive Actions

In one of my previous postings (http://bit.ly/PASources), I stated, “The most fruitful source of preventive actions, however, is data analysis of process control monitoring.” If you are monitoring and measuring your design control process, you can use this approach to:

  • Identify preventive actions for your design process
  • Establish specifications for critical path tasks in each project
  • Calculate your design process capability for successful completion based upon historical data

The answer to the following question may help you identify your next design process improvement. How close are your estimates to achieving a Cpk > 1.33 for completing design verification protocols on-time? %name Keeping Design Projects on Schedule: Using the CAPA Process If you are interested in learning more about CAPA, please register for the Medical Device Academy’s CAPA Workshop on September 9 in Orlando, or on October 3 in San Diego. Click here to register for the event: http://bit.ly/MDAWorkshops.

Posted in: CAPA

Leave a Comment (2) →

How to perform a quantitative CAPA effectiveness check

This article review explains how to conduct a quantitative CAPA effectiveness check, and you will also learn three methods NOT recommended.

quantitative effectiveness check 1024x713 How to perform a quantitative CAPA effectiveness check

There are three methods NOT recommended for a CAPA effectiveness check:

  1. verifying the procedure was revised,
  2. verifying employees were retrained, and
  3. making sure mistakes don’t occur 3x in a row.

The best method is to establish quantitative criteria for effectiveness based upon data collected during the investigation of the root cause. The graph above is an example of objective evidence that preventive action was effective. The chart shows that the process capability (Cpk) was improved from 0.837 to 2.50 by changing a process set-point to adjust the mean of the dimension closer to the center of the specification range. This is typical of adjustments made during process validation and revalidation activities.

Incorrect Method 1: Verify the Procedure was Revised

When a nonconformity is identified during an ISO 13485 audit, the laziest way to “fix” the problem is to revise your procedure. Despite the fact that most FDA 483s identify inadequate procedures as the reason for observation, your procedures are seldom the problem. Your employees may not even be following the procedures. Repeatedly revising procedures may be part of the problem. If you must revise your procedures, please involve the people that use the procedures.

Incorrect Method 2: Verify Employees were Retrained

During your last surveillance audit, you may have revised the procedure, but your auditor noticed that there were no retraining records for employees that were performing the revised procedure. One interviewee was unable to identify where the new inspection step could be found in the revised procedure. It’s too bad the interviewee didn’t notice the bold and underlined text indicating recent revisions. Your auditor wonders how effective your retraining process is.

Incorrect Method 3: No Mistakes 3x in a Row

Last month a manufacturing engineer was assigned to perform an effectiveness check related to corrective actions implemented in the incoming inspection process. The procedure was revised to clarify the proper procedure for a statistical sampling of rolls of plastic film as a corrective action. The engineer sampled the three most recent lots of the same plastic film that was incorrectly sampled in the past. All three lots were correctly sampled in accordance with the revised procedure. The engineer reported that the corrective actions implemented were effective. However, you have two new nonconformities on your desk from manufacturing related to incorrect sampling procedures during an incoming inspection of other raw materials. Now you wonder if the incoming inspection procedure was the real root cause.

Corrective actions that are actually effective

Instead of adding something to your procedures each time someone makes a mistake, you might want to think about how you can simplify and streamline your procedures with fewer words. You can say things more clearly with pictures and flow charts instead of hundreds of words. Training effectiveness can be verified with exams that ensure employees “read and understand” your revised procedures. Finally, when you identify a nonconformity with one product, you need to ensure that you consider how similar mistakes might occur with similar products. Maybe you need a process for incoming inspection that doesn’t rely upon someone reading procedures.

You need to be objective to perform an effectiveness check

The biggest weakness of the auditing process is that it relies heavily upon the subjective opinion of an auditor. This is why auditors are supposed to audit against objective audit criteria in an international standard. The need for objectivity is also why there are guidance documents to clarify a consistent interpretation of those standards. Therefore, when you perform an effectiveness check, you also need objectivity. The best way to ensure objectivity is to establish documented criteria for effectiveness prior to finalizing your corrective action plan. Ideally, that will be in the form of a prospective process validation protocol with quantitative acceptance criteria.

How to ensure objectivity

The single best way to ensure objectivity when you are performing a CAPA effectiveness check is to define the post-implementation goal in terms of a quantitative quality objective. Ideally, you can graph the quality metric using historical data and current data. If you need statistical analysis to see a difference between pre- and post-implementation of the CAPA, then your CAPA was not effective. If your graph looks like a miracle happened and the metric changed almost overnight, and timing corresponds to the date your corrective action(s) was implemented, then your CAPA was effective.

How to set a quality objective for you CAPA effectiveness check

Some people have trouble with using a quantitative approach in performing effectiveness checks because some things are harder to measure than others. However, you can measure anything. For example, you can even measure employees forgetting to initial and date changes to quality records. This can be done by identifying critical control points where quality records are reviewed, and documentation errors are measured. You can measure by the employee, by form, by month, etc. The key to monitoring and measuring a process is to answer the following questions:

  1. Who will measure it?
  2. What will be measured?
  3. Where will it be measured?
  4. When will it be measured?
  5. How will it be measured?
  6. How will measurements be analyzed?
  7. Who will data analysis be communicated to?

When to Perform a CAPA Effectiveness Check

Many companies set arbitrary deadlines for performing an effectiveness check (e.g., – between 30 and 60 days of implementation of corrective actions). Some companies use a risk-based approach to their CAPA process, and the urgency of effectiveness checks may be a function of risk. I recommend a completely different approach. Instead of using an arbitrary or risk-based approach, I recommend monitoring your new quality metric to estimate how long it will take to reach your new quality objective.
%name How to perform a quantitative CAPA effectiveness check

If you are interested in learning more about CAPA, click here to register for Medical Device Academy’s Risk-Based CAPA webinar.

Posted in: CAPA

Leave a Comment (16) →

Where to Locate Preventive Action Sources

%name Where to Locate Preventive Action Sources

The author discusses why preventive action is important in developing a sustainable and robust quality system and where to locate preventive action sources.

Most ISO auditors and FDA inspectors view CAPA as one of the most important processes in your quality system. Still, the approach to preventive actions is distinctly different between the ISO Quality System Standards (i.e., – ISO 9001 and ISO 13485) and FDA regulations (i.e., – 21 CFR 820.100). Throughout the FDA QSR, corrective action and preventive action are always found together, while in the ISO Standards, preventive action is a separate clause (i.e., – Clause 8.5.3). The wording of the two clauses is nearly identical, but ISO certification auditors tend to be purists. Therefore, your ISO certification auditor will expect you to have at least some examples of CAPAs that are 100% preventive. Many auditors will issue a nonconformity if you have no examples that are 100% preventive.

Why is Preventive Action Important?

While I was conducting certification audits, I noticed that the better quality systems tended to have several examples of preventive actions. There were a few companies that had more preventive actions than corrective actions, and the quality systems at those companies happened to be much stronger in general—not just their CAPA process. Is this a coincidence?

No, the CAPA process is how you correct and prevent quality problems. In order to find preventive actions, you have to develop your other quality system processes. These companies have strategically chosen to create their quality systems to a higher level of performance because they know that preventing quality problems results will cost substantially less than waiting until problems occur, and then fixing those problems. These companies often talk about the “Cost of Quality,” and when you tour their facility, you see quality objectives being communicated to everyone.

I have only had a couple of clients in the past decade that argued about the importance of preventive actions, but most clients ask me, “Where can we find more?”

Guidance Documents

As a certification auditor, I was not allowed to “consult,” but was able to mention guidance documents that might help. Therefore, the number one guidance document I recommend is 13485 Plus (a document sold by the Canadian Standards Association – http://bit.ly/ShopCSA).

13485 Plus includes all Clauses of the 13485 Standard, including text from ISO 14969—an international guidance document for the implementation of ISO 13485. In section 8.5.3 of the guidance document, you will find the following list of preventive action sources:

  1. The purchased product rejected on receipt
  2. Evidence that previous decisions affecting product conformity were false
  3. Products requiring rework
  4. In-process problems, wastage levels
  5. Final inspection failures
  6. Customer feedback,
  7. Warranty claims,
  8. Process measurements,
  9. Statistical process control documents,
  10. Identification of results that are out-of-trend, but not out-of-specification,
  11. Difficulties with suppliers,
  12. Service reports, and
  13. Need for concessions.
Practical Experience

In addition to the sources listed in guidance documents, there are three other sources that I like to recommend consulting clients. One source is your internal audit process. Auditors verify the conformity of processes, but internal auditors should also look for processes that are inefficient and need improvement. When auditors are performing a process audit, some process owners have difficulty identifying process metrics that are being tracked for each process. Auditors should be trained to follow the audit trail when process monitoring is absent because processes that are not already measured usually have more room for improvement than processes currently being measured.

Another source of preventive actions is the Total Product Lifecycle Database on the FDA website (http://bit.ly/FDATPLC). Every three-letter product code has a corresponding database report that you can use to identify product malfunctions and adverse events associated with competitor products. Learning from the mistakes of your competitors and implementing appropriate preventive actions internally is a great way to avoid the need for corrective actions—especially for design malfunctions.

The most fruitful source of preventive actions, however, is data analysis of process control monitoring. This source can identify negative trends within your company’s manufacturing process and suppliers’ processes. Catching a negative trend before products and components are nonconforming reduces the number of corrective actions needed, the cost of scrap or rework, and eliminates delays that result in customer complaints.

Setting a CAPA Quality Objective

As your company begins to develop additional sources of preventive actions, you may want to consider establishing a Quality Objective for your CAPA process. The most common Quality Objectives for a CAPA process are:

  1. Initiate at least one new preventive action per quarter
  2. Close all CAPAs within 90 days
  3. Reduce the average aging of CAPAs to <45 days

However, I would like to suggest another possible Quality Objective:

  1. Increase the ratio of preventive actions to corrective actions to > 1.00

To be successful in achieving this Quality Objective, you will need to increase your preventive actions and decrease the number of corrective actions. The reduction of corrective actions indicates that you are identifying potential problems before corrective action is required. In contrast, the increase in preventive actions indicates that your process for identifying potential problems is becoming more effective.

%name Where to Locate Preventive Action Sources

If you are interested in learning more about preventive action, please register for the Medical Device Academy’s CAPA Workshop on September 9 in Orlando, or on October 3 in San Diego. Click here to register for the event: http://bit.ly/MDAWorkshops.

Posted in: CAPA

Leave a Comment (3) →

Root cause analysis – Learn 4 tools

The author describes four tools (Five Why Analysis, Is/Is Not Analysis, Fishbone Diagram, and Pareto Analysis) and how each one can help conduct effective root cause analysis.

Quality problems are like weeds. If you don’t pull them out by the root, they grow right back.

Training on the 4 Tools

Most companies are doomed to repeat their mistakes because the root cause of their mistakes is not fixed. Why don’t companies fix their mistakes? Because the people responsible for the corrective actions (CAPA), were not adequately trained on root cause analysis. Adequate training on root cause analysis requires three things:

  1. Courage to admit that your process is broken
  2. Learning more than one tool for analyzing problems
  3. Practicing the use of root cause analysis tools

If your auditor identifies a nonconformity and you disagree with the finding, then you should not accept the finding and state your case. If an inspector rejects a part, and you believe the part is acceptable, then you should allow the part to be used “as is.” In both of these cases, however, you need to be very careful. Sometimes the problem is that “acceptable” is not as well-defined as we thought. I recommend pausing a moment and reflecting on what your auditors and inspectors are saying and doing. You may realize that you caused the problem.

Once you have accepted that there is a problem, you need to learn how to analyze the problem. There are five root cause analysis tools that I recommend:

Root Cause Analysis Tool # 1 – 5 Why Analysis

A “Five Why Analysis” is not just five questions that begin with the word “why.” Taiichi Ohno is credited with institutionalizing the “Five Why Analysis” at Toyota as a tool to drill down to the root cause of a problem by asking why five times. I have read about this, used this tool, and taught this concept to students, but I learned of a critical instruction that I was missing when I read Toyota Under Fire.

In that book, Jeff Liker makes the following statement, “Toyota Business Practices dictates using the ‘Five Whys’ to get to the root cause of a problem, not the ‘Five Whos’ to find a fire the guilty party.” At the end of the book, there are lessons learned from Toyota’s experience. Lesson 2 says, “There is no value to the Five Whys if you stop when you find a problem that is outside of your control.” If your company is going to use this tool, it is important that the responsible person is the one performing the five why analysis, and asks why they didn’t take into account forces that are out of their control.

5 why analysis for root cause analysis 1024x700 Root cause analysis   Learn 4 tools

Root Cause Analysis Tool # 2 – Is/Is Not Analysis

The next tool was presented to me at an AAMI course that I attended on CAPA. One of the instructors was from Pathwise, and he explained the “Pathwise Process” to us for problem-solving. A few years later, I learned that this tool is called the “Is/Is Not Analysis.” This tool is intended to be used when you are having trouble identifying the source of a problem. This method involves asking where the problem is occurring as a potential clue to the reason for the problem. For example, if the problem only occurs on one machine, you can rule out a lot of possible factors and focus on the few that are machine-specific.

The reverse approach is also used to help identify the cause. You can ask where the problem is not occurring. This approach may also lead you to possible solutions to your problem. For example, if the problem never occurs on the first or second shift, you should focus on the processes and the people that work on the third shift to locate the cause. The “Is/Is Not Analysis” is seldom used alone, but it may be the first step toward locating the cause of a quality problem.

Root Cause Analysis Tool # 3 – Fishbone Diagram

fishbone Root cause analysis   Learn 4 tools

This name comes from the shape of the diagram. Other names for this diagram are the “Cause and Effect” or “Ishikawa” diagram. If a problem is occurring in low frequency and has always existed, this might not be your first tool. However, I typically start with this tool when I am doing an investigation of nonconforming product—especially when rejects suddenly appear.

If you are baffled about the cause of a problem, brainstorming the possible causes in a group sometimes works. However, I like to organize and categorize the ideas from a brainstorming session into the “6Ms” of the Fishbone Diagram.

Root Cause Analysis Tool # 4 – Pareto Analysis

The fourth root cause analysis tool is the Pareto Analysis named after Antoine Pareto. This tool is also a philosophy that was the subject of a book called The 80/20 Principle: The Secret to Achieving More with Less. The Pareto Analysis is used to organize a large number of nonconformities and prioritize the quality problems based upon the frequency of occurrence. The Pareto Chart presents each challenge in descending order from the highest rate to the lowest frequency. After you perform your Pareto Analysis, you should open a CAPA for the #1 problem, and then open a CAPA for the #2 problem. If you get to #3, consider yourself lucky to have the time and resources for it. We have an example of a Pareto Chart in our article on FDA 483 inspection observations from 2013.

Additional Training Resources

If you are interested in learning more about root cause analysis and practicing these techniques, please register for the Medical Device Academy’s Risk-Based CAPA training.

Posted in: CAPA

Leave a Comment (15) →

A3 Reports – The Missing Link to Effective CAPA Process Management

A3 Workbook A3 Reports – The Missing Link to Effective CAPA Process ManagementYour CAPA process is the most important process in your Quality System for two reasons. First, CAPA is the tool you use to fix quality problems. Second, your CAPA process is guaranteed to be an area of interest for your next FDA inspector.

If CAPA is so important, why do companies still have inefficient CAPA processes?

When auditors review a CAPA process, some of them start by reading the procedure. When FDA writes a 483 observation about CAPA processes, the wording begins with “Procedures for corrective and preventive action have not been adequately established. Specifically…”. The approach of auditors and inspectors seems to suggest that your procedure is the key to an effective CAPA process, but your procedures are not the reason for the success or failure of processes.

Processes are effective when the management of the processes is effective. If a CAPA falls behind schedule, writing a justification for an extension is a process “solution.” A real solution is managing the process better. Management needs to monitor the progress of CAPAs regularly, should prioritize resources to ensure that CAPAs are completed on time, and needs to make decisions on which actions should be taken to prevent recurrence of quality problems. Therefore, you need to spend more time developing a method of managing CAPAs than you spend developing the CAPA process itself.

What is an A3 Report?

An A3 report is a tool that is ideally suited for managing CAPAs. “A3” refers to the size of the paper used (i.e., – approximately 11”x17”). An A3 report is a one-sided, single piece of paper that is used to build consensus among company management when you are making an important decision. The initial draft of the A3 report is distributed to each of the affected departments to ensure that all possible inputs to a quality problem are received. By encouraging 360-degree feedback for a proposed solution to a quality problem, you will ensure that the CAPA you develop addresses the issue completely.

In addition to encouraging 360-degree feedback, an A3 report includes an analysis of the problem, identification of the cause, proposed actions that require management decision, a section for documenting actions taken, and a follow-up section for management to review at specific milestones during the implementation plan. Including all of this information in one page forces CAPA owners to summarize information for management, and the standardized format makes it easier for managers to locate the information they want.

Here’s how these sections would be used for managing CAPAs.

Analysis of the Problem

This section is identical to the section of a traditional CAPA record, where the investigation of the problem is documented. This is where tools such as 5 Why analysis, Pareto charts, and Fishbone Diagrams would be used to illustrate the analysis of the problem. This section may change a great deal during the 360-degree review of the A3 report.

Root Cause or Potential Cause

In this section, there should be a concise statement of the root cause for corrective action plans or the potential cause(s) for preventive action plans. During the initial review of the A3 report, management may ask the person or team assigned to the CAPA to investigate the problem in greater depth or investigate other possible sources of information if the analysis appears to be inadequate. Management should also ensure that the causes are within the control of the company to correct or prevent. Identifying a cause that is outside the control of the company is just placing blame.

Proposed Actions

This section is similar to a typical CAPA plan, but the section includes the reason(s) why the proposed actions are recommended. The reasons why actions are proposed is important during the process of management reviewing the initial A3 report and approving the recommended actions. The best practice is to phrase the reasons in terms of quantitative results that will be achieved because this will provide a framework for metrics during follow-up by management.

Actions Taken

This section of the A3 report is updated throughout the implementation of the project. By comparing this section with proposed actions, management can monitor the status of each task included in the CAPA plan.

Follow-up

This section of the A3 report identifies how management will monitor the implementation of actions and when. The initial A3 report identifies what management will be monitoring, how it will be monitored, and at what milestones. Ideally, the monitoring includes quantitative metrics that demonstrate the effectiveness of the CAPA. During the implementation of the CAPA plan, actual metrics will be recorded in this section, and any adjustments that management makes are recorded here.

If you are interested in learning more about A3 reports, you can learn more from Daniel Matthews at http://bit.ly/A3Workbook.

You can also learn more about improving your CAPA process by attending one of the workshops on CAPA: September 9 in Orlando or October 3 in San Diego. Each workshop is one day, and early bird pricing is $249 per day if you register before August 1. Click Here to learn more: http://bit.ly/12AxxQ0

Posted in: CAPA

Leave a Comment (0) →

Benefits of Incorporating Risk Management into Procedure Documents

By Guest Blogger, Brigid Glass
8971385878 db2fe2e49a q Benefits of Incorporating Risk Management into Procedure DocumentsThe author discusses the benefits of incorporating risk management into procedure documents. An example procedure for Record Control is included.

When I was first introduced to FMEA many years ago, I loved it. I loved the systematic approach and particularly appreciated using a Process FMEA to explain to those involved with a production process why certain controls had been put in place. I enthusiastically taught FMEA to our engineers. At the time, our bubbly, buoyant, outcomes-focused Training Manager said to me, “You Quality people have such a negative outlook. You’re always looking for what can go wrong!”  Well, yes, but it’s our role to prevent things from going wrong!  I’d found a tool to help me with that.

Next, there was EN 1441, a risk analysis standard that never satisfied, and always felt incomplete. ISO 14971 followed, covering the entire lifecycle of a product, with closed feedback loops.  So now, risks in product and process design were well covered, but ISO 13485 section 7.1 asks us to “establish documented requirements for risk management throughout product realization.”  Many of us would acknowledge that we could do better, even though we pass audits.  And what about the rest of the quality management system?  I know that when we document a procedure, we already apply risk management principles in our heads, but we usually don’t apply them systematically or write down the results.

The Idea

Recently, Rob Packard and I started work on a project that requires us to generate a full set of documentation for a QMS, compliant with both U.S. and EU requirements, including ISO 13485 and ISO 14971. We each had our ideas on how best to write a procedure, but this project provided us an opportunity to get some synergy going. Rob wanted to address risk management in each procedure. “Yes!” I said, thinking that there was a chance to fill that gap. But then it was my job to develop the template for the procedures and work out how to accomplish this…

My first results looked very complicated, so I took the KISS (Keep It Simple, Stupid) approach: one column for the hazards and consequences, and one for the risk control measures.

What I didn’t include:

  • I started with more complex hazard documentation (hazard ID, impact, trigger event, etc.). Still, I felt the benefits in the context of a procedure document was not balanced by the extra complexity and work required for analysis and training. It would be a hard sell to users within an organization who were not used to the risk management approach.
  • I decided not to assess risks and controls quantitatively for the same reasons as in the bullet point above.
  • Initially, I included references to implementation, but this would be difficult to maintain as other documents changed.
  • I thought about verification of the implementation of risk controls, then decided to leave that verification to reviewers.

Below is an example from a procedure for Record Control where records are completed on paper, then scanned as a pdf. My list won’t be the same as your list, but it is illustrative.

brigid chart 1 Benefits of Incorporating Risk Management into Procedure Documents

Standards and regulations are essentially a set of risk controls, so they are the first starting point when identifying hazards. The list should include direct risks to products, risks to the integrity of the QMS, and regulatory risks. For those of us who have been in this industry for a while, experience, past mistakes, questions fielded in external audits, and observations of other systems will yield further hazards and appropriate controls. Audits provide the opportunity to update and refine the list and test the control measures.

Benefits of Incorporating Risk Management into Procedure Documents

  • Impresses your ISO 13485 auditor!
  • When first writing procedure documents, starting the writing process by reviewing the external requirements, and systematically writing the risk section, sharpens the mind as to what must be included in the procedure. This is the same approach as in design controls, where we include risk mitigators that apply to product design in the design inputs. This is part of planning in the PDCA cycle.
  • Supports future decision-making, in the same way, that the risk file for a product is considered when a design is changed. The risk control section of a procedure provides the criteria against which any improvement or change can be assessed. Will it enhance the risk controls, or might it introduce a new hazard?
  • Serves as the basis for training on the procedure. Making visible the link between potential hazards and procedural controls much more convincing than saying, “Do this because the procedure says so,” or, “It’s in the procedure because the regs say so.”

This is part 1 in a series of blogs that leads up to our Roadmap to Iso 13485 Certification Courses

 

Posted in: ISO 14971:2019 (Risk Management)

Leave a Comment (0) →

CAPA Form – 15 tips to avoid CAPA failure

This blog reviews 15 tips for creating an effective CAPA form including source, quality issue description, and the root cause investigation.

Your cart is empty

CAPA Form 1024x362 CAPA Form   15 tips to avoid CAPA failure

The reason for creating a “great CAPA form” is to improve the effectiveness of your CAPA process. Anyone in your company could be assigned to a CAPA, but not everyone is a CAPA expert. Therefore, designing an effective CAPA form can reduce errors and improve the effectiveness of the actions taken. You can also purchase our CAPA procedure and CAPA form, which is compliant with ISO 13485:2016.

Corrective and Preventive Action CAPA Procedure CAPA Form   15 tips to avoid CAPA failure
SYS-024 Corrective and Preventive Action (CAPA) Procedure, Form, and Log

SYS-024 – Medical Device Academy’s newly updated CAPA procedure is a 6-page procedure. Your purchase will also include our CAPA form (FRM-009), and our CAPA log (LST-005). The procedure is compliant with ISO 13485:2016, 21 CFR 820.100, SOR 98/282, and the EU MDR. You will also receive free updates in the future. We are currently distributing our 16th version of the procedure.

Price: $299.00

Provide adequate space in CAPA form

The most important feature of a CAPA form is to ensure that there is adequate space for writing a complete response for each section. Having sufficient space is more important than the benefits of a shorter record.

Date your CAPA form was initiated

The date your CAPA form begins to be completed can be used to verify that there was no “undue delay” in the initiation of a CAPA in response to internal audit findings. The date of initiation is also used to calculate the due date for completing the investigation and providing a corrective/preventive action plan.

Include a cross-reference number in your CAPA form

This is typically a sequentially assigned CAPA log number. Ensure the number is prominent on all pages—just in case pages are separated.

CAPA source

The source of a CAPA is useful information when performing data analysis—especially for internal audits where the audit schedule should reflect the results of previous audits. Examples of CAPA sources include:

  • Complaints/Reportable Events
  • Internal, Supplier, and Third-Party Audits
  • Service Work Orders
  • Nonconforming Materials
  • Management Reviews

Description of CAPA issue

I use the word “issue” instead of nonconformity because you need a CAPA form that will work for potential nonconformities (i.e., – preventive actions), as well as nonconformities. Typically, the wording is identical to a customer complaint or an auditor’s text, but the description of the issue identifies the symptoms observed. Specific references to records, locations, times, equipment, products, and personnel involved may be necessary for the root cause investigation.

The investigator assigned and target due date for the plan

In ISO 13485:2016, the only change to the requirements for corrective actions and preventive actions was the clarification that planning is required. Since this was always implied in the standard, your procedure should already comply with clauses 8.5.2 and 8.5.3 in the 2016 version of ISO 13485.

This section of your CAPA form should identify who is going to investigate the root cause of the issue and the date that a corrective/preventive action plan is needed. The FDA requires submitting a corrective action plan for all 483 observations within 15 business days, or it will result in an automatic Warning Letter. Most certification bodies require a plan within 30 days. Your target due date should be risk-based unless there is a specific regulatory requirement. The date will also need to be based upon the date the issue was identified—not necessarily the date the CAPA was initiated.

Documenting the investigation of the root cause is the #1 item in a CAPA form

This section always reminds me of the story about the Ohno Circle. Every company asks if they can close a nonconformity during an audit, and the answer should always be “No.” You can correct a problem, but you cannot perform a root cause investigation and implement an effective corrective action during the same audit. You need to investigate the cause and the investigation documented. Some companies include a specific tool in this section, such as a “Fishbone Diagram.” This is also a mistake because there are many root cause analysis tools, and you need to select the best one for your specific situation. You might even need to use more than one tool.

Is your CAPA form missing containment of nonconforming product?

If the issue requires preventive action, there is nothing to contain. If the issue is specific to a procedure’s deficiency, there is also nothing to contain. If the issue requires corrective action and nonconforming materials or products are involved, then you need to quarantine the affected items. If the affected product has already left the company’s direct control (see 21 CFR 806.2(l) for a definition), then you have a potential recall. Regulators often look for “bracketing” or “bounding” of the upper and lower lot limits for an issue. Therefore, this section is where you document the rationale for why certain lots of products/materials are quarantined, and other lots are not.

Correction(s) – Your CAPA form must separate this from corrective actions

Fixing the immediate problem does not prevent a recurrence, but regulators will verify that each occurrence of the issue identified during the investigation of the root cause has been corrected. You should verify that each of the nonconformities identified in the original finding and the investigation is addressed in this section of your CAPA form. For preventive actions, this section is not applicable.

Corrective Action Plan/Target Due Date for Implementation

These are the steps planned to prevent a recurrence. If the plan changes, then it should be updated. There is no need to delete the old version of the plan, but the new version should include a date when the plan was revised. For preventive actions, this section is not applicable. The target date of implementation should reflect the risk associated with the issue.

Preventive action plan / target due date for implementation

These are the steps planned to prevent the occurrence of nonconformity. If an issue occurred for one product, but not for others, the actions taken for other products can be preventive. In this case, both the corrective action plan and the preventive action plan sections should be completed. The target date of implementation should reflect the risk associated with the issue.

Corrective and preventive actions implemented – Update your CAPA form weekly

This section details what specific actions were performed—both corrective and preventive actions can be documented here. The dates of completing actions should be documented, and reasons for delays and overdue actions should be identified.

How to document your plan for verification of effectiveness – CRITICAL

I recommend filling this section before the plan for corrective and preventive action is developed. This often helps the person developing the plan to ensure that the actions planned are adequate. Whenever possible, this should be quantitative, and it helps to identify a specific date for performing the effectiveness check.

Verification of effectiveness

This section of your CAPA form is where you document verification of effectiveness. Specifically, what verification activities were performed to ensure that the corrective and preventive actions you implemented were effective. The date verification of effectiveness was performed should be documented, and if the actions were not effective, then a new CAPA should be referenced here.

Signature and closure date

Someone needs to review, sign, and date your CAPA form when it is completed. Often, regulators will review only closed records.

Posted in: CAPA

Leave a Comment (5) →
Page 20 of 25 «...101819202122...»