Retired course
This course has been retired and is no longer supported.
About this lesson
A Lean Six Sigma Black Belt will often chair the stage gate review meetings for Lean Six Sigma projects. In those meetings, the Black Belt needs to ensure the work of the phase was done and the tools were used effectively. This lesson reviews the normal deliverables due at the Measure stage gate review. It also includes hints and tips for identifying problems to be avoided during that phase.
Exercise files
Download this lesson’s related exercise files.
Measure Stage Deliverables.docx61.4 KB Measure Stage Deliverables - Solution.docx
61.3 KB
Quick reference
Measure Stage Deliverables
The Measure Stage is the second stage of a Lean Six Sigma project. The deliverables from this stage are the data and metrics used for the analysis that occurs in future stages of the project.
When to use
The Measure Stage deliverables should be reviewed and approved at the Measure stage gate review meeting.
Instructions
Throughout the Measure Stage the Lean Six Sigma team is creating the deliverables. The deliverables are the data that is used to clarify the problem statement and the process map or value stream map with data that demonstrates current performance. Normally, the problem statement and process map/value stream map are reviewed and approved during the Measure stage gate review. These maps and the problem statement provide a clear focus for the analysis that will occur in later stages. While data is usually collected for each step in the process map/value stream map; the data collection is focused in the area of the perceived defect or problem. The final result of this stage is a data-based problem statement that describes in measurable terms the magnitude and characteristics (when and where) of the defect.
The focus of this stage is collecting reliable and relevant data. To ensure the data is reliable, a measurement systems analysis is often needed. There is an entire GoSkills course addressing this topic. The bottom line is that the measurement system error (and there is always a measurement system error) should be very small with respect to the measurement variation. This data will serve as the baseline process performance that is used for analysis of the process and to demonstrate that the improvement that is implemented has made a significant difference in the process performance.
The Lean Six Sigma equation is Y=f(x). In this stage, the “x” terms are defined and data collected for each term that establishes the range of the term. Be certain when collecting data from multiple sources that you are using consistent units.
A major challenge for effective analysis in later stages will occur if the problem statement is not clear or the data is inaccurate. When the analysis is not able to establish root causes. As a Black Belt, you will need to review the process for data collection and you will want to ensure the problem statement is specific without assuming a solution. Question you often must work through are:
- Is this the correct Problem Statement and process map/value stream map? Have you walked the process and does the data support this problem statement?
- What data sources and data sets were used? Are you confident that the measurements are accurate?
- What is the real baseline process performance? What is the magnitude of the defect?
Hints & tips
- Use historical data where it is available. This data is usually faster to obtain and you don’t need to worry about the Hawthorne Effect.
- Minimize the Hawthorne Effect as much as possible. This effect usually results in different performance by operators (normally better) because they know someone is watching and measuring what they are doing. Try not to introduce any new data collection steps or actions in the process.
- If your data collection is manual, do a measurement systems analysis, especially in and around the defect zone of the project, to ensure that you have valid data. I had a project one time that had already failed several improvement attempts. When I started to work with the team, I insisted on an MSA for the primary inspection measure. We found that the measurement error was nearly three times larger than the allowed tolerance. The measurement system was the problem in this case – not the process.
- Know the metadata for your data sets, especially if the data set was not collected by your team. You need to ensure you know what was measured, how it was measured, and the measurement system or units. It is as important to know what was not measured as it is to know what was measured.
- Document your baseline performance so that you can demonstrate your solution has made a difference.
- Do a thorough walk-through of your process map/value stream map. There are often overlooked steps that do not make it onto the map. It is also a good idea to do multiple walk-throughs to minimize the Hawthorne Effect.
- Don’t jump to a conclusion from the first piece of data. Collect all your data and save analysis for the next stage. Otherwise, you are likely to jump at the first root cause you see and may miss other important ones.
- 00:04 Hi I’m Ray Sheen,
- 00:05 I want to summarize this sections by discussing the Measure stage deliverables,
- 00:10 and some of the challenges that you may encounter while does are being developed.
- 00:16 Let’s start by looking at the gate reviews and
- 00:18 what’s required to get through that meeting.
- 00:20 The focus of the gate review is to collect reliable and
- 00:23 relevant data that establishes the specific nature of the problem.
- 00:28 This means you would need an accurate process map so that you can clarify where
- 00:32 the problem exists, and the data demonstrates the magnitude of the problem.
- 00:36 That means that our critical take-away are the process map or value stream map and
- 00:41 a clearly defined problem statement.
- 00:43 With those, we can say with specificity, this is the problem.
- 00:48 The decision that occurs at this gate is an approval of the problem statement.
- 00:52 This statement should not assume a solution,
- 00:55 but should clearly state the defect with measurable criteria.
- 00:58 And of course, this points to the biggest risk or challenge of this phase.
- 01:03 That is, a problem statement that is either to vague or ambiguous on one hand,
- 01:07 or that is so specific that it assumes the root cause in the problem statement.
- 01:11 The problem statement should not include the word because, however, it should have
- 01:16 a measurable defect that directly relates to the customer CTQ from the Define stage.
- 01:21 Another major challenge in this stage is the collection or aggregation of data that
- 01:26 is not accurate where it does not reflect the actual process performance.
- 01:30 The data must be relevant and MSA should show that it can be trusted and
- 01:34 that you have minimized the Hawthorne effect.
- 01:37 As you're preparing for the gate review and sometimes during the gate review,
- 01:41 you can expect several questions to come up again and again.
- 01:45 Challenge the team to be certain that there is a good answer to each of these.
- 01:49 Is this the correct problem statement and process map or value stream map,
- 01:53 have you walked the process?
- 01:54 Is the problem statement based upon the actual data collected,
- 01:58 what data sources and data sets were used?
- 02:01 Did you rely on historic data, can you trust it, did you collect new data?
- 02:06 Is the measurement system effective, how do you know,
- 02:09 what is the real baseline process performance?
- 02:12 Is the situation as bad as we thought, worse, or
- 02:15 better, what is the current process capability or Sigma level?
- 02:20 Of course, you don't want to hold a gate review if you're not ready.
- 02:23 So let's look at typical criteria for what is needed for a successful,
- 02:27 Measure gate review.
- 02:28 The primary decision is the approval of the problem statement.
- 02:31 So a key success criteria is to have a complete and
- 02:34 factual-based problem statement.
- 02:36 You will also normally prepare the process map, or value stream map,
- 02:40 to illustrate the location and the process of the defect or defects.
- 02:44 This also will help to illustrate the current process performance.
- 02:48 Be prepared to explain your data sources, both the existing ones that you used and
- 02:52 any new ones that you collected.
- 02:54 You don't need to show the raw data, but summarize data that illustrates process
- 02:59 baseline performance is always good to show.
- 03:02 And of course, you can expect to get questions about the accuracy and validity
- 03:07 of the data, especially if it appears to put one department in a bad light.
- 03:11 Have your MSA ready to discuss it if needed.
- 03:15 I have found that the stakeholders often wanna talk about the baseline performance.
- 03:19 Many times they've only had a vague sense that something is wrong in this area, and
- 03:24 that is why they wanted to do a Lean Six Sigma project.
- 03:27 Now you have real data that shows the real problems.
- 03:31 They often want to dig in and understand the baseline performance with respect to
- 03:35 cycle time, defect rates, throughput, and process capability.
- 03:39 If your data shows a time dependency to the problem highlight this also.
- 03:44 Let's finish this up by providing a few tips and hints to help you get through
- 03:49 this stage and have a successful stage review meeting.
- 03:52 Leverage the historical data, it can be a gold mine of information.
- 03:57 It may not have everything you want, but often it will have most of what is needed.
- 04:01 Always be aware that when collecting data,
- 04:04 you're introducing a possible Hawthorne Effect.
- 04:06 People perform differently when they know that they're being watched,
- 04:10 so keep the intrusion to a minimum.
- 04:13 Since the problem statement is based upon defect data collected,
- 04:16 make sure that that data is accurate.
- 04:19 If there's any place where you need to do an MSA or gauge RNR, this is the spot.
- 04:24 If you're using a data set that was generated historically or
- 04:28 from another project, be sure you understand what each data element means,
- 04:32 that's referred to as the meta-data for the data set.
- 04:35 Establish the baseline performance, not only in the area of the defect but
- 04:40 for the entire process.
- 04:41 When the solution is implemented,
- 04:44 you will need to be able to show that it has improved the defect area while
- 04:48 not degrading performance in other areas of the process.
- 04:52 Do a walk-through of the process,
- 04:54 in fact do several walk-throughs so as to minimize Hawthorne Effect.
- 04:58 You wanna be able to say with confidence that your process map is accurate.
- 05:02 Don't rush to analyze, get all your data. Jumping too soon to a conclusion will
- 05:08 likely get you to an incomplete picture of the root cause or causes of the defect.
- 05:13 As a Lean Six Sigma black belt, it's your job to make sure that the deliverables for
- 05:19 the Measure stage are completed, both for the projects that you're leading, and
- 05:23 the projects that you're coaching.
- 05:24 You need to ask the hard questions of the team before you go to the gate review.
Lesson notes are only available for subscribers.
PMI, PMP, CAPM and PMBOK are registered marks of the Project Management Institute, Inc.