Challenges in Quality by Design Adoption
Challenges in Quality by Design Adoption
TABLE OF CONTENTS
Table of contents 2
Executive summary 3
Introduction 5
Methodology 6
Overview of current state of QbD 7
Key adoption challenges 9
Business case for QbD 14
Implications for FDA 19
Appendix 23
Confidential – Page 3
EXECUTIVE SUMMARY
This report is the result of work done with the FDA, CDER - Office of Pharmaceutical
Sciences as part of its effort to facilitate adoption of QbD. Its purpose is to help
understand the challenges and opportunities for adoption of Quality by Design (QbD).
The work was conducted with input from several sources: an outside press search / scan
of relevant articles, conferences, databases, interviews with internal experts, as well as a
set of blinded industry interviews.
These inputs uncovered several key facts about the state of QbD adoption as well as
potential catalysts.
1) The understanding and practice of QbD is evolving, gaining momentum and
passion throughout the industry
2) More than half of companies interviewed identified the business case as
strong, however, there are still some skeptics
3) Despite the acknowledgement of a strong business case, companies are at
different levels of maturity – characterized by four segments – Novice, Pilot,
Rollout, and Fully implemented
4) 10 key challenges are the most problematic for QbD adoption. These
challenges are evaluated by their relevancy against different drug types as well
as different levels of adoption
y The first four challenges occur within companies
– Internal misalignment (i.e., Disconnect between cross functional areas,
e.g., R&D and manufacturing or quality and regulatory)
– Lack of belief in business case (e.g., “There is a lot of uncertainty over
timing of and investment requirements for QbD implementation”)
– Lack of technology to execute (e.g., Difficulty managing data, limited
understanding of Critical Quality Attribute (CQA) implications)
– Alignment with third parties (i.e., How to implement QbD with
increasing reliance on suppliers and contract manufacturers?)
y The next six challenges are directly related to the FDA
– Inconsistency of treatment of QbD across FDA (e.g., “Although a
number of people in the FDA are supportive of QbD – this is not
consistent”)
– Lack of tangible guidance for industry (e.g., “We understand what
you are asking for broadly, but there are hundreds of variables – there’s
got to be an end in mind – a tangible one we can deliver on”)
– Regulators not prepared to handle QbD applications (i.e., reviewers
at different levels of understanding and acceptance)
Confidential – Page 4
INTRODUCTION
In 2003, the Federal Drug Administration released its Final Report on Pharmaceutical
current good manufacturing practices (cGMP) for the 21st Century. The cGMP initiative
described a “Desired State” for pharmaceutical manufacturing through QbD in which:
The industry has made progress on QbD since the FDA began its 21st Century Quality
Initiative, but this has been a limited number of QbD submissions to date. Despite the
compelling case, the widespread change that the FDA envisioned has not happened at the
pace that was envisioned. Achieving the 21st Century Quality vision will require a
transformative journey for the industry that demands a significant shift in its development
process. This transformation has not taken place due to challenges within companies,
within the FDA, as well as the international regulatory community.
This report is the result of a detailed look at the current state of QbD adoption, focusing
on the challenges preventing full scale implementation. The report additionally takes
preliminary steps to build and quantify a business case for QbD.
Confidential – Page 6
METHODOLOGY
This report was generated with inputs from three main sources.
Data mining within internal McKinsey resources
Extensive search of McKinsey database, including case study libraries, benchmarking
efforts, articles, survey databases, and conference presentations. Team identified and
analyzed relevant materials, including previously obtained industry data and surveys, to
act as a supplement to industry interviews. Team additionally conducted several
interviews with global leading McKinsey experts in strategy, R&D, operations, quality
and product development across Pharmaceuticals, Biologics, and Generics. Experts
shared their knowledge and perspectives from many years of experience dealing with key
decision makers in industry to help push thinking on the topic.
Public publication search
Extensive search for most relevant industry articles, publications, and web resources.
Team identified and analyzed relevant materials to act as a supplement to industry
interviews.
Interviews with industry leaders
The steering committee identified a set of industry leaders from leading Pharmaceutical,
Biotechnology, and Generic pharmaceutical companies across Technical Development,
Pharmaceutical Science, Chemistry Manufacturing and Control, Operations, and
Regulatory. Team conducted interviews with identified set of leaders focusing on four
main areas: (1) current state of the company’s QbD adoption (2) perceived challenges or
barriers to QbD adoption (3) business case for QbD and (4) potential steps to catalyze
QbD adoption.
Exhibit 1: Outline for Industry Interviews
¶ Current state of company’s QbD adoption
o Company definition of QbD
o Current scope of application (mechanisms in place to support)
o Source of motivation to utilize QbD
o Characterization / Track record of company’s QbD efforts
o For generics manufacturers, impact of Question Based Review (QBR)
¶ Perceived challenges or barriers to QbD adoption
o Technical / scientific barriers
o Internal / organizational realities
o External / regulatory / market driven factors
¶ Business case for QbD
o Perceived business benefits from implementation - anticipated / realized
o Costs to implement – anticipated / realized
o If applicable, comparison of development costs of QbD relative to traditional
¶ Potential steps to catalyzing QbD adoption
o Internal to company
o Technical / scientific
o Regulatory (FDA related, International)
Confidential – Page 7
QbD has continued to gain momentum over the past year. One of the most striking
factors has been an increase in the codification and practice of QbD on a standardized
basis. More and more companies are experimenting with the concept and developing
mechanisms to support it. This is accented by an increase in the passion and recognition
of QbD. Several companies, although not the majority, expressed the opinion that this is
something they would do regardless of regulatory benefits from the FDA.
As companies invest and gain experience with QbD, there are also increasing demands
for the FDA and other regulatory bodies. Two major demands that have emerged are the
need for greater clarification of acceptable methods of execution and filing and or
concrete tangible examples, as well as better codification of the benefits FDA ‘promised’
when QbD was originally advocated.
33
50
Strong business
case with multi-year
payback
[Pie chart showing the belief in the business case for QbD. Strong case with multi-year payback = 50%,
Business case is uncertain / neutral = 33%, Strong business case with multi-year payback = 8%, No viable
business case = 8%]
Companies are at very different places in terms of adoption of QbD. Some companies are
still skeptical about the idea of QbD and have not made much, if any, change towards a
QbD approach. While others have fully implemented the concept and are designing every
product in development along a QbD framework. Most are in between these extremes.
Confidential – Page 8
Where companies fall on this spectrum will play a large role in how the FDA should
interact with them.
¶ Novice: Company is skeptical about the value QbD can bring. Utilizes
conventional development and has no platforming.
¶ Pilot: Company is trying QbD, but still on the fence about the potential value.
Tends to apply QbD to a small subset of projects and processes and has
implemented limited or no platforming.
¶ Rollout: Company is convinced about impact of QbD and is beginning to see
some of the benefits. Uses QbD techniques regularly, but not universally. May
engage in some lifecycle management with integrated platform and network
strategy.
¶ Fully implemented: Company is completely convinced about the positive
impact of QbD and is realizing the benefits. Uses QbD in almost every
development program and almost every production step. Additionally, has a
systematic, comprehensive review and re-design of in-line products.
Exhibit 3: Level of maturity and drug type of examined companies
Fully
Group Novice Pilot Rollout implemented Total
New Drug
22% 33% 22% 22% 100%
Gx
40% 20% 40% -- 100%
Biologics
17% 67% 17% -- 100%
[Chart with drug type on y-axis: New Drug, Gx, Biologics. Level of adoption on x-axis: Novice,
Pilot, Rollout, Fully implemented. Level of adoption
– New Drug: Novice (22%), Pilot (33%), Rollout (22%), Fully implemented (22%)
– Gx: Novice: (40%), Pilot (20%), Rollout (40%), Fully implemented (0%)
– Biologics: Novice (17%), Pilot (67%), Rollout (17%), Fully implemented (0%)]
The majority of examined companies develop new drugs. Of these, ~45% fall into the
categories of Roll-out and Fully implemented, another ~30% are piloting. By contrast,
Generics and Biologics manufacturers are at a lower level of adoption, with ~40% of
Generics manufacturers at the Novice level, and ~70% of the Biologics manufacturers at
the Pilot level. Overall, New Drug manufacturers are at a higher level of adoption than
Generics or Biologics.
Confidential – Page 9
1 McKinsey White Paper: Transforming to the Desired State of cGMPs for the 21st Century
Confidential – Page 12
¶ The way promised regulatory benefits are currently being shared does not
inspire confidence. This challenge is primarily a result of the lack of
codification of real regulatory benefits from the FDA. “There is questionable
payback – it is unclear how much regulatory flexibility will actually be given.”
Without clear benefits, proponents of QbD in industry have expressed difficulty
in promoting the idea within their companies, increasing “skepticism and
reliance on the internal business case.” There are a lot of strong feelings
around this challenge, interviewees commented “the FDA has still not shown
us the flexibility we can get from this” and “we started this because we were
promised regulatory benefits, now we can’t even talk about them – it’s like [the
FDA] has amnesia.” Additionally, a couple of companies expressed
disappointment that they had not received as much flexibility as they thought
should be granted in their previous QbD filings.
¶ Misalignment of international regulatory bodies. A large concern,
consistently raised by companies at the Rollout and Fully Implemented levels
of adoption, is whether QbD applications would be accepted by other
regulatory bodies. For example, one interviewee commented that “we are very
concerned about the response to this outside the US and Europe. We sell
products in 75 countries, most are not a part of the ICH.” Although no
interviewees have experienced flat-out rejection, there were comments about
the increased time and effort required in other markets. “It is much more
difficult in secondary markets – it takes longer to review because they ask a lot
of questions several times.” This increased effort has caused some companies
to implement QbD practices but not bother to submit QbD filings.
¶ Current interaction with companies is not conducive to QbD. There is an
admittance that “historically, there is not a lot of comfort talking with the
FDA,” however, companies are eager to open and improve this communication.
Companies that are passionate about QbD want this to be an open, collaborative
journey. One interviewee felt “the pilots asked a lot of tough questions, there
were several tough interactions. When we are treated with suspicion, it does
not feel like collaboration.” One interviewee suggested joint teams working
together. Whatever the solution is, a clear challenge is the current closed way
companies interact with the FDA.
what it takes to achieve them. It makes sense that New Drug issues center
around execution of actual applications; in general, examined New Drug
companies were at a more mature stage of adoption. Internally, alignment
across the company is a problem for many New Drug companies. In many
companies “R&D is incentivized by shots on goal, not QbD” – a concept
contrary to good QbD practices of focusing on developing a solid
understanding of the product.
¶ Generics. The most prominent challenge identified by Generics manufacturers
was a lack of belief in the business case. However, there are two camps. One
half believes that there is a business case for QbD in generics and is
implementing. The other half believes that today, “generics is all about file
first, figure it out later.” These companies fear the potential additional time in
early development will disadvantage them in making it ‘first to file.’ Generics
manufacturers also identified unclear regulatory benefits as a key challenge –
likely closely related to the lack of belief in a business case. A final key
challenge from Generics manufacturers was lack of guidance for how to
actually implement.
¶ Biologics. The most prominent challenge identified by Biologics
manufacturers was around the lack of technology to execute. There is
consensus across the board that it is almost impossible to “prove the molecular
parameters necessary in a QbD file since we don’t really understand what
effects what” at the molecular level. Despite the inability to execute in this
upstream arena, there is general agreement that QbD can be applied to
downstream processes, for example purification and formulation processes.
Biologics manufacturers also identified lack of codification of regulatory
benefits as a key challenge.
¶ Novice. Novices have very little experience with QbD. Most of their
challenges are perceived rather than experienced. Internally, they face a lack of
belief in the business case. Externally, Novices feel the regulatory benefits are
unclear and there is a lack of tangible guidance. They simply do not see the
case for pursuing QbD.
¶ Pilot. Companies in the pilot phase are beginning to implement QbD. They
begin to see more tangible internal challenges, such as internal misalignment,
and limited knowledge of QbD techniques. As with novices, there is still a
substantial problem with lack of clarity of the business case. They face the
same external challenges as Novices, including unclear regulatory benefits and
lack of tangible guidance for the industry. As companies in the pilot phase
have begun experimenting with QbD, they have started to realize other external
challenges, including inconsistency of treatment of QbD across FDA, and
misalignment of international regulatory bodies.
¶ Rollout. Companies in the rollout phase have solved, or are solving, most of
their internal problems in terms of implementation – the majority of their
challenges are external. These challenges are focused on the lack of alignment
of regulatory bodies, we well as lack of clarity of regulatory benefits. They
Confidential – Page 14
As a company thinks about executing QbD, many factors must be weighed and
considered. Two factors that commonly work against QbD are the fear that QbD is very
expensive and will drive costs up, and the fear that QbD will require a lot more time and
analysis. Our interviews provided evidence that the cost to implement QbD is in fact
minimal, and the increase in time, if at all, is negligible.
¶ The cost to implement QbD is minimal. Most people believe QbD leads to a
marginal increase during set up – mostly from procedure development, a
change in human resources, as well as new analytical tools or knowledge
management capabilities (see additional exhibit 1 in appendix). After this
initial set up fee, most people feel there is no marginal cost, some interviewees
even claimed that QbD drives development costs down. Some polled claimed
that QbD has reduced their technical development costs by up to ~25% per
program.
¶ QbD will not increase the timeline for development. Interviews indicated
that QbD may add a negligible amount of time (~2 FTEs over 2 days) during
the early development phase, however there is no effect on time spent in critical
path, and time in tech transfer and scale up were often reduced. Although QbD
many cause minimal increases in time upfront, many companies experienced
time savings downstream.
Confidential – Page 15
[Conceptual picture of three timelines, vertically stacked. Three timelines are clinical development,
traditional technical development, and technical development with QbD. Clinical development shows three
stages – pre-proof of concept, post – proof of concepts and filing. Traditional technical development is
below the clinical development and show 5 phases, Early development, Late development, tech transfer,
scale up, and launch ready. Below is the 3rd timeline for technical development with QbD. This shows the
same phases as the traditional technical development. The Early development phase shows a potential 0 –
10% increase in time for technical development with QbD. The late development phase shows a – 10% -
+10% difference in time for the technical development with QbD. Tech transfer and scale up both show a
potential 10% decrease in time for technical development with QbD.]
Analysis identified many potential benefits from QbD – some of which are quantifiable,
and some of which are not. In terms of quantifiable benefits, value comes from four main
areas – a reduction of Cost of Goods Sold (COGS) and capital expense, increased
technical development productivity, improved quality (and lower risk), and increased
sales. These four combined could potentially provide $20 - $30 billion more profit to the
industry.
¶ Reduction of COGS and capital expense. QbD allows improved planning,
cycle time, yield and quality –potentially driving down costs by as much as $15
– $25 billion across the industry.
¶ Technical development productivity. Utilizing QbD techniques during the
product development process (e.g., platforming, taking advantage of growing
knowledge base) can lead to $4 – $5 billion in savings.
¶ Improved quality and lower risk. Implementing QbD is really using “good
science” which leads to an overall better, more reliable product. Savings from
reduced risk of regulatory citation are estimated to be $0 - $2 billion.
¶ Increased sales. Products that utilize QbD have better launches and generally,
will have better product design leading to fewer stock-outs. This can lead to $0
- $4 billion in increase sales.
Confidential – Page 16
Reduction of
COGS and
15-25
capital
expense
Tech Dev
4-5
productivity
Improved
quality – 0-2
lower risk
Increased
0-4
sales
Total 24-35
[Build-down vertical waterfall chart showing potential sources of incremental profit from
QbD, as determined by McKinsey analysis. First bucket of potential incremental profit is
from reduction of COGS and capital expense, $15 - $25 B. The second bucket of
potential incremental profit is Tech Dev productivity, $4 - $5 B. The third bucket is
improved quality – lower risk, $0 - $2 B. The fourth bucket is increased sales, $0 - $4 B.
The fifth bucket is the total bucket, showing potential incremental profit of $24 - $35 B]
Additionally, QbD has potential to provide benefits that are more difficult to quantify.
Improved public image, standardized definitions within a company, and best practice
sharing were highlighted in interviews.
¶ Improved public image. Implementing QbD in development will lead to an
overall increase in quality of product. As the public learns more about QbD
and its positive implications for product quality, people will potentially trust
companies that are ‘QbD users’ more so than those that are not.
¶ Standardized definitions. Several interviewees indicated an unanticipated,
but extremely valuable benefit in the standardization of definitions across their
companies. In implementing QbD, a company must ensure that the entire
operating model is aligned and that the same language is being used throughout
the company.
¶ Sharing best practices. One company commented that “since our redesign
was global and we are all on the same system, everyone has access to the best
practices – if experts in Sweden develop something, we can roll it out
immediately.” Implementing QbD has enabled global best practice sharing.
2 McKinsey
Confidential – Page 17
Our analysis indicates that in order for companies to experience the most business
benefits possible, two things must be in place. Companies must be aligned across the
entire operating model to support QbD, and the FDA must ensure a high quality of review
and deliver on the regulatory benefits many companies feel were ‘promised.’
¶ Alignment across entire operating model. Companies that are seeing the
most benefits from QbD have aligned their operating systems to QbD in a
systematic and streamlined way. They have aligned across the three elements
of the operating model – technical / processes, management system, and culture
and capabilities.
1. Technical Processes. Companies that are successful have the right
tools and processes to execute on QbD. They have standard
development processes built on QbD principles and may have
standardized equipment across development and commercial
manufacturing plants as well. They also have the data management
systems in place to really make QbD work. Additionally, they
participate in industry and regulatory thought groups.
2. Management system. Successful companies also have alignment to
QbD among leadership – “executive sponsorship is crucial to making
this work.” Additionally, incentives must be aligned to support a
connected operating model (e.g., R&D developers have interest in
product throughout its lifecycle).
3. Culture and capabilities. The right talent with the appropriate
capabilities needs to be in place for QbD to work. This is about
ensuring a company has “people with the smarts, motivation, and
sponsorship to drive it forward.” This can be ensured through talent
acquisition, and capability and training programs. Beyond capabilities,
the company culture needs to support QbD. All of the companies who
are seeing tangible benefits believe QbD is “a part of our culture.”
9 implemented 9
Somewhat Implemented
Fully
Mechanisms to support QbD Novice Pilot Rollout implemented
9 9
Formal QbD pilot program / organization / special
project
9 9 9 9
Standard development processes built upon QbD
principles
9 9
QbD principles "built in" to our regular Regulatory
CMC processes
Moving forward, there are many things that can be done to continue to build and
substantiate the business case.
¶ Bring together industry leaders to share case examples – encourage sharing of
real, specific numbers
¶ Build library of business impacts from pilot and other QbD applications
Confidential – Page 19
QbD should not apply to biologics. The FDA should continue to be patient,
disseminate success stories, and hold forums concerning QbD for Biologics
companies. Over time, the case for QbD for biologics will become increasingly
clear.
APPENDIX
– “QbD does not address raw materials – that’s the biggest cause of variability
for us”
– “A robust raw material management system needs to be in place to facilitate
QbD implementation
… Critical raw materials significantly impact product
quality and should therefore be thoroughly characterized” 3
– “We need a better understanding of excipients, what are their properties?
Their functionalities?”
ƒ Lack of technology to execute: Limited understanding of implications of quality
attributes
– “You will never know enough about your materials and process to be able to
change as you go through”
– “This is a really big problem for large molecules, we are just not very clear
about what aspects are doing what”
– “We just don’t understand the biological significance of CQAs – there is
misplaced confidence in being able to figure this out”
– “Vaccines will be an issue, we have always built consistency into the process
without knowledge of what was going on, we need better technology to get
there”
ƒ Lack of technology to execute: Knowledge of QbD techniques limited
– “In order to make some of the new types of measurements we will need to
develop new skill sets and get new technology”
– “Developing the technical tools and standardized processes necessary was a
big challenge”
ƒ Lack of technology to execute: Difficulty with data management
– “In order to make some of the new types of measurements we will need to
develop new skill sets and get new technology”
– “There is a challenge monitoring a product in late development to understand
how a process is playing out since there is such a huge volume of information”
– “We will need more statisticians with different skill sets and more education to
be able to handle all this new data”
– “For older products we are having difficulty with knowledge management, the
data could be stuck on someone’s hard drive somewhere”
ƒ Alignment with 3rd parties
– “It will be difficult figuring out the best way to provide guidance for outside
partners – heavily engineer vs. brute force
… it will be more complicated to
bring them along since all resources are not under complete control”
– “QbD is a space to redefine relationships with suppliers – hopefully it will
give more freedom in terms of changing suppliers”
– “Suppliers come more into play as we think about sources of variability”
ƒ Inconsistency of treatment of QbD across FDA
– “The FDA is not aligned, the only thing they are aligned on is where you file”
– “Although a number of people in the FDA are supportive of QbD – this is not
consistent”
– “ONDQA has a very philosophical definition based on scientific proof “ 4
3 Rathore, “Roadmap”
4 McKinsey White Paper: Transforming to the Desired state of cGMPs for the 21st Century
Confidential – Page 27
–
“Office of Generic Drugs has taken a more pragmatic approach and provided
an explicit, required process for submitting via Question based Review
(QbR)” 5
– “We had trouble with a recent drug where we put all the appropriate controls
in place, passing our own bio-equivalency tests, then, the bio-equivalence
department asked us to change our method since that was not what they
typically see”
– “We got all the way to the end and then the biopharma side overturned what
the reviewers had already approved. This was a major blow.”
– “There are many different opinions within the FDA on how to apply QbD to
solution, we came to an understanding with chem group that was overturned
by biopharm group at the end”
– “There is a big disparity between center and field. We worked with the center
on QbD filing, then in an inspection the inspector didn’t know what QbD
meant”
ƒ Lack of tangible guidance for industry
– “The QbD lingo is cutting edge and sexy – but there is very little information
out there about how to actually do it on the ground”
– “FDA has not explained what is expected from a QbD file that has to be
proven clinically”
– “We understand what you are asking for broadly, but there are hundreds of
variables – there’s got to be an end in mind – a tangible one we can deliver
on”
– “The path the FDA would like us to take to get here is not clear”
– “We know DOE is not sufficient anymore – we need more but it’s unclear
how to invest”
– “We don’t trust that the FDA will actually accept this filing in a consistent
manner”
ƒ Regulators not prepared to handle QbD applications
– “The FDA needs to increase the depth of expertise of reviewers and inspectors
in the various approaches to quality by design, for example chemometrics,
engineering and modeling”
– “High turnover seems to be an especially big problem”
– “Reviewers who come out of industry fall back to what their organization used
to do”
– “Dealing with reviewers who don’t fully support this or understand this really
slows us down a lot”
– “How can we be comfortable that the recipient of our file will understand?”
– “You never know what feedback you are going to get these days, it’s a very
inconsistent interface”
– “There is a disconnect between compliance and field groups, we often get
different feedback”
– “FDA is not leveraging the data we are giving – reviewers are green and don’t
understand the processes”
– “Regulators have different expectations and ask different questions for smaller
companies than bigger companies”
5 McKinsey White Paper: Transforming to the Desired state of cGMPs for the 21st Century
Confidential – Page 28
Additional Exhibits
Additional Exhibit 1: Correlation between supporting mechanisms and level of
adoption
Projected total cost to
Cost drivers implement
Total < $1 MM