0% found this document useful (0 votes)
82 views34 pages

INFORMS Analytics Framework

The INFORMS Analytics Framework outlines a comprehensive structure for applying analytics to business problems, covering seven key domains from problem framing to solution lifecycle management. It provides best practices, methodologies, and tasks necessary for effective analytics implementation, ensuring alignment with business objectives and stakeholder engagement. The framework aims to enhance analytics maturity and drive measurable impact in various sectors, including business, research, and healthcare.

Uploaded by

CDINH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
82 views34 pages

INFORMS Analytics Framework

The INFORMS Analytics Framework outlines a comprehensive structure for applying analytics to business problems, covering seven key domains from problem framing to solution lifecycle management. It provides best practices, methodologies, and tasks necessary for effective analytics implementation, ensuring alignment with business objectives and stakeholder engagement. The framework aims to enhance analytics maturity and drive measurable impact in various sectors, including business, research, and healthcare.

Uploaded by

CDINH
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 34

ANALYTICS FRAMEWORK

INFORMS ANALYTICS FRAMEWORK ..............................................................................................................................................................................4


Domain I: Business Problem (Question) Framing ........................................................................................................................................................5
Domain II: Analytics Problem Framing........................................................................................................................................................................6
Domain III: Data ........................................................................................................................................................................................................7
Domain IV: Methodology (Approach) Framing .............................................................................................................................................................7
Domain V: Analytics/Model Development ..................................................................................................................................................................8
Domain VI: Deployment ............................................................................................................................................................................................8
Domain VII: Analytics Solution Lifecycle Management ................................................................................................................................................9
CAP CERTIFICATION EXAM BLUEPRINTS and TESTING OBJECTIVES ............................................................................................................................. 10
DOMAIN I: BUSINESS PROBLEM (QUESTION) FRAMING .............................................................................................................................................. 11
Task 1.1: Develop an initial statement of a business problem (question). ............................................................................................................... 11
Task 1.2: Identify all stakeholders and their perspectives. ..................................................................................................................................... 11
Task 1.3: Determine if the business problem (question) is amenable to an analytics solution. ................................................................................ 12
Task 1.4: Refine the initial business problem (question) statement until it is clear and concise. .............................................................................. 12
Task 1.5: Create an initial business case for a solution to the business problem (question). ................................................................................... 13
Task 1.6: Obtain sponsor agreement and stakeholder alignment on the business problem (question) statement. ................................................... 13
DOMAIN II: ANALYTICS PROBLEM FRAMING ............................................................................................................................................................... 14
Task 2.1: Reformulate the statement of the business problem (question) as an analytics problem statement. ........................................................ 14
Task 2.2: Develop a proposed set of drivers/inputs and determine how they relate to outputs. ............................................................................... 15
Task 2.3: State the set of assumptions related to the analytics problem. ............................................................................................................... 15
Task 2.4: Define primary measures of success. .................................................................................................................................................... 16
Task 2.5: Identify baseline performance of the current state.................................................................................................................................. 16
Task 2.6: Identify risks and mitigation strategies for an effective potential analytics solution implementation. ........................................................ 17
Task 2.7: Obtain sponsor agreement and stakeholder alignment on the Analytics Problem Framing. ...................................................................... 17
DOMAIN III: DATA ..................................................................................................................................................................................................... 18
Task 3.1: Identify and prioritize data needs. .......................................................................................................................................................... 18
Task 3.2: Identify and analyze data sources including data structures. .................................................................................................................. 19
Task 3.3: Create a data management plan. ........................................................................................................................................................... 20
Task 3.4: Acquire data. ........................................................................................................................................................................................ 20
Task 3.5: Clean, harmonize, transform, merge/join, and validate data. .................................................................................................................. 21
Task 3.6: Assess data quality and identify relationships in the data. ...................................................................................................................... 21
Task 3.7: Document and report data findings (e.g., data quality, impact analysis, results, data management plan.) ................................................. 22
Task 3.8: Validate and update the business and analytics problem statements. ..................................................................................................... 22
DOMAIN IV: METHODOLOGY (APPROACH) SELECTION ............................................................................................................................................... 23
Task 4.1: Determine available and appropriate methods/techniques for the identified problem. ............................................................................ 23
Task 4.2: Evaluate and select methods / techniques, given the resources and available data. ................................................................................ 24
Task 4.3: Understand the technical solution architecture. ..................................................................................................................................... 24
Task 4.4: Evaluate and select the technology stack............................................................................................................................................... 24
DOMAIN V: ANALYTICS / MODEL DEVELOPMENT ........................................................................................................................................................ 25
Task 5.1: Design the model structure. .................................................................................................................................................................. 25
Task 5.2: Build one or more appropriate models. .................................................................................................................................................. 26
Task 5.3: Run, verify, and evaluate the model performance and outputs. ............................................................................................................... 27
Task 5.4: Calibrate model and improve data applicability based on client input. .................................................................................................... 27
Task 5.5: If necessary, integrate multiple models. ................................................................................................................................................. 28
Task 5.6: Document and communicate model findings including assumptions, limitations, and constraints........................................................... 28
DOMAIN VI: DEPLOYMENT ........................................................................................................................................................................................ 29
Task 6.1: Perform business validation of the analytics solution. ............................................................................................................................ 29
Task 6.2: Deliver business validation report with findings. ..................................................................................................................................... 29
Task 6.3: Obtain sponsor agreement and stakeholder alignment on moving forward with deployment. ................................................................... 30
Task 6.4: Create requirements for a deployed analytics solution including model, usability, system and business. ................................................. 30
Task 6.5: Actively support the implementation and testing of the production analytics solution/system.................................................................. 31
Task 6.6: Actively support deployment validation and verification, including production data flows. ....................................................................... 31
DOMAIN VII: ANALYTICS SOLUTION LIFECYCLE MANAGEMENT ................................................................................................................................... 32
Task 7.1: Track analytics solution performance..................................................................................................................................................... 32
Task 7.2: Recalibrate and maintain the analytics solution. .................................................................................................................................... 32
Task 7.3: Support training activities. ..................................................................................................................................................................... 33
Task 7.4: Validate the business case for the analytics solution over time. .............................................................................................................. 33
Task 7.5: Analyze side effects of the analytics solution over time. .......................................................................................................................... 33
Task 7.6: Ensure documentation is complete and/or maintained. .......................................................................................................................... 33
INFORMS ANALYTICS FRAMEWORK
The INFORMS Analytics Framework details specific analytics roles, responsibilities and tasks essential for successfully applying analytics to
problems, questions, and opportunities enabling impactful business, research, medical, and other decisions. Developed with input from the
analytics community, the framework establishes best practices for analytics success.

� Proven Methodology
The framework mirrors the full analytics lifecycle.

� Strategic Insights
Use the framework to benchmark your practices and identify actionable steps toward analytics excellence.

� Actionable Guidance from Experts


Created by INFORMS with analytics leaders and practitioners, with additional input from the analytics community, this framework
establishes best practices for analytics

Take the next step toward analytics maturity and organizational success.

Whether you're leading a transformation or refining your analytics strategy, this framework provides the structure and clarity you need to
drive measurable impact.

FRAMEWORK DEFINITION:
The INFORMS Analytics Framework was created by experienced Certified Analytics Professionals (CAPs) from diverse industries including
government, military, consulting, and academia serving as subject matter experts. Using a detailed job task analysis methodology, they
defined core sets of activities related to each domain.

The Seven Domains of Analytics Covered in the INFORMS Analytics Framework


OUTCOME:
The result is a comprehensive framework and structure for all considerations during an analytics approach from initial business problem
framing through data collection, model development, deployment, and maintenance. This framework represents best practices for
achieving success in the application of analytics to address important business problems and informed decisions. It helps identify areas
that need more attention to ensure analytics are effectively applied to key challenges and opportunities.

Domain I: Business Problem (Question) Framing


Analytics methodologies are applied to problems, which are sometimes stated as questions. The Business Problem (Question)
Framing domain includes activities related to understanding the business problem and relevant questions, as well as evaluating the scope
of the problem. The activity may also include the identification of opportunities, challenges, or just an evaluation if a question is well
defined. This framing process is essential for ensuring that a clear, actionable problem is defined before seeking solutions. Tasks in this
domain include determining, refining and clarifying a business problem statement, identifying stakeholders and aligning the stakeholders
with the stated business problem statement, and determining whether the problem is amenable to an analytics solution. With agreement on
a business problem statement and appropriate sponsor agreement to move forward with a solution, the remaining domains of the INFORMS
Analytics Framework are now applicable.

• Task 1.1 Develop an initial statement of a business problem (question).


• Task 1.2 Identify all stakeholders and their perspectives.
• Task 1.3 Determine if the business problem (question) is amenable to an analytics solution.
• Task 1.4 Refine the initial business problem (question) statement until it is clear and concise.
• Task 1.5 Create an initial business case for a solution to the business problem (question).
• Task 1.6 Obtain sponsor agreement and stakeholder alignment on the business problem (question) statement.
Domain II: Analytics Problem Framing
The Analytics Problem Framing domain focuses on translating a clearly defined business problem (question) into a structured analytics
problem that can be addressed with analytics techniques applied to data. This process ensures that analytical efforts are aligned with
business objectives and that outcomes will be relevant and actionable. A significant activity in this domain is reformulating the business
question into an analytics problem, requiring the application of descriptive, predictive or prescriptive analytics. This translation helps define
the type of analytics or model needed.

Another activity is identifying the critical drivers or inputs and determining how they relate to desired outputs, forming the basis for
hypothesis testing or model design. To ensure relevance and effectiveness, the domain includes defining primary success measures, such
as accuracy, revenue lift, or operational efficiency gains. Risk identification and mitigation strategies are also important to anticipate
challenges such as data limitations or unintended bias. This domain emphasizes the need for sponsor agreement and stakeholder
alignment to ensure buy-in and shared understanding before moving forward with analytics solution development.

By clearly framing the analytics problem, organizations can reduce ambiguity, align technical efforts with strategic goals, and set a solid
foundation for model development and implementation.

• Task 2.1 Reformulate the statement of the business problem (question) as an analytics problem statement.
• Task 2.2 Develop a proposed set of drivers/inputs and determine how they relate to outputs.
• Task 2.3 State the set of assumptions related to the analytics problem.
• Task 2.4 Define primary measures of success.
• Task 2.5 Identify baseline performance of the current state.
• Task 2.6 Identify risks and mitigation strategies for an effective potential analytics solution implementation.
• Task 2.7 Obtain sponsor agreement and stakeholder alignment on the Analytics Problem Framing.
Domain III: Data
The Data domain encompasses activities related to identifying the data required and available, ensuring its usability for solving analytics
problems, and fulfilling documentation and reporting needs. It also includes the effective utilization of data, maintaining its privacy and
security, ensuring proper data transport across systems, and adhering to best practices for data governance. Making data usable includes
critical actions applied to the data before it can be used such as cleaning, harmonizing, transforming, merging/joining and validating data,
as well as data quality evaluation. As a critical asset, security, management, and privacy protocols are vital to support business needs to
ensure compliance, ethical standards, and trust in output and outcomes from derived data. This domain also addresses the elements of
what data is owned, used, and produced. Understanding the use of data inventory and documentation is incorporated in this domain to
ensure repeatable processes and the ability to manage the volume, velocity, variety, and veracity of data.

• Task 3.1 Identify and prioritize data needs.


• Task 3.2 Identify and analyze data sources including data structures.
• Task 3.3 Create a data management plan.
• Task 3.4 Acquire data.
• Task 3.5 Clean, harmonize, transform, merge/join, and validate data.
• Task 3.6 Assess data quality and identify relationships in the data.
• Task 3.7 Document and report data findings (e.g., data quality, impact analysis, results, data management plan.)
• Task 3.8 Validate and update the business and analytics problem statements.

Domain IV: Methodology (Approach) Framing


The Methodology (Approach) Framing domain involves selecting the appropriate analytical methods, tools, and technologies to solve the
defined analytics problem. This ensures that the chosen approach aligns with the problem type, available data, and resource constraints.
The domain includes identifying suitable analytical techniques based on the nature of the problem, as well as evaluating and selecting the
best-fit methods considering available data, timeframes. and organizational resources. The domain includes the selection of a compatible
technology stack to effectively implement the solution.

Choosing the right methodology is critical to delivering valid, scalable, and actionable insights.

• Task 4.1 Determine available and appropriate methods/techniques for the identified problem.
• Task 4.2 Evaluate and select methods/techniques, given the resources and available data.
• Task 4.3 Understand the technical solution architecture.
• Task 4.4 Evaluate and select the technology stack.
Domain V: Analytics/Model Development
The Analytics/Model Development domain covers activities related to designing, building, and refining models, as well as documenting
and communicating the results. The domain incorporates designing the model structure, building the appropriate models, running and
evaluating model performance to ensure reliability. It also addresses identifying, using, calibrating, and integrating models as well as the
documentation of the model and communication of findings. The domain emphasizes documenting and communicating findings, including
assumptions and limitations, to maintain transparency.

This domain ensures that models are reliable, well-understood, appropriately tested, and effectively support decision-making.

• Task 5.1 Design the model structure.


• Task 5.2 Build one or more appropriate models.
• Task 5.3 Run, verify, and evaluate the model performance and outputs.
• Task 5.4 Calibrate model and improve data applicability based on client input.
• Task 5.5 If necessary, integrate multiple models.
• Task 5.6 Document and communicate model findings including assumptions, limitations, and constraints.

Domain VI: Deployment


The Deployment domain covers activities related to delivering the analytics solution and ensuring it is effectively integrated into the
business environment. This involves performing business validation of the solution and a report of the validation findings. It includes
securing sponsor agreement and stakeholder alignment to proceed with deployment. The deployment activities support the
implementation, migration, and testing of the solution for production, ensuring it functions as intended. Analytics plays a key role in this
domain as it involves validation and verification, working in conjunction with technology management, and production data flows. This
domain also includes the role of analytics in evaluation of deployment challenges to determine best resolution through data, model,
technology, or operational environment conditions. This domain ensures the analytics solution is successfully adopted, integrated, and
delivers business value.

• Task 6.1 Perform business validation of the analytics solution.


• Task 6.2 Deliver business validation report with findings.
• Task 6.3 Obtain sponsor agreement and stakeholder alignment on moving forward with deployment.
• Task 6.4 Create requirements for a deployed analytics solution including model, usability, system and business.
• Task 6.5 Actively support the implementation and testing of the production analytics solution/system.
• Task 6.6 Actively support deployment validation and verification, including production data flows.
Domain VII: Analytics Solution Lifecycle Management
Analytics Solution Lifecycle Management domain involves ongoing oversight and calibration to ensure the analytics solution continues to
perform effectively and delivers valid results over time that continue to deliver business value. Ongoing training activities are incorporated in
this domain to ensure optimal performance management. The domain includes tracking solution performance, covering recalibration and
maintenance to keep the solution accurate. Another task validates the business case periodically to confirm continued value, and another
task ensures documentation is kept up to date taking into consideration context, environment, and the need for delivering effective end
results. Continuous lifecycle management is critical in sustaining the impact and reliability of analytics solutions.

• Task 7.1 Track analytics solution performance.


• Task 7.2 Recalibrate and maintain the analytics solution.
• Task 7.3 Support training activities.
• Task 7.4 Validate the business case for the analytics solution over time.
• Task 7.5 Analyze side effects of the analytics solution over time.
• Task 7.6 Ensure documentation is complete and/or maintained.
CAP CERTIFICATION EXAM BLUEPRINTS and TESTING OBJECTIVES
The INFORMS Analytics Framework details specific analytics roles, responsibilities and tasks essential for successfully applying analytics to
challenging problems and opportunities enabling impactful business decisions. It also serves as the basis for the exam blueprints (testing
objectives) of all three INFORMS Certified Analytics Professional (CAP®) certification levels. In this section each element of the INFORMS
Analytics Framework is broken down into sub-tasks used to define the testing objectives for each of the three levels of the CAP exams.

Using the INFORMS Analytics Framework as a guide, three CAP levels of competency, generally corresponding to different roles within an
analytics team, were created corresponding to the CAP certification.

CAP-Essentials (Foundational-level) CAP-Pro (Mid-level) CAP-Expert (Advanced level)

The INFORMS Analytics Framework describes seven core domains of knowledge, detailing tasks necessary for professional success within
an analytics team. The tasks were then broken down to subtasks, with competence differences across the three role levels elaborated for
each task and subtask. The resulting exam blueprints of analytics competencies were validated by a larger sample of practicing analytics
professionals.

OUTCOME:

The result is a comprehensive list of subtasks for each task in the INFORMS Analytics Framework. For each subtask, testing objectives are
defined for each of the three levels of the Certified Analytics Professional exam. This provides guidance to those interested in achieving the
designation of Certified Analytics Professional.
DOMAIN I: BUSINESS PROBLEM (QUESTION) FRAMING
INFORMS Analytics Framework: Analytics methodologies are applied to problems, which are sometimes stated as questions. The Business
Problem (Question) Framing domain includes activities related to understanding the business problem and relevant questions, as well as
evaluating the scope of the problem. The activity may also include the identification of opportunities, challenges, or just an evaluation if a
question is well defined. This framing process is essential for ensuring that a clear, actionable problem is defined before seeking solutions. Tasks
in this domain include determining, refining and clarifying a business problem statement, identifying stakeholders and aligning the stakeholders
with the stated business problem statement, and determining whether the problem is amenable to an analytics solution. With agreement on a
business problem statement and appropriate sponsor agreement to move forward with a solution, the remaining domains of the INFORMS
Analytics Framework are now applicable.

CAP Testing Objectives:


Task 1.1: Develop an initial statement of a business problem (question).
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.1.1.1 Identify the difference between CAP-P.1.1.1 Identify the business problem CAP-X.1.1.1 Identify and explain questions for
business statements. statement that clearly and obtaining information needed for
completely defines the business creating a clear and complete
problem (question). business problem (question)
statement.

Task 1.2: Identify all stakeholders and their perspectives.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.1.2.1 Identify the stakeholders. CAP-P.1.2.1 Identify the primary and secondary CAP-X.1.2.1 Identify and explain an effective
stakeholders. method of conducting stakeholder
analysis.
CAP-E.1.2.2 Identify stakeholders and bystanders. CAP-P.1.2.2 Identify the characteristics of a CAP-X.1.2.2 Apply responsible, accountable,
stakeholder including sponsors, consulted, and informed criteria to
business process owners, a set of stakeholders.
information technology,
influencers, end users, etc.
Task 1.3: Determine if the business problem (question) is amenable to an analytics solution.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E 1.3.1 Identify an example of a simple CAP-P.1.3.1 Identify an example of an CAP-X.1.3.1 Identify and explain an issue that
business problem statement that intermediate business problem would likely have an impact on the
could be solved with an analytic statement that requires analytics. feasibility of an analytics solution.
solution.
CAP-E.1.3.2 Not tested at this level. CAP-P 1.3.2 Identify a reason a problem CAP-X 1.3.2 Identify and explain changes to a
statement might not be amenable problem statement and the reasons
to an analytic solution when that the modified statement would
framing the business problem. make the problem amenable to an
analytic solution.

Task 1.4: Refine the initial business problem (question) statement until it is clear and concise.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E 1.4.1 Identify the part of a business CAP-P.1.4.1 Identify revisions of an unclear CAP-X.1.4.1 Identify revisions necessary to
statement that is unclear. business problem statement that clarify and correct a business
provide the most clarity. problem statement.
Task 1.5: Create an initial business case for a solution to the business problem (question).
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.1.5.1 Identify the definition of business CAP-P.1.5.1 Identify an appropriate business CAP-X1.5.1 Identify the difference between
benefits. benefit or set of benefits. types of business, societal, and
analytical benefits.
CAP-E.1.5.2 Identify the definition of business CAP-P.1.5.2 Identify the difference between CAP-X.1.5.2 Identify the different types of
costs. types of business, societal, and business costs.
project/program costs.
CAP-E 1.5.3 Identify appropriate questions to CAP-P 1.5.3 Identify inappropriate questions CAP-X 1.5.3 Identify methods for determining
determine the current state and to determine the current state the current state and operating
operating procedures. and operating procedures. procedures of business processes
that are relevant to the business
problem.
CAP-E.1.5.4 Identify an example of a business CAP-P.1.5.4 Identify the tradeoffs of business CAP-X.1.5.4 Identify how to measure value in a
benefit or cost. benefits and costs. potential solution.
CAP-E 1.5.5 Identify risks to the business of CAP-P 1.5.5 Identify the most significant risk CAP-X 1.5.5 Identify the most effective
implementing a solution. to the business of implementing a approach of risk mitigation to
solution address acceptable risks of
implementing an analytics solution.
CAP-E.1.5.6 Identify unintended direct CAP-P.1.5.6 Identify indirect consequences of CAP-X.1.5.6 Identify options for addressing
consequences of the potential a potential solution to a business unintended direct and indirect
solution. problem statement. consequences of a potential
analytics solution.

Task 1.6: Obtain sponsor agreement and stakeholder alignment on the business problem (question) statement.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.1.6.1 Identify an example of required CAP-P.1.6.1 While obtaining sponsor approval CAP-X.1.6.1 Identify how to respond to a
sponsor agreement about the and stakeholder alignment, concerned party who is either
business problem, (question) identify the proposed elements Responsible, Accountable,
statement. that are in or out of scope of the Supporting, Consulted, or Informed
business problem (question) about the business problem
statement. (question) statement.
DOMAIN II: ANALYTICS PROBLEM FRAMING
INFORMS Analytics Framework: The Analytics Problem Framing domain focuses on translating a clearly defined business problem (question)
into a structured analytics problem that can be addressed with analytics techniques applied to data. This process ensures that analytical efforts
are aligned with business objectives and that outcomes will be relevant and actionable. A significant activity in this domain is reformulating the
business question into an analytics problem, requiring the application of descriptive, predictive or prescriptive analytics. This translation helps
define the type of analytics or model needed.

Another activity is identifying the critical drivers or inputs and determining how they relate to desired outputs, forming the basis for hypothesis
testing or model design. To ensure relevance and effectiveness, the domain includes defining primary success measures, such as accuracy,
revenue lift, or operational efficiency gains. Risk identification and mitigation strategies are also important to anticipate challenges such as data
limitations or unintended bias. This domain emphasizes the need for sponsor agreement and stakeholder alignment to ensure buy-in and shared
understanding before moving forward with analytics solution development.

By clearly framing the analytics problem, organizations can reduce ambiguity, align technical efforts with strategic goals, and set a solid
foundation for model development and implementation.

CAP Testing Objectives:


Task 2.1: Reformulate the statement of the business problem (question) as an analytics problem statement.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.1.1 Identify the most appropriate CAP-P.2.1.1 Identify the aspect of a business CAP-X.2.1.1 Identify what is missing from a
analytics problem statement. problem that makes it an business problem statement that
analytics problem. would make it an analytics
problem.
CAP-E.2.1.2 Identify if is a statement is a business CAP-P.2.1.2 Identify the most appropriate CAP-X.2.1.2 Identify what information is
problem, analytics problem, both or analytics problem statement. necessary to translate a business
neither. problem statement into one or
more analytics problem
statement(s) and how the
information should be obtained.
CAP-E.2.1.3 Not tested at this level. CAP-P.2.1.3 Where some analytics research CAP-X.2.1.3 Identify and explain the analytics
has been performed, assess the problem statement that will result
research and identify appropriate in meeting client requirements and
next steps. achieving client success and
project/program goals.
Task 2.2: Develop a proposed set of drivers/inputs and determine how they relate to outputs.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.2.1 Identify analytic inputs and outputs. CAP-P.2.2.1 Identify why analytics element(s) CAP-X.2.2.1 Identify and explain the
would be classified as an input, appropriateness of a proposed set
output, both, or neither. of analytics inputs and outputs.
CAP-E.2.2.2 For a simple business problem CAP-P.2.2.2 Identify how the stated drivers of CAP-X.2.2.2 Identify and explain the stated
statement, identify stated drivers and a moderately complex business drivers or inputs and their
their relationship to outputs. problem statement may impact relationship to outputs.
outputs.

Task 2.3: State the set of assumptions related to the analytics problem.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.3.1 Identify the explicit assumptions of CAP-P.2.3.1 Identify the implicit assumptions CAP-X.2.3.1 Identify explicit and implicit
the business problem that are of the business problem that are assumptions and the implications
included in the analytics problem included in the analytics problem of those assumptions for
statement. statement. appropriate analytical
approach(es).
CAP-E.2.3.2 Identify aspects of the business CAP-P.2.3.2 Identify how to verify if the CAP-X.2.3.2 Identify and explain the impacts if
problem that have been simplified. assumptions for the the assumptions for a
project/program have been met. project/program have not been
met.
CAP-E.2.3.3 Identify the constraints that should CAP-P.2.3.3 Identify how to verify if the CAP-X.2.3.3 Identify examples of the types of
be documented in an analytics business environment limitations constraints that need to be
problem statement. have been considered within the addressed in an analytics problem
context of an analytics problem statement.
statement.
CAP-E.2.3.4 Not tested at this level. CAP-P.2.3.4 Not tested at this level. CAP-X.2.3.4 Identify limitations to an analytics
problem statement with respect to
a business problem.
Task 2.4: Define primary measures of success.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.4.1 Identify the appropriate primary CAP-P.2.4.1 Identify the appropriate analytical CAP-X.2.4.1 Identify the tradeoff and relative
measures of success from the problem primary measures of importance of the primary
analytical problem statement that success that apply to the measures of success as they relate
apply to the business statement. business statement. to business and analytic problem
statements.
CAP-E.2.4.2 Identify the primary measures of CAP-P.2.4.2 Identify the process to verify if the CAP-X.2.4.2 Identify and explain the process to
success of an analytics problem primary measures of success verify if the primary measures of
statement. have been met. success have been met.

Task 2.5: Identify baseline performance of the current state.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.5.1 Identify how to measure the baseline CAP-P.2.5.1 Identify current baseline CAP-X.2.5.1 Identify the analytical problem
values of the primary measures of performance and how it relates to statement that will have the most
success of the current state. expected performance as significant impact on the
measured by the primary performance of the current state.
measures of success.
Task 2.6: Identify risks and mitigation strategies for an effective potential analytics solution implementation.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.6.1 Identify risks of an analytics solution. CAP-P.2.6.1 Identify the most significant risks CAP-X.2.6.1 Identify and explain the most
of an analytics solution. effective approach for risk
mitigation.
CAP-E.2.6.2 Identify the most likely bias for a CAP-P.2.6.2 Identify the risk of using biased CAP-X.2.6.2 Identify and explain the most
predictive model. training data for a predictive effective approach for mitigating
model to address the business ethical risks.
problem.
CAP-E.2.6.3 Not tested at this level. CAP-P.2.6.3 Not tested at this level. CAP-X.2.6.3 Identify the risks of using
Generative AI as part of the
analytics solution.

Task 2.7: Obtain sponsor agreement and stakeholder alignment on the Analytics Problem Framing.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.2.7.1 Not tested at this level. CAP-P.2.7.1 Identify proposed elements that CAP-X.2.7.1 Identify how to gain alignment on
are in scope for the analytics the analytics problem statement
problem statement while getting from a party who is either
sponsor approval and Responsible, Accountable,
stakeholder alignment. Supporting, Consulted, or
Informed.
CAP-E.2.7.2 Not tested at this level. CAP-P.2.7.2 Not tested at this level. CAP-X.2.7.2 Evaluate the clarity and
completeness in communicating
the analytics problem statement
including future concerns and
sustainability for informed
stakeholder alignment.
DOMAIN III: DATA
INFORMS Analytics Framework: The Data domain encompasses activities related to identifying the data required and available, ensuring its
usability for solving analytics problems, and fulfilling documentation and reporting needs. It also includes the effective utilization of data,
maintaining its privacy and security, ensuring proper data transport across systems, and adhering to best practices for data governance. Making
data usable includes critical actions applied to the data before it can be used such as cleaning, harmonizing, transforming, merging/joining and
validating data, as well as data quality evaluation. As a critical asset, security, management, and privacy protocols are vital to support business
needs to ensure compliance, ethical standards, and trust in output and outcomes from derived data. This domain also addresses the elements of
what data is owned, used, and produced. Understanding the use of data inventory and documentation is incorporated in this domain to ensure
repeatable processes and the ability to manage the volume, velocity, variety, and veracity of data.

CAP Testing Objectives:


Task 3.1: Identify and prioritize data needs.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.1.1 Identify data needs, sources, and CAP-P.3.1.1 Identify an appropriate CAP-X.3.1.1 Prioritize data needs, sources, and
acquisition sequence. sequencing and prioritization of sequence for an analytics project
data needed, including sources. statement.
CAP-E.3.1.2 Identify issues related to sensitive CAP-P.3.1.2 Identify the costs, benefits and CAP-X.3.1.2 Identify the data requirements,
data and restricted usage in constraints associated with data limitations, and priorities when
collecting and using data. collection and usage of a data communicating data requirement
source. to stakeholders and providers when
conflicts exist.
Task 3.2: Identify and analyze data sources including data structures.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.2.1 Identify limitations and possible CAP-P.3.2.1 Identify data limitations and CAP-X.3.2.1 Based on data attributes, data
constraints of data, given its constraints based on data context, and metadata, identify
attributes, context, and metadata. attributes, data context, and appropriate courses of action;
metadata, and propose consider negotiating changes in
appropriate course of actions. business processes or different
source systems.
CAP-E.3.2.2 Identify characteristics of roles CAP-P.3.2.2 Identify overlaps and gaps in CAP-X.3.2.2 Based on an organization's data
responsible for data governance (data responsibility, including roles strategy, identify and explain how
owner, data steward, data custodian). responsible for data governance. necessary roles should be defined
and deconflicted.
CAP-E.3.2.3 Identify the source of the data CAP-P.3.2.3 Identify what data sources might CAP-X.3.2.3 Identify data that is missing from a
(system of record, a data contain relevant information. project and how it might be
warehouse/data lake, manually obtained.
created, curated spreadsheets, and
user input on a screen, and manually
recorded data).
CAP-E.3.2.4 Identify the fundamental strengths CAP-P.3.2.4 Identify the appropriate data CAP-X.3.2.4 Identify how the analytics
and weaknesses of various data architecture. technology stack connects and
architecture. how performance or other needs
may shape architecture choices.
CAP-E.3.2.5 Identify the data architecture that CAP-P.3.2.5 Identify strengths and CAP-X.3.2.5 Identify implications of data
should be used. weaknesses of data architectures architectures for analytics
including security, timeliness, projects/programs based on
and level of effort. specific attributes.
CAP-E.3.2.6 Identify characteristics of a CAP-P.3.2.6 Identify basic characteristics of a CAP-X.3.2.6 Identify advanced characteristics of
normalized data set. relational database. a relational database.
CAP-E.3.2.7 Identify which of the 4 Vs (volume, CAP-P.3.2.7 Identify which of the 4 Vs CAP-X.3.2.7 Identify the relevance of the 4 Vs
veracity, variety, velocity) are NOT (volume, veracity, variety, (volume, veracity, variety, velocity)
relevant. velocity) are NOT relevant. in a project.
Task 3.3: Create a data management plan.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.3.1 Identify appropriate ways to handle CAP-P.3.3.1 Identify the consequences of a CAP-X.3.3.1 Identify how to work with
sensitive data. poor data strategy, poor data stakeholders to develop a data
governance for an organization, strategy and data governance
lack of responsibility for data culture.
ownership, and impact on
society.

Task 3.4: Acquire data.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.4.1 Identify techniques that are CAP-P.3.4.1 Identify the techniques CAP-X.3.4.1 Identify the trade offs and risks of
appropriate for acquiring data. appropriate in acquiring the data different types of data sources and
and identifying data source bias. how to address potential issues.
CAP-E.3.4.2 Identify the risks or ethical CAP-P.3.4.2 Identify which data is likely to CAP-X.3.4.2 Identify methods for mitigating or
implications of acquiring have risks or ethical implications managing data that contains
unnecessary or unintended data. if acquired for the potential risks and ethical
project/program. implications.

CAP-E.3.4.3 Identify characteristics of lineage, CAP-P.3.4.3 Identify the purposes of lineage, CAP-X.3.4.3 Identify appropriate methods for
traceability, and version control of traceability, and version control establishing lineage, traceability,
data. of data. and version control of data.
Task 3.5: Clean, harmonize, transform, merge/join, and validate data.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.5.1 Identify what it means to clean and CAP-P.3.5.1 Identify the transformations and CAP-X.3.5.1 Identify an appropriately designed
transform data, and that merge/joins that may be solution to resolve conflicting
merging/joining data across sources necessary to solve an analytics needs from data in multiple
may require business rules. problem. sources.
CAP-E.3.5.2 Identify common issues in data CAP-P.3.5.2 Identify how to correct common CAP-X.3.5.2 Identify problems related to
wrangling, such as missing values, issues with data. cleaning and transforming data in a
duplicates, redundancy, way to support future modeling.
incorrect/mismatched data types,
corrupt data and default data.

Task 3.6: Assess data quality and identify relationships in the data.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.6.1 Identify data quality gaps including CAP-P.3.6.1 Identify how to recognize issues CAP-X.3.6.1 Identify how to correct issues with
accuracy, completeness, with the data based on data data that contains quality gaps
consistency, timeliness, validity, quality gaps including missing including missing data, accuracy,
uniqueness, and outliers. data, accuracy, completeness, completeness, consistency,
consistency, timeliness, validity, timeliness, validity, uniqueness,
uniqueness, and outliers. and outliers.
CAP-E.3.6.2 Identify patterns and characteristics CAP-P.3.6.2 Identify patterns and CAP-X.3.6.2 Identify patterns and
of a univariate data set with data characteristics of a multivariate characteristics of data and their
profiling outputs data set from data profiling implications when dealing with
outputs. multivariate data and data profiling
outputs.
CAP-E 3.6.3 Identify common visualizations and CAP-P.3.6.3 Identify advanced visualizations CAP-X.3.6.3 Identify and explain the clearest
their purpose. and their purpose. interpretation of a visual
representation of data.
CAP-E.3.6.4 Identify the methods to evaluate data CAP-P.3.6.4 Identify composite features from CAP-X.3.6.4 Identify appropriate methods of
quality. the data set and how they can evaluating data quality issues and
improve data quality. how to mitigate them.
Task 3.7: Document and report data findings (e.g., data quality, impact analysis, results, data management plan.)
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.7.1 Identify findings in a report about data CAP-P.3.7.1 Identify appropriate elements of a CAP-X.3.7.1 Identify and explain valid
sets that may affect analysis. data report. conclusions about a data set's
applicability for analytics.

Task 3.8: Validate and update the business and analytics problem statements.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.3.8.1 Identify which finding for univariate CAP-P.3.8.1 Identify appropriate changes to CAP-X.3.8.1 Identify appropriate changes to an
data is a quality issue that will result an analytic problem statement analytic problem statement and the
in an update to the analytics problem based on multiple observed data business implications of the
statement. findings changes based on observed data
findings.
DOMAIN IV: METHODOLOGY (APPROACH) SELECTION
INFORMS Analytics Framework: The Methodology (Approach) Framing domain involves selecting the appropriate analytical methods, tools,
and technologies to solve the defined analytics problem. This ensures that the chosen approach aligns with the problem type, available data, and
resource constraints. The domain includes identifying suitable analytical techniques based on the nature of the problem, as well as evaluating
and selecting the best-fit methods considering available data, timeframes. and organizational resources. The domain includes the selection of a
compatible technology stack to effectively implement the solution.

Choosing the right methodology is critical to delivering valid, scalable, and actionable insights.

CAP Testing Objectives:


Task 4.1: Determine available and appropriate methods/techniques for the identified problem.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.4.1.1 Identify the methods/techniques CAP-P.4.1.1 Identify the most appropriate CAP-X.4.1.1 Understand and explain the
used in each type of analytics methods/techniques that business problem statement to
(descriptive, diagnostic, should be used. identify the methods/techniques
predictive, and prescriptive). that should used.
CAP-E.4.1.2 Identify the characteristics of CAP-P.4.1.2 Identify which CAP-X.4.1.2 Understand and explain the
descriptive/diagnostic analytics descriptive/diagnostic analytics analytics problem statement to
methods/techniques. methods/techniques should be identify which descriptive/diagnostic
used. analytics methods/techniques
should be used.
CAP-E.4.1.3 Identify the characteristics of CAP-P.4.1.3 Identify which predictive CAP-X.4.1.3 Understand and explain the
predictive analytics analytics methods/techniques analytics problem statement to
methods/techniques. should be used. identify which predictive analytics
methods/techniques should be
used.
CAP-E.4.1.4 Identify the characteristics of CAP-P.4.1.4 Identify which prescriptive CAP-X.4.1.4 Understand and explain the
prescriptive analytics analytics methods/techniques analytics problem statement to
methods/techniques. should be used. identify which prescriptive analytics
methods/techniques should be
used.
CAP-E.4.1.5 Not tested at this level. CAP-P.4.1.5 Not tested at this level. CAP-X.4.1.5 Identify how Generative AI could be
used to address an analytics
problem statement and explain the
benefits.
Task 4.2: Evaluate and select methods / techniques, given the resources and available data.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.4.2.1 Identify the technical and business CAP-P.4.2.1 Identify technical and business CAP-X.4.2.1 Identify and explain technical
characteristics and uses of specific benefits of one methodology over costs, business costs, benefits,
methodologies (descriptive, another, given limitations on risks, and implications of choosing
diagnostic, predictive, and resources and data. different methods/techniques
prescriptive) and techniques. when limitations on resources and
data exist.

Task 4.3: Understand the technical solution architecture.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.4.3.1 Identify which component(s) belong CAP-P.4.3.1 Identify what belongs in the CAP-X.4.3.1 Identify and explain an appropriate
in the selection of technical solutions selection of technical solutions to technical solution needed to
to implement the methodology. implement the methodology. employ in a solution set.

Task 4.4: Evaluate and select the technology stack.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.4.4.1 Identify characteristics of the CAP-P.4.4.1 Identify strengths and weaknesses CAP-X.4.4.1 Identify strengths, weaknesses, and
technology stack including of the technology stack including risks of the technology stack
databases, analytics software, databases, analytics software, including databases, analytics
networking, security, on-premise, networking, security, on-premise, software, networking, security, on-
cloud, open source vs. proprietary, cloud, open source vs. proprietary, premise, cloud, open source vs.
platforms, etc. platforms, etc. proprietary, platforms, etc.
CAP-E.4.4.2 Identify the strengths of a CAP-P.4.4.2 Identify the weaknesses of a CAP-X.4.4.2 Identify alternatives to a
spreadsheet analytics model. spreadsheet analytics model. spreadsheet analytics model and
when they are appropriate.
DOMAIN V: ANALYTICS / MODEL DEVELOPMENT
INFORMS Analytics Framework: The Analytics/Model Development domain covers activities related to designing, building, and refining
models, as well as documenting and communicating the results. The domain incorporates designing the model structure, building the appropriate
models, running and evaluating model performance to ensure reliability. It also addresses identifying, using, calibrating, and integrating models
as well as the documentation of the model and communication of findings. The domain emphasizes documenting and communicating findings,
including assumptions and limitations, to maintain transparency.

This domain ensures that models are reliable, well-understood, appropriately tested, and effectively support decision-making.

CAP Testing Objectives:


Task 5.1: Design the model structure.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.1.1 Identify appropriate inputs, outputs, CAP-P.5.1.1 Identify appropriate inputs, CAP-X.5.1.1 Identify and explain appropriate
and relationships for simple outputs, and relationships for inputs, outputs, and relationships
descriptive/ diagnostic analytics descriptive/ diagnostic analytics for descriptive/ diagnostic analytics
models. models. models.
CAP-E.5.1.2 Identify appropriate inputs, outputs, CAP-P.5.1.2 Identify appropriate inputs, CAP-X.5.1.2 Identify and explain appropriate
and relationships for simple outputs, and relationships for inputs, outputs, and relationships
predictive analytics models. predictive analytics models. for predictive analytics models.
CAP-E.5.1.3 Identify appropriate inputs, outputs, CAP-P.5.1.3 Identify appropriate inputs, CAP-X.5.1.3 Identify and explain appropriate
and relationships for simple outputs, and relationships for inputs, outputs, and relationships
prescriptive analytics models. prescriptive analytics models. for prescriptive analytics models.
Task 5.2: Build one or more appropriate models.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.2.1 Identify the appropriate dependent CAP-P.5.2.1 Identify the appropriate CAP-X.5.2.1 Identify what does not belong or is
and independent variables of a dependent and independent missing from a predictive model
predictive model. variables of a predictive model. and a set of model elements
(dependent and independent
variables).
CAP-E.5.2.2 Identify the appropriate decision CAP-P.5.2.2 Identify the appropriate decision CAP-X.5.2.2 Identify what does not belong or is
variables, constraints, and variables, constraints, and missing from a prescriptive model
objective(s). objective(s) of a prescriptive and a set of model elements
model. (dependent and independent
variables).
CAP-E.5.2.3 Identify an error from a list of CAP-P.5.2.3 Identify an error from a list of CAP-X.5.2.3 Identify an error and how to rectify
candidate errors for a predictive candidate errors for a predictive the error(s) for a predictive model.
model. model.
CAP-E.5.2.4 Identify an error from a list of CAP-P.5.2.4 Identify an error from a list of CAP-X.5.2.4 Identify an error and how to rectify
candidate errors for a prescriptive candidate errors for a prescriptive the error(s) for a prescriptive
model. model. model.
Task 5.3: Run, verify, and evaluate the model performance and outputs.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.3.1 Identify the correct interpretation of a CAP-P.5.3.1 Identify the correct interpretation CAP-X.5.3.1 Identify and explain the correct
descriptive/ diagnostic analytics of a descriptive/ diagnostic interpretation with a descriptive/
mode output. analytics model output diagnostic analytics model output.
CAP-E.5.3.2 Identify the appropriate division of CAP-P.5.3.2 Identify an appropriate method of CAP-X.5.3.2 Identify the correct ensemble
training, testing, and validation data cross validation of a predictive modeling approach for a set of
for a predictive model. analytics model. predictive analytics models.
CAP-E.5.3.3 Identify a correct interpretation of the CAP-P.5.3.3 Identify an appropriate CAP-X.5.3.3 Identify an appropriate
predictive analytics model output. interpretation of the output of a interpretation of the output from a
predictive analytics model predictive analytics model.
CAP-E.5.3.4 Identify the correct verification of the CAP-P.5.3.4 Identify the correct verification of CAP-X.5.3.4 Identify and explain the correct
solution of a simple prescriptive the solution of a prescriptive verification of the solution for a
analytics model output. analytics model output. prescriptive analytics model
output.
CAP-E.5.3.5 Identify which data or model issue is CAP-P.5.3.5 Identify which data or model issue CAP-X.5.3.5 Identify and explain which data
the cause of an observed bias or is the cause of an observed bias or and/or model issue is the cause of
unethical outcomes of a simple unethical outcomes of a an observed biased or unethical
predictive model moderately complex predictive outcome of a predictive or
model. prescriptive model.

Task 5.4: Calibrate model and improve data applicability based on client input.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.4.1 Identify which data or model issue is CAP-P.5.4.1 Identify which data or model issue CAP-X.5.4.1 Identify and explain the
the cause of a client concern about is the cause of a client concern combination of data and model
the output of a simple predictive about the output of a moderately issues that are the cause of a client
analytics model complex predictive analytics concern with the output of a
model. predictive analytics model.
CAP-E.5.4.2 Identify which data or model issue is CAP-P.5.4.2 Identify which data or model issue CAP-X.5.4.2 Identify and explain the
the cause of a client concern about is the cause of a client concern combination of data and model
the output of a simple prescriptive about the output of a moderately issues that are the cause of a client
analytics model complex prescriptive analytics concern with the output of a
model. prescriptive analytics model.
Task 5.5: If necessary, integrate multiple models.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.5.1 Identify the business purpose of a CAP-P.5.5.1 Identify a combined set of CAP-X.5.5.1 Identify and explain conflicts and
specific model from a set of applicable models from a set of synergies between multiple
candidate purposes. candidate models. models.

Task 5.6: Document and communicate model findings including assumptions, limitations, and constraints.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.5.6.1 Identify appropriate visualization CAP-P.5.6.1 Identify the most appropriate non- CAP-X.5.6.1 Identify and explain appropriate
techniques for communicating the technical explanation of the results assumptions, limitations and
results. of a completed model. constraints when communicating
findings for an audience.
DOMAIN VI: DEPLOYMENT
INFORMS Analytics Framework: The Deployment domain covers activities related to delivering the analytics solution and ensuring it is
effectively integrated into the business environment. This involves performing business validation of the solution and a report of the validation
findings. It includes securing sponsor agreement and stakeholder alignment to proceed with deployment. The deployment activities support the
implementation, migration, and testing of the solution for production, ensuring it functions as intended. Analytics plays a key role in this domain
as it involves validation and verification, working in conjunction with technology management, and production data flows. This domain also
includes the role of analytics in evaluation of deployment challenges to determine best resolution through data, model, technology, or operational
environment conditions. This domain ensures the analytics solution is successfully adopted, integrated, and delivers business value.

CAP Testing Objectives:


Task 6.1: Perform business validation of the analytics solution.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.1.1 Identify the characteristics of CAP-P.6.1.1 Identify the characteristics of CAP-X.6.1.1 Identify how to perform business
validation when performing a validation when performing a validation of the analytics solution
business validation of the analytics business validation of the analytics and how it should be
solution. solution. communicated to the client.

CAP-E.6.1.2 Identify a potential ethical analytics CAP-P.6.1.2 Identify topics related to ethical CAP-X.6.1.2 Identify the business use of a
risk. analytics that should or should not model that has the most risk of
be included in the business adverse ethical analytics
validation report of a business use consequences.
for a model.

Task 6.2: Deliver business validation report with findings.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.2.1 Identify sections which belong in the CAP-P.6.2.1 Identify elements which belong in CAP-X.6.2.1 Identify a non-technical summary
business validation report. the business validation report. of technical findings that is most
appropriate for a non-technical
audience.
Task 6.3: Obtain sponsor agreement and stakeholder alignment on moving forward with deployment.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.3.1 Not tested at this level. CAP-P.6.3.1 Not tested at this level. CAP-X.6.3.1 Identify the characteristics of
business impacts of implementing
the analytics solution to ensure
stakeholder alignment.

Task 6.4: Create requirements for a deployed analytics solution including model, usability, system and business.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.4.1 Identify appropriate requirements for CAP-P.6.4.1 Identify what is missing or does not CAP-X.6.4.1 Identify and explain the appropriate
the analytics solution to be used in belong in an outline of the documentation of a production
production. requirements of a production system for a business user.
system
CAP-E.6.4.2 Not tested at this level. CAP-P.6.4.2 Identify characteristics of the CAP-X.6.4.2 Identify characteristics of the
model and report documentation model and report documentation
so that the analytics solutions can necessary so that an analytics
be reused if the business solution could be reused if the
circumstances should change. business circumstances should
change.
Task 6.5: Actively support the implementation and testing of the production analytics solution/system.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.5.1 Not tested at this level. CAP-P.6.5.1 Identify the characteristics of CAP-X.6.5.1 Identify the characteristics of
deployment testing. deployment testing and why they
are important.
CAP-E.6.5.2 Not tested at this level. CAP-P.6.5.2 Not tested at this level. CAP-X.6.5.2 Identify the responsibilities of the
analytics professional in the
delivery of the production analytics
solution or system.

Task 6.6: Actively support deployment validation and verification, including production data flows.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.6.6.1 Not tested at this level. CAP-P.6.6.1 Identify causes of incorrect data in CAP-X.6.6.1 Identify which data sources need to
production systems. be synchronized during deployment
when using multiple data sources.
DOMAIN VII: ANALYTICS SOLUTION LIFECYCLE MANAGEMENT
INFORMS Analytics Framework: The Analytics Solution Lifecycle Management domain involves ongoing oversight and calibration to ensure
the analytics solution continues to perform effectively and delivers valid results over time that continue to deliver business value. Ongoing training
activities are incorporated in this domain to ensure optimal performance management. The domain includes tracking solution performance,
covering recalibration and maintenance to keep the solution accurate. Another task validates the business case periodically to confirm continued
value, and another task ensures documentation is kept up to date taking into consideration context, environment, and the need for delivering
effective end results. Continuous lifecycle management is critical in sustaining the impact and reliability of analytics solutions.

CAP Testing Objectives:


Task 7.1: Track analytics solution performance.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.1.1 Identify the metrics that monitor CAP-P.7.1.1 Identify metrics that reflect an CAP-X.7.1.1 Identify factors that may affect
analytics solution performance. acceptable analytics solution analytics solution performance
performance. over time.

Task 7.2: Recalibrate and maintain the analytics solution.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.2.1 Not tested at this level. CAP-P.7.2.1 Identify potential opportunities for CAP-X.7.2.1 Identify potential opportunities and
recalibration of the analytics risks for recalibration of the
solution. analytics solution.
CAP-E.7.2.2 Not tested at this level. CAP-P.7.2.2 Not tested at this level. CAP-X.7.2.2 Identify and compare alternative
solutions when there are changes
in the external environment.
Task 7.3: Support training activities.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.3.1 Identify the type of training about the CAP-P.7.3.1 Identify the type of training that is CAP-X.7.3.1 Identify the type of training that is
analytics solution that is needed for needed for an IT audience. needed for business users in
an analytics professional audience. different roles.

Task 7.4: Validate the business case for the analytics solution over time.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.4.1 Identify what has changed over time CAP-P.7.4.1 Identify which benefit is CAP-X.7.4.1 Identify the benefits and costs that
for the business case. attributable to the analytics are directly attributable to the
solution over time. analytics solution.

Task 7.5: Analyze side effects of the analytics solution over time.
CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.5.1 Identify the importance of reviewing CAP-P.7.5.1 Identify likely adverse CAP-X.7.5.1 Identify an outcome from a
analytic solutions post deployment consequences of implementing the predictive model that exhibits
for unintended consequences. analytics solution. ethical issues but is not readily
apparent in the data.

Task 7.6: Ensure documentation is complete and/or maintained.


CAP-Essentials Subtask CAP-Pro Subtask CAP-Expert Subtask
(CAP-E) (CAP-P) (CAP-X)
CAP-E.7.6.1 Identify the types of documentation CAP-P.7.6.1 Identify the types of documentation CAP-X.7.6.1 Identify the lifecycle activities that
needed for various analytics needed for various audiences. should be documented and
methodologies. monitored.

You might also like