Analytics Maturity Model

AMM User Guide
Page 1: Introduction

View as PDF




1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

INFORMS Analytics Maturity Model

User Guide

Introducing the INFORMS Scorecard

INFORMS, the leading association for advanced analytics professionals, seeks to advance the practice, research, methods, and applications of advanced analytics by providing valuable, relevant guidance to individuals and institutions as they pursue analytics initiatives. INFORMS considers analytics to be the scientific process of transforming data into insight for making better decisions. In INFORMS' view, Analytics is broadly inclusive and encompasses practices and techniques from multiple disciplines.

To advance the practice of analytics, INFORMS has developed an Analytics Maturity Model (AMM) scorecard that serves to:

  • Introduce an analytics function/department to corporations and organizations that don't currently have an analytics capability;
  • Enable those already involved in analytics to assess their level of effectiveness (i.e. beginning, developing, advanced);
  • Help plan improvements to the analytical function in order to solidify their strengths;
  • Help advance their function to a higher level.

The scorecard is based on twelve questions that indicate your organization's analytics maturity. The questions are grouped into three broad sections:

  • Organizational — does your organization have the practices and culture to enable effective use of analytics?
  • Analytics Capability — does your organization possess the methods, models, and services needed to perform analytics?
  • Data & Infrastructure — are data sufficiently integrated and infrastructure present to support analytics?

The questions provide focus areas for benchmarking capabilities and identifying specific actions that your organization might take to improve analytical maturity. Further explanations of key terms used in the questions are provided in the appendix.

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 2: Scorecard Questions

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

The scorecard questions are focused as shown below:

Organizational Questions
People Focuses on awareness and acceptance of the use of analytics by employees to support their job/roles within the organization.
Leadership Impact Focuses on the level of support and commitment by those in leadership positions.
Measures Focuses on analytics-based metrics that drive decision making.
Processes Focuses on the use of analytics within processes and activities such as product design, manufacturing, sales and marketing, R&D, etc.
Analytics Capability Questions
Analytics Governance Focuses on how well the organization has defined and documented an approach for making decisions, and if it is optimized to support key operational or investment decisions that provide value.
Roles and Skills Focuses on the analytic talent that the organization has on hand and how the depth and breadth of talent is being managed.
Analytic Services Focuses on the analytical spectrum (descriptive, predictive, prescriptive models) and the breadth and depth of techniques used.
Analytic Processes Focuses on identification of the analytical processes that support business processes and how well they are standardized and integrated across the organization.
Data & Infrastructure Questions
Health Focuses on quality of the organization's data, and the adoption of data quality management practices.
Access Focuses on ability of employees at all levels of the organization to get the data they need for use in their day-to-day activities. The range of formats and access speed would be important considerations.
Traceability Focuses on the ability of an organization to trace from data to decisions, through the use of Master Data Management and Lifecycle Management practices.
Analytics Architecture Focuses on the degree to which the Enterprise Architecture considers analytical capabilities and the pervasiveness, variety, and access modes of the capabilities provided.
NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 3: Assessment Depth

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

Using the Scorecard

You can choose to use either 'Quick' or 'Full' assessment depth. The 'Full' option enables goal setting, and provides links to services that are relevant to your assessment results.

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 4: Scoring

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

The scorecard is presented one question at a time. An example question is shown below:

Below the answers, the scorecard provides a scale where you can click on the scale value that represents your organization's current or "As-Is" state. Further space is available to provide rationale behind the chosen score, and any additional notes.

If you selected the 'Full' assessment option, a second part of the question provides an option to set an incremental goal within a realistic time period. You can click on the scale value to establish the goal level, and optionally provide a date and action plan for achievement. If desired, you can also opt out of setting any or all goals by checking the 'skip factor' box.

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 5: Setting Goals

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

An example goal setting is shown below:

Click 'Continue' to advance to the remaining questions.

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 6: Theme Summary

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

After all four questions for the section are completed, the scorecard displays a section summary, as shown here:

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 7: Assessment Summary

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

After completing the assessment, the scorecard presents an overall summary, as shown here:

You have the option to 'Save' or 'Cancel' the assessment. If saved, you will be able to monitor progress over time as future assessments are made.

NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 8: How INFORMS can help

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

What Next?

After completing the assessment, you'll find a set of links that describe ways that INFORMS can help you achieve your goals.


NEXT PAGE

Analytics Maturity Model

AMM User Guide
Page 9: Appendix

View as PDF
PREVIOUS PAGE
1 - Introduction2 - Scorecard Questions3 - Assessment Depth4 - Scoring5 - Setting Goals6 - Theme Summary7 - Assessment Summary8 - How INFORMS can help9 - Appendix

Appendix: Key Terms Explained

Center of Analytical Excellence — a facility or organizational entity providing leadership, practices, and technology covering a wide range of analytics capabilities and application areas.

Certified professional — an individual with the INFORMS Certified Analytics Professional or similar credential.

Descriptive analytics — methods, largely from the fields of statistics and visualization, that summarize a set of data in a quantitative or graphical way, indicating similarities, differences, or logical groupings, or trends. Examples include: a clustering analysis to find groupings of customers likely to behave in similar ways; a correlation analysis or graph to portray how the values of two or more factors may move together.

Predictive analytics — the use of techniques from statistics, data mining and machine learning disciplines, to predict a quantity or group membership or future state of entities of interest. Examples include: the use of logistics regression or classification trees to classify telecom customers into those likely to churn or not (i.e. discontinue service); use of neural networks to predict the likely outcome of a medical procedure.

Prescriptive analytics — methods that may combine techniques from operations research and other disciplines to achieve an "optimal" solution to a complex quantitative problem. Examples include: the use of optimization algorithms to produce a schedule for employees and/or other resources; the use of machine learning algorithms to automate a loan approval process.

Data Quality Management — practices and methods focusing on all of the quality-related attributes of data and providing processes and tools to ensure that quality goals are met.

Master Data Management — an approach consisting of standards, processes, and tools to help ensure that a single version of master data (the principal entities) is maintained and accessible.

Lifecycle Management — an approach to managing data, software, systems, models, documents, etc. that tracks and provides visibility from inception through end of service life.