Data Analytics

Brian B. Joseph

Deputy Director, Data Analytics

Data Analytics: Using data to enhance acquisition outcomes

Mission

The Data Analytics division of ADA serves as the functional lead for establishing an Analytic Framework to support "Data Driven Decisions" within ASD(A). The division gathers strategic questions from the organization, integrates acquisition data from disparate DoD and Federal data stores, and conducts appropriate analytics to answer those questions. This informs acquisition strategic decision making and policy changes in OUSD (A&S) and the DoD at large, at the speed of relevance, improving acquisition outcomes. The Data Analytics Division also conducts analyses to help the Department inform the public and other parts of the U.S. Government, including the Legislative Branch, on the performance of the defense acquisition system.

Capabilities

Data Analytics provides cross cutting analyses of DoD acquisition by commodity type, contract, contractor, contractor incentive, portfolio, and individual program using data mining principles, analytic tools, data scientists, and functional subject matter experts.

Research & Reports

Updates to Performance of the Defense Acquisition System Series (2021)

The latest update to the PDAS series shifts focus from MDAPs to MTA programs, prototype OTs, and DoD initiatives. Also, Nunn-McCurdy updates.

Assessment of AoA Studies in the DoD as Compared to Best Practices (2021)

Report by Data Analytics assessing DoD implementation of the AoA process: time required to complete, recommendations to improve, etc.

A Feasibility Study on the Use of AI for Defense Acquisition Program Review (2020)

IDA study exploring specific examples of how AI can help Acquisition analysts be more effective in their predictions and efficient in their processes.

Evaluating and Predicting Contract Performance Using Machine Learning (2020)

Study by IDA assessing the feasibility of predicting program performance using text analytics and machine learning techniques on contract text data.

SAR Text Analysis: Joseph and Sconion, Acquisition Research Symposium (2020)

Using Natural Language Processing, Sentiment Analysis, and Text Mining to test correlation between SAR executive summaries and unit costs.

Schedule Slip Study: Joseph and Hastings, Acquisition Research Symposium (2020)

Using ANOVA and Multinomial Logistic Regression to analyze DAES and APB milestone estimates to determine contributing factors to schedule slips.

Performance of the Defense Acquisition System Series (2018-2020)

The annual PDAS reports use SAR data to examine Nunn-McCurdy breaches and cost performance / cost growth of MDAPs. See PDAS 2020, 2019, 2018.

Performance of the Defense Acquisition System (2016)

Annual report by A&S (formerly AT&L) which uses quantitative analysis of broad data to measure the effectiveness of the defense acquisition system.

RAND Study: Assessing DoD Use of Data Analytics in Acquisition (2019)

Research study conducted by RAND on the use of data analysis, measurement, and other evaluation-related methods in DoD acquisition programs.

DoD Response to NDAA 2017 Report: Data Analytics to Improve Outcomes (2019)

Report to Congress on the use of data analysis, measurement, and other evaluation-related methods in DoD acquisition programs.

Working Collaboratively

Acquisition Analytic Forum

This forum creates a culture that collectively shares industry analytics best practices to improve analytics and data literacy within the acquisition workforce. It brings together OUSD(A&S) and service component representatives to discuss analytics and ensure that the correct metrics are created and used to answer the strategic questions that informs the Analytics Framework and ultimately improve outcomes.

Acquisition Analytics Board

This board is comprised of the A&S DASD’s, key members from the services, and chaired by the PDASD, AE. It is a subset of the Acquisition Visibility Steering Group. The purpose of this board is to discuss current and future analytics initiatives in A&S at the strategic level.

Training Opportunities

ADVANA

Advana*, DoD’s big data platform for advanced analytics, has numerous free training materials* and third party training resources for its various tools, as well as webinars and office hours*. Please reach out to the Advana Help Desk* and initiate a Help Desk Ticket to inquire about or request a training.

Advana Access Request Guide

*DoD network access only

DAU Coursera

DAU is teaming up with the world’s largest provider of massive online open courses to extend the reach of its DoD workforce training with online DoD-Coursera programs.

Relevant courses include Data Science, covering Programming in R, Practical Machine Learning, Statistical Inference, and more.

What We Do

Data Mining

Data Mining uses the Analytic Framework to search through copious amounts of computerized data to find insightful patterns or trends.

Machine Learning

Machine Learning uses statistical models and algorithms to give computers the ability to do new tasks based on patterns and inference, without being explicitly programmed. This diagram shows a small sample of the applications in which machine learning is currently being used.

Tree-Based Modeling

Decision trees can be used to aid the description, categorization and generalization of a set of data, such as shown on the right with our model of total and procurement costs.

Tree-Based Model of Total Cost vs Procurement for MDAP Costs in (TY$M)

Abstract network of data points varying in size and color.

Topological Data Analysis

“Data has Shape, Shape has Meaning, Meaning drives Value.” -Gunnar Carlsson
Topological Data analysis studies the underlying shape of data by bringing together mathematics with computer science. It uses algorithms and concepts from algebraic topology to extract insights from complex multi-dimensional data structures.

Natural Language Processing & Text Mining

In machine learning, Natural Language Processing (NLP) is the computer’s ability to understand and analyze human language. Text mining is useful in analyzing patterns and unexpected trends by measuring the frequency of words, which can indicate topics of concern or importance like the diagram on the right.