The Application Readiness Level Metric - NASA

The Application Rea

NASA Application Re

The NASA Applied S
Readiness Level (AR
distribution of funded p
NASA for managing t
Levels, TRLs), and refl
deployment. In general
address development,
of the “application” into
project teams are bein
project on a regular bas

At the beginning of ea
the project is starting a
project will reach upon
projects, teams are ex
(LifeCycle ARL), ever
the close-out of their
projects will start at AR
milestones that need to
addition, while some p
this generalized prog
components at differen
by the highest leve
completed in full.

Definitions for each lev

adiness Level Metric

eadiness Levels (ARLs)

Sciences Program has instituted a nine-step Application
RL) index to track and manage the progression and
projects. This index is an adaptation of a scale used by
technology development and risk (Technology Readiness
lects three main tiers of project research, development, and
al, ARLs 1-3 encompass discovery and feasibility; ARLs 4-6

testing, and validation; and, ARLs 7-9 focus on integration
o an end-user’s decision-making activity. Using this scale,
ng asked to assess the “maturity” of their Applied Sciences
sis, starting with the project proposal.

ach project, project teams are asked to assess which ARL
at (Start-of-Project ARL) and also to project what level the
n completion (Goal ARL). Throughout the duration of most
xpected to re-assess their project’s ARL on periodic basis
ry August for a federal “Fiscal Year ARL” measure, and at

award (End-of-Project ARL). It is not expected that all
RL 1 and end at ARL 9, so please carefully read through the
o be met to achieve each ARL, and choose appropriately. In
projects may complete a few milestones out of phase with
gression from ARL 1 to ARL 9 or may have project
nt levels, a project’s ARL is determined at any given time
el for which all milestones preceding it have been

vel and its associated milestones follow. 1

ARL Schema

Approved, Operational De
Application Completed an
Application Prototype in P
Demonstration in Relevan
Validation in Relevant En
Initial Integration and Veri
Proof of Application Conc
Application Concept (Inve
Basic Research (Baseline

a – The Levels

eployment and Use in Decision Making (Sustained Use)

nd Qualified (Functionality Proven)
Partner’s Decision Making (Functionality Demonstrated)

nt Environment (Potential Demonstrated)
nvironment (Potential Determined)

ification (Prototype/Plan)
cept (Viability Established)

ention) 2
e Ideas)

AR

Basic Research

(Baseline Ideas)

This level is the foundation upo
developed. At this level, basic s
and insights and are observed
produces results that provide th

Milestones:

 Ideas for how specific re
decision making develop

 Baseline support resear
results on the theory, mo
and other current or plan
support the application i
Team or not

RL 1

on which application concepts are
scientific concepts, connections,
and reported, and research
he basis for applications ideas.

esearch results could enhance
ped
rch identified and documented (i.e.,
odels, remotely sensed products,
nned measurements needed to
idea) – whether done by the PI’s

3

AR

Application Concept

(Invention)

Application invention and formula
understanding and characterizati
articulated. At this level, the full a
and there is no proof or detailed

Milestones:

 Independent application c
 Decision making activity t

identified
 Plans to better characteri

developed

RL 2

ation of concept begins here. Initial
ion of the decision making activity are
application system is still speculative
analysis to support the assumption.

components formulated and created
to be enhanced by the application
ize the decision making activity

4

AR

Proof of Application Concept

(Viability Established)

Feasibility studies to assess the p
proof-of-concept for the applicatio
complete characterization of the
Different components of the appl

Milestones:

 Components of applicatio
 Detailed characterization

completed (e.g., pre-appli
mechanisms, and limitatio
 Convincing case for the v

RL 3

potential viability of and provide a
on are conducted. In addition, a more
decision making process is completed.
lication system are not yet integrated.

on tested and validated independently
of user decision making process
ication baseline performance,
ons)

viability of the application concept made

5

AR

Initial Integration & Verification

(Prototype/Plan)

Basic components of Earth scien
activity (decision support system,
a prototype “application system” t
together. At this level, the technic
issues related to the decision sup
Project team must verify that co
achieve this ARL.

Milestones:

 Components of eventual a
and technical integration i

 Organizational challenges
and managed

RL 4

n

nce products and the decision making
, tool, etc.) are integrated together into
to establish that they will work
cal, organizational, and human process
pport activities are also worked out.
omponents will work together to

application system brought together
issues worked out
s and human process issues identified

6

AR

Validation in Relevant Environm

(Potential Determined)

Basic components are integrated
elements so application can be te
environment. Prototype impleme
target environment and standard
making activity both functions wit
projected to improve performance
articulate the potential for perfo
making to achieve this ARL.

Milestones:

 Application components in
application system with re

 The application system’s
making activity determine
impacts on cost, functiona

RL 5

ment

d with reasonably realistic supporting
ested in a simulated decision making
entations conform to the end-user’s
d interfaces. Validation that the decision
th the Earth science products and is
e is achieved. Project team must
ormance improvement in decision

ntegrated into a functioning prototype 7
ealistic supporting elements
potential to improve the decision
ed and articulated (e.g., projected
ality, delivery time, etc.)

AR

Demonstration in Relevant Env

(Potential Demonstrated)

Achieving this level represents a m
demonstrated readiness. The pro
demonstrated in a relevant enviro
decision making environment. Any
deployed in the end-user’s enviro
decision making context. Project t
for performance improvement in d

Milestones:

 Prototype application syste
operational environment

 Projected improvements in
activity demonstrated in si

RL 6

vironment

major increase in the application’s
ototype application system is
onment or in a simulated operational

y application component(s) already
onment are tested in operational
team must demonstrate the potential
decision making to achieve this ARL.

em beta‐tested in a simulated

n performance of decision making
imulated operational environment

8

AR

Application Prototype in Partne

(Functionality Demonstrated)

Prototype application system and
integrated into the end-user’s ope
partner’s decision making activity
maturity, functionality is demonstr
partner. Project team must demo
integrated components in the dec
ARL.

Milestones:

 Prototype application syst
operational environment

 Prototype application func
decision making activity

RL 7

er’s Decision Making

d all pre-deployed components are fully
erational environment, such as the
y. At this level of application system
rated to win the confidence of the
onstrate the functionality of the
cision making activity to achieve this

tem integrated into end‐user’s
ctionality tested & demonstrated in

9

AR

Application Completed & Quali

(Functionality Proven)

Actual application system is comp
through testing and demonstratio
activity. The application is proven
expected conditions. In addition,
documentation, and maintenance
Partner must approve the applic
making activity to achieve this AR

Milestones:

 Finalized application syste
shown to operate as expe

 Application qualified and a
making activity

 User documentation and t

RL 8

ified

pleted and ‘qualified’ by the partner
on in the targeted decision making
n to work in its final form and under

most user documentation, training
e documentation are completed.
cation system for use in their decision
RL.

em tested, proven operational, and
ected within user’s environment

approved by user for use in decision

training completed 10

AR

Approved, Operational Deploym

(Sustained Use)

Actual operational, successful use
decision making activities. To rea
use in the decision making organ
achieved.

Milestone:

 Sustained use of applicati

RL 9

ment & Use in Decision Making
e of application by users in their
ach ARL 9, full integration and repeated
nization’s operations has been

ion system in decision making context

11