Skip to content
Version 1.3
Login

Lecture 5 - Sustainability And Transportation - Frameworks, Indicators, And Performance Measures

Sustainable Transportation Curriculum for Universities

Slide 1

INVEST - Sustainable Highways Self-Evaluation Tool (logo).

LECTURE 5: Sustainability and Transportation — Frameworks, Indicators, and Performance Measures

Slide 2

Indicators and Performance Measures

  • Quantifiable criteria used to evaluate progress toward goals
  • The terms are sometimes used interchangeably, but performance measures can be viewed as an indicator used within a specific goal-oriented context
  • A hierarchy of goals→ objectives→ performance measures can help define measures aligned with sustainability goals
The image represents an example of a performance indicator, in this case how the concentration of carbon dioxide (CO2) in the air can be a measure indicator for the issue of climate change. The measured indicator of 390 parts per million (ppm) of  CO2 in the atmospheric air has a value of 390, measured in the unit/scale of ppm, and the variable in question is the CO2 in the air.

Source: Gudmundsson et al. (2016). Sustainable Transportation: Indicators, Frameworks, and Performance Management. Springer.

Slide 3

Frameworks for Sustainable Transportation

  • Frameworks can organize information and provide structure to a sustainability assessment
  • Characteristics of a good sustainability performance measurement framework
    • Comprehensive and holistic
    • Connected to goals and objectives of an agency
    • Integrated vertically and horizontally in an agency
    • Capture interactions among variables
    • Reflect stakeholders' perspectives
    • Consider capabilities and constraints
    • Be flexible and foster self-learning

Source: Pei, Yi Lin, et al. (2010). “Performance Measurement Frameworks and Development of Effective Sustainable Transport Strategies and Indicators.” Transportation Research Record 2163.1, 73-80.

Slide 4

Performance Measures for Sustainable Transportation

Performance measures are:

  • Easily understood
  • Provide clear indication of moving toward the goal or objective
  • Tracked using accessible and available data

Recognize that it is the application of a collective set of measures, aligned with the objectives and goals and viewed within the context of the sustainability principles, that makes them relevant to a sustainability framework.

Slide 5

Uses of Performance Measures

Description
Describe the effect of program or policy

Evaluation
Assess progress and diagnose problems or barriers

Accountability
Set targets for specific staff or programs and measure how well they are reaching those goals

Decision Support
Inform which approach supports the most sustainable outcomes

Communication
Explain to stakeholders what the program or policy is achieving

Source: A Guidebook for Sustainability Performance Measurement for Transportation Agencies. National Academies Press. https://doi.org/10.17226/14598

Slide 6

Applying Performance Measures

Performance measures may be applied over:

  • Different time frames
  • Different levels
  • Different types of operation

Slide 7

Applying Performance Measures (continued)

Performance measures must add value to decision making:

  • Some agencies start by designing measures for one component of their overall program and build from there
  • Some agencies begin with an agency-wide, multiyear perspective and drill down

Whatever the approach, performance measures must be practical.

Slide 8

Considerations for Using Sustainable Transportation Performance Measures

  • What do we want to accomplish by using sustainability performance measurement?
    • Reduce long-term costs
    • Build public support
    • Address energy consumption
    • Respond to regulatory requirements

The approach to sustainability performance measurement should evolve over time.

Slide 9

Considerations for Using Sustainable Transportation Performance Measures (continued)

  • In what phase of decision making do we want to use sustainability performance measurement?

The approach to sustainability performance measurement should evolve over time.

Slide 10

Considerations for Using Sustainable Transportation Performance Measures (continued)

  • How will we use the results?
    • Understand/describe current conditions
    • Assess what is working or not working and why
    • Hold staff and other programs accountable
    • Make good decisions
    • Communicate the value of the work

Slide 11

Considerations for Using Sustainable Transportation Performance Measures (continued)

  • Is this a new process for us?
  • Have we defined goals?
  • Are there external requirements?
  • What partners are we working with?
  • Are we integrating this into an existing performance measurement process?
  • What data do we have available?
  • How much/how soon?
  • Are we ready for this?

Start based on data and resources you have on hand; buy-in from stakeholders and management is essential.

Slide 12

Application of the Sustainability Performance Measurement (SPM) Framework

This framework was developed to answer the question “What do transportation agencies need to successfully address sustainability issues through performance measurement?”

Three types of components:

  1. Fundamental
  2. Overarching
  3. Auxiliary
The image represents the Sustainability Performance Measurement (SPM) Framework from A Guidebook for Sustainability Performance Measurement for Transportation Agencies, NCHRP Report 708. It includes fundamental steps of understanding sustainability, development of transportation sustainability goals, development of objectives, and implementation of transportation sustainability performance measures. The framework has a feedback loop, and also includes overarching and auxiliary components.

Source: A Guidebook for Sustainability Performance Measurement for Transportation Agencies. National Academies Press. https://doi.org/10.17226/14598

Slide 13

Framework Components

Fundamental Components

Core elements required to apply the framework:

  1. Understanding sustainability
  2. Developing transportation sustainability goals
  3. Developing objectives
  4. Developing performance measures
  5. Implementing performance measures
  6. Refining the framework and applying feedback

Overarching Components

Items that need to be taken into consideration throughout the process, such as engagement of:

  • Stakeholders
    • Industry and business
    • Civic/religious organizations
    • General public
  • Partners
    • Planners, designers, and contractors
    • Maintenance teams
  • External agencies
    • Environmental
    • Transit/rail/air/water

Auxiliary Components

Optional components that supplement the process but are not central to it, such as:

  • Developing a working definition of sustainability (optional as consensus can be reached on sustainability goals and objectives without developing a definition)
  • Other sustainability initiatives that are independent of the transportation agency›s functions, such as energy-efficient buildings or recycling of office waste
  • Organizational application of broader transportation sustainability performance measures for the agency's employees, such as carpooling or ridesharing

Slide 14

Fundamental Components
STEP 1 Understanding Sustainability

The SPM framework is based on the four principles outlined earlier

  1. Preserve/enhance environmental/ecological systems (environmental)
  2. Foster community health and vitality (social)
  3. Promote economic development and prosperity (economic)
  4. Ensure equity in population groups over generations (equity)

Slide 15

Fundamental Components
STEP 2 Developing Transportation Sustainability Goals

Mapping goals to sustainability principles

  • Cross-check goals to ensure they address sustainability principles
  • Do not force-fit goals to map them to sustainability principles
  • Some goals may address more than one principle

Slide 16

Fundamental Components
STEP 2 Developing Transportation Sustainability Goals (continued)

Addressing equity

  • Do not neglect equity impact for economic or environmental gain
  • Address equity in present-day and future context of:
    • Income
    • Age
    • Race/ethnicity
    • Disabled/handicap populations
    • Gender
    • Geography

No one goal in itself is sufficient to achieve sustainability — it takes multiple goals, pursued in concert, to promote sustainability.

Slide 17

Fundamental Components
STEP 2 Developing Transportation Sustainability Goals (continued)

The image represents the Sustainability Performance Measurement (SPM) Framework from A Guidebook for Sustainability Performance Measurement for Transportation Agencies, NCHRP Report 708. It includes fundamental steps of understanding sustainability, development of transportation sustainability goals, development of objectives, and implementation of transportation sustainability performance measures. The framework has a feedback loop, and also includes overarching and auxiliary components.

Source: A Guidebook for Sustainability Performance Measurement for Transportation Agencies. National Academies Press. https://doi.org/10.17226/14598

Slide 18

Fundamental Components
STEP 3 Developing Objectives

  • Objectives provide specific actions to meet established goals
  • Objectives may be organized into focus areas
    • Planning, programming, project development, construction, maintenance, and system operations
  • Consider how objectives may vary among activities
    • Objectives may be the same for different phases of work
    • Objectives may be different for different phases of work

Slide 19

Fundamental Components
STEP 4 Develop Performance Measures

Performance measures assess progress toward each objective and provide the ongoing data to help further improve performance

In general, performance measures are classified as:

  • Outcome measures
    • Provide information on the achievement of sustainability goals
    • Measure the result/impact of a program, policy, or decision
  • Output measures
    • Relate to results/changes in terms of the system and its function
    • Measure a product or tangible item that results from an action
  • Process measures
    • Relate to inputs/products related to an agency's activities
    • Measure components of an agency practice that are deemed to support the related goal or objective

Slide 20

Fundamental Components
STEP 4 Develop Performance Measures (continued)

Example Measures for Goal

Goal: Reduce waste generated by transportation-related activity
Outcome measure example Change in the amount of waste generated
Output measure example Change in the percentage of operational activities with a recycling plan or waste diversion goal
Process measure example Whether an asset management system exists (Y/N)

Slide 21

Fundamental Components
STEP 4 Develop Performance Measures (continued)

Inventory Existing Measures
(Start with what you have!)

  • Gather a list of all performance measures currently in use, including data sources, method of tracking, frequency of reporting, etc.
  • Match these measures with your established objectives and goals.
  • Identify areas where measures are lacking to support principles, goals, or focus areas.

Select Additional Measures

  • There is no ideal number of performance measures, so keep the number to a manageable level
  • How will you calculate the measure?
  • What data are needed? What other measures can benefit from the data?
  • Where will you get the data? (Note: It is best to begin with data you have on hand or can easily obtain)
  • How many departments/agencies will benefit from the use of the measure?
  • Who will be in charge of tracking and reporting the data?

Slide 22

Fundamental Components
STEP 5 Implementing Performance Measures

  • Consider the application of the performance measures:
    • Description, evaluation, accountability, decision support, and communication
  • Determine the appropriate scale (e.g., by department or agency)
  • Determine appropriate applications (if more than one) for each measure, goal, or focus area
  • Establish a reporting system and schedule with roles and responsibilities for data collection, analysis, and reporting
  • Set benchmarks and targets at the level of goals, objectives, or measures. In the SPM framework, these benchmarks and targets need to be tracked at the level of performance measures.

Slide 23

Fundamental Components
STEP 6 Refine Framework and Apply Feedback

Applying the SPM framework requires constant feedback and refinement to ensure that progress toward sustainability is achieved.

Illustration of the constant feedback and refinement needed when applying the SPM framework: Plan, Do, Check, Act and repeat.

Slide 24 [end]

LECTURE 5: Sustainability and Transportation — Frameworks, Indicators, and Performance Measures

 

 

Downloads

Lecture 5 - Sustainability and Transportation - Frameworks, Indicators, and Performance Measures

(1,062 kb)

Lecture 5 - Sustainability And Transportation - Frameworks, Indicators, And Performance Measures

(2,761 kb)