Posts Tagged ‘data quality’

Approaches and Considerations for Measuring Secondary CTE Program Quality in Perkins V

Wednesday, July 24th, 2019

It is common practice in the private sector to use big data to improve efficiency, strengthen product quality and better target services to customers. Can data also be used to improve the quality of public education, specifically Career Technical Education (CTE)?

The Strengthening Career and Technical Education for the 21st Century Act (Perkins V) gives states the opportunity to use data more strategically to improve quality and equity in CTE. While states have been collecting data for years on student performance in CTE programs, Perkins V pushes them to make more informed decisions about program approval and alignment, equity and access, and program improvement. In particular, states can drive program improvement through the new secondary CTE program quality indicator, a state-selected measure that will be included in each state’s accountability system starting in the 2020-21 program year.

To help states select and define a robust measure of secondary CTE program quality, Advance CTE – in partnership with the Data Quality Campaign; the Workforce Data Quality Campaign, a project of the National Skills Coalition; Education Strategy Group; and the Council of Chief State School Officers – developed a series of short briefs highlighting each of the three indicator options:

Each brief examines the pros and cons of each indicator, describes different state approaches, and offers meaningful considerations for implementation. The reports also draw on survey data from one of Advance CTE’s latest report, The State of Career Technical Education: Improving Data Quality and Effectiveness to describe common approaches to collecting and validating program quality data.

Choosing a secondary CTE program quality indicator is a decision state leaders should not take lightly. This choice will send a clear signal to the field about state priorities for CTE and create an incentive structure that will be in place for years to come. To make an informed and thoughtful decision, state leaders should consider:

The Measuring Secondary CTE Program Quality briefs are available in the Learning that Works Resource Center at this link. Advance CTE is also available to provide input and expertise to states as they select and define their Perkins V accountability measures.

Austin Estes, Senior Policy Associate

By admin in Advance CTE Resources, Publications, Resources
Tags: , , , , , ,

State Leaders Are Prioritizing Workforce Readiness but the Data to Get There Is Missing

Wednesday, May 22nd, 2019

Workforce readiness takes center stage in most education policy conversations these days. With last year’s reauthorization of the Carl D. Perkins Career and Technical Education Act of 2006 (now known as the Strengthening Career and Technical Education for the 21st Century Act or Perkins V), state leaders are increasingly focused on how they can improve and increase access to high-quality career technical education (CTE) programs. With more attention being paid to this important work, state leaders must be transparent about which kinds of CTE programs are being offered, who is accessing them, and how participants fare once they’re finished. To do this, states need to collect data that is meaningful and share it in ways that people can access and use to make informed decisions. Unfortunately, CTE data currently available leaves most students and families in the dark.

According to a recent report from Advance CTE in collaboration with partners including Data Quality Campaign (DQC), less than half of State CTE Directors say their CTE data systems provide the information needed to assist in making decisions about program quality and initiatives at both the secondary and postsecondary levels. The majority of states report being able to collect learner-level data on a variety of career readiness measures at the secondary level, but for a variety of reasons this information isn’t found on states’ most public-facing resource about school quality, their school report card.

In January 2019, DQC reviewed every state’s report card and found that only 21 states included the number or percentage of students who completed a CTE program or earned an industry credential. Almost no state reported a separate graduation rate for CTE concentrators. How states chose to report this information also varied greatly, making it difficult at times to understand and interpret the data. Some states reported CTE certification rates as a standalone indicator, while others rolled it into a broader college and career readiness (CCR) indicator. Combined CCR indicators are simple (in theory) but often contain a variety of very different data points (such as CTE certifications earned, dual enrollment, and AP course completion rates) and that summary indicator is rarely broken out to give readers a clear picture of the outcomes for each of the included, and very different, measures.

Two states, South Carolina and Pennsylvania, stood out for the variety of data each include about students’ pathways, which DQC highlighted as bright spots. South Carolina reports detailed CTE data, including course enrollment and completion, credential attainment, and the types of industry credentials earned by Career Cluster® (e.g., Business Management & Administration, Finance, etc.). Pennsylvania includes data about postsecondary pathways more broadly, such as military enlistment and postsecondary enrollment rates disaggregated by student group, as well as the percentage of students who have completed a work-based learning experience.

It’s certainly a positive step forward to see almost half of states beginning to include CTE data on their report cards, but more state leaders need to follow suit. By including CTE and career readiness data side-by-side with college-going rates, state leaders can help students and families see the value of CTE pathways. As states invest significant resources into further developing CTE programming, it is critical that they be transparent about program participation and student outcomes. In order for students to utilize these programs as paths to better outcomes, they must be equipped with the data needed to guide them there.

This is a guest blog post from Elizabeth Dabney, Director of Research and Policy Analysis at the Data Quality Campaign. The post was originally published here

By admin in Public Policy, Research
Tags: , , ,

Navigating the Stormy Waters of Career Readiness Data: New Report Highlights Opportunities for States to Improve their CTE Data Systems

Thursday, April 18th, 2019

How many girls of color earned an industry-recognized credential in Information Technology last year? What types of work-based learning experiences lead to the best wage outcomes for learners from low-income families? How many graduates from Career Technical Education (CTE) programs in advanced manufacturing go on to work in their field of study?

A strong, well-aligned data system allows State CTE Directors and other state leaders to answer these questions and more. But according to the latest State of CTE report, The State of Career Technical Education: Improving Data Quality and Effectiveness, these data systems are not meeting the need for data-informed decision making.

While the report finds that 86 percent of State CTE Directors believe improving and enhancing their CTE data systems is a priority, only 45 percent say they have the information they need to assist in making decisions about CTE program quality and other initiatives at both the secondary and postsecondary levels. Making decisions about CTE program quality and equity without sufficient data is tantamount to sailors navigating the stormy seas using old maps and constellations rather than modern GPS technology.

What is the cause for this gap?

For one, state data systems are not sufficiently aligned across the secondary, postsecondary and workforce sectors. According to the survey, less than half of State Directors say their CTE data system is “mostly” or “fully” aligned with secondary data systems, 28 percent with postsecondary data systems and 18 percent with workforce data systems.

Ensuring learners are prepared with the skills and experiences they need for high-wage, high-skill employment in in-demand occupations is a shared responsibility among secondary education, postsecondary education and the workforce sector. Yet too many states continue to use disparate data systems for collecting, validating and accessing learner-level data. Using disparate systems not only increases the data collection burden for local leaders but also threatens the quality of the data and the ability of state leaders to use their data effectively.

Another critical challenge is improving the methods for collecting and validating learner-level data. Too many states rely on self-reported information without confirming that learners successfully completed a work-based learning experience, verifying that the industry-recognized credentials reported on school data submissions were awarded by credential providers, or documenting that learners earned postsecondary credit for completing dual or concurrent enrollment in high school.

Notably, 61 percent of states say they use student surveys – which have notoriously low response rates and are difficult to validate – to determine whether secondary learners go on to meaningful employment after they graduate. Thirty-three percent report the same for postsecondary learners.

This information is not easy to obtain and requires clear data sharing partnerships with employers, credential providers and other state agencies. But improving the methods of collecting and validating CTE data gives critical decision makers confidence in their use of data and ensures learners, educators and community members can trust decisions that are made on their behalf.

There are clear skies ahead, however, if states leverage implementation of the Strengthening Career and Technical Education for the 21st Century Act (Perkins V) to improve the quality and effectiveness of their career readiness data. Perkins V pushes states to improve data collection and reporting and make more data-informed decisions about CTE program quality and equity. As states begin the months-long process of vision setting, stakeholder engagement and plan development for Perkins V, they should consider the opportunity to improve their CTE data systems by auditing their current practices, establishing and formalizing data-sharing partnerships, and embedding data-informed decision making in policy and practice.

Equipped with strong, well-aligned data systems that are reinforced by trusted methods of collecting and validating data, State Directors can use their data to chart out a path to success for learners in their state. Otherwise the institutions, learners and communities they serve will be left unmoored.

The State of CTE report is based on a national survey of State Directors and examines how states are collecting, validating and using career readiness data. This resource was developed through the New Skills for Youth initiative, a partnership of the Council of Chief State School Officers, Advance CTE and Education Strategy Group, generously funded by JPMorgan Chase & Co. This resource was developed in partnership with the Workforce Data Quality Campaign, a project of the National Skills Coalition, and the Data Quality Campaign.

Austin Estes, Senior Policy Associate

By admin in Advance CTE Resources, Publications, Research, Resources
Tags: , , ,

CTE Research Review

Wednesday, October 29th, 2014

Research Image_6.2013As talk of data increasingly dominates education and employment conversations across the country, 37 states are working to track the employment outcomes of participants in education and workforce programs, according to a new report from the Workforce Data Quality Campaign (WDQC).

WDQC promotes a 13-point state blueprint for inclusive, aligned and market-relevant education and workforce data systems that identifies key features of high-quality data infrastructure to provide useful information for policymakers, educators, employers and more. NASDCTEc is a WDQC partner.

The report surveyed 40 states and the District of Columbia about their progress implementing the 13 indicators including:

The results found a majority of states had achieved or were progressing toward establishing cross-agency councils to oversee statewide data collection, capturing employment outcomes such as graduates’ employment status and cross-state data sharing, and creating scorecards for students and workers. More than half of states, however, reported not having starting initiatives related to industry-recognized credentials such as increasing the range of credentials being counted or developing a process for industry validation of credentials.

WDQC highlighted several standout states such as Utah, Maryland, Florida, North Carolina and Maine. Be sure to check out the report for many more outstanding state examples.

WDQC will host a webinar on Thursday, Nov. 6, to discuss the report and highlight the work being done to connect and use workforce data in Utah and Indiana.

In Case You Missed It:

Check out new research from Burning Glass, Education Development Center and more!

Andrea Zimmermann, State Policy Associate

By admin in Public Policy, Research, Webinars
Tags: , , , , , , , ,

 

Series

Archives

1