Research Roundup: Strategies for Fostering Effective Partnerships for Equitable CTE Research

June 26th, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights strategies that support the connection between researchers and local CTE practitioners to generate evidence-based research to inform program improvement. These findings align with Advance CTE’s vision for the future of CTE where each learner engages in a responsive career preparation ecosystem.

State CTE leaders are eager to learn about the newest innovations or best practices to improve CTE learner outcomes. Researchers play an important role in translating the outcomes of different interventions and distilling their findings into recommendations that help to shape the direction of CTE programs. The K-12 education research landscape is rapidly shifting, and to effectively recruit districts and schools, researchers need to have strategies for building strong partnerships. A recent blog from the Career & Technical Education Research Network suggests that understanding these changes and their implications for evaluations is crucial for funders, researchers, and policymakers because of limited information on evidence-based CTE strategies and relatively few causal studies of CTE.

During the pandemic, it became clear that districts and schools are already facing many challenges regarding the availability of resources and their capacity to participate in research evaluations. Additional barriers include challenges with identifying clear counterfactuals, or programs to serve as reasonable comparisons, navigating district approval processes, and the willingness of schools to participate in district research.

States can support researchers to mitigate these challenges and foster mutually beneficial research partnerships with local practitioners that will contribute to the development of an effective data strategy. 

Strategies 

The CTE Research Network suggests the following strategies: 

  • Consider the research-practice partnership (RPP) model.
    • Research-practice partnerships (RPPs) are intentional, formalized partnerships between agencies that primarily administer education (such as state education agencies, local education agencies, or schools) and those that primarily research education (such as public and private universities, research institutions, or community groups that conduct research). These partnerships are created to impact decision-making in education through the use of research evidence.
    • RPPs offer a great model for long-term working relationships between practitioners and researchers that make it possible to develop and sustain research projects that address educational needs. The National Network of Education Research-Practice Partnerships offers a warehouse of curated resources to support the facilitation of these partnerships.
  • Initiate contact and survey the landscape early.
    • Conducting early conversations with target participant populations will help determine whether the study’s design and questions are a good fit for a district or school.
    • The state branch of the Association for Career and Technical Education (ACTE) as well as existing state-level convenings of district leaders and educators are ideal spaces for initiating conversations between researchers and target audiences.
    • These conversations can help the recruitment team answer the following key questions to guide their outreach strategy:
      • Why is this project worth a district’s or school’s limited time?
      • What remains unclear about the research project’s design?
      • What research question is most exciting to practitioners?
      • When can partners engage with district and school leaders in the recruitment process, and how can they do so most cost-effectively?
  • Expand the target population to include smaller districts.
    • One of the major changes that occurred during the pandemic was the rise in virtual communication. If finding comparison populations is challenging, recruiting rural one-school districts could be a solution. Research teams can now leverage virtual methods to collect qualitative data, which mitigates the cost barriers associated with conducting in-person site visits to rural districts.

Application for State CTE Leaders 

Strategic partnerships provide CTE leadership with relevant, evidence-based recommendations for implementing high-quality CTE programs for every learner. These partnerships expand the scope and quality of data available to state leaders by working directly with districts to capture the most timely information available to improve the alignment and quality of CTE programs.

There are several examples of established partnerships between state-level agencies and researchers. The Data Quality Campaign produced a Roadmap for Effective Data Use and Research Partnerships that breaks down the steps for integrating research into school improvement policies. 

The American Youth Policy Forum and Results for America also offer resources targeted to support state leaders in pushing beyond simply disseminating data to leverage research evidence to drive policy decisions.

Additional resources on data-informed program improvement can be found in Advance CTE’s Learning that Works Resource Center. The Advancing Postsecondary CTE Data Quality Initiative blog series represent lessons learned and successful strategies employed across the five states to move their data systems and structures forward.

Amy Hodge, Policy Associate 

Research Round-up: The Impact of the High School CTE Education Teacher Pathway Initiative Grant

May 31st, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights a study produced by the U.S.  Department of Education’s Office of Career, Technical and Adult Education (OCTAE) on the impact of the High School CTE Education Teacher Pathway Initiative Grant. These findings align with Advance CTE’s vision for the future of CTE where each learner is supported by and has the means to succeed in the career preparation ecosystem.  

In 2017, the U.S. Department of Education’s Office of Career, Technical and Adult Education (OCTAE) launched the High School Career and Technical Education (CTE) Teacher Pathway Initiative (also referred to as CTE TPI). Last year, OCTAE published The Impact of the High School CTE Education Teacher Pathway Initiative Grant, a report on the outcomes of these three-year grants and the specific activities that the five grantees implemented to increase the pipeline capacity of high-school CTE teachers. These findings can inform state leaders on best practices for recruitment and retaining high-quality CTE instructors.

The study, conducted by the American Institutes for Research (AIR), focused on the following questions to examine the challenges and potential solutions encountered during grant implementation and to summarize grantee activities: 

  1. What do grantees see as the major factors contributing to shortages of secondary CTE teachers in their state or community?
  2. How have grantees used CTE TPI funding to alleviate CTE teacher shortages? 
  3. What challenges have grantees experienced in implementing their CTE TPI activities, and what strategies are they using to overcome those challenges? 
  4. Are there early indicators of success in alleviating CTE teacher shortages?

 

Grants were awarded to two state departments of education, a regional education service center, a community college system and a school district: 

Grantee Findings and Activities 

In the first collection of data in 2019, grantees were surveyed about what they saw as the major factors influencing the shortages of secondary teachers in their state or community. The five major issues identified were:

  1. Disparities in compensation and work-life balance between in-demand industry positions and teaching
  2. Lack of higher education programs to train potential CTE educators
  3. Challenges navigating the CTE teacher licensure process and requirements
  4. The differentiated education and experience required to teach different CTE content areas
  5. Exams in teaching skills or content areas

 

The table above shows the activities pursued by each grantee with the following outcomes: 

  • New Jersey Department of Education: 53 industry professionals enrolled in an educator preparation program and 9 current teachers completed a program to help them transition to CTE teaching.
  • Tennessee Department of Education: 61 teachers enrolled in new school district-led educator preparation programs, and 39 teachers and 30 mentors piloted a new regional mentoring model.
  • Southeast Kansas Education Service Center: 165 new CTE teachers and 63 mentors participated in at least 1 year of a structured mentoring program.
  • Portland Community College: 48 industry professionals and 27 current teachers transitioning to CTE teaching enrolled in an educator preparation program and community of practice.
  • School Board of Broward County: 100 teachers gained certification in business education, computer science, or engineering and 23 teachers implemented a new CTE course.

Promising Practices for States

Chronic teacher shortages were only exacerbated by the COVID-19 pandemic and without taking immediate action, these gaps may continue to grow. The findings from this study speak to the variety of strategies that state and local CTE leaders can employ to increase the number of CTE instructors:

  • Broad Professional networks: Establishing broader regional or statewide professional and/or mentoring networks through which new CTE teachers can access support from peers and more experienced CTE teachers is particularly important for new CTE teachers to combat what many teachers refer to as “professional isolation.”
  • Tailored Mentorship: Mentorship is clearly a needed support, particularly when it is aligned with new CTE teachers’ content areas or tailored to meet the individual’s professional needs.
  • Accessible Instructor Shortage Data: Grantees were unable to access systematic data regarding where and in what content areas high school CTE teachers are needed. This information must be collected from the district level, aggregated to the state level, and made accessible to coordinate an effective response to addressing staffing shortages.
  • Proactive Certification Planning: Educational institutions that are interested in recruiting current non-CTE teachers for CTE positions can make advance planning for moving teachers into those roles an explicit component of their strategy. The investment of preparing teachers for certification and licensure might be most impactful when accompanied by an institution-level commitment to directly translate teacher preparation into expanded CTE programs and an increase in CTE course opportunities for students.
  • Data Sharing through Partnerships: Whenever possible, grantees should solidify agreements with partners as partnerships launch or within grant applications that allow participant-level data sharing and a flow of information across organizations to monitor participant progress. This data sharing allows grantees to offer better support and enables flexibility in supporting CTE teachers.

For additional learning, visit Advance CTE’s Learning that Works Resource Center to access reports on how states can leverage Perkins V to Support Teacher Recruitment and Retention and State of the States 2022: Teacher Compensation Strategies.

Amy Hodge, Policy Associate

Research Roundup: Prior Learning Assessment as a Strategy for Upskilling Learners

April 26th, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-based Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights prior learning assessment as a strategy for upskilling learners by offering college credit for previous academic and professional experiences which aligns with CTE Without Limits: A Shared Vision for the Future of Career Technical Education where each learner’s skills are counted, valued, and portable.

Prior learning assessment (PLA) is a strategy being utilized by postsecondary institutions to increase enrollment and retention of learners in their CTE programs. PLA, which is similar in design and implementation to credit for prior learning (CPL) offers benefits for both learners and institutions. These programs are effective options for adult learners that have work or academic experience but lack the credentials and the information they need to upskill to complete a degree. 

Methods of PLA include:

The PLA Boost Report

The PLA Boost, released in 2020, was collaboratively produced by the Western Interstate Commission for Higher Education (WICHE) and the Council for Adult and Experiential Learning (CAEL). This study examined the use and impact of prior learning assessment (PLA) on adult outcomes using enrollment, credit-earning and degree-earning data from 72 postsecondary institutions of more than 465,000 learners of all ages, focusing in particular on more than 232,000 adult learners (defined as learners age 25 and older) from 69 of the participating institutions that were able to provide the most detailed data on PLA credit-earning.

Findings: The shared benefits of PLA to learners and institutions

When postsecondary institutions acknowledge previous education and training through PLA, it removes a barrier to returning to the classroom for adult learners by decreasing the cost of earning their degree. 

Based on the report’s findings, learners can save money by taking advantage of PLA: The adult students in this sample saved an estimated average of $1,481 at two-year public institutions, $3,794 at four-year publics, $10,220 at four-year privates, and $6,090 at for-profits when considering the lower costs of PLA compared to course tuition.

In addition to saving money, PLA allows the learner to save time and reportedly, increases feelings of motivation and validation. PLA was strongly associated with higher rates of credential completion for adult learners. The 24,512 adult students who earned PLA credits had a credential completion rate of 49 percent over the seven-and-a-half-year observation period, compared to 27 percent among adult students with no PLA credits.

Adult students with PLA were more likely to persist and continue to complete their degree at their participating institution. Adult students with PLA earned an average of 17.6 more credits from institutional courses compared to adult students without PLA.

Study Limitations 

The sample was overly representative of predominantly online institutions, some of the results (most notably for the sector and for race/ethnicity groups) were influenced by a handful of large institutions or by institutions where key student groups were concentrated, and there were too few students in some of the race categories (Native Hawai‘ian/Other Pacific Islander and American Indian/ Alaska Native). While this study was able to demonstrate the benefits of PLA,  the sample of adult learners was relatively small. Forty percent of the participating institutions reported participation rates of under three percent of adult learners with PLA. Disaggregating this data also revealed low participation rates for female, low-income and Black adult learners compared to other subgroups. It is worth noting that, despite variation in the extent, all learner subgroups experienced credential boosts from PLA.

Recommendations and Additional Resources

Now is the time to invest in PLA. PLA offers a solution for increasing credential attainment by extending an opportunity for adult learners to upskill and/or return to complete their degrees. The data shows us that access to PLA is not equal across adult learner groups. In order to provide access for all adult learners institutions should critique their data to better identify the gaps in access and to leverage the full potential of these programs.

To learn more about strategies to increase participation in PLA and CPL, check out the Credit for Prior Learning Messaging Toolkit. This toolkit provides effective messages targeted to key audiences and strategies for dissemination to increase participation in Credit for Prior Learning among adult learners who are pursuing career pathways and CTE programs of study that lead to jobs in in-demand fields. 

For state and local CTE leaders looking to increase their data literacy, Advance CTE’s Train the Trainer: Opportunity Gap Analysis Workshop focuses on the skills that leaders need to investigate outcome gaps and perform root cause analysis. These sessions will provide the necessary training and resources to support state leaders in addressing gaps in access to high-quality CTE. 

Amy Hodge, Policy Associate

Research Round-Up: Analyzing Enrollment Gaps in South Carolina’s Health Sciences Career Cluster

March 27th, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights findings from a replicative study that explores educational inequity within the South Carolina CTE Health Science Career Cluster®. These findings align with Advance CTE’s vision for the future where each learner can access CTE without borders.

CTE programs offer learners the opportunity to build their awareness of different career options through exposure to activities that promote early exploration to more explicit skill development through work-based learning and apprenticeships. When well designed, these programs achieve robust and equitable enrollment that supports local and state economic growth by aligning with relevant and high-wage industries.

One recent dissertation, Educational Equity Patterns within South Carolina Career and Technical Education (CTE): A Replication Study, authored by Nickolas Sumpteris describes the outcomes of replicating a previous study by Fuller Hamilton. Fuller Hamilton analyzed STEM CTE enrollment patterns in Illinois by the racial/ethnic make-up and sexual characteristics of all students within the state. Since no CTE educational equity research exists in South Carolina, Sumpter sought to apply this same analysis to South Carolina’s CTE Health Science Career Cluster. 

Fuller Hamilton et al. (2015) showed considerable differences in enrollment of male participants in the STEM career cluster compared to females and how these enrollment patterns correlated to other enrollment patterns within career clusters at the state and national levels. The original study also showed that all racial/ethnic groups in Illinois, except white students, were generally underrepresented in CTE programming. In addition, learners within marginalized groups identified as special populations under the Strengthening Career and Technical Education for the 21st Century Act (Perkins V) experienced significant success in obtaining high-demand skills as a pathway to college or the career of their choice when enrolled in CTE courses

The population represented in Sumpter’s paper consisted of high school learners enrolled in CTE within South Carolina during the 2018-19 school year. Secondary data was collected from a sample of 196,318 CTE enrollees and examined using descriptive analysis procedures. Sumpter’s research questions for this replication study were:

  • RQ1. What are South Carolina students’ CTE enrollment patterns, by sex, in both Health Science and Non-Health Science career clusters?
  • RQ2. What are South Carolina students’ CTE enrollment patterns, by race/ethnicity, in both Health Science and Non-Health Science career clusters?
  • RQ3. What are South Carolina students’ CTE enrollment patterns, by region, in both Health Science and Non-Health Science career clusters?
  • RQ4. What are South Carolina students’ CTE enrollment patterns, by socioeconomic status, in both Health Science and Non-Health Science career clusters?

Findings 

The study in South Carolina found inconsistencies in the levels of equity that existed within race, ethnicity, and sex. These inequities were also present regarding regional effects and socioeconomic status.

Sumpter concluded with recommendations for future research:

  • Conduct a qualitative or mixed-method study to explain further the enrollment patterns of CTE programs in South Carolina. 
  • Address the inequities in South Carolina by: 
    • improving the underrepresentation of educators by sex and race/ethnicity;
    • recommending equity audits;
    • examining access and availability of opportunities within CTE programs;
    • encouraging all educators to actively adopt and advance the equity agenda from the original study. 

Additional Resources

Analyzing the Health Science Career Cluster was significant because the healthcare field represents a major employer in South Carolina and is one of the largest growing fields nationally. By improving the enrollment of underrepresented groups in the Health Science Career Cluster, South Carolina can improve the quality of life and the labor market for its residents. 

State, local CTE and career pathways leaders can learn more about effectively harnessing learner group data using Advance CTE’s Achieving Inclusive CTE Goal-Setting Tool. The Achieving Inclusive CTE Goal-Setting Tool strives to equip state and local CTE and career pathways leaders to approach program participation, outcomes data, and goal setting with an inclusive and representative lens. With this goal-setting tool, leaders can more intentionally plan to recruit, engage and support underrepresented learner groups to increase access to high-quality CTE programs and career pathways.

Amy Hodge, Policy Associate

To read more of Advance CTE’s “Research Round-Up” blog series featuring summaries of relevant research reports and studies click here.

Research Round-Up: CTE Concentration Stays Strong Against the Challenges Posed by the COVID-19 Pandemic

March 1st, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog examines how the COVID-19 pandemic impacted CTE concentration rates. The findings align with Advance CTE’s vision for the future of CTE where each learner has the means to succeed in the career preparation ecosystem.

Due to the specific hands-on delivery and instruction requirements of career and technical education (CTE) courses, the coronavirus pandemic and the resulting online instruction posed new challenges for CTE programs and concentrators. The study, A Multi-State Analysis of Trends in Career and Technical Education, explored the level of impact of the coronavirus pandemic on CTE concentration rates using administrative data across five states: Massachusetts, Michigan, Montana, Tennessee, and Washington.

Methodology

 

The analysis sample for each state was defined as first-time ninth graders observed consistently over their four years in high school. The population of learners, CTE concentrators, was selected for observation because the definition of a concentrator is more similar across states than the definition for CTE participation. Another reason that the authors chose to observe rates of CTE concentrators rather than completers was that indicators for program completion were not readily available across the state populations.

The following tables share the concentrator definitions used as well as a breakdown by race/ethnicity and geography of the learners observed to aid state CTE leaders in aligning the findings with their own learner populations. 

The study was conducted by researchers Carly Urban, Celeste K. Carruthers, Shaun Dougherty, Thomas Goldring, Daniel Kreisman, and Roddy Theobald and examined the following questions:

  1. Did CTE concentration rates change at the start of the coronavirus pandemic? 
  2. Did gaps in concentration rates change by student race, ethnicity, gender or identified disability status?
  3. What are the differences in concentration rates across rural and urban areas and have these gaps changed over time?
  4. Were CTE concentrators more likely to graduate from high school and did this change at the start of the pandemic? 
  5. Which career clusters have seen the largest changes in participation? 

 

Findings

  1. CTE concentration rates changed minimally in the featured states at the start of the pandemic, with the exception being Tennessee, where the class of 2020 was significantly more likely to concentrate in CTE than the previous cohorts.
  2. The gaps in CTE concentration by gender, race and ethnicity largely did not widen at the start of the pandemic.
  3. The gaps in CTE concentration by identified disability status did not widen in any state for the first cohort impacted by the pandemic (SY16-17). However, one year into the pandemic, concentration rates for students with an identified disability in two states fell compared to students without an identified disability.
  4. In Michigan, Montana, and Tennessee, students in rural areas appeared more likely to concentrate in CTE than students in urban areas post-pandemic. In Massachusetts, CTE concentration was higher in urban than rural areas. While the two groups have virtually no difference in concentration rates in Washington. 
  5. CTE concentrators are more likely to graduate from high school than non-concentrators in all five states both before and after the pandemic.
  6. Changes in CTE clusters were relatively small when comparing the cohorts who were on track to graduate just before and after the pandemic. The fields with the largest positive and negative changes to concentrator rates varied by state.

 

Recommendations for Members

While these findings are descriptive and suggest that CTE concentration rates did not drop at the onset of the pandemic, the researchers have recommendations for state leaders to continue to support the successful coordination of CTE programs.

  • Preliminary findings indicate that the ways states adapted CTE education at the onset of the pandemic maintained concentration rates for learners with a disability. However, concentration gaps widened for learners with disabilities in subsequent years in some states, signaling that more attention must be given to meeting these learners’ needs in program design. 
  • States should consider the mode of communication they’re currently using to monitor the change in demand for or inability to supply specific CTE programs in schools.
  • States should continue to track and improve the quality of the outcome data they gather from CTE programs.

To learn more about how states can approach continuing to develop effective and accessible CTE data reporting tools to advance this report’s final recommendation, check out Advance CTE’s Beyond the Numbers: Design Principles for CTE Data Reporting. This guide provides state and local leaders with the necessary tools to inform early design and development of CTE data reporting tools or as a checklist to ensure their final reports align with best practices for access and usability.

To read more of Advance CTE’s “Research Round-Up” blog series featuring summaries of relevant research reports and studies click here.

Research Round-up: Graduation, College, and Employment Outcomes for CTE Learners with Identified Disabilities

January 31st, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights Career Technical Education and the graduation, college, and employment outcomes for CTE learners with identified disabilities. These findings align with Advance CTE’s vision for the future of CTE where each learner is supported and has the means to succeed in the career preparation ecosystem.

Last spring, the Career and Technical Education Policy Exchange (CTEx) at the Georgia Policy Lab published Graduation, College, and Employment Outcomes for CTE Students with Identified Disabilities. This report examines the relationship between CTE participation and transition outcomes for learners with an identified disorder and for learners receiving special education services for different identified disabilities.

For learners with identified disabilities, participating in career and technical education (CTE) programs in high school appears to positively impact graduation rates and a higher likelihood of securing employment in the year after high school. This report utilizes administrative data from three states, including Massachusetts, Tennessee, and Washington. This analysis is based on data from the 2007-08 through 2015-16 ninth-grade cohort data in Massachusettes, 2009–10 through 2013–14 ninth-grade cohorts in Tennessee, and 2010–11 through 2015–16 ninth-grade cohorts in Washington. This decision was made to address the different learner population sizes;  some categories (e.g., specific disability categories) were relatively small within a single high school cohort

Graph: The chart below offers summary statistics for the population of interest across the three states. The blue bar signifies learners with an identified disorder, and the red bar signifies learners without an identified disorder

The authors examined how CTE concentration for learners with an identified disorder relates to three outcomes:

High school graduation rate within five years of their first year of ninth grade.

  • CTE concentration rates for learners with an identified disorder vary across states and disorder types. Concentration rates for learners with specific learning disabilities, communication disorders, or health disorders are relatively high in all three states.

  • Across all three states and different identified disabilities, learners with an identified disorder who concentrate in CTE are more likely to graduate from high school than non-concentrators. While not identical, these states have similar concentrator definitions. These differences by CTE concentration status and disorder type vary across the states but tend to be the largest in Massachusetts.

Graph: Five-year graduation rates by CTE concentration and disorder categories

Postsecondary attendance at two-and four-year institutions.

  • In Massachusetts, learners with an identified disorder who concentrate in CTE and graduate from high school are less likely to attend college. By contrast, learners with a recognized disorder in Tennessee are more likely to enroll in college if they concentrate in CTE than if they do not. In Washington, the relationship between CTE and college enrollment varies across disorder categories. The gap in college attendance among learners with an identified disorder tends to be smaller between CTE concentrators and non-concentrators in Tennessee and Washington, though in Tennessee, learners with autism who concentrate in CTE are much more likely to attend college than non-concentrators.

Graph: College attendance rates among high school graduates by CTE concentration and disorder categories

Employment rates following graduation.

  • Learners with an identified disorder who concentrate in CTE and graduate from high school are more likely to be employed at least half-time in the year after graduation than non-concentrators. This pattern is consistent across all identified disorder types in Massachusetts and Tennessee and across most identified disorder types in Washington.

Graph: At least half-time employment rates among high school graduates by CTE concentration and disorder categories.

While the authors noted that their findings were descriptive and may not account for unobserved differences between learners with an identified disorder that are high school CTE concentrators and those with an identified disorder who are not high school CTE concentrators, the results do support existing research trends. Given the differences across states, the authors suggested that state leaders investigate trends in their educational context. Additionally, there may be an opportunity to improve access to these programs for those groups that reported much lower program enrollment rates than learners in other disorder categories.

Suggested follow up reading: Advancing Employment for Secondary Learners with Disabilities through CTE Policy and Practice. This report provides a policy landscape of state-level efforts to support secondary learners with disabilities in CTE programs based on a national survey of State Directors and was produced in partnership with University of Massachusetts Chan Medical School.

To read more of Advance CTE’s “Research Round-Up” blog series featuring summaries of relevant research reports and studies click here.

Amy Hodge, Policy Associate

Research Round-up: State and local government leaders should look to the “STARs” to address hiring woes.

January 5th, 2023

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s blog highlights the benefits of skills-based hiring that closely aligns with Advance CTE’s vision for the future of CTE where statewide systems and institutions effectively support each learner to earn credentials that are counted, valued, and portable.

Public sector jobs are necessary for the continued function of our society, but they are struggling to maintain staffing. The Center for American Progress’s report, The Benefits of Skills-Based Hiring for the State and Local Government Workforce, recommends that “state and local government shift to using skills-based hiring practices to expand and diversify the hiring pool and meet the sector’s skills needs.” This shift would be a departure from the present trend of state and local agencies requiring degrees that act as a proxy for skills. Skills-based hiring is gaining momentum and early implementation has shown promise. Adopting a skills-based approach for employees can be accomplished through initiatives that are already established in many states such as upskilling, teaching an employee new skills at any point in their tenure, or registered apprenticeships, a formal model that combines on-the-job training, classroom instruction and wage progression. 

The Center for American Progress defines skills-based hiring as the practice of describing a job by the technical skills required to perform it. Employers use skills-based hiring practices to fill vacancies by assessing whether a candidate’s skillset aligns with those needed. This report suggests that skills-based hiring is mutually beneficial for institutions and job candidates. Removing the bachelor’s degree requirement on job listings has the potential to increase the talent pool of potential candidates for open public sector positions and position government institutions as more competitive employers.

 

Talent Pool Demographics

More than 70 million Americans are skilled through alternative routes (STARs), a term coined by Opportunity@Work in their report, Reach for the STARs: Realizing the Potential of America’s Hidden Talent Pool. These individuals have either a high school diploma, some college, an associate’s degree or other credentials, but they do not hold a bachelor’s degree, which is the typical educational screen employers put on job postings. This requirement acts as a barrier for workers who are skilled through alternative routes ineligible for public sector jobs.

*Opportunity@Work excludes 20 million workers under age 25 from its analysis of the labor force to ensure that the majority of the population studied has completed their education. **STARs are workers who have attained a high school diploma but not a bachelor’s, master’s, or doctoral degree. Chart: Center for American Progress  Source: Opportunity@Work, “Rise with the STARs,” available at https://opportunityatwork.org/our-solutions/stars-insights/rise-with-the-stars-report/ (last accessed October 2022).

By reconsidering degree requirements, public sector jobs can again be the engines of mobility they once were and reflect the demographics of the constituents they serve. The skills that STARs have built through alternative routes and pathways can be transferable from one job to another. 

*The proportion of Hispanic workers who are STARs is lower because Hispanic workers are less likely to have obtained a high school diploma. Source: Opportunity@Work, “STARsInsights,” available at https://opportunityatwork.org/our-solutions/stars-insights/hispanic-stars/ (last accessed October 2022); Opportunity@Work calculations based on U.S. Census Bureau, “ACS 1-Year Estimates Public Use Microdata Sample: YEAR 2021 ANALYZED,” available at https://data.census.gov/mdat/#/ (last accessed October 2022).

 

Skills-based hiring practices can make governments more competitive employers

State and local governments are facing a significant labor shortage as their workforce comes closer to retirement. Retiring workers (currently comprising twenty-eight percent of state and local government workforce) are far less likely to have a bachelor’s degree than younger workers. This suggests that the barrier to entry to these positions has increased over time and is not mandatory for these positions.

This report recommends the following five principles to make a skills-based hiring policy successful in state and local governments:

  • Involve key stakeholders.
  • Identify target job roles.
  • Reconsider degree requirements to build a skills-based job description.
  • Build recruitment partnerships.
  • Invest in worker training.

Additional resources about skills-based hiring can be found in Advance CTE’s Resource Center.

Amy Hodge, Policy Associate

Research Round-up: New Reports on Work-Based Learning Address Impacts for Learners and Institutions

December 6th, 2022

Advance CTE’s “Research Round-Up” blog series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices and topics related to college and career readiness. This month’s focus supports a vision for the future of CTE where statewide systems and institutions effectively support each learner to earn credentials that are counted, valued, and portable.

Two recent reports from JFF and New America highlight the benefits of different workforce development programs; apprenticeships and work-based learning (WBL), and the opportunity to increase equitable access to these programs for every learner.

Addressing disparities in apprenticeship participation may fast-track non-traditional learners into living wage jobs.

JFF’s Center for Apprenticeship & Work-Based Learning published a report analyzing young people’s apprenticeship participation through an equity lens. The Current State of Diversity and Equity in U.S. Apprenticeships for Young People utilizes data from the U.S. Department of Labor’s Registered Apprenticeship Partners Information Database System to analyze youth apprenticeship participation from fiscal years 2010-2020. 

  • This report showed that, in total, 389,8860 young people (ages 16-24) started a Registered Apprenticeship program between 2010-2020. This rate outpaced overall youth employment. 
  • The average exit wage of $30 per hour for young people completing apprenticeships is much higher than the median wages among all young people, which suggests that work-based learning facilitates movement into well-paid jobs.
  • The data demonstrate that learners participating in apprenticeships are more likely to be white than non-white (63 percent compared to 35 percent) and more likely to be male. 

Average Hourly Exit Wage by Gender and Race/ Ethnicity for All Youth Participants in Apprenticeships, FY 2010-2020

 

 

 

 

 

 

  • This report identified “occupational segregation” as the explanation for the drastic differences in exit wages across lines of race and gender. For example, the data showed that the top occupation for female learners, pharmacy technician, paid $12 per hour compared with $26 per hour for the top male occupation of electrician. Similarly, these findings suggest that Black apprentices’ average exit wage of $23 (compared to $32 for Hispanic workers and $30 for white workers) is likely attributable to the large share of Black apprentices participating in heavy trucking and tractor-trailer programs, which paid $18 in exit wages. 
  • This report noted the shared benefits of increasing equitable access to workforce training programs: “When employers tap into a broader swath of talent, they often see a positive return on investment via healthier bottom lines and greater innovation, thanks to the wide range of backgrounds and experiences these apprentices bring to the job.”

Paid, postsecondary work-based learning pilot programs may be an effective tool for improving learner retention. 

New America recently published case studies of postsecondary institutions that have piloted paid work-based learning programs. This report, “What Everyone Should Know about Designing Equity-Minded Paid Work-Based Learning Opportunities for College Students” highlights the findings from case studies of emerging paid WBL program models across the country to understand the motivation, goals, and design of paid WBL opportunities available at two-year colleges. The findings include implications for state policymakers and college stakeholders in career services, academic advising, and workforce development. 

  • Paid WBL programs appear to correlate with improved learner retention strategy. Learners appear to value and engage more in paid WBL opportunities on campus or in the local community since transportation was previously an obstacle.
  • Institutions featured in these case studies funded paid WBL programs through multiple sources, from Higher Education Emergency Relief Funds (HEERF), Pell grants to supplement student employment, and internal funding sources from the institution’s general operating budget.

While the learner populations across these reports vary, common themes can be drawn from the key findings of these two reports: 

  • Workforce programs benefit participants by increasing earnings and providing opportunities to gain in-demand skills, and in turn, these benefits are also enjoyed by adjacent stakeholders, including employers and postsecondary institutions.
  • Understanding learner barriers can create more equitable access for underrepresented learners in these programs.
    • Braiding funding sources can allow states to design more equitable programs and supports that facilitate young adults’ transition into competitive wage jobs.
  • States and postsecondary institutions still need support in collecting data on longitudinal workforce outcomes for those who complete work-based learning and apprenticeship programs. 

Additional Resources

Amy Hodge, Policy Associate 

Research Round-up: Perceptions of and Participation in Alternative Credentials

August 25th, 2022

Advance CTE’s “Research Round-Up” series features summaries of relevant research reports and studies to elevate evidence-backed Career Technical Educational (CTE) policies and practices, as well as topics related to college and career readiness. This month’s topic, Alternative Credentials, advances a vision for the future of CTE where statewide systems and supports are in place for each learner’s skills to be fully counted, valued, and portable, and highlights the potential benefits of alternative credentials for both learners and employers.

Defining Alternative Credentials 

According to the Society for Human Resource Management, alternative credentials can be loosely defined as any micro-credential, industry or professional certification, acknowledgment of apprenticeship (registered or non-registered), or badging that indicates one’s competencies and skills within a particular field. Other common characteristics of alternative credentials include: 

  • These credentials typically take less time to complete;
  • Focus on specific skills; 
  • Are stackable;
  • Are verifiable; and 
  • Are often aligned to industries and can be frequently delivered digitally.

The key takeaways from three recent reports on the perceptions and outcomes of alternative credentials suggest that skills-based hiring offers a competitive alternative to the traditional, four-year degree job requirement and benefits both employers and employees. 

Research shows a growing need to think outside of the traditional four-year degree.

Jobs for the Future (JFF) and American Student Assistance (ASA)’s white paper, “Degrees of Risk: What Gen Z and Employers Think About Education-to-Career Pathways…and  How Those Views are Changing”, illustrates the shifting perceptions of alternative credentials

  • When trying to determine their next steps after graduation, Generation Z youth are becoming increasingly wary of the cost and time to complete a traditional four-year degree. Almost 86 percent of learners today receive financial aid; the average student loan balance accumulated over four years ranges from $25,880 to $107,520. Knowing this, they are open to the idea of non-degree pathways and credentials to help build job readiness skills in order to accelerate their timelines for entering the workforce. 
  • Employers who are willing to look outside of the traditional four-year degree are looking for a certain threshold of experience (typically measured in years) to satisfy skill requirements. This could suggest that potential candidates who have completed an apprenticeship or work-based learning have an advantage over traditional college applicants who may not yet have accumulated work experience.

 

 

 

 

 

 

 

 

 

 

 

For employees, alternative credentials may have a return on investment that is competitive with the traditional degree track.

The Midwest Economic Policy Institute co-authored “Apprenticeship as a Career Development Alternative” with the University of Illinois’ Labor and Employment Relations division to examine registered apprenticeship programs in the state of Wisconsin. The report analyzes enrollment, hours worked, and wages earned by learners, to demonstrate the market value of alternative credentials when learners are considering their postsecondary options. 

  • Wages earned by workers who have achieved journey-level experience start at $67,200 annual salary, on par with annual earnings for workers with bachelor’s degrees.
  • The average construction worker who completes an apprenticeship program in Wisconsin earns 33 percent more than the average worker with an associate degree. These wages are only 3 percent less than the average worker with a bachelor’s degree and avoid incurring $27,100 in student debt, the average loan burden for graduating seniors from the University of Wisconsin-Madison.

For employers, lowering barriers to jobs by removing burdensome degree requirements has the potential of diversifying talent pools.

The Society for Human Resource Management (SHRM) published the findings of a survey sampling executives, supervisors, HR professionals, and workers to measure the frequency and perceptions of alternative credentials. A majority of executives, supervisors, and HR professionals believe that including alternative credentials in hiring decisions can actually improve overall workplace diversity. The findings show that 81 percent of executives, 71 percent of supervisors, and 59 percent of human resource professionals recognize that using alternative credentials can uncover untapped talent and make it easier for diverse candidates to obtain employment.

Credentials are popular with nontraditional groups: 

  • Older Workers: Most workers ages 50 and older funded through the Workforce Innovation and Opportunity Act (WIOA) who seek further education earn a non-degree credential. WIOA observed a clear preference on the part of older workers for training options that are usually under one year in duration with training program completion rates ranging from 74 to 85 percent .
  • Individuals without a postsecondary degree: 58 percent of working-age adults with some college but no degree have earned nondegree credentials, while 19 percent of those with no higher education have earned nondegree credentials.
  • Veterans: For those adults without college degrees, military veterans (57 percent) are far more likely than nonveterans (35 percent) to have a certificate or certification.

Confidence in alternative credentials is growing among learners and employers, alike. CTE has long been viewed as a responsive, skills-based avenue for learners to earn alternative credentials. To move the needle on skills-based practices, CTE leaders must ensure that alternative credentials are high-quality, backed by labor market information and provide on and off ramps to allow learners to stack their credentials.

Additional discussions about skills-based hiring can be found in this webinar,  Valuing Individuals’ Career-Ready Competencies Through Skills-Based Hiring, hosted earlier this year by Advance CTE, and in the Learning that Works Resource Center.

Amy Hodge, Policy Associate 

CTE Research Review: Q&A with Shaun Dougherty on the Impacts of CTE Access on Learner Outcomes in Connecticut 

June 15th, 2022

This research review series features interviews with three CTE researchers— Julie Edmunds, Shaun Dougherty, and Rachel Rosen — to highlight new and relevant Career Technical Education (CTE) research topics being pursued and discuss how state CTE leaders might leverage these to make evidence-based decisions. This series is conducted in partnership with the Career and Technical Education Research Network, which is providing new CTE impact studies and strengthening the capacity of the field to conduct and use rigorous CTE research.

For the final post in this series, Advance CTE caught up with researcher Shaun Dougherty to learn more about the outcomes of his study, The Effects of Career and Technical Education: Evidence from the Connecticut Technical High School SystemThis study took place at The Connecticut Technical High School System (CTHSS), an independent district of choice composed of 16 high schools where all students who attend the school participate in some form of CTE. The technical high schools in this study offer between 10 and 17 programs of study compared to the two to four typically offered at traditional comprehensive high schools. These findings suggest that student participation in CTE programs can improve graduation and college enrollment rates, and labor force participation, especially for male students. These findings should be meaningful to state leaders who are interested in improving CTE data quality to improve programming and learner supports.

How do your research findings advance the CTE field’s understanding of ways to better serve learners?

My findings in Connecticut and an earlier study in Massachusetts suggest that increasing access to high-quality CTE-focused schools can improve high school graduation rates, test scores, and early workforce experiences (earnings especially). These findings suggest that ensuring access to high-quality CTE is important, especially in areas where there is high demand for it among students. In Connecticut, we show that the benefits accrue to males only, but in Massachusetts, the impacts are broader-based and larger for students who come from less financially advantaged backgrounds. 

What is also important about both of these contexts is that students are attending CTE-dedicated high schools, which is the least common form of CTE instructional delivery in the United States. Students explore multiple programs in 9th grade and then make an informed decision about what program of study to pursue for the rest of their high school experience. Within the program they choose, they then have a relatively stable set of peers and instructors, and there is alignment between content in the state graduation requirements, such as math and English Language Arts (ELA), and their technical area of study. Each of these dimensions of the experience tends not to exist in CTE delivered in comprehensive high schools or regional technical centers.

What findings would you highlight for state CTE leaders in particular?

In particular, I’d highlight the following:

  • Whole-school models of CTE may be more expensive but have been shown to have quite larger impacts on student success and so could be worth the long-term investment.
  • If whole-school models aren’t feasible, adapting some of the structures of how those schools operate in other settings could be worth pursuing.
  • Creating ways for students to explore multiple programs of study early in high school is likely to improve the experience of all students as they get more information about their interests and strengths.
  • Investing in skilled trade programs likely helps mitigate otherwise undesirable educational and social outcomes, especially for boys who struggled to be engaged in middle school. Avoiding tracking is critical, but also finding ways to engage students in ways that likely benefit them and their families and communities is critical. 

You find male students enrolled in Connecticut’s Technical High School System (CTHSS) are more likely to graduate high school and experience a notable wage increase compared to males attending traditional high schools, yet this effect is not seen among female students. What do you make of this finding? 

There are two things worth noting here:

  • Male labor force participation in the U.S.  is generally lower than females, as are their likelihoods of completing high school or entering college. Thus, there is more opportunity to have a positive impact on males than females. 
  • Males are more likely to enter traditionally male-dominated fields, such as manufacturing and construction, which are the two industries where we see the largest payoff for participating in these technical high schools. Thus, gendered patterns of program participation are related to similarly gendered patterns of employment, which are directly related to the earnings premiums we see for males. 

Can you tell me about how you were able to leverage the state’s longitudinal data system, the value that this process brought to your work, and about any limitations you encountered??

We matched the CTHSS admissions records to the Connecticut State Department of Education’s (CSDE) longitudinal data system sequentially using the following criteria: SASID, exact match on first and last name plus birth year, first initial and exact match on last name plus birth year and month, and exact match on last name plus exact birth date. The reason for the sequential match process is reporting errors in the CTHSS application file on birth dates, spelling errors and uses of nicknames in the application file that parents and/or students fill out by hand. A failure to match after applying all of these criteria leads to the observation being omitted from the sample. Our resulting match rate was 95 percent yielding a final sample of 57,658 student applications.

From the CSDE longitudinal data system, we obtained information on each student’s race, gender, free or reduced-price lunch status, English learner and special education status (i.e. presence of an IEP).

The CSDE data also provided information on short- and medium-term educational outcomes including standardized test scores prior to and during high school, attendance, and high school graduation, as well as information on college attendance drawn from the National Student Clearinghouse.

Further, through the P20Win process, students in our sample were matched to Connecticut State Department of Labor (CSDOL) data. This CSDOL match is facilitated by Department of Motor Vehicle records that contain gender, birth date, and first and last name and is matched to the CSDOL data using social security numbers. CSDOL personnel then matched the resulting data to the CSDE data using an exact match on birth date and gender and a fuzzy match algorithm on the student’s name.

Failure to match applicants in the CSDOL data may have been driven by several factors including never having a driver’s license in the state of Connecticut, name changes due to marriage or other factors, moving out of state prior to or upon the completion of high school or failure to participate in the labor market after high school perhaps due to college attendance. Our labor market data ends in the 1st quarter of 2018. Therefore, we restrict this sample to the years 2006 to 2012 so that we have a potential for at least six quarters of data on each applicant.

Without the matching to the workforce outcomes, we would be left to wonder or speculate about what happened to most students, since there is no real evidence of impact on college-going (nor should we expect it early on for students who attended schools that emphasize manufacturing and skilled trades). Thus, the linkages were critical to being able to provide policymakers with relevant, detailed answers  

The primary limitation is that we cannot see workers who moved out of state, who were employed by the federal government, who work for unreported wages, or who are independent contractors. However, our takeaway is that our findings are likely an underestimate of the benefits of CTE. 

What new questions has this work raised for you that could be applied to future research?

The two biggest questions this work has raised for me so far are:

  • First, what financial benefits will persist through middle age and beyond?
    Other work has shown that early-career benefits of CTE may decline or turn negative over a 30-year career if the jobs and skills become obsolete or workers are not able to maintain their labor force participation. The evidence that raises this concern is from much earlier periods, so following this over the long term is critical. 
  • Second, are there conditions under which females see similar, or at least positive benefits? The gendered patterns of results are both informative and distressing. For instance, Sade Bonilla (2020) found larger high school graduation benefits from CTE in California where recent expansions of CTE had focused on health services pathways, which were both in demand and disproportionately female. Relatedly, it would be important to get other measures of benefits, such as job satisfaction, flexibility, or other indirect financial benefits. For example, females are more likely to go into education. For early childhood educators, there may be an indirect financial benefit in the form of free or reduced-cost childcare for one’s own children. Further, flexibility in work schedules around children’s school schedules may also carry weight in estimating benefits. 

Visit the Learning that Works Resource Center for additional publications examining career-centered education models and Advance CTE’s 50-state report on equity in CTE early postsecondary opportunities (EPSOs) released earlier this year.

The work of the CTE Research Network Lead is supported by the Institute of Education Sciences at the U.S. Department of Education with funds provided under the Carl D. Perkins Career and Technical Education Act through Grant R305N180005 to the American Institutes for Research (AIR). The work of the Network member projects is supported by the Institute. The opinions expressed are those of the authors and do not represent the views of the Institute or the U.S. Department of Education.

Amy Hodge, Policy Associate

 

Series

Archives

1