Developmental Education in Community Colleges - U.S ...
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Developmental Education in Community Colleges Thomas Bailey and Sung-Woo Cho Community College Research Center When students arrive to enroll in community college students who do not enroll in any college, almost all are asked to take a skills developmental education course complete a assessment in math, reading, and writing. degree or certificate in the same time period.2 Based on these assessments, students are either It will be very difficult to meet the Obama categorized as “college-ready” and can enroll administration’s goal of increasing the number in college-level classes in the relevant of community college graduates by 5 million subjects, or they are considered by 2020 without making significant progress “developmental” or “remedial” students and on improving outcomes for students who are referred to academic services designed to arrive at community colleges with weak raise their skills up to college standards. Many academic skills. students are referred to multiple levels of remediation—up to five levels in some cases. In this Brief we first report on evidence about This means that such students would have to the effectiveness (or, unfortunately, in too successfully navigate five semesters of pre- many cases, the ineffectiveness) of college instruction before being prepared for remediation and then provide information their first college-level course. about the progression of students through the developmental sequence. We discuss problems While a variety of other remedial services are associated with the crucial assessments and offered, the large majority consists of these make a brief statement about costs. We then semester-long developmental classes in the describe three initiatives designed to improve subjects to which students have been referred. the performance of remedial services. About 60 percent of incoming students are referred to at least one developmental course.1 This is often surprising to them since the large Effectiveness majority of community college entrants are high school graduates. And for many, Do the services provided to students through remediation is not just a course, but rather, for developmental education programs work to those referred to multiple levels, a whole improve student outcomes? Given the size and curriculum. importance of the developmental function, there are surprisingly few rigorous Addressing the needs of developmental evaluations, and outcomes from those are not students is perhaps the most difficult and most encouraging. Two rigorous studies, one in important problem facing community colleges. Florida and one in Texas, found that students Developmental students face tremendous who participated in remediation did no better barriers. Less than one quarter of community on several outcome measures than similar college students who enroll in developmental students who enrolled directly in college-level education complete a degree or certificate courses. 3 On the other hand, a study in Ohio, within eight years of enrollment in college. In using a more restricted sample, found positive comparison, almost 40 percent of community effects for math remediation but none for 46
reading. 4 But the results of these studies are recruits students to enroll in the first place, that most reliable for referred students whose improves the teaching that takes place in the assessment scores put them close to the remedial classroom in order to retain students remediation cutoff points—that is, these were in the courses, and that helps students bridge among the stronger of the students who were the gap between courses. referred to developmental education. We know very little about the effectiveness of Of course the best developmental education developmental education for students who program is the one that avoids the need for score well below the cutoff score, although a remediation in the first place. Certainly K12 study of a program for students in adult basic reform will help, but students will continue to skills classes in Washington State—the I- arrive needing help (many community college BEST program—does show promising early students have been out of school for several outcomes. This will be discussed in more years or were schooled in their home detail below. countries). Intensive bridge programs that take place in the summer before college starts have the potential to make up for weaknesses and Progression allow students to start college at the college level. Analysis of the progression of students through developmental education provides Assessments some insight into why these students are unlikely to go on to complete a degree or other Problems with the assessments (often called credential. Using student data from colleges placement tests) used to refer students participating in the nationwide Achieving the represent another barrier to improved Dream initiative outcomes for students with weak academic (http://www.achievingthedream.org/), we skills. Overall, there is no consensus about found that many students do not complete their what constitutes preparation for college. States sequences of developmental courses, and a and institutions use many different sizeable proportion of those referred never assessments, and even when they use the same even enroll. 5 To take math developmental assessments, they often set different cutoff education as an example, 28 percent of those scores. Moreover, there is no obvious point of referred did not enroll. Another 30 percent discontinuity in the distribution of cutoff failed or withdrew from one of the scores that might provide a meaningful point developmental courses in which they enrolled. to distinguish between “remedial” and Ten percent dropped out of their ”college-ready” students. Thus, there is little developmental sequences without ever failing to differentiate students within the wide range a course. Thus, only 31 percent successfully of students above and below the cutoff scores. completed their sequences of math remediation. Of those completers, about half Moreover, students who are referred to (16 percent of all of those referred) actually developmental courses through the completed a college-level course in math assessments face many different problems. within three years. (Outcomes for reading Again taking math as an example, some were somewhat better: about one quarter students may have had difficulty learning math completed the first relevant college-level in high school, some may have taken very course within three years.) little math, some older students may have done well in math but have forgotten much of what The data on progression provide several they learned, and others may have language insights into directions for reform. First, the problems and experience trouble sequence of course is often too complicated understanding the placement tests. These and takes too long. This suggests a different groups of students need different comprehensive strategy that effectively types of services, but the assessments do not 47
differentiate among them, and the colleges do data have revealed the extent and nature of the not provide different classes or other problems that we have described. This better interventions to address the varied reasons for understanding of the problems is informing the the skills deficiencies. Assessments that do a many potential solutions that are currently better job of identifying particular weaknesses being tested. could lead to more customized developmental programs that have the potential to reduce the For example, Bill and Melinda Gates time that students must spend in remediation. Foundation and Lumina Foundation for Education have funded the Developmental Some developments over the past two years Education Initiative (DEI) as an outgrowth of suggest that we may be moving toward a Achieving the Dream better system of assessments. The Common (http://www.deionline.org/). Sixteen colleges Core State Standards that have been adopted are participating in the DEI, the purpose of by 34 states have advanced the national which is to help the colleges expand small or discussion of what constitutes being ready for pilot programs that have been shown to be college, and assessment companies are effective. Lumina Foundation has also funded developing more diagnostic assessments, but an initiative titled Getting Past Go these improvements are still at an early stage. (http://www.gettingpastgo.org), which is In the meantime, states such as Florida and focused on improving developmental California are already implementing early education through enhanced state policy. The college readiness testing along with National Center for Postsecondary Research, opportunities for remediation for students funded by the Institute for Education Sciences while they are still in high school. These are in the U.S. Department of Education, is examples of state-level efforts that aim to conducting rigorous evaluations of engage high schools around the need to reduce developmental education models and remediation of their graduates. interventions, including studies of six learning communities (discussed below) and a study of intensive summer bridge programs designed to Costs help students become college-ready in a compressed time period the summer after high Developmental education is certainly costly. school graduation. These programs appear to States spend tens of millions of dollars on have potential, but most of them are at early remediation, and very rough national estimates stages. suggest that well over $1 billion a year are spent on these services. But it is students who Below we outline three promising programs probably have to bear the most significant for which we do have some evaluation costs. They must not only pay for the classes evidence. but also must delay their progress through college. Many students are discouraged when Accelerated Learning Program (ALP) they find out that they are not eligible for college-level courses. This may explain the Description: In Accelerated Learning high “no-show” rates among those referred to Programs, or ALPs, students placed into remediation. upper-level developmental courses are “mainstreamed” into college-level courses in that subject, and are simultaneously enrolled in Reform Initiatives and Exemplars a companion ALP course (taught by the same instructor) that meets in the class period Thus, developmental education is costly and immediately following the college-level class. not very effective. But there is some reason for The aim of the ALP course, which has a small optimism. It is only recently that number of students, is to help students improvements in the availability and quality of maximize the likelihood of success in their 48
first college-level course and to speed up their progress through the developmental sequence. Integrated Basic Education and Skills Training (I-BEST) Value-added: ALP accelerates those students who are most ready to take their first college- Description: In the I-BEST model, basic skills level course by allowing them to bypass the instructors and professional-technical faculty highest level of developmental education. jointly teach college-level occupational classes Students needing remediation are thus that admit basic skills students. The objective “mainstreamed” directly into college-level is to accelerate the rate at which adult basic coursework that incorporates supplemental skills students advance to college-level instruction, tutoring, or other supports. In programs that lead to career-path employment. some other acceleration models, colleges The Washington State Board for Community combine developmental courses at different and Technical Colleges (SBCTC) has levels, thus reducing the total number of such implemented I-BEST since the 2005-06 courses students must take. ALP is more of a academic year, when 10 colleges piloted the structural innovation than an instructional one, program. In 2007-08, I-BEST was expanded to save for the additional instruction that the all 34 colleges in the system. college-level instructors provide for these developmental students. Value-added: By integrating instruction in basic skills with instruction in college-level Population targeted/served: ALP serves professional-technical skills, I-BEST seeks to students at the upper end of the developmental increase the rate at which adult basic education range, that is, those students who are assigned students advance to college-level programs to remediation but score near the and complete postsecondary credentials in developmental cut-off point on assessments. fields offering good wages and opportunities for career advancement. In the state of Evidence of effectiveness: The Community Washington, I-BEST is funded at 1.75 times College of Baltimore County (CCBC) has had the normal rate per full-time equivalent the ALP since the 2007-08 academic year. student to compensate for the cost of using Using a multivariate analysis, one study found two faculty members as well as other planning that among CCBC students who were referred and coordinating costs. to the highest level of developmental English, those who enrolled directly into the college- Population targeted/served: I-BEST serves level course and the concurrent ALP basic skills students with an interest in companion course were significantly more enrolling in occupational classes that lead to likely to take and pass that college-level jobs with higher wages. The program is course and the course immediately after it targeted to students who have specific (English 101 and 102) than those who enrolled occupations in mind and who cannot afford to in the highest level of developmental wait to finish basic skills before enrolling education. 6 ALP was also found to be a postsecondary education and training. significantly more cost-effective pathway through the required college-level English Evidence of effectiveness: Using propensity courses than the traditional developmental score matching, one study found that students sequence, as measured by cost per successful who enrolled in I-BEST were more likely to student. Because of the promising preliminary progress into credit-bearing courses, persist in findings on the program, CCBC is in the college, accumulate credits that count toward a process of scaling up ALP such that by next credential, and make learning gains on basic year, the majority of students who are referred skills tests. 7 A forthcoming paper that to the highest level developmental English employed difference-in-differences analysis, course will be enrolled in English 101 with the found that students who were exposed to I- concurrent ALP support course. BEST were 10 percentage points more likely 49
to earn college-level credits and more than developmental course sequence completion in seven percentage points more likely to earn a English. 9 However, the evidence was mixed as certificate. 8 Due to the positive preliminary to whether the programs increased persistence, findings, I-BEST has generated much measured within two years. Less excitement within Washington’s community comprehensive learning community programs college system and elsewhere. Other states had no substantive effects. look at it as a model for constructing similar programs, and major foundations such as the Bill & Melinda Gates Foundation have Summary and Conclusion expressed interest in replicating it. By stepping back and taking in the broad Learning Communities picture of developmental education, one sees an extensive system that involves thousands of Description: Many community colleges dedicated counselors and professors carrying operate learning communities to improve low out a crucial function. But at the same time, rates of student success. Basic learning that system is characterized by uncertainty, communities co-enroll a cohort of students lack of consensus on the definition of being into several classes together. More college-ready or of the best strategies to comprehensive versions include integrated pursue, high costs, and varied and often curricula, collaboration among instructors, and unknown benefits. Many students who are student services such as enhanced advising referred to developmental education never and tutoring which are embedded into the enroll in it. Many who complete one remedial course. course fail to show up for the next course in the sequence. Overall, fewer than one half of Value-Added: Learning communities provide students who are referred to developmental academically low-performing students with education complete the recommended the opportunity to enroll and complete courses sequence. What is more, many students who together at the developmental level. Students do complete their developmental courses do are grouped in small cohorts (a program in not go on to enroll in the associated college- Kingsborough Community College places 25 level courses. The evaluation data concerning first-year students in each cohort) and enroll in developmental education are equally a developmental course, a course on another discouraging. Much of the research on academic subject, and a one-credit college developmental education is suggestive but orientation course. This is designed to help cannot reliably measure the effect of students advance through developmental remediation or differentiate among different education and into college-level courses within approaches. The handful of more definitive a structure of cohort accountability. studies shows mixed results at best. Population targeted/served: Learning This picture is further complicated by the lack communities are designed to serve of consensus about what constitutes being academically low-performing students who college-ready and by assessments that have have been referred to developmental courses only a weak relationship with subsequent upon arriving at an institution as first-time educational performance. This uncertainty is students. Many of the students in these reflected in the bewildering plethora of programs are also from low-income assessments and cutoff points used around the backgrounds. country. And perhaps even more importantly, there is no break or discontinuity in Evidence of effectiveness: Researchers have assessment test scores that clearly shown that more comprehensive programs led differentiates developmental from college- to positive impacts on student engagement, level students. Many students who test out of college persistence, credits earned, and remediation nonetheless struggle in their 50
college courses, and educational outcomes for such students are too low. Thus, a sharp colleges. Economics of Education Review, 29(2), distinction in the services received by these 255–270. 6 two types of students is not justified. Jenkins, D., Speroni C., Belfield, C., Jaggars, S. S., & Edgecombe, N. (2010). A model for The picture of past and current developmental accelerating academic success of community college remedial English students: Is it effective education appears bleak. If students cannot get and affordable? (CCRC Working Paper, established in college with college-level forthcoming). New York: Columbia University, courses, then they will certainly not be able to Community College Research Center. graduate. But the initiatives that we have 7 Jenkins, D., Zeidenberg, M., & Kienzl, G. (2009). described and many others currently on the Building bridges to postsecondary training for low- drawing board and in the field have the skill adults: Outcomes of Washington State’s I- potential to significantly improve the BEST program (CCRC Brief No. 42). New York: effectiveness of these services. Finding better Columbia University, Teachers College, ways to address the needs of underprepared Community College Research Center. 8 students is a necessity for meeting the Obama Zeidenberg, M., Cho, S-.W., & Jenkins, D. (2010). Washington State’s Integrated Basic administration’s goal of increasing the number Education and Skills Training program (I-BEST): of community college graduates by 5 million New evidence of effectiveness (CCRC Working by 2020. Paper No. 20). New York: Columbia University, Teachers College, Community College Research Center. 9 Weiss, M., Visher, M., & Wathington, H. (2010). Learning communities for students in developmental reading: An impact study at Endnotes Hillsborough Community College. New York: National Center for Postsecondary Research. 1 Bailey, T. (2009). Challenge and opportunity: Rethinking the role and function of developmental education in community college. New Directions for Community Colleges, 145, 11–30. 2 Attewell, P., Lavin, D., Domina, T., & Levey, T. (2006). New evidence on college remediation. Journal of Higher Education, 77(5), 886-924. 3 Calcagno, J. C., & Long, B. T. (2008). The impact of postsecondary remediation using a regression discontinuity approach: Addressing endogenous sorting and noncompliance (NBER Working Paper 14194). Cambridge, MA: National Bureau of Economic Research. Martorell, P., & McFarlin, I. J. (2009). Help or hindrance? The effects of college remediation on academic and labor market outcomes. Unpublished manuscript, RAND and University of Michigan. 4 Bettinger, E. P., & Long, B. T. (2009). Addressing the needs of underprepared students in higher education: Does college remediation work? Journal of Human Resources, 44(3), 736–771. 5 Bailey, T., Jeong, D.W., & Cho, S-.W. (2010). Referral, enrollment, and completion in developmental education sequences in community 51
You can also read