Topic/Purpose

As I look at my renewed focus on applying data analytics and human creativity to the problem of community college developmental education, it really is an Action Research problem. That is, my goal is to empower and encourage advisors to apply Action Research methodologies to their advising. Accomplishing this, however, will require some research of my own to “prime the pump.”

An essential place to start is to research how effective the changes we’ve tried in the past have been. Specifically, we made a change a few years back to our ELA prerequisite requirements to allow instructors to classify their courses as needing an ELA prerequisite, corequisite, or no requirements. Unfortunately though, the College hasn’t studied how effective it’s been. A study on this would lay the groundwork to further study changes and experiments against an existing set of success metrics.

My initial research question is,

“Have the implemented recommendations of the SVCC ELA Task Force improved student success and time to completion at Sauk Valley Community College?”

Design/Methods/Measurement

Determining how to measure student success is a crucial step in this process. A review of the literature provides an excellent starting point and benchmark. Based on my literature review, I believe that the following measures will be important to examine and compare:

• Gateway English course (ENG 101) pass rates (defined as “C” or above)
• Pass rates for the next English course (ENG 103)
• Pass rates for courses with ELA corequisite or no prerequisite requirements
• 2-year and 4-year graduation rates

In addition, Sauk looks at other metrics to gauge student success such as fall-to-fall retention, fall-to-spring retention, and persistence.While not all of these measures would necessarily be significant, I intend to include these in my study for completeness and comparison. Finally, I would like to introduce another measure called “acceleration” to measure the rate at which students are moved through their developmental sequence.

The time period for the comparison study would be Fall 2010 – Spring 2018 semesters; since the 2013-14 school year was a transition year with full implementation in Fall 2014. This allows ample time for comparison of the time period before and after the change. Some measures (for example, 4-year graduation rates) may warrant a longer study period, but this will be enough data to determine whether the changes have been successful.

Data would be collected from the College’s student information system (SIS) and (if applicable) learning management system (LMS) using anonymized exports of student records. This will allow tracking individual students’ progress through multiple courses and through their program of study. Additional comparison and benchmark data may be collected from IPEDS data and other publicly available data.

After obtaining initial results, I will need to examine additional demographic and academic data to control for other factors that may explain part or all of the results and to determine future areas of study and trials. This will likely consume the majority of the study time, and while it is difficult to predict all the factors I will need to examine, I would need to examine the following at minimum: age, gender, high school, and (to the extent possible) socioeconomic factors.

Timeline

July 2018 – Approval.

The first step is to obtain approval from the SVCC Institutional Review Board to conduct human subject research. I have filed an application and expect to receive a response by mid-July.

July-August 2018 – Initial Success Results.

After I have received approval, I will pull initial student data and begin sorting and analyzing to obtain initial results.

September – November 2018 – Follow the Data.

Once I have the initial success data compiled

November – December 2018 – Write Paper.

With the data compiled and analyzed, I will write a formal research paper. The paper can then be shared with relevant faculty, administration the College’s developmental education committee for feedback. Once the paper is finalized, I will begin to submit it for publication.

January 2018 – Share Results.

Results would be shared with faculty and staff at the College Spring Kickoff, with a copy of the study shared prior for a robust discussion of next steps and further study. I also hope for the opportunity to discuss developing a regular research cycle under the auspices of the developmental education committee.