With increased public pressure to impact student success, assess student learning and increase completion outcomes at community colleges, mandatory orientation can be an important first step on the path to success. Colleges also need to identify opportunities for assessing co-curricular learning in student affairs programs and functions. This study describes the process of implementing a mandatory new student orientation at a community college in Colorado. The program assessment included data collection at the individual student level to document student learning, and more broadly to demonstrate that the program contributed to increases in student retention outcomes and documented student learning from the beginning of the college transition process. The authors found statistically significant differences in student learning about key on boarding topics following orientation and the new student orientation also contributed to a seventeen percent increase in fall to spring retention of new students.
KeywordsCo-Curricular LearningAssessment of Student LearningOrientationCommunity Colleges
Awad, G. H., Patall, E. A., Rackley, K. R., & Reilly, E. D. (2016). Recommendations for Culturally Sensitive Research Methods. Journal of Educational and Psychological Consultation, 26, 283-303. https://doi.org/10.1080/10474412.2015.1046600
Banks, J. A. (2015). Cultural Diversity and Education. New York, NY: Routledge.
Blake, J. H. (2007). The Crucial Role of Student Affairs Professionals in the Learning Process. New Directions for Student Services, 2007, 65-72. https://doi.org/10.1002/ss.234
Blome, C., & Augustin, M. (2016). Measuring Change in Subjective Wellbeing: Methods to Quantify Recall Bias and Recalibration Response Shift (No. 2016/12). HCHE Research Paper.
Boening, C. H., & Miller, M. T. (2005). New Student Orientation Programs Promoting Diversity. The Community College Enterprise, 11, 41-50.
Braskamp, L. A., Trautvetter, L. C., & Ward, K. (2016). Putting Students First: How Colleges Develop Students Purposefully. New York, NY: John Wiley & Sons.
Dale, P. A., & Drake, T. M. (2005). Connecting Academic and Student Affairs to Enhance Student Learning and Success. New Directions for Community Colleges, 2005, 51-64. https://doi.org/10.1002/cc.205
Darling-Hammond, L. (2015). The Flat World and Education: How America’s Commitment to Equity Will Determine Our Future. New York, NY: Teachers College Press.
Davis, G. A. (2002). Using a Retrospective Pre-Post Questionnaire to Determine Program Impact. In The Annual Meeting of the Mid-Western Educational Research Association.
Dean, K. L. (2015). Understanding Student Success by Measuring Co-Curricular Learning. New Directions for Institutional Research, 2014, 27-38. https://doi.org/10.1002/ir.20113
Degen, G., & Sheldahl, E. (2007). The Many Hats of Teaching in Small Colleges: The Seamless Web of Student and Academic Affairs. New Directions for Student Services, 2007, 47-56. https://doi.org/10.1002/ss.232
Derby, D. C., & Smith, T. (2004). An Orientation Course and Community College Retention. Community College Journal of Research and Practice, 28, 763-773. https://doi.org/10.1080/10668920390254771
Drennan, J., & Hyde, A. (2008). Controlling Response Shift Bias: The Use of the Retrospective Pre-Test Design in the Evaluation of a Master’s Programme. Assessment & Evaluation in Higher Education, 33, 699-709. https://doi.org/10.1080/02602930701773026
Eagan, K., Stolzenberg, E. B., Ramirez, J. J., Aragon, M. C., Suchard, M. R., & Hurtado, S. (2013). The American Freshman: National Norms Fall 2013. Los Angeles, CA: Higher Education Research Institute.
Ellertson, S., & Thoennes, K. V. (2007). Reframing Teaching and Learning: Lessons from Learning Communities for Student Affairs. New Directions for Student Services, 2007, 35-46. https://doi.org/10.1002/ss.231
Fike, D. S., & Fike, R. (2008). Predictors of First-Year Student Retention in the Community College. Community College Review, 36, 68-88. https://doi.org/10.1177/0091552108320222
Fontaine, K. (2014). Effects of a Retention Intervention Program for Associate Degree Nursing Students. Nursing Education Perspectives, 35, 94-99. https://doi.org/10.5480/12-815.1
French, N. K. (2002). Paraeducator Supervision Academy (PSA) Outreach Project. Final Performance Report.
Gale, T., & Parker, S. (2014). Navigating Change: A Typology of Student Transition in Higher Education. Studies in Higher Education, 39, 734-753. https://doi.org/10.1080/03075079.2012.721351
Ganser, S. L. (2012). Where It All Began: Peer Education and Leadership in Student Services. New Directions for Higher Education, 2012, 17-29. https://doi.org/10.1002/he.20003
Gibbons, M. M., & Woodside, M. (2014). Addressing the Needs of First-Generation College Students: Lessons Learned from Adults from Low-Education Families. Journal of College Counseling, 17, 21-36. https://doi.org/10.1002/j.2161-1882.2014.00045.x
Gray, R., Vitak, J., Easton, E. W., & Ellison, N. B. (2013). Examining Social Adjustment to College in the Age of Social Media: Factors Influencing Successful Transitions and Persistence. Computers & Education, 67, 193-207.
Greenfield, G. M., Keup, J. R., & Gardner, J. N. (2013). Developing and Sustaining Successful First-Year Programs: A Guide for Practitioners. New York, NY: John Wiley & Sons.
Gulley, N. Y., & Mullendore, R. H. (2014). Student Affairs and Academic Affairs Collaborations in the Community College Setting. Community College Journal of Research and Practice, 38, 661-673. https://doi.org/10.1080/10668926.2011.585115
Harbour, C. P., & Smith, D. A. (2016). The Completion Agenda, Community Colleges, and Civic Capacity. Community College Journal of Research and Practice, 40, 100-112. https://doi.org/10.1080/10668926.2014.996923
Heinisch, B. P. (2016). Small Fish Out of Water: Rural First-Generation Student Experience at a Large University. The Journal of College Orientation and Transition, 24, 21-33.
Henning, G. W., Mitchell, A. A., & Maki, P. L. (2008). The Assessment Skills and Knowledge Standards: Professionalizing the Work of Assessing Student Learning and Development. About Campus, 13, 11-17. https://doi.org/10.1002/abc.259
Hirt, J. (2006). Where You Work Matters: Student Affairs Administration at Different Types of Institutions. Lanham, MA: University Press of America.
Hollins Jr, T. N. (2009). Examining the Impact of a Comprehensive Approach to Student Orientation. Inquiry, 14, 15-27.
Howard, G. S. (1980). Response-Shift Bias: A Problem in Evaluating Interventions with Pre/Post Self-Reports. Evaluation Review, 1, 93-106. https://doi.org/10.1177/0193841X8000400105
Hughes, A. R. (2015). Leadership Development among Traditional-Age Community College Students. Northeastern University.
Hunter, M. S. (2006). Fostering Student Learning and Success through First-Year Programs. Peer Review, 8, 4-7.
Hunter, M. A., & Linder, C. W. (2005). First-Year Seminars. In M. L. Upcraft, J. N. Gardner, B. O. Barefoot, & Associates (Eds.), Challenging and Supporting the First-Year Student: A Handbook for Improving the First Year of College (pp. 275-291). San Francisco, CA: Jossey-Bass.
Hunter, M. A., & Murray, K. A. (2007). New Frontiers for Student Affairs Professionals: Teaching and the First-Year Experience. New Directions for Student Services, 2007, 25-34. https://doi.org/10.1002/ss.230
Jacoby, B. (2014). Engaging Commuter and Part-Time Students. In S. R. Harper, & S. J. Quaye (Eds.), Student Engagement in Higher Education: Theoretical Perspectives and Practical Approaches for Diverse Populations (pp. 289-305). New York, NY: Taylor & Francis.
Jamelske, E. (2009). Measuring the Impact of a University First-Year Experience Program on Student GPA and Retention. Higher Education, 57, 373-391. https://doi.org/10.1007/s10734-008-9161-1
Jenkins, D., & Fink, J. (2016). Tracking Transfer: New Measures of Institutional and State Effectiveness in Helping Community College Students Attain Bachelor’s Degrees. Community College Research Center, Teachers College, Columbia University.
Keeling, R. P., Underhile, R., & Wall, A. F. (2007). Horizontal and Vertical Structures: The Dynamics of Organization in Higher Education. Liberal Education, 93, 22-31.
Kezar, A., Chambers, A. C., & Burkhardt, J. C. (2015). Higher Education for the Public Good: Emerging Voices from a National Movement. New York, NY: John Wiley & Sons.
Kisker, C. B. (2005). Key Resources for Student Affairs Professionals in Learning-Centered Community Colleges. New Directions for Community Colleges, 2005, 89-97. https://doi.org/10.1002/cc.208
Klatt, J., & Taylor-Powell, E. (2005). Using the Retrospective Post-then-Pre Design, Quick Tips 27. Program Development and Evaluation. Madison, WI: University of Wisconsin-Extension.
Kuh, G. D., Jankowski, N., Ikenberry, S. O., & Kinzie, J. L. (2014). Knowing What Students Know and Can Do: The Current State of Student Learning Outcomes Assessment in US Colleges and Universities. Urbana, IL: National Institute for Learning Outcomes Assessment.
Lotkowski, V. A., Robbins, S. B., & Noeth, R. J. (2004). The Role of Academic and Non-Academic Factors in Improving College Retention. Iowa City, IA: ACT Policy Report.
Majer, J. M. (2017). Community Colleges. In J. J. Viola, & O. Glantsman (Eds.), Diverse Careers in Community Psychology (p. 189). Oxford: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780190457938.003.0016
Martin, K., Galentino, R., & Townsend, L. (2014). Community College Student Success: The Role of Motivation and Self-Empowerment. Community College Review, 42, 221-241. https://doi.org/10.1177/0091552114528972
Mayhew, M., Vanderlinden, K., & Kim, E. (2010). A Multi-Level Assessment of the Impact of Orientation Programs on Student Learning. Research in Higher Education, 51, 320-345. https://doi.org/10.1007/s11162-009-9159-2
Metzoff, B. (1981a). How to Get Accurate Self-Reports of Training Outcomes. Training and Development Journal, 35, 56-61.
Metzoff, B. (1981b). Pre-then-Post Testing: A Tool to Improve the Accuracy of Management Training Program Evaluation. NSPI Journal, 20, 10-16.
Moser, K., Kemter, V., Wachsmann, K., Kover, N. Z., & Soucek, R. (2016). Evaluating Rater Training with Double-Pretest One-Posttest Designs: An Analysis of Testing Effects and the Moderating Role of Rater Self-Efficacy. The International Journal of Human Resource Management, 27, 1-23. https://doi.org/10.1080/09585192.2016.1254102
Mullin, C. M. (2012). Why Access Matters: The Community College Student Body (Policy Brief 2012-01PBL). Washington DC: American Association of Community Colleges.
O’Gara, L., Mechur, K., & Hughes, K. (2009). Student Success Courses in the Community College: An Exploratory Study of Student Perspectives. Community College Review, 36, 195-218. https://doi.org/10.1177/0091552108327186
Permzadian, V., & Credé, M. (2016). Do First-Year Seminars Improve College Grades and Retention? A Quantitative Review of Their Overall Effectiveness and an Examination of Moderators of Effectiveness. Review of Educational Research, 86, 277-316. https://doi.org/10.3102/0034654315584955
Quaye, S. J., & Harper, S. R. (2014). Student Engagement in Higher Education: Theoretical Perspectives and Practical Approaches for Diverse Populations. New York, NY: Routledge.
Rhoads, R. A., & Valadez, J. R. (2016). Democracy, Multiculturalism, and the Community College: A Critical Perspective (Vol. 1081). New York, NY: Routledge.
Robinson, D. A., Burns, C. F., & Gaw, K. F. (1996). Orientation Programs: A Foundation for Student Learning and Success. New Directions for Student Services, 1996, 55-68. https://doi.org/10.1002/ss.37119967507
Rockwell, S. K., & Kohn, H. (1989). Post-then-Pre Evaluation. Journal of Extension, 27, 19-21.
Ribera, T., Fernandez, S., & Gray, M. (2012). Assessment Matters: Considering the Scholarship of Teaching and Learning in Student Affairs. About Campus, 16, 25-28. https://doi.org/10.1002/abc.20084
Sandeen, A. (2004). Educating the Whole Student: The Growing Academic Importance of Student Affairs. Change: The Magazine of Higher Learning, 36, 28-33. https://doi.org/10.1080/00091380409605577
Sandeen, A., & Barr, M. J. (2014). Critical Issues for Student Affairs: Challenges and Opportunities. New York, NY: John Wiley & Sons.
Schwartz, C. E., & Sprangers, M. G. (2010). Guidelines for Improving the Stringency of Response Shift Research Using the then Test. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 19, 455-464. https://doi.org/10.1007/s11136-010-9585-9
Shugart, S. C., & Romano, J. C. (2008). Focus on the Front Door of the College. New Directions for Community Colleges, 2008, 29-39. https://doi.org/10.1002/cc.343
Singer, J. (2016). The Effect of a First Year Experience Program on Student Retention in Community College (p. 25). Counselor Education Capstone. http://digitalcommons.brockport.edu/edc_capstone/25
Skipper, T. L., & Keup, J. R. (2017). The Perceived Impact of Peer Leadership Experiences on College Academic Performance. Journal of Student Affairs Research and Practice, 54, 95-108. https://doi.org/10.1080/19496591.2016.1204309
Soares, L. (2013). Post-Traditional Learners and the Transformation of Postsecondary Education: A Manifesto for College Leaders (p. 118). Washington DC: American Council on Education.
Soria, K., Lingren Clark, B., & Coffin Koch, L. (2013). Investigating the Academic and Social Benefits of Extended New Student Orientations for First-Year Students. The Journal of College Orientation and Transition, 20, 33-45.
Tovar, E. (2015). The Role of Faculty, Counselors, and Support Programs on Latino/a Community College Students’ Success and Intent to Persist. Community College Review, 43, 46-71. https://doi.org/10.1177/0091552114553788
Turner, P., & Thompson, E. (2014). College Retention Initiatives Meeting the Needs of Millennial Freshman Students. College Student Journal, 48, 94-104.
Umble, K., Upshaw, V., Orton, S., & Matthews, K. (2000). Using the Post-Then Method to Assess Learner Change. Presentation at the AAHE Assessment Conference, Charlotte, 15 June 2000.
Winston, R. B., Creamer, D. G., & Miller, T. K. (2013). The Professional Student Affairs Administrator: Educator, Leader, and Manager. New York, NY: Routledge.
Zuniga, X., Williams, E. A., & Berger, J. B. (2005). Action-Oriented Democratic Outcomes: The Impact of Student Involvement with Campus Diversity. Journal of College Student Development, 46, 660-678. https://doi.org/10.1353/csd.2005.0069