Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                

20 Years of Multidisciplinary Capstone Projects: Design Implementation, and Assessment

Download as pdf or txt
Download as pdf or txt
You are on page 1of 18

Paper ID #14091

20 Years of Multidisciplinary Capstone Projects: Design Implementation,


and Assessment
Jessica Macklin, University of Maryland, College Park
Jessica Macklin is the Program Coordinator for the QUEST Honors Program. Jessica received her BA in
Psychology from the University of Maryland, College Park and her MA in Higher and Postsecondary Education from Teachers College, Columbia University. Prior to joining QUEST, Jessica was the Graduate
Assistant in Columbia Universitys Office of Student Engagement.
Mrs. Kylie Goodell King, QUEST Honors Program, University of Maryland, College Park
Kylie King is Program Director of the Quality Enhancement Systems and Teams (QUEST) Honors Program. She has worked with the program since 2010 and currently teaches courses on defining and completing innovation and consulting projects. She is also involved in QUESTs learning outcomes assessment
process. Kylie has a B.S. in Industrial and Systems Engineering from North Carolina State University and
a M.S. in Educational Leadership and Policy Studies from the University of Maryland, College Park. She
is currently a Ph.D. candidate in Evaluation, Measurement, and Statistics at Maryland.

c
American
Society for Engineering Education, 2015

Twenty Years of Multidisciplinary Capstone Projects:


Design, Implementation, and Assessment
Introduction
The Quality Enhancement Systems and Teams (QUEST) Honors Program at the University of
Maryland unites undergraduate students with business, engineering, and science backgrounds in
order to promote a multidisciplinary, hands-on, learning experience. QUESTs curriculum
focuses on quality management, process improvement, and system design. This curriculum is
delivered in the form of three required courses and two elective courses. The first program
course introduces the concepts of innovation, design, and quality. Multidisciplinary teams work
on a series of three projects, challenging them to design products and processes to improve the
University of Maryland and the lives of their fellow students. The next required course involves
a semester-long systems project where students work in teams to identify and solve problems
about which they are passionately invested. Goals of past projects include improving access to
healthy foods, providing more opportunities to individuals experiencing homelessness, and
improving safety for pilots of light and midsize aircraft. In the final of the three required courses,
a consulting project course, QUEST students collaborate on multidisciplinary teams to solve
organizational challenges for corporate clients over the span of a semester.
Over the past 20 years, QUEST has linked these multidisciplinary student teams with corporate
sponsors in order to provide an opportunity for students to translate the quality tools learned in
the classroom to real-world solutions. Teams are guided throughout the semester by course
instructors from the colleges of business and engineering, faculty advisors from business,
engineering, and science departments, and representatives from sponsoring organizations
(referred to as project champions). While the core of the program remains focused on quality
management, process improvement, and system design through multidisciplinary teamwork, the
program has undergone a number of changes that influence student learning and projects.
QUEST was created in conjunction with a 5-year grant from IBM to bring total quality principles
to college campuses. Business and engineering students were recruited and approximately 25
students were admitted to the program after submitting an application and participating in an
interview. After the grant expired, the University of Maryland committed to support a majority
of program finances. Additional funding is contributed by the organizations sponsoring projects.
In addition to changes in program sponsorship, QUEST has expanded to include students from
mathematics, computer science, and physical and natural sciences in addition to those studying
business and engineering (aerospace, biomedical, civil, fire protection, materials, and mechanical
disciplines). This has enabled more diversity in project topics and the incorporation of more
diverse perspectives to the multidisciplinary project teams.
With the expansion of the program to include more academic disciplines, the pool of qualified
candidates also grew. From a maximum cohort size of 75 students in the early 2000s, QUEST
was recently restructured to admit two cohorts of 45 students per year. In addition to providing
more students with the opportunity to take part in this unique learning experience, more faculty
with the opportunity to engage with these talented and inquisitive students, and more companies

the chance to sponsor project teams, the program is able to more rapidly innovate and improve
by doubling the number of times each course is offered.
Multidisciplinary programs and projects are gaining popularity at universities across the country
as they have been found to promote professional and personal development1, 2. With twenty years
of history, QUEST is able to draw on lessons learned from its own history of failure and success
and contribute to a growing body of literature about this important topic. The goal of this paper is
to describe the consulting project course, project trends, and its results as reported by students
and alumni.
Evolution of Projects
In the spring of 1996, the first cohort of QUEST students worked with seven corporate clients on
multidisciplinary projects. Ranging in topic from creating new product concepts for athletic
apparel, to creating a cost-estimating tool for a manufacturing firm, to analyzing the feasibility of
telecommuting, these projects provided excellent learning opportunities for students and real
results for clients.
Ten years later, in the fall of 2006, cohort 12 of QUEST was busy undertaking projects related to
inventory management, product design, and mergers and acquisitions. According to one of these
students, We helped an oil and gas company think about how to enable their convenience stores
to better cater to 18-24 year olds. We had an immensely supportive project champion, who was
very generous with his time to help us better understand the organization, and even invited us to
participate in meetings at the companys headquarters where decisions regarding the
convenience stores were made. With the right context and the right support from our project
champion, we had a much better basisto arrive at meaningful conclusions 2.
To date, over 1,000 alumni have participated in the consulting project course. The availability of
information related to these and other past projects provides QUEST with a unique opportunity
to learn from previous semesters and evaluate trends in projects by industry and by topic area.
Some of the lessons learned in terms of successful and unsuccessful topics, importance of client
support, and trends in project topics are discussed below.
In evaluating past projects related to student learning and client outcomes, QUEST has been able
to discern certain topics that work well and others that are not as successful. Projects that
incorporate small wins throughout the semester typically have better outcomes as students are
more engaged in the project from the start and build momentum as they progress toward the final
project deliverables. An example of a project that works well in this regard is using data to
identify relevant metrics and using these metrics to create a tool. A Fall 2014 project involved
analyzing the elements of customer payment tendencies that ultimately impact cash-on-hand.
This required distinct phases that helped keep the team engaged in the project.
Conversely, projects that require teams to conduct research among industry peers or competitors
are typically not successful. QUEST students do not have the requisite research background or
professional networks to enable them to uncover meaningful insight to influence their client.
While these projects have been appealing to clients and interesting to students on the surface,
they have not resulted in significant student learning or client results.

In recent years, most QUEST clients have returned to sponsor a series of projects. While this
provides support to our claims of the excellent work our students produce, it also leads to betterdeveloped projects that are an excellent fit for the skills and backgrounds of the students in our
program. As clients learn more about our students, the cadence of projects, and our expectations
for the semester, it is a better experience for everyone involved in the course.
Looking through twenty years of past project data, it is apparent that project topics have shifted
in conjunction with national trends. For example, in the mid-1990s many projects involved
making use of the internet and web-based research and communication to enhance quality and
improve operations. Starting in the early 2000s and running through the current semester,
QUEST has witnessed a number of projects that focused on environmental concerns or reducing
environmental impact. In recent years there has also been a surge in demand for projects related
to enhancing cyber security, mining data, and utilizing machine reading.
Defining Multidisciplinary Project Scopes
After 17 years of successful projects, QUEST began offering an elective course to involve
students in the process of defining project scopes. In this course, students learn about best
practices for written and verbal communication and practice having conversations about QUEST
and sponsorship opportunities with program faculty and staff, each other, and alumni volunteers.
Following this training, students are assigned to companies and manage the process of outreach
and defining project scopes. They base ideas for project topics on past QUEST projects and case
studies provided through journals and online articles.
Course deliverables include sample emails, scheduling and participating in site visits to clients,
and writing and presenting precise and well-defined project scopes. To date, approximately 40
students have taken part in this course on defining consulting projects. Not only have students
greatly enhanced their professional network and communication skills, but they have also
increased the quality of projects that are handed off to student teams on day one of the practicum
course. This, in turn, has led to greater learning among teams and enhanced results for project
sponsors. A template of the project scope document is included in the appendix of this paper.
Course Design and Deliverables
The consulting project course is designed to incorporate a number of perspectives. In addition to
the course faculty and teaching assistant, students learn from their clients, alumni, guest
lecturers, and each other. Each month, teams are responsible for delivering a professional
presentation where they receive feedback from alumni, corporate partners, instructors, faculty
advisors, and other teams. Teams build upon past work in each phase of project completion.
Between presentations, students interact with panels of alumni and clients to obtain guidance and
feedback. The course also incorporates guest lectures following the flipped-classroom model
where students watch videos and read materials then interact with this material and each other
during class time3. This results in a truly multidisciplinary experience where students learn from
a number of sources and backgrounds and also teach each other through work in teams. A course
schedule, detailing this process, is included in the appendix of this paper.
The final course deliverables, a presentation and paper, are the focus of the course. All other
deliverables help teams prepare for this final phase of the project. A series of presentations and

papers are due throughout the semester, which contribute to a teams final product. Additionally,
teams are required to create a project poster to concisely convey their project results in an easyto-read and visually appealing manner. These course deliverables, along with other course
assignments and evaluations, are detailed in the appendix. As is indicated by this list, there are a
number of team deliverables, which is appropriate given the team-based nature of the course.
There are, however, a few individual assignments to ensure that all team members are fully
engaged in the course and its content.
There are seven learning outcomes that are covered by this course. These learning outcomes
relate to students ability to apply quality management tools, improve processes, design systems,
analyze data, work in multidisciplinary teams, provide solutions to clients, understand team roles
and mitigate conflict, communicate effectively, manage projects, and use business etiquette
skills. A complete list is provided in the appendix of this paper. It should be emphasized that
these learning outcomes are strongly related to a number of ABET student learning outcomes,
particularly outcome 3d, an ability to function on multidisciplinary teams 4 .
An example of a past process improvement project involved creating a tool that enabled a large
defense contractor to decide whether or not to bid on future work. An example of a past design
project involved coming up with a method whereby massive ocean buoys could be safely and
effectively deployed.
Project Results
Based on self-reported information, client and faculty advisor evaluations, and a number of
direct assessments, it is clear that students learn a great deal from participating in this course.
According to data collected from 49 students upon completing this course in Fall 2013, over 80%
of students evaluate themselves as Proficient or Advanced on every course learning
outcome, with nearly 100% of students evaluating themselves as Proficient or Advanced on
most outcomes. These results are detailed in Figure 1 below.
The results of this survey were used to improve the curriculum in areas where students did not
feel that they were proficient or advanced. For example, a greater emphasis has been placed on
quantitative analysis in future iterations of this class. The survey questions that were asked of
students to provide this data are included in Appendix 5. The program has recently made an
effort to improve accountability by identifying and measuring student learning outcomes.
Therefore, while similar data do not exist for past years, this information will continue to be
collected and analyzed moving forward.

Figure 1: Student self-evaluations


Results from a previous study about QUEST outcomes indicate that alumni value the
experiences gained from this course 5. Alumni were surveyed about how QUEST has made an
impact on their professional skills in full-time positions. Results showed that QUEST alumni
perceive a high level of skill gained from this course and attribute these skills to professional
success. Teamwork, professionalism, communication, and project management self-ratings
indicate that QUEST alumni believe themselves to possess higher-than-average skills within
these domains than their peers who did not participate in this multidisciplinary program. A table
of results from this survey and survey questions are included in Appendix 6.
Recent feedback from clients immediately following projects indicates that all teams meet
expectations for a team of senior honors students, 90% of teams exceed expectations, and over
half of all teams provide work that is on par with what could be expected from a team of
professional consultants. One client stated The QUEST project is a rewarding experience for
both the sponsor and the students. As a sponsor there is an opportunity to have an objective party
review internal issues from a fresh, creative angle. For the students, it is an opportunity to work
in a professional environment. Internships are valuable but typically very specific to a student's
desired field. The QUEST project takes students out of their academic niches, introducing them
to working on multidisciplinary teams with exposure to industries that might not be a logical fit
for their major fields of study 6. This exemplifies the multidisciplinary nature of QUEST
projects and the value that they bring to all parties involved.
A logical question to follow such positive reviews would be related to the impact of projects
months or years after their completion. This information is collected by the program and
indicates similarly positive results. Over half of all projects completed in 2012 and 2013 have
resulted in a lasting impact for the sponsoring organization. Six months after the completion of a
recent project related to supply chain quality enhancement, a client indicated that staffing
changes were made based on recommendations from the team and the tool developed by the
team was in use across multiple departments. Another past client informed the program that,
thanks to the work of the students, the firm was able to win a $250,000 contract to further
develop the teams recommendations.

Additionally, both students and clients benefit from this project experience in placing QUEST
students in full-time positions after graduation. Of the 73% of students in the QUEST graduating
class of 2014 who went on to work full-time after graduation, 59% accepted positions with
sponsoring organizations. This shows how, beyond enhancing performance in QUEST learning
outcomes, this course provides students with career-building opportunities and provides clients
with a talented pool of prospective full-time hires.
Suggestions and Practical Implications
Many elements of this course are not unique to the QUEST program and may be replicated in
other courses and at other universities. By identifying and assessing learning outcomes, we are
able to better understand what our students are learning and make improvements to the course.
This has been critical in enabling comparisons to be made across projects and across years.
Additionally, by involving a number of stakeholders in the instruction of the course, students are
able to learn from a variety of perspectives, backgrounds, and experiences.
In order to ensure that students are exposed to diversity of perspective beyond course instructors,
multidisciplinary teams of students complete all projects. This is perhaps the most important
suggestion that we may provide; it gives students the opportunity for a learning experience that is
not typical of most undergraduate courses. Students are able to teach each other, and in doing so,
gain a deeper understanding of their own discipline. Additionally, students are able to learn from
each other. This provides a unique opportunity for students to engage with those coming from
different academic backgrounds and approaches and provides critical exposure to the type of
work that is encountered in professional settings after graduation. According to a former
students recollections of his Fall 2006 project, This was a great exercise in people from varied
backgrounds coming together as a team. Once we had coalesced as a team, we were more
creative and stronger than ever 3.
While QUEST is unique in that it is structured precisely to enable such multidisciplinary
collaboration, other programs or departments may consider collaborating with other disciplines
on capstone, senior design, or other semester-long projects. While collaboration across
engineering departments is good, it may yield even more benefit if business, science,
psychology, architecture, or liberal arts majors are engaged in team projects. This integration of
engineering with other disciplines would further enhance the experience of students and better
prepare them for teamwork after graduation by enhancing learning and facilitating self-efficacy
and innovation.

References
1.
2.

3.

Holley, K.A., 2009, "Best Practices Related to Interdisciplinary Education," ASHE Higher Education
Report, 35(2), 89-99.
Hotaling, N., Hermann, C. D., Fasse, B. B., Bost, L. F., and Foresta, C. R., 2012, A Quantitative Analysis
of the Effects of a Multidisciplinary Engineering Capstone Design Course, Journal of Engineering
Education, 101(4), 630-656.
Zohar, Ori. Letter to the author. 25 Jan 2015. TS.

4.
5.
6.
7.

Sams, Aaron, and Jonathan Bergmann. "Flip your classroom: Reach every student in every class every
day." International Society for Technology in Education (ISTE) (2012).
ABET, Criteria for Accrediting Engineering Programs, Baltimore, Md.: Engineering Accreditation
Commission, 11 Nov 2003. See http://www.abet.org/criteria_eac.html.
Ashton, M., Bailey, J., Goodell, K., & Weiland, K. (Peer Reviewed Paper). The Value of a
Multidisciplinary Engineering Education after Graduation. Industrial and Systems Engineering Research
Conference. Orlando, FL. 21 May 2012.
Penna, Elizabeth. Letter to the author. 19 Dec 2014. TS.

Appendix 1: Project scope document

Project Name:
Sponsor Organization and Department:
Project Champion(s):
Executive Sponsor:
Scoping Contact:
Project Team:

Client Overview
Client Summary: Background information (employees, revenue, offices, divisions, etc.)
Relationship History: How did we connect? Have they worked with (program name) in the
past?

Project Summary
Project Overview: One or two lines Scope
Business Issue / Opportunity: More in depth discussion

Primary Project Objectives

Objective 1

Objective 2, etc.

Project Benefits
Benefits to Client: List of benefits

Benefits to (program name) Team List of benefits

Primary Project Deliverables

Gantt chart, process flow diagram, or other visual representation of proposed course of
action
Discussion of the nature and frequency of communication with the client
Critical issues related to project

Project Conditions
Contributions from Client:

A gift of $6,000 to the (program name)

A project champion to provide the team with data, other contacts at the organization, and other
items which may be necessary for project success (time commitment is approximately 1-2 hours per
week)

Participation in (program name) 490H Consulting Practicum course (participation on panels,


judging presentations, etc.)
Received by Client:

Thirteen weeks of interaction with a team of (program name) students

400-600 hours of consulting services from the student team

Innovative recommendations to an identified organizational challenge

Support from (university) faculty and staff included a dedicated process expert for the duration
of the project.

Key Project Dates


Project Start: 01/28/2015
Action Plan: 02/18/2015
Status Update: 03/25/2015
Preliminary Results: 04/22/2015
Final Presentations: 05/07/2015

Requests and Notes:

Major Requirements: List requested majors


Other Requests: List any other requests

APPROVALS
Prepared By ______________________________________
QUEST Scoping Contact
Approved By ______________________________________
Project Champion
______________________________________
Executive Sponsor

Appendix 2: Course schedule

Course Schedule
Class

Date

1/27

2/3

3
4

Friday
2/13
2/17

2/24

3/3

Class Discussions,
Workshops, Panels, and
Presentations
Session 1: Introduction
Discussion: Project Bids,
Syllabus and Course Schedule
Review, Project Scopes,
Alumni Panel

Location

Guests

Attire

Deliverables

VMH 1415

QUEST
Alumni

Casual

Project Bid and


Resume Due
January 27 at
midnight

Session 2: Meeting Client


Expectations
Panel: Client Expectations
Exercise: Identify
expectations, hopes, and
concerns for projects.
Meetings: Teams and clients.

VMH 1415
and meeting
rooms

Project
Champions

Business
Casual

Prepare for Client


Meetings
(availability,
review Statement
of Value, prepare
questions)

Session 3: Consulting Retreat

Reagan
Building
VMH 1415

QUEST
Alumni
QUEST
Alumni

Business
Casual
Business
Profession
al

Team Charter
Meeting Minutes 1
Statement of Work
and Action Plan
(Report and
Presentation)
Meeting Minutes 2
Meeting Minutes 3
Peer Evaluation 1

Session 4: SOW & Action


Plan Presentations
4:30pm Class photo
5:00pm Present: Statement of
Work and Action Plan
Session 5: Project
Management and Risk
Management

VMH 1415

Casual

Session 6: Quality Tools

VMH 1415

Casual

Meeting Minutes 4

3/10

Session 7: Data Analysis

VMH 1415

Casual

Meeting Minutes 5

3/24

Session 8: Status Update


Presentations
Present: Status Update

VMH 1415

Business
Profession
al

3/31

Session 9: Working in
Multidisciplinary Teams

VMH 1415

Dr. Linda
Schmidt

Casual

Status Update
Presentation and
Report
Meeting Minutes 6
Peer Evaluation 2
Meeting Minutes 7

10

4/7

Session 10: Ethical Action

VMH 1415

11

4/14

Session 11: Preliminary


Results Presentations
Present: Preliminary Results

VMH 1415

Corporate
sponsor
QUEST
Alumni

Business
Casual
Business
Profession
al

12

4/21

Session 12: Team Time

No class
session

David
Ashley
QUEST
Alumni

Meeting Minutes 8
Meeting Minutes 9

Meeting Minutes 10

13

4/28

Session 13: Planning for


Your Future

VMH 1415

Dr. Joe
Bailey

Casual

14

5/5

Session 14: Dress Rehearsal


Present: Dress Rehearsal of
Final Presentation
Vote on Project of the Year
Session 15:(program name)
Conference
4:00 to 8:00 p.m.

VMH 1415

QUEST
Alumni,
Faculty
Advisors
Family &
friends;(pr
ogram
name)
students,
corporate
partners,
alumni;
University
Friends of
QUEST

Business
Profession
al

Final Examination

VMH 1415

5/6

TBD

Riggs
Alumni
Center

Final Project Poster.


Portfolio Team
Description,
Abstract, and
Recommendations
Draft Final
Presentation

Business
Professio
nal

Final Presentation

Casual

Final Report

Appendix 3: Course deliverables

Individual Assignments (30% of Final Grade)


Project Management
Quality Tools
Data Analysis
Multidisciplinary Teams
Ethics
Final Exam
Peer Evaluations (2)
Advisor Evaluations (2)

2%
2%
2%
2%
2%
10%
2% and 3%
2% and 3%

Team Assignments (70% of Final Grade)


TEAM REPORTS (30%)
Statement of Work
Status Update
Preliminary Results
Final Report

5%
5%
5%
15%

TEAM PRESENTATIONS (20%)


Statement of Work
5%
Status Update
5%
Preliminary Results
5%
Final Presentation
5%
OTHER TEAM ASSESSMENTS (20%)
Team Charter
5%
Final Poster and Portfolio Page 5%
Meeting Minutes
5%
Client Evaluations (2)
2% and 3%

Appendix 4: Course learning outcomes

Learning Outcomes
Upon completion of this course, students will be able to:
Apply quality management tools, improve processes, and design systems;
Use quantitative and qualitative data analysis techniques;
Work in multidisciplinary teams to evaluate, analyze and recommend solutions to realworld problems provided by corporate sponsors;
Work in multi-disciplinary teams with an understanding of different roles and how to
negotiate conflict in these situations;
Communicate ideas effectively in business environments through written, visual and oral
methods;
Manage projects and people using effective project management tools;
Use business etiquette skills to network and communicate in diverse professional settings
and behave in a professional and ethical manner.

Appendix 5: Student Survey


(Program Name) has defined a set of learning outcomes that we would like our students to obtain
during their time in the program. For each learning outcome below, please evaluate your knowledge
of, or competence in, the given outcome, using a scale from 1 to 4 (as defined below). 4: Advanced
(Strong knowledge of, or competence in, this outcome) 3: Proficient (Some knowledge of, or
competence in, this outcome) 2: Developing (Minimal knowledge, of or competence in, this outcome)
1: Unacceptable (No knowledge of, or competence in, this outcome

Appendix 6: Alumni Survey Questions and Results

You might also like