Challenges of Adopting Agile Methods in A Public Organization
Challenges of Adopting Agile Methods in A Public Organization
Challenges of Adopting Agile Methods in A Public Organization
Management
2016
Kirsi Aaltonen
University of Oulu
Jaakko Kujala
University of Oulu
Recommended Citation
Nuottila, Jouko; Aaltonen, Kirsi; and Kujala, Jaakko (2016) "Challenges of adopting agile methods in a
public organization," International Journal of Information Systems and Project Management: Vol. 4 : No. 3
, Article 5.
Available at: https://aisel.aisnet.org/ijispm/vol4/iss3/5
This material is brought to you by AIS Electronic Library (AISeL). It has been accepted for inclusion in International
Journal of Information Systems and Project Management by an authorized administrator of AIS Electronic Library
(AISeL). For more information, please contact elibrary@aisnet.org.
ISSN (print):2182-7796, ISSN (online):2182 -7788, ISSN (cd-ro m):2182-780X
Available online at www.sciencesphere.org/ijispm
Jouko Nuottila
University of Oulu
Linnanmaa, PL 8000, 90014 Oulun yliopisto, Finland
www.shortbio.net/jouko.nuottila@oulu.fi
Kirsi Aaltonen
University of Oulu
Linnanmaa, PL 8000, 90014 Oulun yliopisto, Finland
www.shortbio.net/kirsi.aaltonen@oulu.fi
Jaakko Kujala
University of Oulu
Linnanmaa, PL 8000, 90014 Oulun yliopisto, Finland
www.shortbio.net/jaakko.kujala@oulu.fi
Abstract:
Agile development methods are widely used among business enterprises. Since the introduction of the Agile Manifesto
in 2001, several agile methods have been implemented, first in single-team set-ups and later in larger multi-team set-ups
for complex Information Technology (IT) system development. However, the adoption of agile methods has been slow
in the public sector. This is also reflected in the academic literature, as there are only a few studies discussing agile
adoption in public organizations. This paper contributes to research on the use of agile practices specifically in the
context of public organizations, and sheds light on the challenges a public organization may face while adopting these
practices. The aim of this paper is to identify and categorize the challenges that may hinder efficient adoption and use of
agile methods in public IT projects that include private software vendors. This research is based on a case study of a
large governmental office. As a result, this paper presents several categories of identified challenges, the root causes of
these challenges, and a discussion of the characteristics of these challenges for the public sector.
Keywords:
agile methods; adoption of agile methods; agile challenges; agile barriers; agile project management; software project
management.
DOI: 10.12821/ijispm040304
Copyr ight © 2016, SciKA. General per missio n t o republish in pr int or elect ronic forms, but not for profit , all or part of t his mat er ial is gran t ed, provided t hat t he
Int ernat ional Jour nal o f I nfor mat io n S yst ems and Pro ject Manage ment copyr ight notice is given and t hat reference made t o t he publicat ion, t o it s dat e of issue, and t o
t he fact t hat reprint ing pr ivileges were grant ed by per miss io n o f Sc iKA - Associat ion for Pro mot ion and D isseminat io n o f Scient ific Knowledge.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 65 ►
Challenges of adopting agile methods in a public organization
1. Introduction
Software development processes have evolved radically from traditional control-oriented and sequential waterfall
models to today’s agile development methods, the underlying principles and values of which are declared in the “Agile
Manifesto” [1], [2]. Agile development methods combined with corresponding project management methods are
intended to increase efficiency and flexibility in software projects and minimize unnecessary specification,
administration, documentation and unproductive work [3]. Indeed, in recent studies agile methods have been proved to
contribute to project success by increasing customer satisfaction and enabling flexible change management in software
development, particularly within private sector projects [4]. Currently, the use of agile software procurement is gaining
prominence within public sector software procurement projects. Applying agile methods in a multi-organizational
public sector context requires radical changes in the way projects are negotiated, contracted, procured and organized in
order to maximize created value over the project lifecycle. To date, though, only scant attention has been devoted to
empirically identifying and describing the managerial challenges that may relate to the procurement and execution of
agile software projects within the public sector context.
Agile methods were first implemented in small teams, projects and companies, but during the last few years the usage
of agile methods has also been scaled up for use in large system development and distributed software development.
However, public agencies and governmental organizations have been slow in adopting agile practices, with the
exception of some specific high-tech research organizations. This situation is also reflected in academic research. Only
a handful of studies exist on agile methods adoption in public organizations. Abrahamsson et al. [5] identified several
research gaps in their editorial. They call for further research by stating that “with agile methods being routinized and
infused in the adopting organisations, one of the most pressing issues is the need to develop a better understanding of
the implementation of agile at the organisational level” [5]. Mangalaraj et al. [6] suggest in the same special issue that
there are myriad issues and challenges that an organization needs to overcome to sustain agile methods. They call for
research to elucidate “issues in managing the change to new and conceptually different software development
approaches”. Similarly, Conboy et al. [7] discuss organizational challenges in adopting agile practices and then call for
further research on “the effectiveness of agile method adoption” and new research on agile project management.
Furthermore, Conforto et al. [8] call for more research on agile project management and use of agile practices in
software and other industries. Project Management Journal [9] also calls for more research on agile implementations
and project management in different contexts. As these numerous calls for more breadth and depth of research into agile
methods show, there are many topics in this area that would benefit from further study.
We found these calls for research encouraging and well-aligned with our interest in studying different forms of
flexibility in projects and co-creational value in projects utilizing agile practices. Our specific interest for this paper was
to study a public organization conducting software procurement with a project setup that is utilizing agile practices.
Specifically, this paper was designed to investigate the kinds of challenges a public organization faces when adopting
agile practices in subcontracting a software project. In addition, we wanted to gain a thorough understanding of the root
causes of these challenges. To gain this understanding, we used a case study as our chosen methodology, with our
chosen case being a public agency that was subcontracting complex IT system development from private software
vendors. This agency’s development project utilized agile methods and provided a great insight into the adoption and
implementation of agile practices.
In this paper, we first review the earlier literature on the challenges in adopting agile methods. We then present the
methodology and the case study setting, followed by the empirical findings. Finally, we discuss the findings and
conclude with a summary of the obtained results and suggestions for the development of future research.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 66 ►
Challenges of adopting agile methods in a public organization
The utilization of agile practices has been rapidly increasing during the last fifteen years, and there has been a distinct
change in the type of organizations using them. This change is also reflected in research on the adoption of agile
methods. The first years of research focused on early adopters, single team studies and implementation in small
organizations; the research focus later shifted to studying multi-team implementations and adoption in larger
organizations. In our view, the current wave of studies has increasingly been focusing on the adoption of agile practices
in procured and internal multi-site set-ups, off-shore implementations, and increasingly, as this paper does, on agile
methods adoption in public organizations. In this section, we will briefly review the earlier studies. We will first
consider the challenges that have been identified in research in small organizations and studies on early adopters, then
discuss challenges in large system development and distributed software development. Finally, we will look at the few
existing studies related to challenges identified in the public sector.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 67 ►
Challenges of adopting agile methods in a public organization
naturally better suited to flexible and agile practices [12]. Secondly, small companies usually do not have any legacies
to follow; they have not established formal and rigorous processes yet [10], [12]. The recommendation of limiting the
size of an agile organization is often linked with the importance of direct communication. Efficient communication is
important when a software development project utilizes agile practices, especially because of the goal of having less
documentation compared to traditional methods. There is no requirement specification done for the whole project in the
beginning; typically, requirements are agreed on for the next sprint and goals, and requirements are sketched for 2-3
following sprints [15]. Developers need to get the requirements for each sprint in time and they need to understand them
correctly, otherwise they might have incorrect assumptions and thus not work on what actually needs to be done [11],
[12]. In order to succeed with this type of continuous discussion between the product owner and the agile team, they
need to have the discipline to follow agile practices. Customers and software vendors should discuss the software
development project in question and agree that agile methods are suitable for the project [12]. This does not mean that
agile methods are proved not to be suitable for specific type of projects, but rather, that for the successful
implementation of agile methods both parties must share the same understanding of how to utilize agile methods [11].
This also increases clarity regarding the project goals and the management structure of agile governance and decision-
making. Devolved decision-making in agile team meetings can cause problems if individuals do not feel comfortable in
sharing their opinions, or if the decision-making is not fair and democratic.
Knowledge transfer has been also identified as a possible challenge in an agile set-up. Agile practices promote
minimizing required project documentation, and this might make it difficult to conduct a proper knowledge transfer in a
situation when one or several individuals leave the team [12]. This was one of the main concerns of project managers.
On the other hand, agile practices suggest ensuring that projects have high-quality and well-commented source code to
make it easier for new programmers to take over. Another identified issue related to personnel management was that
companies have not developed agile-specific recruitment policies or agile-compliant performance evaluation methods to
support individual- and team-level abilities [14]. This makes it difficult to evaluate and educate individuals and agile
teams.
As the issues listed above demonstrate, researchers have found that people-related factors and social factors are more
important than the technical factors in the successful adoption of agile practices [12], [15]. There is one exception,
though: communication tools are essential for agile practices if there are several individuals or teams working on a
project who are not located at the same office. Agile practices are based on efficient communication, and in case of
physical distance between the teams there must be efficient virtual communication tools available, and the individuals
and teams should feel comfortable using them. The situation is naturally even more challenging if the teams are based
in different time zones [12].
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 68 ►
Challenges of adopting agile methods in a public organization
implemented during the next sprint(s). The customer must also continuously work together with an agile team to accept
the implemented features and participate in the planning work with the team [16], [17]. In larger organizations there are
usually many teams working on a single project, and thus each team must be able to communicate and coordinate with
other teams. This might be challenging in an agile setup, especially if other teams are not using agile practices [16].
Teams are also often located separately in several offices and this can create communication and coordination problems
as agile practices assume efficient real-time communication [5], [11], [16].
There are several challenging issues related to development processes which are typically well-defined and mandatory
in large organizations and might conflict with agile practices. Agile practices encourage self-driven, self-disciplined
teams to plan testing, test-cases, and quality control, but in larger organizations test case verification and quality
reviews are often centralized and centrally-controlled [5], [11], [15], [16], [17]. Agile practices also usually suggest that
a developer, or a pair of developers, can integrate new software frequently into the Software architecture baseline as
they wish, but especially in larger systems this is controlled and monitored because there is centralized architectural
control over system development [16], [17]. Agile practices assume iterative development, small releases and
continuous integration. Thus, agile practices can be seen to favor new system development from scratch. Bowers et al.
[17] identified some complications when agile practices were used to update and maintain a legacy system. While the
agile development focused on developing and delivering small releases, there were lots of legacy interfaces and internal
dependencies in the legacy system which caused many unexpected errors in the system testing [15], [17].
Agile practices very often contradict traditional quality systems in large organizations. This can be a challenge,
especially if teams using both traditional and agile approaches are working on the same software system [15]. For
example, formal reviews of project documentation, source code and test cases are usually part of the traditional software
quality system but they are not part of the agile approach. Differences in the process can also lead to a situation of
double work done, once in an agile team and then again as required in a traditional process [16], [17]. There are also
other process-related implications. Agile practices promote self-disciplined decision making, feature development and
integration on a team level. This should also apply to managing changes. However, in large organizations there often
are change control boards for system or architectural changes [16], [17]. This might reduce the flexibility provided by
agile methods and decrease the customer’s perceived value of the implementation of an agile approach.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 69 ►
Challenges of adopting agile methods in a public organization
Finally, it is reported that the development processes are not optimal in the public sector and thus it is difficult to
estimate the received value of the projects and to get the maximum output from them [23]. There have been different
approaches in research to suggest improvements for these challenges. For example, Hardy and Williams [25] have
examined e-procurement software systems and Atkinson [28] analyzed how different contract models enhance software
procurement. In this paper, the focus is on the adoption of agile methods in a public organization.
3. Research approach
As the knowledge related to challenges with the adoption of agile methods in public organizations is still very limited,
an inductive, single-case-study approach was selected [29]. We considered the case study approach to be most suitable
for the purpose of this study, as we wanted to gain a rich and in-depth understanding of the challenges in adopting agile
practices in the public sector. The case study organization is a government transport safety agency which operates as an
appointed commission under the ministry of transportation and communications in the Finnish government. The
government agency, herein referred to simply as Agency (pseudonym), is responsible for the oversight and
administration of specific area of public and private services to citizens, companies, non-profit organizations and other
government offices. Agency issues permits, regulations and approvals in the transport sector. It handles transport sector
taxation and registration. Agency also oversees compliance with rules and regulations governing the transport system. It
has over 500 employees and manages an annual budget over 100 million euros. Agency is a large organization, but
Agency’s IT department has traditionally been relatively small. However, there is currently a need to deploy more
resources for software projects to add to the number of online services Agency offers. To access capable resources,
Agency’s management has decided to increase software subcontracting, and they have also made a decision to start to
use agile methods in the subcontracted projects. Agency is one of the first government offices widely utilizing agile
methods, and is therefore a very interesting and suitable subject for research on agile project management in the public
domain.
Semi-structured interviews were used to gain insights into informants’ experiences of the adoption of agile methods in
Agency, agile practices used in Agency’s projects, and project management practices in agile development. The key
people working on the selected project were interviewed, and several other people in Agency were also interviewed to
gather background information on the decisions to adopt agile practices in Agency. In addition, a few participants in the
first agile pilot project in Agency were interviewed to learn about the progress of the adoption of the agile approach in
Agency. During the interviews, informants were asked to provide their background information and an overview of
their experience with agile methods, and then to describe the project stages from procurement to delivery. After this, the
interview focused more on the advantages of and challenges with using agile methods in the project. The interviews
were done with two researchers, except for 4 instances when this was impossible due to conflicting schedules. The
duration of the interviews was 50-120 minutes, and they were conducted face-to-face at the interviewees’ offices
between April and July 2015. The interviews were recorded (audio) and transcribed for content analysis [30]. The
transcribed data was semantically complex, thus we decided to rely on human coders [30], [31]. Computer-assisted
qualitative data analysis software, NVivo, was used to support the coding of the research data and facilitate data
analysis. Open coding was used to identify the challenge areas, then the initial list of challenges was reviewed by
several researchers; finally the challenges were grouped into the categories and subcategories presented in this paper
[30]. This methodology enabled us to access rich data both from interviews and background material to analyze this
case. The interviews with the representatives of the SW subcontractor also provided additional insights into the project
and the adoption of agile methods. Information about the informants is presented in Table 1.
In addition to data from interviews, in this study we also used publicly available information, documentation and
presentations on Agency. We also acquired internal documentation, presentations and memos from Agency to gain a
deeper understanding of the adoption of agile methods inside the organization.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 70 ►
Challenges of adopting agile methods in a public organization
The project we investigated in this study is a software development project which produced a software solution for
organizing and managing driving license examinations nationwide. The solution is running on a server, accessing
several existing databases (e.g. exam content database and id database for candidates) and enabling remote connection
by users (examination offices by computer and driving test examination officers by tablets). The software solution
includes several interconnected components as it has interfaces to systems managed by other organizations and
interfaces to databases (other government offices and e.g. insurance companies). Multiple user groups access the service
with several types of devices. The solution is not a large software product, but it is a complex system in a dynamic
environment. Agency implements Scrum as its agile method. Scrum masters and software developers are provided by
the subcontractor; other project-related roles are internal ones. Agency uses a slightly modified Scrum: in addition to
Scrum’s default roles they have an administrative project manager and an ICT product owner for technical issues and
requirements.
4. Findings
The informants from Agency were generally satisfied with the results of agile adoption in the organization and they
thought that the transition to using agile methods instead of traditional software (SW) development methods was
successful. In addition, they had observed remarkable improvements in the efficiency of the software development
process compared to the traditional methods. Similarly, the informants from the SW subcontractor were satisfied with
the project and cooperation with Agency. The positive impact of the adoption of agile methods was also recognized by
Agency management. Based on information obtained from management presentations, development productivity was
increased, transparency of development activities was enhanced, and relative portion of administrative work was
decreased (even up to 25%). The increase of efficiency enables Agency to develop more digitized services with the
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 71 ►
Challenges of adopting agile methods in a public organization
limited budget they have. This is one of the main reasons why Agency management considered agile adoption to be
successful.
However, there were also significant challenges with the adoption of agile methods. Based on analysis of our data, we
identified seven categories of challenges:
Documentation;
Education, experience and commitment;
Stakeholder communication and involvement;
Roles in agile set-up;
Location of the agile teams;
Legislation;
Complexity of SW architecture and system integration.
Detailed descriptions of the challenges identified in the agile adoption are presented in Table 2. Illustrative quotes are
also included to demonstrate the root causes of the challenges and to highlight the perceptions of the informants.
Some of the feature requirements are not documented. The agile method promotes less documentation but there
should be documentation on what was done and why we made the choices we made. As organization evolves and
people leave, without documentation the knowledge is lost. – Business Product Owner 1, Agency
If the vendor gets changed then where is the information of the project as the documentation is light-weighted?
There lies a risk upon this... – ICT Project Manager, Agency
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 72 ►
Challenges of adopting agile methods in a public organization
We use internal people to test the product features. While starting to use agile we didn’t have as much
documentation as we used to have. It caused some problems, people who started testing were confused that where
are the use cases we earlier tested against. I told them we don’t have them, that in agile model we have user stories
instead. It was a conflicting situation. – Business Product Owner 1, Agency
It came quite suddenly to me, the change was led by the management… by the ICT team. They wanted that we start
to use agile. – Development Manager, Agency
Introduction of agile methods was started by initiating product owner trainings and
trainings on agile methods. After a successful pilot project, the roll-out to all
projects was started and overall agile adoption was started. Some people thought
Education, experience and
that the agile methods were introduced quickly and thus the education and training
commitment - Personnel
was inadequate in the beginning. This issue also relates to the ongoing service
education and commitment
digitization activities in Agency. The activities expose more people to software
development and agile methods - people who are originally coming from other
business disciplines. Therefore, many people need to learn new skills in addition to
their earlier area of responsibilities.
Illustrative quotes:
I participated in one product owner training but I was not very well trained when we started to use agile. I knew the
terminology. But there were many new tools involved, backlogs and other new issues, I wasn’t ready for it in the
beginning. – Business Product Owner 1, Agency
We had a training earlier but when we started with agile I had forgotten it already. Also in the beginning the scrum
master at the time couldn’t help us with agile methods so it was quite difficult. We couldn’t manage the method in
the beginning so we needed help from the agile team, what to do and when. Especially when we didn’t manage all
the tools yet. – Business Product Owner 2, Agency
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 73 ►
Challenges of adopting agile methods in a public organization
Good communication is the base for everything in agile. And trust. Also openness is a key thing… Sometimes we
can’t be sure if they really do their part in the project. We are not sure if the testing is done by the customer as it
should be done. – Scrum Master 1, SW Subcontractor
We needed to discuss through the customer with other teams. It was a rigid approach. It would’ve been easier to
discuss directly via virtual tools. Sometimes we traveled to the same location to discuss. – Software Developer, SW
Subcontractor
The responsibilities were not clear in the beginning. However, it helped when we made the RACI matrix. – Business
Product Owner 1, Agency (RACI=Responsible, Accountable, Consulted, Informed)
The communication is really important. Some people do it naturally better than the others, the communication is
important. – Development Manager, Agency
Agile methods require good communications, there are still some challenges between the teams. – Business Product
Owner 2, Agency
Agility requires change in attitudes individually, it requires responsibility and change individually. – ICT
Development Manager, Agency
Stakeholder Agency develops large IT systems which are also used by several stakeholders,
communication and usually large companies. These stakeholders use the services automatically via
involvement - Agile their own IT systems. When service interfaces are renewed or added, the
planning vs. stakeholder stakeholders also need to plan and implement changes to their software systems.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 74 ►
Challenges of adopting agile methods in a public organization
We have strong interfaces to our partners and thus we can’t implement all agile development methods because they
need to know interface specifications beforehand. – Development Manager, Agency
Stakeholder As agile planning is done iteratively sprint by sprint; it is possible that some
communication and preliminarily-agreed-upon design choices would need to be changed, and the order
involvement - Flexible of implementation would be changed or some features dropped. If any of these
changes allowed by agile changes require stakeholders to change their implementation, it is a challenge as
methods vs. stakeholder stakeholders will be informed late.
communication
Illustrative quotes:
We definitely would’ve liked to run some pilot testing for the system. There are many user groups for the system and
it would’ve been a necessity to have different user groups testing it. – Scrum Master 1, SW Subcontractor
There is a big change in the role of the product owner as defined in agile methods
compared to traditional methods of software development. It is essential for the
Roles in an agile set-up -
successful implementation of agile methods that the product owner is available to
Role of the product owner
the agile team and is able to provide the team with clearly-defined user
stories/requirements in a timely manner, contribute to the prioritization of user
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 75 ►
Challenges of adopting agile methods in a public organization
When I think retrospectively, I should have been more actively working on the backlog and following the status of
implementation. – Business Product Owner 1, Agency
Especially in the beginning, we didn’t follow the agile methods well enough. At some point we realized that we
didn’t participate in the scrum activities as we should have been and the team was working without guidance. –
Business Product Owner 2, Agency
It requires a lot from a product owner to participate in the project in a way that scrum agile mode demands. –
Scrum Master 1, SW Subcontractor
The product owner works together with the Scrum master and the agile team to
take care of the responsibilities of requirement specification and prioritization. The
Roles in an agile set-up -
product owner, however, collects the input from several business area owners,
Multiple interfaces of
technical experts, legal advisors etc., so there is dependence between the
product owners
contribution of the product owner to the agile team and the availability of internal
stakeholders and the information they provide.
Illustrative quotes:
Product owners are really strained and they do not have enough time to concentrate to work with the scrum team.
You only meet them in the official meetings, there is no informal discussion as much as they should be in agile
approach. – Scrum Master 2, SW Subcontractor
Sometimes product owner couldn’t exactly define the specification of what was needed so we implemented features
based on our understanding and after the sprint demonstrated the implementation to customer to see if any changes
were needed. – SW Developer, SW Subcontractor
Agency utilizes two product owners in agile projects: the business product owner is
Roles in an agile set-up -
responsible for business requirements, and the ICT product owner is responsible for
Business product owner vs.
system requirements and technical questions. This approach can create confusion in
ICT product owner
the agile team on product ownership and responsibilities.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 76 ►
Challenges of adopting agile methods in a public organization
It wasn’t always clear to the agile team who to contact when they had questions. I have been working for the project
as a stable resource but they also knew that ICT product owner takes care of technical issues. But maybe the roles
have not been clear enough in every situation. – Business Product Owner 2, Agency
Traditionally, a project manager owns the project budget, but in agile projects there
Roles in an agile set-up - is a product owner who manages the budget and uses it for the features prioritized
Project manager vs. business for each sprint. Agency utilizes the model of an administrative project manager and
product owner a business product owner in agile projects which does not exactly follow the agile
principles and might create conflicting situations between the roles.
Illustrative quotes:
In the first agile project I was involved with, there were some role issues… The project manager wanted to have the
ownership of the project and sometimes it was conflicting with the agile ideas. For example, sometimes the project
manager didn’t remember to invite the business product owner to all necessary meetings which was a problem. –
Business Product Owner 2, Agency
The Scrum master and the product owner are the key roles in agile methods and
Roles in an agile set-up - determine if the project is managed successfully. The product owner is responsible
Scrum master vs. Business for defining what is to be implemented, and the Scrum master is responsible for the
product owner implementation. In the beginning, Agency had some challenges with the
cooperation between these central roles.
Illustrative quotes:
At first, the scrum master didn’t manage or didn’t implement the agile methods in the most optimal way. We didn’t
have enough experience of the agile methods and the scrum master didn’t implement them and the situation
hindered the project progress. – Business Product Owner 2, Agency
Agency also has experience on a project in which an agile team and a Scrum
master were working remotely from a separate location. Although virtual
Location of the agile teams communication tools were available, it was difficult to organize the agile
development remotely, and the cooperation was not on the same level as the co-
located teams.
Illustrative quotes:
We ended up in a virtual project world. We could operate like that, there were no major problems, but it is not as
good as having all in the same location. – Scrum Master 1, SW Subcontractor
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 77 ►
Challenges of adopting agile methods in a public organization
Some of the big companies are professionals of making bidding documentation; they have lots of experience on it.
They have experts on writing bidding documents and they know how to answer all the questions by the customer.
Sometimes when you read those documents and you compare the data to your own experience on how those
companies work in practice you can see come conflicts between the documents and the real project work by them.
But it is impossible to use your experience or history knowledge on the evaluation; you can only use the documents.
But that’s how it goes, you only have to live with it. – ICT Development Manager, Agency
There are also some peculiar consequences for project implementation because of
Legislation - Information the public procurement act. In the worst case, it prevents information sharing to all
sharing stakeholders as would be necessary. This is a challenge as agile methods are based
on open communication and information sharing.
Illustrative quotes:
There was a plan to collect more information from stakeholders but as one of them was going to participate in the
next competitive procurement, we couldn’t share this issue with them. – Business Product Owner 1, Agency
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 78 ►
Challenges of adopting agile methods in a public organization
After a sprint, we release features to the development environment. They will wait there until the date when the law
comes to effect. In that sense, our approach is somewhere between the agile and the waterfall. – Development
Manager, Agency
You need to consider when the law comes to effect, in a sense it limits the options for a product owner, it sets a
schedule for the project. – ICT Development Manager, Agency
Agency develops digital services that a) have several user groups in the market, b)
Complexity of SW integrate with several backend systems and databases, and c) are developed by
architecture and system several teams. Technically, this means that the software architecture of those
integration - Complexity of services is complex and has many interfaces and integrations. As agile methods
SW architecture were originally meant for rather small and isolated systems, the complexity of
developed systems causes challenges in agile adoption.
Illustrative quotes:
It has been quite challenging, while implementing features with agile, we always need to think what are the other
systems affected and what is the impact. – Development Manager, Agency
Backend systems are developed by other teams. It is challenging to take into account all the backend systems and
databases. – Business Product Owner 2, Agency
There are backend systems we only use through interfaces while we develop our service. It is a bit challenging for
example when planning performance and performance testing. – Scrum Master 1, SW Subcontractor
Complexity of SW Agency develops digital services and complex systems by subcontracting software
architecture and system projects. These services also use other backend systems and databases which were
integration - Complexity of developed earlier. The integration of separate systems is done through technical
system integration interfaces. Agency does not maintain the existing systems and databases but uses
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 79 ►
Challenges of adopting agile methods in a public organization
We have had big problems with our system integration environments. It kind of made it impossible to follow the
scrum cycle. – Business Product Owner 1, Agency
Agile adoption reflects the organizational capabilities in my opinion. After we got teams working ok, we faced
problems with technical infrastructure and system integration. – ICT Product Owner, Agency
We have had problems with the system integration. For example we couldn’t provide the agile team with a
possibility to continuous release and integration as the assumption is with agile methods. – ICT Project Manager,
Agency
The system integration and interface management has been difficult. For example, a while ago our integration
interface to a backend system just stopped working. After a while we realized that it was changed but we were not
informed at all. – Scrum Master 1, SW Subcontractor
5. Discussion
The adoption of agile methods was considered to be successful by the management of Agency. This assessment was
based on the measurable metrics inside the organization. Despite this, we identified several major challenges in the agile
methods adoption. Some of the challenges are, as expected, similar to the ones recognized in prior literature. However,
some of the challenges we identified are particularly unique to public organizations.
Finding the optimal balance between formal documentation and informal communication was difficult for Agency. This
challenge is related to the conflicting objectives of the waterfall and agile methods. The emphasis of the waterfall
approach is to specify a project in detail while one of the founding values of agile methods is to focus on working
software over comprehensive documentation [32]. This principle of agile practices is sometimes wrongly interpreted as
a goal of minimizing documentation. This finding was also supported by earlier research in the private sector [12], [14].
The documentation challenge was even more serious in Agency, as in public organizations heavy and detailed
documentation has traditionally been one of the most salient requirements and expected ways of working.
Personnel education is identified as one of the key tasks for ensuring the successful adoption of agile methods [10].
There was formal training organized by Agency, but it was not enough to make personnel feel that they fully grasped
the method and required practices and had the necessary competencies. According to our analysis, this was one of the
reasons there was a lack of commitment, especially in the beginning of the project. Conboy et al. [14] argue that formal
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 80 ►
Challenges of adopting agile methods in a public organization
training is not enough; people should understand and learn agile values and principles in addition to practices to be
motivated and committed. Murphy and Cormican [33] similarly argue that the psychological motivators play a
significant role, together with abilities to cope with and manage change, in adopting new technologies and methods.
These issues relate to role definition in agile methods, which is different compared to the waterfall method and
traditional project management styles [15]. In the case of Agency it was clearly a challenge for some individuals, e.g.
product owners, to embrace the roles and responsibilities of agile methods, and this hindered the efficient adoption of
agile practices. In addition, Agency implemented a modified version of Scrum, which included an administrative
project manager. The existence of multiple and overlapping roles possibly increased the confusion between the old
project management model and the agile one. Clear roles are identified to be essential for successful agile
implementation [15]. Similarly, the social skills of individuals and well-established social relationships in the project
facilitate the problem solving that is so important for an agile approach [14], [34], [35]. Lack of direct communication
in the case project was also seen as a barrier for the efficient usage of agile methods. These human-related factors
reflect the fact that individuals and organizations need to change their ways of working when they start to adopt agile
practices. Moe et al. [36] argue that this change requires a reorientation by project personnel and management, and they
add that this change takes time and resources. Our findings support their claim, as the people-related issues comprised
the largest single category of challenges in this case study. In Agency, as in many public organizations, there was an
established formal mode of operation, which created a challenging environment for adopting agile methods.
Consequently, a public organization might even need to revisit its underlying organizational values and culture to be
able to adopt agile methods successfully.
Legislation caused challenges in agile adoption in two separate ways for Agency. The first one is specific to the case
study organization, although it may represent a problem facing many governmental organizations. Public agencies must
develop IT systems for implementing digital services for a public audience. Some of these public services are related to
legislation, such as tax legislation, and they need to reflect any changes to the existing legislation. Therefore, the date
when a change in a law comes to effect sets a deadline for the project, which conflicts with agile methods. The other
challenge in terms of legislation relates to the public procurement act. To guarantee that all companies participating in
bidding will be on an equal and impartial basis at all stages, the public procurement act dictates a code of conduct for
public agencies regarding bidding. In some specific issues this can restrict the possibility of a public agency acquiring
and using all information available, and it can also restrict the possibility for early discussions with companies in the
market. Currently, there are some calls, specifically on the European Union level, to revisit regulations regarding agile
procurement to address this current situation.
Technical issues can also hinder the adoption of agile methods. Agency faced severe challenges in integrating the
software architecture of several related systems with the newly-developed one, and they had difficulties following agile
practices to enable continuous integration of sprint releases. These issues lend support to the findings of earlier studies
[15], [16], [17]. In our case study and also in earlier research, these problems largely relate to the external environment
of the project. In many cases, stakeholders and organizations managing other internal systems are not informed,
prepared or committed to support the agile development and related demands. This also relates generally to stakeholder
involvement, which may be challenging with an agile approach, especially if the stakeholders are used to following
traditional software development processes [15]. Consequently, it requires extra efforts in planning, communication and
alignment to synchronize organizations utilizing a traditional development cycle with those using an agile approach.
A public agency generally faces similar challenges in agile methods adoption as private organizations do; however,
there is additional complexity related to those challenges because of the characteristics of governmental organizations.
A unique finding of this study is that governmental regulation of procurement procedures can introduce more
challenges in the adoption of agile methods compared to the private sector. Also, technology dependence on external
systems as a hindrance of agile method adoption is rarely discussed, although it must be addressed in large system
development.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 81 ►
Challenges of adopting agile methods in a public organization
6. Conclusions
In this paper we presented our findings on the challenges in the adoption of agile methods in a governmental
organization. The identified challenges were related to a) documentation, b) personnel education, experience and
commitment, c) stakeholder communication and involvement, d) roles in an agile set-up, e) location of the agile teams,
f) legislation, and g) complexity of SW architecture and system integration. This research has a few limitations that may
present opportunities for further research. As our research was conducted as an exploratory, single case study, further
empirical research is needed. It will be important to verify and extend our findings, especially when public software
procurement is continuously increasing. We think that it would also be important to have more research specifically on
the relationship between the aforementioned challenges and agile project management, as our focus was on the
challenges, not on the practices of project management required for agile methods. We would also suggest more
research on the management of projects utilizing agile methods. Especially interesting is the evolution from traditional
project management into the concept of agile project management. In addition, more empirical research is required on
the project role definitions in an agile setup, and the agile forms of organizing in the public sector.
Acknowledgments
This research was conducted as part of the research project “Value co-creation in agile project development,” which
was mainly funded by Tekes – the Finnish Funding Agency for Innovation (2015-2017).
References
[1] K. Beck, M. Beedle, A. van Bennekum, A. Cockburn, W. Cunningham, M. Fowler, J. Grenning, J. Highsmith, A.
Hunt, R. Jeffries, J. Kern, B. Marick, R. C. Martin, S. Mellor, K. Schwaber, J. Sutherland and D. Thomas. (2015, June
11th). Manifesto for agile software development [Online]. Available: http://www.agilemanifesto.org
[2] J. Highsmith and A. Cockburn, “Agile software development: The business of innovation,” Computer, vol. 34, no.
9, pp. 120-127, 2001.
[3] T. Karrbom Gustavsson and A. Hallin, “Rethinking dichotomization: A critical perspective on the use of "hard" and
"soft" in project management research,” International Journal of Project Management, vol. 21, no. 4, pp. 568-577,
2014.
[4] P. Serrador and J. K. Pinto, “Does Agile work? – A quantitative analysis of agile project success,” International
Journal of Project Management, vol. 33, no. 5, pp. 1040-1051, 2015.
[5] P. Abrahamsson, K. Conboy and X. Wang, “Lots done, more to do: The current state of agile systems development
research,” European Journal of Information Systems, vol. 18, no. 4, pp. 281-284, 2009.
[6] G. Mangalaraj, R. Mahapatra and S. Nerur, “Acceptance of software process innovations – the case of extreme
programming,” European Journal of Information Systems, vol. 18, no. 4, pp. 344–354, 2009.
[7] K. Conboy, M. Pikkarainen and X. Wang, “Agile practices in use from an innovation assimilation perspective: A
multiple case study,” in Proceedings of the 28th International Conference on Information Systems 2007, Montreal,
Quebec, Canada, Dec 9-12, 2007.
[8] E. C. Conforto, F. Salum, D. C. Amaral, S. L. da Silva and L. F. M. de Almeida, “Can agile project management be
adopted by industries other than software development?” Project Management Journal, vol. 45, no. 3, pp. 21-34, 2014.
[9] Project Management Journal. (2015, Dec 1 st). Call for proposals; Project Management Journal special issue:
Exploring the role of agile approaches for the management of projects [Online]. Available:
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 82 ►
Challenges of adopting agile methods in a public organization
http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1938-9507/homepage/PMJ_Call_ad_-
_Agile_Theory__long__v3.pdf
[10] A. Cockburn and J. Highsmith, “Agile software development: The people factor,” Computer, vol. 34, no. 11, pp.
131–133, 2001.
[11] L. Cao, K. Mohan, P. Xu and B. Ramesh, “A framework for adapting agile development methodologies,”
European Journal of Information Systems, vol. 18, no. 4, pp. 332–343, 2009.
[12] A. L. Asnawi, A. M. Gravell and G. B. Wills. “Empirical investigation on agile methods usage: Issues identified
from early adopters in Malaysia,” in Proceedings of the 12th International Conference, XP 2011 (Madrid, Spain, May
10-13, 2011), A. Sillitti, O. Hazzan, E. Bache and X. Albaladejo, Eds. Berlin, Germany: Springer-Verlag, 2011, pp.
192-207.
[13] C. Tolfo, R. S. Wazlawick, M. G. G. Ferreira and F. A. Forcellini, “Agile methods and organizational culture:
Reflections about cultural levels,” Journal of Software Maintenance and Evolution: Research and Practice, vol. 23, no.
6, no. 423–441, 2011.
[14] K. Conboy, S. Coyle, X. Wang and M. Pikkarainen, “People over process: Key people challenges in agile
development,” IEEE Software, vol. 28, no. 4, pp. 48–57, 2011.
[15] B. Boehm and R. Turner, “Management challenges to implementing agile processes in traditional development
organizations,” IEEE Software, vol. 22, no. 5, pp. 30–39, 2005.
[16] M. Lindvall, D. Muthig, A. Dagnino, C. Wallin, M. Stupperich, D. Kiefer, J. May and T. Kähkönen, “Agile
software development in large organizations,” Computer, vol. 37, no. 12, pp. 26–34, 2004.
[17] J. Bowers, J. May, E. Melander, M. Baarman and A. Ayoob, “Tailoring XP for large system mission critical
software development,” in Proceedings of the 2nd XP Universe and 1st Agile Universe Conference on Extreme
Programming and Agile Methods (Chicago, Illinois, USA, Aug 4-7, 2002), D. Wells and L. Williams Eds. Berlin,
Germany: Springer-Verlag, 2002, pp. 100-111.
[18] S. Sarker and S. Sarker, “Exploring agility in distributed information systems development teams: An interpretive
study in an offshoring context,” Information Systems Research, vol. 20, no. 3, pp. 440-461, 2009.
[19] A. Kärkkäinen, Agile IS deployment in the context of public organizations. Master’s Thesis. Oulu, Finland:
Department of Information Processing Science, Faculty of Science, 2012.
[20] K. A. Artto and K. Wikström, “What is project business?,” International Journal of Project Management, vol. 23,
no. 5, pp. 343-353, 2005.
[21] N. Cerpa and J. M. Verner, “Why did your project fail?,” Communications of the ACM, vol. 52, no. 12, pp. 130-
134, 2009.
[22] R. N. Charette, “Why software fails?,” Spectrum, IEEE, vol. 42, no. 9, pp. 42-49, 2005.
[23] T. Brown, “Modernisation or failure? IT development projects in the UK public sector,” Financial Accountability
& Management, vol. 17, no. 4, pp. 363-381, 2001.
[24] S. Goldfinch, “Pessimism, computer failure, and information systems development in the public sector,” Public
Administration Review, vol. 67, no. 5, pp. 917-929, 2007.
[25] C. A. Hardy and S. P. Williams, “E-government policy and practice: a theoretical and empirical exploration of
public e-procurement,” Government Information Quarterly, vol. 25, no. 2, pp. 155-180, 2008.
[26] T. Janowski, “Digital government evolution: from transformation to contextualization,” Government Information
Quarterly, vol. 32, no. 3, pp. 221-236, 2015.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 83 ►
Challenges of adopting agile methods in a public organization
[27] C. Edquist, L. Hommen and L. Tsipouri, “Policy implications,” in Public technology procurement and innovation,
C. Edquist, L. Hommen and L. Tsipouri Eds. New York, Ny, USA: Springer Science+Business Media, 2000, pp. 301-
311.
[28] S. Atkinson, “Why the traditional contract for software development is flawed,” Computer and
Telecommunications Law Review, vol. 16, no. 7, pp. 179-182, 2010.
[29] K. M. Eisenhardt, “Building theories from case study research,” Academy of Management Review, vol. 14, no. 4,
pp. 532-550, 1989.
[30] K. Krippendorff, Content analysis: An introduction to its methodology. Thousand Oaks, CA, USA: Sage
Publications Inc., 2012.
[31] K. Krippendorff, “Content analysis,” in International encyclopedia of communication (Vol. 1), E. Barnouw, G.
Gerbner, W. Schramm, T. L. Worth and L. Gross Eds. New York, NY, USA: Oxford University Press, 1989, pp. 403-
407.
[32] A. Cockburn, Agile software development. Boston, MA, USA: Pearson Education, Inc., 2002.
[33] T. Murphy and K. Cormican, “Towards holistic goal centered performance management in software development:
lessons from a best practice analysis,” International Journal of Information Systems and Project Management, vol. 3,
no. 4, pp. 23-36, 2015.
[34] A. Leonard and D. van Zyl, “Social relationships in IT project teams: its role, complexity and the management
thereof,” International Journal of Information Systems and Project Management, vol. 2, no. 1, pp. 21-39, 2014.
[35] O. Stawnicza, “Distributed team cohesion – not an oxymoron. The impact of information and communications
technologies on teamness in globally distributed IT projects,” International Journal of Information Systems and Project
Management, vol. 3, no. 2, pp. 23-39, 2015.
[36] N. B. Moe, A. Aurum and T. Dybå, “Challenges of shared decision-making: A multiple case study of agile
software development,” Information and Software Technology, vol. 54, no. 8, pp. 853-865, 2012.
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 84 ►
Challenges of adopting agile methods in a public organization
Biographical notes
Jouko Nuottila
Jouko Nuottila is doctoral student and researcher in Industrial Engineering and Management at the
University of Oulu. His primary research interests lie in studying the forms of flexibility in project
contracting with a particular interest in agile development methods and agile project management. He
holds an MSc in Industrial Engineering and Management. He has industrial experience in technology
marketing and software product management at Nokia Corporation.
www.shortbio.net/jouko.nuottila@oulu.fi
Kirsi Aaltonen
Kirsi Aaltonen (Dr. Tech) is Assistant Professor of Project Management at University of Oulu,
Industrial Engineering and Management in Finland. Prior to that she has worked as Senior Lecturer
at Aalto University in Finland. Her current research interests are in areas of stakeholder and
uncertainty management in large and complex projects. Her publication list includes more than 40
academic papers and book chapters in the area of project business. She has published for example in
Scandinavian Journal of Management, International Journal of Project Management and
International Journal of Managing Projects in Business.
www.shortbio.net/kirsi.aaltonen@oulu.fi
Jaakko Kujala
Jaakko Kujala is Professor of Project and Quality Management at University of Oulu. His current
research interest include simulation as a research method, stakeholder management in the project
business context, governance of complex project networks with specific focus on collaborative
project delivery methods such as agile and project alliancing.
www.shortbio.net/jaakko.kujala@oulu.fi
International Journal of Information Systems and Project Management, Vol. 4, No. 3, 2016, 65-85
◄ 85 ►