Automated Drilling Algorithms Implementation
Automated Drilling Algorithms Implementation
Energy and Petroleum Engineering Department, University of Stavanger, Stavanger, Norway. E-mail: dan.sui@uis.no
Abstract
Considering the state of art technology that exists today and the significant resources that are being
invested into the technology of tomorrow, an idea of intelligent and fully automated machineries working
on a drilling floor that is capable of consistently selecting best decisions or predictions based on realtime
information available and providing drillers and operators with such recommendations, becomes closer to
a reality every day.
This work shows results of the research carried out on the topic of drilling automation. Its objectives
are to design and test proof of concept technologies conducted on a laboratory-scale autonomous drilling
rig developed at University of Stavanger, Norway. Main contribution of the study is on drilling speed
(ROP) optimization with considering operational safety to personnel and environment (HSE) and drilling
efficiency along with a digitized drilling program for directional drilling. The case studies are presented
to show the different scenarios for drilling vertical wells and inclined wells.
doi:10.4173/mic.2020.1.1
c 2020 Norwegian Society of Automatic Control
Modeling, Identification and Control
2. Drilling Rig
The drilling rig, see Figure 1, consists of in total four
hardware systems, in addition to the control system.
These are: rotation, hoisting, circulation and power
systems that are introduced below.
Rotation System: There exist two rotational systems:
a conventional top drive, used for vertical drilling and
a downhole motor used for directional drilling. This
set-up allows us to circulate drilling fluid (either wa- Figure 1: Drill rig.
ter, water-based mud or oil-based mud ) all the way
from the top of derrick to the drill bit nozzles. The Parameter Description and Unit
top drive provides rotational speeds up to 1500 RPM. Material Aluminium, 6061-T6 alloy
By varying two analog voltage signals one can control Pipe length 914.4 mm
the RPM and torque from the top drive. The signals Pipe OD 9.53 mm
are transmitted from programmable logic controllers Pipe ID 7.75 mm
(PLCs) to a driver for the top drive. Wall thickness 1.2446 mm
Hoisting System: In order to simulate drilling opera-
tions, the system is equipped with a hoisting system
that consists of three actuators, each equipped with a Table 1: Drill pipe description
stepper motor. The motors raise/lower the top plate
that resembles the drill floor where the top drive and
downhole motor and drill bit. While the knuckle joint
other components are mounted. The three actuators
can be used to control the dogleg by varying the WOB
are controlled by its own stepper motor with a step-
so that a spring gets compressed (bend) or left un-
angle of 1.8 degrees, where for each 1.8 degrees of step-
compressed (no bend), the mechanical angle of the top
ping 10 micro-steps get transmitted (resulting in a to-
drive can be varied through pulsing to change the az-
tal of 2000 steps/rev). High accuracy for the actua-
imuth, if an offset is registered. The bit RPM is con-
tors is a key in order to ensure the required weight on
trolled by throttling the air flow coming from a com-
bit (WOB) control. Such powerful stepper motors can
pressor to the downhole pneumatic motor. The alu-
provide an approximate maximum WOB up to 500 N.
minium drill pipe used for drilling has the following
To address the challenge of vibrations in the system,
dimension:
a rigid coupling is used between the stepper motors
Pipe limit calculations and destructive testing of the
and actuators to reduce the overall vibrations making
drill pipe are given in Hagen et al. (2018), which are
the system more sturdy. More information and details
summarized below:
are found in Løken and Trulsen (2017), Hagen et al.
(2018), Hjelm and Nilsen (2018). • critical slenderness ratio of the pipe is 70.2, and
Circulation System: The circulation system consists of slenderness ratio of the drill pipe is approximately
two pumps alternating for 30 seconds each. This pre- 280.2,
vents the pumps from over-heating and should one
pump fail, the other will kick in to ensure the required • buckling limit is 280.5 N,
velocity margin for adequate hole cleaning and cooling • maximum torque before the pipe yields is approxi-
of the bit. The pumps have a maximum flow rate of mately 19.0 Nm, while the maximum torque before
19 L/min at a working pressure of 3.1 bar, see Hagen the pipe shears is approximately 24.7 Nm,
et al. (2018).
The drill string assembly consists of: aluminium drill • maximum tensile load is approximately 10.331 kN
pipe, downhole sensor sub, knuckle joint, pneumatic and maximum compressive load is approximately
2
Løken et al., “Automated Drilling”
3
Modeling, Identification and Control
4.3. Graphical User Interfaces (GUIs) our requirements where both leverages the features of
relational database systems, and also offers great query
Two GUIs have been developed for this laboratory
optimization for time series data. This is convenient in
scale drilling rig. These are a visualization GUI to
order to not have to implement two different databases;
track the progress of the autonomous control system
one to store sensor data and another to store rig state
and drilling performance and a downhole well trajec-
data.
tory environment, see Figure A.2, also showing the
In order to easily manage the data that gets stored in
real-time position, inclination and orientation of the
the database, an application that serves as the inter-
bit.
face between the users and the database is required. A
separate small application is also required: responsible
5. Data Management for pushing the data to the database. The sensors’ sig-
nals are sampled at a specific frequency and these data
5.1. Sensors are stored in text files on the computer.
To make the data in the database easily accessible, a
With the main task being developing an autonomous user-friendly platform to access the data was created
drilling rig, the sensor implementation is an area that in the team. This is solved by writing a web appli-
has received a lot of attention. The computer relies cation, where users can log in and manage the stored
on good data from sensors implemented to make deci- data. Users can access and download the data gathered
sions and provide users with valuable information. Our from either specific experiments, or a particular subset
drilling rig system has a total of 17 sensors, including of those data. They can then choose to visualize the
three load cells capable of providing measurements for data by generating graphs, query experiments using
x, y and z-axis; two torque sensors, one integrated in different parameters, manage which variables that the
the top drive and one external for torque measurement database shall contain, register the drilled rocks (la-
at the top of the drill string. The design, manufactur- bel the rock types, experiments, add comments etc.),
ing and implementation of a downhole measurement manage access to the database, and so on. In addition,
tool including accelerometer, gyroscope and magne- the data can easily be down-sampled to for instance
tometer have also been conducted in our work. Drill 10% of the raw data. When working with datasets of
string vibration is a complex phenomenon that often millions of rows (measurements) and between five and
results in Non-Productive Time. The complexity lies thirty columns (sensors or features), this immediately
in the coupled action of the three vibrational modes: allows the user to select which data-frequency to work
axial, lateral and torsional. The modes excite one an- with, rather than having to import a large dataset,
other, which makes it difficult to recognize a particular carry out either a linear down-sampling process and
mode and prevent destructive vibrations. A downhole then save the data as a new file.
measurement system allows us to capture the moment
when vibrations occur and adjust operational parame-
ters (the WOB and the RPM) in real-time to mitigate 6. Autonomous Drilling
vibrations. The other function of downhole measure-
ment is to do he bit position tracking and control. The concept is a closed-loop autonomous control sys-
tem that combines several models with a digital de-
tailed operational drilling procedure developed for di-
5.2. Database
rectional drilling. A simplified flow chart illustrating
During each drilling experiment, the sensors installed the system is shown in Figure 2. In addition, a novel
on the rig gather a large amount of time-stamped data. voting system has been designed to prioritize which
There have been many drilling experiments conducted commands that should receive priority if an event, or
over the years and a lot of data has been collected, incident gets detected or if conflicting commands from
either in real-time or for post analysis using a high- models get received at the same time. The voting sys-
frequency data acquisition (DAQ) module. tem has been configured so that critical incidents that
TimescaleDB is a faster and more reliable solution. can risk damage to either equipment or the well re-
It is created by heavily modifying the architecture of ceive the highest priority. Maximizing the ROP and
PostgreSQL, a well-known RDBMS. TimescaleDB still ensuring that downhole vibrations are low are located
preserves all the features and capabilities of a con- at the lowest priority since these tasks are not critical
ventional RDBMS. Data is organized in tables with to handle immediately to meet the objective.
columns, rows, indexes, primary keys, foreign keys, There are however several challenges to perform an op-
constraints and all the desirable features usually re- timal ROP search. In the drilling scene, there is lacking
served for relational databases. TimescaleDB satisfies information with regards to the destination that the
4
Løken et al., “Automated Drilling”
to measure the response. If the step size is too large An objective function J can be defined using Euclidean
however, this reduces the time required to reach the norm, so that:
destination but increases the likelihood of possibly by-
passing the destination (overshooting). min J(X) = kf (X) − ROPsetpoint k2 . (5)
X
5
Modeling, Identification and Control
At any given combination of the control parameters, For every 1 mm measured depth (MD), the relation-
the ROP gradient always points to the maximal in- ship between horizontal build and true vertical depth
crease of the ROP function, and the gradient is al- (TVD) gets calculated so that:
ways perpendicular to the ROP hyper-surface contour
f (X) = c, where the constant c is an arbitrary real H horizontalbuild[mm]
= (10)
number. The algorithm is now capable of determining TV D T V D[mm]
A look up table has been created which contains the
H/T V Dplanned . The look up table values are then
called every mm, and the relationship between the ac-
tual build and planned build is checked by the equa-
tion:
H/T V Dactual
Statusbuild = . (11)
H/T V Dplanned
If the build status is ≥ 1, the system will be in a drop
angle mode, and if the build status is ≤ 1, the machine
will be in a build angle mode and needs to increase the
build-rate by increasing the WOB.
While the downhole RPM only depends on the gra-
dient search algorithm and the different phases of the
operation, the voting system in the control system will
continuously evaluate whether or not the system is in
a build or drop mode. If for example the ROP gradient
search proposes 14 kg WOB, but the system should be
in a drop mode, the WOBsetpoint will be overwritten
Figure 3: Constraints and ROP contours in the state to 12 kg, which is the highest permissible WOB in the
space of the drilling machine. drop mode. While a higher WOB from experiments
have yielded a higher ROP, another control algorithm
the search direction from a previous operating point. exists that evaluates whether the recommended con-
The optimization now is reduced to a univariate line troller setpoint (within the range identified for build or
search, moving along the local gradients. The gradient drop mode) gets forwarded to the PID controller, or
descent method can be shown as: whether an even lower setpoint should be used in the
event of severe downhole vibrations or if the system is
→
− →
− −→
X k+1 = X k − ηgk Xk , (7) in a critical phase.
where η represents the learning rate; i.e. the step size 6.3. Digital Detailed Operating Procedure
to move in each iteration, and k denotes the iteration
number. The step size can be selected by the equation The following digital detailed operating procedure
below, considering that we define φ(ηk ) = f (Xk + ηgk ) (DDOP) has been developed to autonomously execute
and 0 < < 12 , which satisfies the Wolfe condition: the drilling of a directional well. The DDOP is ar-
ranged in eight phases, as visualized in Figure 4.
0
φ(ηk ) ≥ (1 − )φ (0). (8)
6
Løken et al., “Automated Drilling”
Figure 4: Eight phases constitute the digital direc- 7.3. Experiment 3: Deviation Well with
tional drilling operation. WOB 5 to 20 kg
7
Modeling, Identification and Control
Figure 5: Experiment 1: Well log representing rig performance when drilling with downhole motor in inclined
section using a 7 degrees whipstock.
8
Løken et al., “Automated Drilling”
Figure 7: Experiment 2: Well log representing rig performance when drilling with downhole motor in vertical
pilot hole section for 170 mmTVD to later RIH with whipstock. Riser is used to ensure verticality.
Figure 8: Experiment 3: Well log representing rig performance when RIH to 240 mmTVD and then drilling
with downhole motor to 600 mmTVD. A 7 degrees whipstock is used to kick off.
the University of Stavanger. We acknowledge Equinor tecture and API Integration. Bachelor thesis, Uni-
academia program and Aker BP for funding the ongo- versity of Stavanger, 2019.
ing project.
Hagen, H., Jakobsen, A., and Khadisov, M. Laboratory
Drilling Rig Construction, Testing and Modeling for
References Optimization and Problem Management. Bachelor
thesis, University of Stavanger, 2018.
Bello, e. a. Application Of Artificial Intelligence Meth-
ods In Drilling System Design And Operations: A Hjelm, O. A. and Nilsen, S. J. Further Develop-
Review Of The State Of The Art. Journal of Artifi- ment and Testing of an Autonomous Drilling Rig
cial Intelligence and Soft Computing Research, 5(2), and Control Algorithms for Improved Drilling Per-
2015. pages 121–139. doi:10.1515/jaiscr-2015-0024. formance. Master’s thesis, University of Stavanger,
Geekiyanage, S. C. H., Loeken, E. A., and Sui, D. 2018.
Draft: Architectures and Algorithms of an Au-
tonomous Small-Scale Drilling Agent. Submitted for Løken, E. A. and Trulsen, A. Construction, Design
review, Elsevier, 2019. and Optimization of an Autonomous Laboratory-
Scale Drilling Rig. Bachelor thesis, University of
Guggedal, C. and Steinstø, M. Control System Archi- Stavanger, 2017.
9
Modeling, Identification and Control
Figure A.1: Implemented control system illustrating layers and dataflow internally and externally with PLCs
and sensor equipment.
A. Appendix
10
Løken et al., “Automated Drilling”
Figure A.2: GUI is equipped with gauges and parameters showing the control system setpoints and sensor
feedback as well as building a well log in real-time for interpretation of all stages of the drilling
operation.
11