How To Disable HAIP in Exadata - Example

How To Disable HAIP In Exadata Configurations
We are providing the steps (below) to disable HAIP in an Exadata Configuration:
► -|- Exadata Configuration used for this testing:
► (1) -|- Clusterware release:

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ crsctl query crs activeversion

Oracle Clusterware active version on the cluster is [12.2.0.1.0]
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Oracle Home : /u01/app/12.2.0.1/grid

Hostnames: orlx48db01.us.oracle.com / orlx48db02.us.oracle.com
ARU platform id: 226
ARU platform description:: Linux x86-64
Interim patches (4) :
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Patch 28163235 : applied on Fri Jan 04 01:05:59 EST 2019

Patch description: "ACFS JUL 2018 RELEASE UPDATE 12.2.0.1.180717 (28163235)"
--
Patch description: "OCW JUL 2018 RELEASE UPDATE 12.2.0.1.180717 (28163190)"
--
Patch description: "Tomcat Release Update 12.2.0.1.0(ID:171023.0830) (27144050)"
--
Patch description: "DBWLM RELEASE UPDATE 12.2.0.1.0(ID:170913) (26839277)"
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (2) -|- Exadata image:

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# /usr/local/bin/imageinfo
Kernel version: 2.6.39-400.294.4.el6uek.x86_64 #1 SMP Tue Mar 14 18:42:17 PDT

2017 x86_64
Image kernel version: 2.6.39-400.294.4.el6uek
Image version: 12.1.2.3.5.170418
Image activated: 2017-06-08 16:39:46 -0400
Image status: success
System partition on device: /dev/mapper/VGExaDb-LVDbSys1
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (3) -|- Two nodes are present in this cluster:

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
ora.asm
1 ONLINE ONLINE orlx48db01 Started,STABLE
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (4) -|- I followed the steps from the “HOWTO: Remove HAIP on Exadata (Doc ID
2524069.1)” document:
► (Step # 1) -|- I confirmed that HAIP and the ADVM proxy are in use in the Node #2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ . oraenv

ORACLE_SID = [+ASM2] ?
The Oracle base remains unchanged with value /u01/app/12201base
[grid@orlx48db02 ~]$
[grid@orlx48db02 ~]$ crsctl stat res ora.cluster_interconnect.haip -t -init
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cluster_interconnect.haip
1 ONLINE ONLINE orlx48db02 STABLE
--------------------------------------------------------------------------------
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ srvctl enable asm -proxy -node orlx48db02
[grid@orlx48db02 ~]$ srvctl start asm -proxy -node orlx48db02
[grid@orlx48db02 ~]$ crsctl stat res ora.proxy_advm -t

--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.proxy_advm
ONLINE ONLINE orlx48db02 STABLE
--------------------------------------------------------------------------------
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 2) -|- I determined what interfaces are used for the ASM network in the Node
#2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ oifcfg getif

bondeth0 10.141.132.0 global public
ib0 192.168.8.0 global cluster_interconnect,asm
bondeth1 11.10.196.0 global public
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 3) -|- I determined the associated IP addressed for the

“cluster_interconnect,asm” IB interfaces in the Node #2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib0
inet addr:192.168.8.9 Bcast:192.168.11.255 Mask:255.255.252.0
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib1
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib2
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib3
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib4
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib5
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib6
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
+ ifconfig ib7
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 4) -|- I created a pfile for the ASM proxy instance (+APX2) in node #2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

ORACLE_SID = [+ASM2] ? +APX2
[grid@orlx48db02 ~]$ env | grep ORA

ORACLE_SID=+APX2
ORACLE_BASE=/u01/app/12201base
ORACLE_HOME=/u01/app/12.2.0.1/grid
[grid@orlx48db02 ~]$ ls -l $ORACLE_HOME/dbs

total 24
-rw-rw---- 1 grid oinstall 1618 Sep 12 14:20 ab_+ASM2.dat
-rw-rw---- 1 grid oinstall 1544 Oct 2 12:54 hc_+APX2.dat
-rw-rw---- 1 grid oinstall 1544 Oct 2 12:16 hc_+ASM2.dat
-rw-rw---- 1 grid oinstall 1544 Sep 12 14:22 hc_-MGMTDB.dat
-rw-r--r-- 1 grid oinstall 3079 Jan 13 2019 init.ora
-rw-r----- 1 grid oinstall 24 Feb 7 2019 lk_MGMTDB
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ sqlplus "/as sysasm"
SQL*Plus: Release 12.2.0.1.0 Production on Wed Oct 2 14:39:22 2019
Copyright (c) 1982, 2016, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
SQL> show parameter instance_name
NAME TYPE VALUE

------------------------------------ ----------- ------------------------------
instance_name string +APX2
SQL> show parameter instance_type
NAME TYPE VALUE

------------------------------------ ----------- ------------------------------
instance_type string ASMPROXY
SQL>
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SQL> create pfile from memory;

File created.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SQL> !ls -l $ORACLE_HOME/dbs

total 32
-rw-rw---- 1 grid oinstall 1618 Sep 12 14:20 ab_+ASM2.dat
-rw-rw---- 1 grid oinstall 1544 Oct 2 12:54 hc_+APX2.dat
-rw-rw---- 1 grid oinstall 1544 Oct 2 12:16 hc_+ASM2.dat
-rw-rw---- 1 grid oinstall 1544 Sep 12 14:22 hc_-MGMTDB.dat
-rw-r--r-- 1 grid oinstall 7951 Oct 2 14:40 init+APX2.ora
-rw-r--r-- 1 grid oinstall 3079 Jan 13 2019 init.ora
-rw-r----- 1 grid oinstall 24 Feb 7 2019 lk_MGMTDB
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
SQL> !cat $ORACLE_HOME/dbs/init+APX2.ora

# Oracle init.ora parameter file generated by instance +APX2 on 10/02/2019 14:40:23
__oracle_base='/u01/app/12201base' # ORACLE_BASE set from environment
_adaptive_window_consolidator_enabled=TRUE
_aggregation_optimization_settings=0
_always_anti_join='CHOOSE'
_always_semi_join='CHOOSE'
_and_pruning_enabled=TRUE
_b_tree_bitmap_plans=TRUE
_bloom_filter_enabled=TRUE
_bloom_filter_ratio=35
_bloom_folding_enabled=TRUE
_bloom_pruning_enabled=TRUE
_bloom_serial_filter='ON'
_complex_view_merging=TRUE
_compression_compatibility='12.2.0'
_connect_by_use_union_all='TRUE'
_convert_set_to_join=FALSE
_cost_equality_semi_join=TRUE
_cpu_to_io=0
_diag_adr_trace_dest='/u01/app/12201base/diag/apx/+apx/+APX2/trace'
_dimension_skip_null=TRUE
_distinct_agg_optimization_gsets='CHOOSE'
_ds_enable_view_sampling=TRUE
_ds_sampling_method='PROGRESSIVE'
_ds_xt_split_count=1
_dummy_instance=TRUE
_eliminate_common_subexpr=TRUE
_enable_type_dep_selectivity=TRUE
_fast_full_scan_enabled=TRUE
_first_k_rows_dynamic_proration=TRUE
_gby_hash_aggregation_enabled=TRUE
_gby_vector_aggregation_enabled=TRUE
_generalized_pruning_enabled=TRUE
_globalindex_pnum_filter_enabled=TRUE
_gs_anti_semi_join_allowed=TRUE
_improved_outerjoin_card=TRUE
_improved_row_length_enabled=TRUE
_index_join_enabled=TRUE
_key_vector_create_pushdown_threshold=20000
_ksb_restart_policy_times='0'
_ksb_restart_policy_times='240' # internal update to set default
_left_nested_loops_random=TRUE
_local_communication_costing_enabled=TRUE
_minimal_stats_aggregation=TRUE
_mmv_query_rewrite_enabled=TRUE
_mv_access_compute_fresh_data='ON'
_new_initial_join_orders=TRUE
_new_sort_cost_estimate=TRUE
_nlj_batching_enabled=1
_optim_adjust_for_part_skews=TRUE
_optim_enhance_nnull_detection=TRUE
_optim_new_default_join_sel=TRUE
_optim_peek_user_binds=TRUE
_optimizer_adaptive_cursor_sharing=TRUE
_optimizer_ads_use_partial_results=TRUE
_optimizer_ads_use_spd_cache=TRUE
_optimizer_aggr_groupby_elim=TRUE
_optimizer_ansi_join_lateral_enhance=TRUE
_optimizer_ansi_rearchitecture=TRUE
_optimizer_band_join_aware=TRUE
_optimizer_batch_table_access_by_rowid=TRUE
_optimizer_better_inlist_costing='ALL'
_optimizer_cbqt_no_size_restriction=TRUE
_optimizer_cbqt_or_expansion='ON'
_optimizer_cluster_by_rowid=TRUE
_optimizer_cluster_by_rowid_batched=TRUE
_optimizer_cluster_by_rowid_control=129
_optimizer_coalesce_subqueries=TRUE
_optimizer_complex_pred_selectivity=TRUE
_optimizer_compute_index_stats=TRUE
_optimizer_connect_by_combine_sw=TRUE
_optimizer_connect_by_cost_based=TRUE
_optimizer_connect_by_elim_dups=TRUE
_optimizer_control_shard_qry_processing=65534
_optimizer_correct_sq_selectivity=TRUE
_optimizer_cost_based_transformation='LINEAR'
_optimizer_cost_hjsmj_multimatch=TRUE
_optimizer_cost_model='CHOOSE'
_optimizer_cube_join_enabled=TRUE
_optimizer_dim_subq_join_sel=TRUE
_optimizer_distinct_agg_transform=TRUE
_optimizer_distinct_elimination=TRUE
_optimizer_distinct_placement=TRUE
_optimizer_eliminate_filtering_join=TRUE
_optimizer_eliminate_subquery=TRUE
_optimizer_enable_density_improvements=TRUE
_optimizer_enable_extended_stats=TRUE
_optimizer_enable_plsql_stats=TRUE
_optimizer_enable_table_lookup_by_nl=TRUE
_optimizer_enhanced_filter_push=TRUE
_optimizer_enhanced_join_elimination=TRUE
_optimizer_extend_jppd_view_types=TRUE
_optimizer_extended_cursor_sharing='UDO'
_optimizer_extended_cursor_sharing_rel='SIMPLE'
_optimizer_extended_stats_usage_control=192
_optimizer_false_filter_pred_pullup=TRUE
_optimizer_fast_access_pred_analysis=TRUE
_optimizer_fast_pred_transitivity=TRUE
_optimizer_filter_pred_pullup=TRUE
_optimizer_fkr_index_cost_bias=10
_optimizer_full_outer_join_to_outer=TRUE
_optimizer_gather_feedback=TRUE
_optimizer_gather_stats_on_load=TRUE
_optimizer_group_by_placement=TRUE
_optimizer_hybrid_fpwj_enabled=TRUE
_optimizer_improve_selectivity=TRUE
_optimizer_inmemory_access_path=TRUE
_optimizer_inmemory_autodop=TRUE
_optimizer_inmemory_bloom_filter=TRUE
_optimizer_inmemory_cluster_aware_dop=TRUE
_optimizer_inmemory_gen_pushable_preds=TRUE
_optimizer_inmemory_minmax_pruning=TRUE
_optimizer_inmemory_table_expansion=TRUE
_optimizer_inmemory_use_stored_stats='AUTO'
_optimizer_interleave_jppd=TRUE
_optimizer_interleave_or_expansion=TRUE
_optimizer_join_elimination_enabled=TRUE
_optimizer_join_factorization=TRUE
_optimizer_join_order_control=3
_optimizer_join_sel_sanity_check=TRUE
_optimizer_key_vector_pruning_enabled=TRUE
_optimizer_max_permutations=2000
_optimizer_mode_force=TRUE
_optimizer_multi_level_push_pred=TRUE
_optimizer_multi_table_outerjoin=TRUE
_optimizer_multicol_join_elimination=TRUE
_optimizer_native_full_outer_join='FORCE'
_optimizer_new_join_card_computation=TRUE
_optimizer_nlj_hj_adaptive_join=TRUE
_optimizer_null_accepting_semijoin=TRUE
_optimizer_null_aware_antijoin=TRUE
_optimizer_or_expansion='DEPTH'
_optimizer_order_by_elimination_enabled=TRUE
_optimizer_outer_join_to_inner=TRUE
_optimizer_outer_to_anti_enabled=TRUE
_optimizer_partial_join_eval=TRUE
_optimizer_proc_rate_level='BASIC'
_optimizer_push_down_distinct=0
_optimizer_push_pred_cost_based=TRUE
_optimizer_reduce_groupby_key=TRUE
_optimizer_rownum_bind_default=10
_optimizer_rownum_pred_based_fkr=TRUE
_optimizer_skip_scan_enabled=TRUE
_optimizer_sortmerge_join_inequality=TRUE
_optimizer_squ_bottomup=TRUE
_optimizer_star_tran_in_with_clause=TRUE
_optimizer_strans_adaptive_pruning=TRUE
_optimizer_system_stats_usage=TRUE
_optimizer_table_expansion=TRUE
_optimizer_transitivity_retain=TRUE
_optimizer_try_st_before_jppd=TRUE
_optimizer_undo_cost_change='12.2.0.1'
_optimizer_union_all_gsets=TRUE
_optimizer_unnest_corr_set_subq=TRUE
_optimizer_unnest_disjunctive_subq=TRUE
_optimizer_unnest_scalar_sq=TRUE
_optimizer_use_cbqt_star_transformation=TRUE
_optimizer_use_feedback=TRUE
_optimizer_use_gtt_session_stats=TRUE
_optimizer_use_histograms=TRUE
_optimizer_use_table_scanrate='HADOOP_ONLY'
_optimizer_use_xt_rowid=TRUE
_optimizer_vector_base_dim_fact_factor=200
_optimizer_vector_transformation=TRUE
_or_expand_nvl_predicate=TRUE
_ordered_nested_loop=TRUE
_parallel_broadcast_enabled=TRUE
_partition_view_enabled=TRUE
_pivot_implementation_method='CHOOSE'
_pre_rewrite_push_pred=TRUE
_pred_move_around=TRUE
_push_join_predicate=TRUE
_push_join_union_view=TRUE
_push_join_union_view2=TRUE
_pwise_distinct_enabled=TRUE
_px_adaptive_dist_bypass_enabled=TRUE
_px_adaptive_dist_method='CHOOSE'
_px_concurrent=TRUE
_px_cpu_autodop_enabled=TRUE
_px_dist_agg_partial_rollup_pushdown='ADAPTIVE'
_px_external_table_default_stats=TRUE
_px_filter_parallelized=TRUE
_px_filter_skew_handling=TRUE
_px_groupby_pushdown='FORCE'
_px_join_skew_handling=TRUE
_px_minus_intersect=TRUE
_px_object_sampling_enabled=TRUE
_px_parallelize_expression=TRUE
_px_partial_rollup_pushdown='ADAPTIVE'
_px_partition_scan_enabled=TRUE
_px_pwg_enabled=TRUE
_px_replication_enabled=TRUE
_px_scalable_invdist=TRUE
_px_scalable_invdist_mcol=TRUE
_px_single_server_enabled=TRUE
_px_ual_serial_input=TRUE
_px_wif_dfo_declumping='CHOOSE'
_px_wif_extend_distribution_keys=TRUE
_query_rewrite_setopgrw_enable=TRUE
_query_rewrite_use_on_query_computation=TRUE
_recursive_with_branch_iterations=7
_recursive_with_parallel=TRUE
_remove_aggr_subquery=TRUE
_replace_virtual_columns=TRUE
_right_outer_hash_enable=TRUE
_selfjoin_mv_duplicates=TRUE
_sql_model_unfold_forloops='RUN_TIME'
_sqlexec_hash_based_distagg_ssf_enabled=TRUE
_subquery_pruning_enabled=TRUE
_subquery_pruning_mv_enabled=FALSE
_table_scan_cost_plus_one=TRUE
_union_rewrite_for_gs='YES_GSET_MVS'
_unnest_subquery=TRUE
_use_column_stats_for_function=TRUE
_vector_encoding_mode='MANUAL'
_xt_sampling_scan_granules='ON'
connection_brokers='((TYPE=DEDICATED)(BROKERS=1))'
connection_brokers='((TYPE=EMON)(BROKERS=1))' # connection_brokers default
value
core_dump_dest='/u01/app/12201base/diag/apx/+apx/+APX2/cdump'
local_listener=' (ADDRESS=(PROTOCOL=TCP)(HOST=10.141.132.54)(PORT=1521))'
SQL>
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 5) -|- I set the +APX2.cluster_interconnects parameter in the

$ORACLE_HOME/dbs/init+APX2.ora parameter file including the IP addresses from the
“cluster_interconnect,asm” IB interfaces:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ cd $ORACLE_HOME/dbs
[grid@orlx48db02 dbs]$ pwd

/u01/app/12.2.0.1/grid/dbs
[grid@orlx48db02 dbs]$ ls -l $ORACLE_HOME/dbs/init+APX2.ora

-rw-r--r-- 1 grid oinstall 7951 Oct 2 14:40 /u01/app/12.2.0.1/grid/dbs/init+APX2.ora
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 dbs]$ grep cluster_interconnects

$ORACLE_HOME/dbs/init+APX2.ora
+APX2.cluster_interconnects='192.168.8.9:192.168.8.10:192.168.8.11:192.168.8.12:19
2.168.8.13:192.168.8.14:192.168.8.15:192.168.8.16'
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 6) -|- +APX2 ASM proxy is stopped in the node #2:

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ srvctl stop asm -proxy -node orlx48db02 -force
[grid@orlx48db02 ~]$ srvctl status asm -proxy -node orlx48db02

ADVM proxy is not running on node orlx48db02
[grid@orlx48db02 ~]$ crsctl stat res ora.proxy_advm -t

--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.proxy_advm
OFFLINE OFFLINE orlx48db02 STABLE
--------------------------------------------------------------------------------
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 7) -|- As root user I started the ACFS resources in the node #2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# . oraenv
# crsctl start res -w "TYPE = ora.acfs.type" -n orlx48db02
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 8) -|- As grid user I started the ASM Proxy instance resource in the node #2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# srvctl start asm -proxy -node orlx48db02
[Wed Oct 02 15:04:18][root@orlx48db02:~][0]
# srvctl status asm -proxy -node orlx48db02

ADVM proxy is running on node orlx48db02
# crsctl stat res ora.proxy_advm -t

--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.proxy_advm
--------------------------------------------------------------------------------
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Note: I had to manually start the ASM Proxy.
► (Step # 9) -|-As grid user, I validated the cluster_interconnects settings in the ASM
Proxy Instance (+APX2) in node 2:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
ORACLE_SID = [+ASM2] ? +APX2
[grid@orlx48db02 ~]$ sqlplus "/as sysasm"
SQL*Plus: Release 12.2.0.1.0 Production on Wed Oct 2 15:28:35 2019
Copyright (c) 1982, 2016, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production
192.168.8.16
SQL> show parameter instance_name
NAME TYPE VALUE

------------------------------------ ----------- ------------------------------
instance_name string +APX2
SQL> show parameter cluster_interconnects
NAME TYPE VALUE

------------------------------------ ----------- ------------------------------
cluster_interconnects string 192.168.8.9:192.168.8.10:192.1
68.8.11:192.168.8.12:192.168.8
.13:192.168.8.14:192.168.8.15:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 10) -|-As root user, I disabled HAIP feature in node 2:

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# . oraenv
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# which crsctl
/u01/app/12.2.0.1/grid/bin/crsctl
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl modify res ora.asm -attr "START_DEPENDENCIES='hard(ora.cssd,ora.ctssd)

pullup(ora.cssd,ora.ctssd) weak(ora.drivers.acfs)',
STOP_DEPENDENCIES='hard(intermediate:ora.cssd)' " -init
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl stat res -t -init | egrep -A1 ora.cluster_interconnect.haip

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl stop crs -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources
on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.crsd' on 'orlx48db02'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server
'orlx48db02'
CRS-2673: Attempting to stop 'ora.qosmserver' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.proxy_advm' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.chad' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.test.db' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.pdbzdlra.db' on 'orlx48db02'
CRS-2677: Stop of 'ora.pdbzdlra.db' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.qosmserver' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.chad' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.mgmtdb' on 'orlx48db02'
CRS-2677: Stop of 'ora.mgmtdb' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.MGMTLSNR' on 'orlx48db02'
CRS-2677: Stop of 'ora.proxy_advm' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.MGMTLSNR' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.test.db' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.DBFS_DG.dg' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.LISTNET2.lsnr' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.SCANLSNR_2_SCAN1_NET2.lsnr' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.cvu' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.orlx48db01.vip' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.orlx48db01_2.vip' on 'orlx48db02'
CRS-2677: Stop of 'ora.DBFS_DG.dg' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'orlx48db02'
CRS-2677: Stop of 'ora.cvu' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'orlx48db02'
CRS-2677: Stop of 'ora.LISTNET2.lsnr' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.SCANLSNR_2_SCAN1_NET2.lsnr' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.scan1_net2.vip' on 'orlx48db02'
CRS-2677: Stop of 'ora.asm' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'orlx48db02'
CRS-2677: Stop of 'ora.orlx48db01_2.vip' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.orlx48db02_2.vip' on 'orlx48db02'
CRS-2677: Stop of 'ora.orlx48db01.vip' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.orlx48db02.vip' on 'orlx48db02'
CRS-2677: Stop of 'ora.scan3.vip' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.orlx48db02_2.vip' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.orlx48db02.vip' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.scan1_net2.vip' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.net2.network' on 'orlx48db02'
CRS-2677: Stop of 'ora.net2.network' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.ons' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'orlx48db02'
CRS-2677: Stop of 'ora.net1.network' on 'orlx48db02' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'orlx48db02'
has completed
CRS-2677: Stop of 'ora.crsd' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.crf' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'orlx48db02'
CRS-2677: Stop of 'ora.drivers.acfs' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.crf' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.gpnpd' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.asm' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.evmd' on 'orlx48db02'
CRS-2677: Stop of 'ora.ctssd' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.evmd' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'orlx48db02'
CRS-2677: Stop of 'ora.cssd' on 'orlx48db02' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'orlx48db02'
CRS-2673: Attempting to stop 'ora.gipcd' on 'orlx48db02'
CRS-2677: Stop of 'ora.gipcd' on 'orlx48db02' succeeded
CRS-2677: Stop of 'ora.diskmon' on 'orlx48db02' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on
'orlx48db02' has completed
CRS-4133: Oracle High Availability Services has been stopped.
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl start crs
CRS-4123: Oracle High Availability Services has been started.

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
# crsctl stat res -t -init | egrep -A1 ora.cluster_interconnect.haip
1 ONLINE OFFLINE STABLE
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 11) -|- And all the clusterware services successfully started:
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
[grid@orlx48db02 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr
ora.DBFS_DG.dg
ora.LISTENER.lsnr
ora.LISTNET2.lsnr
ora.chad
ora.net1.network
ora.net2.network
ora.ons
ora.proxy_advm
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
ora.MGMTLSNR
1 ONLINE ONLINE orlx48db01 169.254.51.221 192.1
68.8.1 192.168.8.2,S
TABLE
ora.SCANLSNR_2_SCAN1_NET2.lsnr
ora.asm
ora.cvu
ora.junhedb.db
ora.mgmtdb
1 ONLINE ONLINE orlx48db01 Open,STABLE
ora.orlx48db01.vip
ora.orlx48db01_2.vip
ora.orlx48db02.vip
ora.orlx48db02_2.vip
ora.pdbzdlra.db
1 ONLINE ONLINE orlx48db02 Open,HOME=/u01/app/b
ase/dbhome,STABLE
ora.qosmserver
ora.scan1.vip
ora.scan1_net2.vip
ora.scan2.vip
ora.scan3.vip
ora.test.db
1 ONLINE ONLINE orlx48db01 Open,HOME=/u01/app/o
racle/product/12.1.0
/dbhome_1,STABLE
2 ONLINE ONLINE orlx48db02 Open,HOME=/u01/app/o
racle/product/12.1.0
/dbhome_1,STABLE
--------------------------------------------------------------------------------
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
► (Step # 12) -|- The same steps need to be implemented in the other nodes in the
same RAC Exadata Cluster.
Esteban Bernal
Oracle Engineered Systems, Exadata Cloud and Scalability
Team

How To Disable HAIP in Exadata - Example

Uploaded by

Copyright:

Available Formats

How To Disable HAIP in Exadata - Example

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

How To Disable HAIP in Exadata - Example

Uploaded by

Copyright:

Available Formats

How To Disable HAIP In Exadata Configurations

We are providing the steps (below) to disable HAIP in an Exadata Configuration:

► -|- Exadata Configuration used for this testing:

► (1) -|- Clusterware release:

[grid@orlx48db02 ~]$ crsctl query crs activeversion

Oracle Home : /u01/app/12.2.0.1/grid

Patch 28163235 : applied on Fri Jan 04 01:05:59 EST 2019

► (2) -|- Exadata image:

Kernel version: 2.6.39-400.294.4.el6uek.x86_64 #1 SMP Tue Mar 14 18:42:17 PDT

► (3) -|- Two nodes are present in this cluster:

[grid@orlx48db02 ~]$ . oraenv

[grid@orlx48db02 ~]$ srvctl enable asm -proxy -node orlx48db02

[grid@orlx48db02 ~]$ srvctl start asm -proxy -node orlx48db02

[grid@orlx48db02 ~]$ crsctl stat res ora.proxy_advm -t

[grid@orlx48db02 ~]$ oifcfg getif

► (Step # 3) -|- I determined the associated IP addressed for the

[grid@orlx48db02 ~]$ . oraenv

[grid@orlx48db02 ~]$ env | grep ORA

[grid@orlx48db02 ~]$ ls -l $ORACLE_HOME/dbs

[grid@orlx48db02 ~]$ sqlplus "/as sysasm"

SQL*Plus: Release 12.2.0.1.0 Production on Wed Oct 2 14:39:22 2019

Copyright (c) 1982, 2016, Oracle. All rights reserved.

SQL> show parameter instance_name

NAME TYPE VALUE

NAME TYPE VALUE

SQL> create pfile from memory;

SQL> !ls -l $ORACLE_HOME/dbs

SQL> !cat $ORACLE_HOME/dbs/init+APX2.ora

► (Step # 5) -|- I set the +APX2.cluster_interconnects parameter in the

[grid@orlx48db02 dbs]$ pwd

[grid@orlx48db02 dbs]$ ls -l $ORACLE_HOME/dbs/init+APX2.ora

[grid@orlx48db02 dbs]$ grep cluster_interconnects

► (Step # 6) -|- +APX2 ASM proxy is stopped in the node #2:

[grid@orlx48db02 ~]$ srvctl status asm -proxy -node orlx48db02

[grid@orlx48db02 ~]$ crsctl stat res ora.proxy_advm -t

# crsctl start res -w "TYPE = ora.acfs.type" -n orlx48db02

# srvctl status asm -proxy -node orlx48db02

# crsctl stat res ora.proxy_advm -t

Note: I had to manually start the ASM Proxy.

[grid@orlx48db02 ~]$ sqlplus "/as sysasm"

SQL*Plus: Release 12.2.0.1.0 Production on Wed Oct 2 15:28:35 2019

Copyright (c) 1982, 2016, Oracle. All rights reserved.

NAME TYPE VALUE

SQL> show parameter cluster_interconnects

NAME TYPE VALUE

► (Step # 10) -|-As root user, I disabled HAIP feature in node 2:

# crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=0" -init

# crsctl modify res ora.asm -attr "START_DEPENDENCIES='hard(ora.cssd,ora.ctssd)

# crsctl stat res -t -init | egrep -A1 ora.cluster_interconnect.haip

# crsctl stop crs -f

CRS-4123: Oracle High Availability Services has been started.

You might also like