Maniphest T249319

Remove wb_terms from sqoop
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Addshore
	Apr 3 2020, 10:31 AM

Tags

Referenced Files

None

Subscribers

Description

The wb_terms table is no longer being used and will be removed.

Remove code from refinery so data will no longer be generated
Remove the data and tables already in hadoop

Details

	Subject	Repo	Branch	Lines +/-
	Remove wb_terms from sqoop	analytics/refinery	master	+0 -59

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		jbond	T236277 Extend Puppet CA Expiry date
		Resolved		jbond	T237259 Document all uses of the puppetCA certificate
		Resolved		RLazarus	T237362 Rolling restart of etcd to pick up the renewed CA public certificate.
		Resolved		Marostegui	T239791 DB: perform rolling restart of mariadb daemons to pick up CA changes
		Resolved		Marostegui	T251981 Upgrade and restart s2 and s8 (wikidatawiki) primary database masters: Tue 19th May
		Resolved		jbond	T240330 Check if traffic servers need restarting/reloading post CA change
		Resolved		Addshore	T208425 [EPIC] Kill the wb_terms table
		Resolved		Marostegui	T248086 Drop wb_terms in production from s4 (commonswiki, testcommonswiki), s3 (testwikidatawiki), s8 (wikidatawiki)
		Resolved		JAllemandou	T249319 Remove wb_terms from sqoop

Event Timeline

Addshore created this task.Apr 3 2020, 10:31 AM

Restricted Application added a project: Wikidata. · View Herald TranscriptApr 3 2020, 10:31 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 585720 had a related patch set uploaded (by Addshore; owner: Addshore):
[analytics/refinery@master] Remove wb_terms from sqoop

https://gerrit.wikimedia.org/r/585720

gerritbot added a project: Patch-For-Review.Apr 3 2020, 10:32 AM

Addshore added a parent task: T248086: Drop wb_terms in production from s4 (commonswiki, testcommonswiki), s3 (testwikidatawiki), s8 (wikidatawiki).Apr 3 2020, 10:33 AM

Addshore updated the task description. (Show Details)

Addshore moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.

Maintenance_bot moved this task from incoming to in progress on the Wikidata board.Apr 3 2020, 11:15 AM

Change 585720 merged by Joal:
[analytics/refinery@master] Remove wb_terms from sqoop

https://gerrit.wikimedia.org/r/585720

Maintenance_bot removed a project: Patch-For-Review.Apr 3 2020, 2:10 PM

Addshore moved this task from Doing to Stalled/Waiting on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold)) board.Apr 6 2020, 9:20 AM

@joal I'll leave this one here until you remove the tables!

FYI: checked monthly sqoop and it's not referenced there so puppet is good to go (https://github.com/wikimedia/puppet/blob/ef13ee28202b2ff9653bfaf3cbf6b2a0433aa8c2/modules/profile/templates/analytics/refinery/job/refinery-sqoop-mediawiki.sh.erb)

Milimetric moved this task from Incoming to Radar on the Analytics board.Apr 6 2020, 4:03 PM

JAllemandou closed this task as Resolved.Jun 2 2020, 10:35 AM

JAllemandou updated the task description. (Show Details)

Aklapper edited projects, added Analytics-Radar; removed Analytics.Jun 10 2020, 6:43 AM