Covers the work from April 24th to May 13th, 2023
Details
Details
Description
Sep 12 2024
Sep 12 2024
Aklapper edited Description on Data Pipelines (Sprint 12).
Jun 21 2024
Jun 21 2024
Apr 12 2024
Apr 12 2024
VirginiaPoundstone added a project to T361889: Decision: OpenAPI spec viewer for AQS: Data Pipelines (Sprint 12).
Mar 18 2024
Mar 18 2024
Mar 16 2024
Mar 16 2024
VirginiaPoundstone removed a project from T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks: Data Products.
Nov 10 2023
Nov 10 2023
Oct 4 2023
Oct 4 2023
VirginiaPoundstone moved T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks from Wikistats Backlog to Radar (other teams) on the Data Products board.
Sep 19 2023
Sep 19 2023
Aug 22 2023
Aug 22 2023
VirginiaPoundstone raised the priority of T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks from Medium to Needs Triage.
VirginiaPoundstone moved T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks from Incoming to To be discussed/To be estimated on the Data Products board.
Aug 18 2023
Aug 18 2023
MarkAHershberger updated subscribers of T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks.
is it fair to assume, give this unfortunate time lag of a decade, that this request no longer necessary?
Aug 17 2023
Aug 17 2023
VirginiaPoundstone moved T327982: Add cawiki to clickstream dataset from To be discussed/To be estimated to Wikistats Backlog on the Data Products board.
VirginiaPoundstone changed the status of T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks from Open to Stalled.
@MarkAHershberger is it fair to assume, give this unfortunate time lag of a decade, that this request no longer necessary? Do you have an objection if I change the status to "invalid" or is this still a request we need to (finally) try to meet?
Jul 19 2023
Jul 19 2023
Gehel moved T336306: Ask Airflow community whether there are plans for LTS releases from Incoming to Done on the Data-Platform-SRE board.
Jul 14 2023
Jul 14 2023
MarkAHershberger added a comment to T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks.
I'm not sure what you should do with this since I haven't thought about it in 10 years. Mobile technology and data connections have changed significantly in that period of time, also.
Jul 13 2023
Jul 13 2023
VirginiaPoundstone moved T327982: Add cawiki to clickstream dataset from Incoming to To be discussed/To be estimated on the Data Products board.
VirginiaPoundstone added a comment to T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks.
Hello @MarkAHershberger!
As I am onboarding as the new Product Manager to Data Products, I am going through tasks on the Data Products board to learn more about them. This ticket has sadly been lingering since 2013.
I am curious to learn about the efforts specifically this would support.
Thank you, in advance, for helping me by adding more context here.
Jul 1 2023
Jul 1 2023
JArguello-WMF added a project to T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks: Data Products.
Jun 30 2023
Jun 30 2023
JArguello-WMF moved T327982: Add cawiki to clickstream dataset from Discussed (Radar) to Sprint 12 on the Data Pipelines board.
JArguello-WMF moved T58628: Non-mobile UAs on mobile (2g/gprs, etc) IP-blocks from Discussed (Radar) to Sprint 12 on the Data Pipelines board.
Jun 20 2023
Jun 20 2023
Jun 13 2023
Jun 13 2023
Ottomata reopened T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs as "Open".
Jun 5 2023
Jun 5 2023
May 24 2023
May 24 2023
gerritbot added a comment to T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs.
Change 922905 had a related patch set uploaded (by Stevemunene; author: Stevemunene):
[operations/puppet@production] Add the refinery-cache/revs directory to git safe list
Stevemunene added a comment to T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs.
We had this error pop up again during this weeks refinery deploy.
May 18 2023
May 18 2023
Stashbot added a comment to T333001: Setup for allowing Airflow deployment via Git Repository.
Mentioned in SAL (#wikimedia-operations) [2023-05-18T18:57:13Z] <xcollazo@deploy1002> Finished deploy [airflow-dags/platform_eng@502ddae]: T333001 (duration: 00m 35s)
Stashbot added a comment to T333001: Setup for allowing Airflow deployment via Git Repository.
Mentioned in SAL (#wikimedia-operations) [2023-05-18T18:56:38Z] <xcollazo@deploy1002> Started deploy [airflow-dags/platform_eng@502ddae]: T333001
May 16 2023
May 16 2023
Maintenance_bot removed a project from T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs: Patch-For-Review.
gerritbot added a comment to T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs.
Change 920280 merged by Btullis:
[operations/puppet@production] Add the refinery-cache directory to the git safe list
gerritbot added a comment to T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs.
Change 920280 had a related patch set uploaded (by Btullis; author: Btullis):
[operations/puppet@production] Add the refinery-cache directory to the git safe list
Stevemunene added a comment to T334493: analytics/refinery deployment broken at refinery-deploy-to-hdfs.
We experienced this again during today's (May 16 2023) refinery deploy.
May 15 2023
May 15 2023
MusikAnimal moved T334041: Run maintain-views on zhwiki, newiki from Blocked (Non-XTools) to Complete on the XTools board.
JArguello-WMF edited projects for T335859: Document Solutions and Decisions for Realtime Dump Implementation, added: Data Pipelines (Sprint 12); removed Data Pipelines.
May 12 2023
May 12 2023
JArguello-WMF closed T328049: Investigate the effects of IP Masking on Data Eng systems as Resolved.
JArguello-WMF closed T334101: [Airflow] Migrate mediawiki geoeditors druid loading job, a subtask of T324485: [Airflow] Migrate Druid loading Oozie jobs - Parent task, as Resolved.
JArguello-WMF closed T334096: [Airflow] Migrate unique devices Druid loading jobs, a subtask of T324485: [Airflow] Migrate Druid loading Oozie jobs - Parent task, as Resolved.
JArguello-WMF closed T334104: [Airflow] Migrate pageview-related Druid loading Oozie jobs as Resolved.
JArguello-WMF closed T334105: [Airflow] Migrate virtualpageviews Druid loading Oozie jobs as Resolved.
JArguello-WMF closed T334106: [Airflow] Migrate webrequest sampled 128 druid loading jobs as Resolved.
JArguello-WMF closed T334104: [Airflow] Migrate pageview-related Druid loading Oozie jobs, a subtask of T324485: [Airflow] Migrate Druid loading Oozie jobs - Parent task, as Resolved.
JArguello-WMF closed T334105: [Airflow] Migrate virtualpageviews Druid loading Oozie jobs, a subtask of T324485: [Airflow] Migrate Druid loading Oozie jobs - Parent task, as Resolved.
JArguello-WMF closed T334106: [Airflow] Migrate webrequest sampled 128 druid loading jobs, a subtask of T324485: [Airflow] Migrate Druid loading Oozie jobs - Parent task, as Resolved.
Done wit all steps! 🎉 Thank you @Stevemunene and @BTullis for your support!