Through this investigation, we've learned that:

1. Popular LLMs do in fact generate some identifiable HTML. See T379908#10322254.
2. The HTML included in pastes from LLMs is more likely to change than HTML included in pastes from popular document editors (T376306).

In T378833#10409591, @Msz2001 wrote:

In T378833#10377353, @ppelberg wrote:

Per offline discussion with @Trizek-WMF, Flow will be set to read only at Phase 1 wikis (see task description), this Thursday.

Is this still under control? :)

I'm glad you asked, @Msz2001; Flow is scheduled to be set to read only at Phase 1 wikis today (19 December).

In T380910#10389224, @Pppery wrote:

I've semi-automatically deleted about 7,000 Flow boards with no useful content on MediaWiki.org. The remaining 10,000 boards have at least one topic and I will leave to be processed by the script.

Wow! Thank you, @Pppery for doing the above and continuing to support this work.

Next steps

• @ppelberg: tidy task description
• @ppelberg: create sub-tasks for future work as we'd like to continue treating this ticket as the "umbrella" ticket for the work of showing people multiple Reference Checks within an edit session (when warranted)

Next steps

• @ppelberg to create tickets for items 4. and 5.

See: T382277

Next Step
Per today's team meeting, Editing Engineering will review and respond T374066#10337785 seeing as how the Edit Check API has evolved since this feedback was shared.

Per what @MNeisler and I discussed offline today:

• We're going to start with pursuing the parametized notebook (not in production) approach Megan detailed in T380540#10395754.
• When we are certain about the two points below, we will pursue the Superset dashboard using data pipelines approach:
  • We know what metrics the decisions we'll need to make over time require we have easy access to
  • We are consulting these metrics frequently enough to warrant the upfront investment required to have easy/omnipresent access to them

Updating task description to include new questions that surfaced in conversation with @Esanders and @nayoub offline today.

The demo @Esanders recorded is here: https://drive.google.com/file/d/1h_dbnnseneQrJSq_YddQqdkqfn-0t-kD/view?usp=drive_link

Per what @MNeisler and I discussed offline on 4 December 2024, the findings Megan shared in T378036#10349611 are leading us to include that proceeding with hiding the Tools and Appearance menus when Edit Check has the potential to activate is not likely to be disruptive.

Monday, 16 December 2024 (tentative date), a script will automatically do this moving

Per today's offline discussion with @Trizek-WMF, we're going to mover forward with running the Flow migration script at Phase 2a wikis on 16 December.