Submissions:2018/JADE: complementing artificial intelligence with human judgment

This submission has been accepted for WikiConference North America 2018.

Title

JADE: complementing artificial intelligence with human judgment

Theme (optional)

Tech & Tools

Academic Peer Review option

No

Type of submission

Presentation

Author

James Hare

E-mail address

jhare@wikimedia.org

Wikimedia username

Harej (WMF)

Affiliation(s) (optional)

Wikimedia Foundation

Abstract

JADE, the Judgment and Dialogue Engine, is a feature under development that will complement the automatic judgment of the ORES prediction service with thoughtful annotations from human contributors. ORES uses statistical modeling to guess, at massive scale, the quality of articles and edits made to them. On wikis large and small, ORES helps administrators and patrollers do their work more efficiently by automatically triaging incoming tasks – filtering out obvious cases and leaving more subtle ones for human review. However, AI is far from perfect. JADE will allow human contributors to step in and add annotations to pages, article revisions, and individual edits (diffs). These annotations can in turn be used to improve ORES. During this presentation I will explain how JADE works and its potential to make the work of Wikipedians more efficient while giving them a say in how the AI functions.

Length of presentation

15 minutes not including questions, 30 with questions?

Special requests

N/A

Preferred room size

No idea

Have you presented on this topic previously? If yes, where/when?

No

If you will be incorporating a slidedeck during your presentation, do you agree to upload it to Commons before your session, with a CC-BY-SA 4.0 license, including suitable attribution in the slidedeck for any images used?

Yes

Will you attend WikiConference North America if your submission is not accepted?

Yes

Interested attendees

If you are interested in attending this session, please sign with your username below. This will help reviewers to decide which sessions are of high interest. Sign with four tildes. (~~~~).

1. Gamaliel (talk) 00:02, 22 August 2018 (UTC)
2. Minh Nguyễn ^💬 18:54, 14 September 2018 (UTC)
3. Omar sansi (talk) 04:49, 20 October 2018 (UTC)