Submissions:2018/Supporting Search in Many Languages

This submission is waitlisted for WikiConference North America 2018. It was not scheduled in the first round of scheduling, but may still be scheduled after further review, as slots open up, or as a pre-conference session.

Title

Supporting Search in Many Languages

Theme (optional)

Tech & Tools

Academic Peer Review option

No

Type of submission

Presentation

Author

Trey Jones

E-mail address

treywikimedia.org

Wikimedia username

TJones (WMF)

Affiliation(s) (optional)

Wikimedia Foundation

Abstract

The Wikimedia Foundation Search Platform Team supports search in over 250 languages—admittedly with varying degrees of “support”. We have to work within the resource limitations of a small team and balance the absolute impact of improving search on big wikis in well-supported languages against the relative impact of improving search on smaller wikis in less well-supported languages.

Many aspects of English make searching in English relatively easy, and every language that differs from English in an interesting way suffers for it when it comes to search. We'll start with a basic overview of the components of search, a quick survey of some of the features of other languages that make search even more challenging, a review of the techniques used to meet those challenges, and then maybe we'll commiserate a little bit over a few problems that are more difficult.

We’ll also review some useful semi-automated techniques for evaluating changes to language processing—particularly in languages no one on our team is familiar with—including heuristics for highlighting problem areas, and good ways to leverage limited assistance from native speakers who are not search experts.

We’ve done a lot to improve search on various wikis over the last several years, so we’ll touch on a few other interesting search projects—from the biggest to the smallest—that our team has worked on, time permitting.

Finally, we’ll have a short Q&A period, during which people are encouraged to tell me why search sucks for them in their favorite language or on their favorite wiki. I can’t promise everything (or even anything) will get fixed quickly (or ever)—how’s that for a disclaimer!—but I do love learning about and working on interesting language-related search problems!

Length of presentation

30-45 minutes

Special requests

None

Preferred room size

~25

Have you presented on this topic previously? If yes, where/when?

No

If you will be incorporating a slidedeck during your presentation, do you agree to upload it to Commons before your session, with a CC-BY-SA 4.0 license, including suitable attribution in the slidedeck for any images used?

Yes

Will you attend WikiConference North America if your submission is not accepted?

Yes

Interested attendees

If you are interested in attending this session, please sign with your username below. This will help reviewers to decide which sessions are of high interest. Sign with four tildes. (~~~~).

1. Minh Nguyễn ^💬 06:23, 23 August 2018 (UTC)
2. Add your username here.