WikiDo
WikiDo: millions of events, one local search
A search engine for things to do in US cities. I built the website and data indexing, making millions of crawler-sourced events searchable by place, day and category.
- Project type
- In-house project
The project at a glance · Illustrated overview
Millions of events. One local search.
Collection
Niccolò’s crawler finds the events.
Index
Solr makes the data searchable.
Discovery
Browsing by city, day and category.
Scale
Large event volumes and traffic peaks.
01
The challenge
Finding things to do means navigating scattered and changing sources. The project needs to make large event datasets searchable while supporting heavy traffic.
02
The solution
Niccolò’s crawler supplies the data. The website I developed indexes it in Solr and provides local search. MySQL and Memcache complement the search engine in the portal’s stack.
03
Capabilities
- Event search by city and day.
- Categories including culture, nightlife, food, social and religious events.
- Solr indexing for millions of events.
- Large data volumes and traffic peaks.
Scale and usage
Over approximately 15 years online, through September 2026: millions of indexed events and visitors, with historical peaks of 10,000 visits per day.
LET’S BUILD WHAT’S NEXT
Start with the problem to solve.
A workflow to organise, systems to connect or a product to build. The first step is understanding the people, needs and constraints.