Workshop: Browser-based Domain Crawling with Browsertrix

The purpose of the workshop is to share and compare approaches and experiences thus far with Browsertix domain-level crawling, discuss successes and failures, and figure out what the gaps are to make domain-level crawling with Browsertrix more feasible. The idea is to compare notes from different institutions that have experimented with this, identify existing challenges, and plan the work needed to make domain-level crawling easier for everyone.

This will be a technical discussion aimed at developers. The workshop will help inform future development tasks for the Webrecorder team and potentially allow for future collaborative open-source development on Browsertrix to support domain-level crawling. Participation is especially encouraged from anyone who has attempted national domain-level crawling. Those who are curious but have not tried are also welcome to join!