IIPC CRAWLER HACKATHON – LONDON 2016
BUILDING BETTER CRAWLERS
22 – 23 SEPTEMBER 2016
BRITISH LIBRARY, LONDON
“To make collaboration a habit” was the main message of the General Assembly 2016 that took place in Reykjavik. Based on the members’ feedback, the lead of the Tools Development Portfolio, Tom Cramer, proposed the direction for advancing tools development. Consequently, one of the key actions in the IIPC Strategic Plan 2016 – 2017 was “to develop collaborative platforms and social engagement targeted at developers, by organising events such as hack fests or unconferences, in order to address specific technical issues already identified and well-known in the community”.
Following up on the proposed strategy for tools development and building on the success of the technical training workshop organised at the British Library in January 2015, IIPC members were invived to participate in a “Building Better Crawlers” hackathon. Topics included:
1) archiving with Warcprox,
2) browser-based crawling,
3) web archiving APIs.
The event was co-sponsored by the IIPC and the British Library and took place on 22nd – 23rd September (9.40am – 5pm, both days), at the British Library in London.
