Status: Past Project
Call for participation:
BUILDING BETTER CRAWLERS
IIPC CRAWLER HACKATHON
22–23 SEPTEMBER 2016
BRITISH LIBRARY, LONDON
“To make collaboration a habit” was the main message of the General Assembly that took place in Reykjavik last April. Based on the members’ feedback, the lead of the Tools Development Portfolio, Tom Cramer, proposed the direction for advancing tools development. Consequently, one of the key actions in the IIPC Strategic Plan 2016 – 2017 is “to develop collaborative platforms and social engagement targeted at developers, by organising events such as hack fests or unconferences, in order to address specific technical issues already identified and well-known in the community”.
Following up on the proposed strategy for tools development and building on the success of the technical training workshop organised at the British Library in January 2015, we would like to invite the IIPC members to participate in a “Building Better Crawlers” hackathon. The topics include, but are not limited to:
1) archiving with Warcprox,
2) browser-based crawling,
3) web archiving APIs.
Any suggestions within the proposed theme are welcome.
The event is co-sponsored by the IIPC and the British Library and will take place on 22nd – 23rd September (9.40am – 5pm, both days), at the British Library in London. In order to participate, please send a request to the IIPC PCO by 19th August 2016 including suggestions for hackathon topics. We will confirm acceptance by email. Please note that the number of participants is limited to 25.