BEGIN:VCALENDAR
VERSION:2.0
METHOD:PUBLISH
CALSCALE:GREGORIAN
PRODID:-//WordPress - MECv7.37.0//EN
X-ORIGINAL-URL:https://netpreserve.org/
X-WR-CALNAME:IIPC
X-WR-CALDESC:International Internet Preservation Consortium
X-WR-TIMEZONE:UTC
BEGIN:VTIMEZONE
TZID:UTC
X-LIC-LOCATION:UTC
BEGIN:STANDARD
TZOFFSETFROM:+0000
TZOFFSETTO:+0000
TZNAME:UTC
DTSTART:20261023T122216
END:STANDARD
END:VTIMEZONE
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-PUBLISHED-TTL:PT1H
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VEVENT
CLASS:PUBLIC
UID:MEC-80b618ebcac7aa97a6dac2ba65cb7e36@netpreserve.org
DTSTART;TZID=UTC:20210608T140000
DTEND;TZID=UTC:20210608T153000
DTSTAMP:20210425T214623Z
CREATED:20210425
LAST-MODIFIED:20210427
PRIORITY:5
SEQUENCE:0
TRANSP:OPAQUE
SUMMARY:WAC 2021: Workshop: SolrWayback 2
DESCRIPTION:Web archive discovery systems and scaling\nThomas Egense & Toke Eskildsen\nThe Royal Danish Library\nDescription:\nThis workshop will\n\nPresent challenges for building and maintaining a web archive scale discovery system\nExplain concrete strategies for running Solr at different scales (same strategies should work for Elacticsearch)\nProvide a forum for sharing experiences and problems with the scale of web archives. Bring your own challenges and we will solve them together!\n\nPrerequisites:\n\nAn interest in the scaling of web archive discovery systems\n\nBackground:\nThe Royal Danish Library has been providing full text search and discovery for the Danish Netarchive for several years, lately using SolrWayback. The archive contains 33 billion records, which are all indexed and available online. Solr is used as the underlying search engine and scaling has been both a design criteria and an ongoing challenge.\nIndexing (using Web Archive Discovery (https://github.com/ukwa/webarchive-discovery ( https://github.com/ukwa/webarchive-discovery )) and searching (using Solr (https://solr.apache.org/ ( https://solr.apache.org/ )) each have their own issues which can easily compound to larger problems: Setups that works well at a certain size is no guarantee for a working system at 10× that size.\n
URL:https://netpreserve.org/event/wac2021-solrwayback-2/
CATEGORIES:Conference,IIPC WAC,WAC2021,Workshop
END:VEVENT
END:VCALENDAR