BEGIN:VCALENDAR
VERSION:2.0
METHOD:PUBLISH
CALSCALE:GREGORIAN
PRODID:-//WordPress - MECv7.37.0//EN
X-ORIGINAL-URL:https://netpreserve.org/
X-WR-CALNAME:IIPC
X-WR-CALDESC:International Internet Preservation Consortium
X-WR-TIMEZONE:UTC
BEGIN:VTIMEZONE
TZID:UTC
X-LIC-LOCATION:UTC
BEGIN:STANDARD
TZOFFSETFROM:+0000
TZOFFSETTO:+0000
TZNAME:UTC
DTSTART:20261023T180626
END:STANDARD
END:VTIMEZONE
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-PUBLISHED-TTL:PT1H
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VEVENT
CLASS:PUBLIC
UID:MEC-3bd00b198a4acdcdd6de880c3bbc917d@netpreserve.org
DTSTART;TZID=UTC:20250213T150000
DTEND;TZID=UTC:20250213T170000
DTSTAMP:20250124T211812Z
CREATED:20250124
LAST-MODIFIED:20250207
PRIORITY:5
SEQUENCE:30
TRANSP:OPAQUE
SUMMARY:IIPC-IFLA News Media Section Workshop: Browser-based Crawling of News Websites Behind Paywalls
DESCRIPTION:The IFLA News Media and International Internet Preservation Consortium (IIPC) are teaming up again to host a series of workshops focusing on archiving news media. As most news is now published online, there is a growing interest to better understand the current best practices in web archiving. The main goal of our workshops is to examine and compare how organizations of varying sizes tackle this topic and to learn from their collective experiences. Through presentations and informal discussions, we will showcase diverse organizational approaches to archiving news media, including audiovisual content and social media, highlight key challenges, and explore innovative solutions. \nOur initial event on December 4 ( https://netpreserve.org/event/ifla-iipc-workshop-4-dec-2024/ ) featured a short introduction to the work of IIPC and IFLA News Media Section as well as three use cases from the National Library of France, National and University Library of Iceland and Library of Congress. We invite you to stay tuned for information about subsequent events that will take place in the first quarter of 2025.\nThe workshop will be moderated by Kopana Terry (Historic Newspapers Curator) of the University of Kentucky. \nAGENDA\n10:00-10:05 : Introduction to IFLA News Media section & IIPC\n10:05-11:25: Presentations\n11:25-11:55: Q&A with all speakers\n11:55-12:00: Wrap-up\nIn a digital age characterized by information abundance, access to online content remains a significant challenge. Many valuable resources are hidden behind paywalls and login screens, making it difficult for researchers, archivists, and data enthusiasts to retrieve, preserve, and analyze this content. In this workshop, experts from web archives across Europe aim to empower participants with the knowledge and tools necessary to tackle these obstacles effectively and will equip participants with the skills and knowledge required to navigate paywalls, conduct web crawls effectively, ensure data quality, and foster ongoing communication with site owners. The following key components will be covered:\n\nAccessing Paywalled Content:\n\nTechniques to bypass paywalls and access restricted websites\nNegotiating with newspapers and publishers to obtain login credentials\nStrategies for requesting IP Authentication from site administrators\nBrowser plugins and user agent customization to enhance access\n\n\nActually Crawling Content:\n\nExploration of web crawling tools, including Heritrix and Browsertrix\nUtilizing Browsertrix Cloud and Browsertrix Crawler for efficient and scalable crawling\nUsing Browsertrix Behaviors for harvesting special content, such as videos, podcasts and flipbooks\nIntroduction to other essential tools for web harvesting\n\n\nQuality Assurance of Content:\n\nDeduplication techniques and best practices\nImplementing dashboards for IP-validation to ensure data integrity\nWorkshop segment on setting up the initial infrastructure and performing proxy at home\n\n\nCommunication with Site Owners:\n\nEmphasizing the importance of communication with site owners\nHighlighting the direct correlation between effective communication and access privileges\nStrategies for maintaining ongoing relationships with content providers\n\n\n\nSPEAKERS\nAnders Klindt Myrvoll, Royal Danish Library\nAnders has been the Programme Manager at the national Danish web archive, Netarkivet, at the Royal Danish Library since 2018. Together with colleagues, he is collecting, preserving and providing access to the Danish web. Prior to web archiving, Anders worked for more than 13 years in the broadcast, film and media industry, collaborating globally on high-end localization, making original content for children, saving digital cultural heritage, strategy, optimization, leadership and much more. You can find him on Linkedin or @andersklindt on X/Twitter.\nAntares Reich, Austrian National Library\nAntares is a crawl engineer and is responsible for the set-up and quality assurance of all crawls at the Austrian National Library ( https://onb.ac.at/ ). Previously he worked as a software developer for cashier systems and as a local assistant to a member of the European Parliament. He loves books and to play music.\nJoel Nieminen, National Library of Finland\nJoel is an Information Systems Specialist who has been working at the Legal Deposit Office ( https://www.kansalliskirjasto.fi/en/legal-deposit-services ) of the National Library of Finland ( https://www.kansalliskirjasto.fi/ ) since 2022. With a degree in Computer Science, he specializes in web crawling and data extraction, adeptly navigating paywalls to access valuable information while adhering to ethical standards. He combines technical expertise with a passion for open data, advocating for information accessibility. During his free time, you can find him enjoying the Finnish nature.\nLászló Tóth, National Library of Luxembourg\nLászló is a software engineer involved in the development of tools related to web archiving at the National Library of Luxembourg. This includes web crawling, ingest workflows and playback. Previously, he worked as a developer for a European media company, specializing in software concerned with broadcasting, media and post-production. László holds an MSc in Advanced Computing Science from the University of East Anglia (United Kingdom) and outside of software development he is mainly interested in mathematics and classical music.\nSamuli Sairanen, National Library of Finland\nSamuli has been an Information Systems Specialist at the Legal Deposit Office ( https://www.kansalliskirjasto.fi/en/legal-deposit-services ) of the National Library of Finland ( https://www.kansalliskirjasto.fi/ ) since 2019, working with processes and challenges of electronic material management, though has lately been more involved in web archiving and its infrastructure.\nRESOURCES\n\nJari Heikkinen, Topi Chamchoon, Samuli Sairanen, Joel Nieminen, Sanna Haukkala: Collecting Online Newspapers and Bypassing Paywalls. IFLA International News Media Conference 2024.\nProceedings of the 16th IFLA ILDS conference: Beyond the paywall – Resource sharing in a disruptive ecosystem : held at the National Library of Technology in Prague, Czech Republic, October 9-11, 2019.\n\n
URL:https://netpreserve.org/event/iipc-ifla-news-media-section-workshop-crawling-behind-paywalls/
CATEGORIES:IIPC-IFLA News Media,Series
ATTACH;FMTTYPE=image/png:https://netpreserve.org/resources/IFLA-IIPC_workshops-banner.png
END:VEVENT
END:VCALENDAR