BEGIN:VCALENDAR
VERSION:2.0
METHOD:PUBLISH
CALSCALE:GREGORIAN
PRODID:-//WordPress - MECv7.37.0//EN
X-ORIGINAL-URL:https://netpreserve.org/
X-WR-CALNAME:IIPC
X-WR-CALDESC:International Internet Preservation Consortium
X-WR-TIMEZONE:UTC
BEGIN:VTIMEZONE
TZID:UTC
X-LIC-LOCATION:UTC
BEGIN:STANDARD
TZOFFSETFROM:+0000
TZOFFSETTO:+0000
TZNAME:UTC
DTSTART:20261024T181430
END:STANDARD
END:VTIMEZONE
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-PUBLISHED-TTL:PT1H
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VEVENT
CLASS:PUBLIC
UID:MEC-d41b5422b44a34d123006225fd1d3484@netpreserve.org
DTSTART;TZID=UTC:20250317T130000
DTEND;TZID=UTC:20250317T140000
DTSTAMP:20250115T134105Z
CREATED:20250115
LAST-MODIFIED:20250922
PRIORITY:5
SEQUENCE:2
TRANSP:OPAQUE
SUMMARY:IIPC RSS Webinar: PANDORÆ and Hyphe: Open-Source Tools and Methodologies for Researching Web Archives
DESCRIPTION:IIPC Research Speaker Series (RSS) focuses on the research use of web archives and features presentations of use cases, collaborative projects and new tools for researchers. This webinar will showcase two open-source tools designed to assist with the building and in-depth exploration of research corpora: PANDORÆ and the Hyphe crawler. A Q&A will follow the presentations.\nBuilding Web Corpora from the Live and Archived Web Using the Hyphe Crawler\nDeveloped by Sciences Po médialab as an open-source software, Hyphe ( https://github.com/medialab/hyphe ) was designed to provide researchers and students with a research-oriented crawler to build and enrich corpora of websites through a qualitative fieldwork methodology. It provides a method and a tool to build a research corpus from web content (web pages and HTTP links) with an innovative “curation­-oriented” step-by-step expansion approach meant to address two of the main social sciences problems when working with automatized web mining: how to build a theme-focused corpus and how to delineate an actor’s presence on the web.\nA step-by-step iterative process supports Hyphe users in dynamically curating and defining “web entities” in a way that is both granular and flexible by choosing single pages, a subdomain, a combination of websites, etc. The pages residing under these entities are then crawled in order to extract the outgoing links and part of the textual contents. The most cited “web entities” can then be prospected manually in order to enrich the corpus before visualizing it in the form of a network and exporting it for cleaning and analysis in other tools such as Gephi.\nIn partnership with the two French web archiving teams, Hyphe was recently adapted to crawl web archives from the National Library of France (BnF) and the Audiovisual National Institute (INA) as well as from archive.org, empowering users to build web corpora from the past or to complete web corpora from the live web with archives of disappeared websites.\n\nSPEAKER:\nTrained as a multidisciplinary engineer, Benjamin Ooghe-Tabanou specialises in applying computer science to scientific research. After multiple experiences within the astrophysics field at Johns Hopkins University in the USA and École Normale Supérieure in France, Benjamin entered the social sciences field first as an OpenData and Parliament transparency activist. He joined Sciences Po’s médialab as a research engineer in 2012, focused on web mining and developing open source tools for social sciences. He has led médialab’s research engineers team since 2020.\nPANDORÆ: A Methodology for Systematic Exploration of Full-Text Indexed Web Archives\nQualitative fieldwork on web archives can easily be daunting due to the profusion of available data. How can researchers make sure their fieldwork reaches a satisfactory “saturation level” through which they can isolate the signal from the noise? PANDORÆ  ( https://github.com/Guillaume-Levrier/PANDORAE )is a free and open-source software designed by and for social scientists to harvest documents from established sources and provides algorithms to normalize, curate, and explore such corpora. \nPANDORÆ has two pipelines that can work independently from the other: one to retrieve data to constitute corpora, and another one to explore document collections. The first pipeline connects to full-text web archive Solr endpoints and builds a corpus by retrieving document metadata in a way consistent with the applicable legal framework. It then normalizes the documents following the CSL-JSON standard and uploads them to a user-managed Zotero library, which serves as a database search and curation software. The second pipeline retrieves curated collections from Zotero and enables their exploration through data-visualization heuristics. These explorations are not only based on the document metadata but also on in-document data (such as a document full-text search and navigating amongst available captures) if and only if the software is being run within an authorized network.\nThis software-led methodology also comes with two online interactive fieldwork notebooks that guide users in exploring their topic. Taken together, the software and the notebooks allow for an exhaustive exploration of a given topic over a preselected period in a full-text indexed web archive collection. The presentation will detail the capacity of PANDORÆ on web archives through the example of research currently underway at the Bibliothèque Nationale de France (BnF).\n\nSPEAKER:\nGuillaume Levrier is a political scientist working on biotechnology. He is also the lead developer of PANDORÆ, a free and open-source software for scientific research. He is currently an associate researcher at Sciences Po (CEVIPOF) and the Bibliothèque Nationale de France (BnF).\n
URL:https://netpreserve.org/event/iipc-rss-webinar-pandorae-and-hyphe/
CATEGORIES:RSS,Webinar
ATTACH;FMTTYPE=image/png:https://netpreserve.org/resources/RSS-webinar-logo.png
END:VEVENT
END:VCALENDAR