- Large ingestion of 4 gig tifs with derivates and preservation checks (10k works) in ~ 1 hour - 5k batch metadata updates ~5 minutes - Round trip spreadsheet update (5k records in 5 minutes) - Preservation dashboard / verification - Local authority creation and updates This presentation will discuss the process, what we learned, and how it relates to the Samvera community at large. and On St. Patrick's Day NU went live with our new digital collection repository and asset management tool prioritizing speed of ingestion and metadata updates. We reframed the problem by working with end-users to look closely at workflows and prioritize solutions rather than any specific technology. The resulting application ecosystem is extremely budget friendly and the architecture supports
Heavily inspired by QA, "Authoritex" is a Hex package for querying any controlled vocabulary or set of authority terms that NUL developed for use within our Elixir ecosystem. We'll go through quick overview of Authoritex and how it fits into our repository ingest application "Meadow" and our broader strategy for handling controlled terms and authorities. The 'Related URL' below links to a video recording of the session. The video has closed captioning. and A lightning talk (seven minute) presentation given at Samvera Connect 2020 On-line described thus
Elixir, Phoenix, React, GraphQL, PostgreSQL, Elasticsearch, Amazon Web Services, Docker and Terraform. This presentation will focus on describing why we chose this path and the decisions and tradeoffs we've made along the way, along with a brief demonstration of our current state. The 'Related URL' below links to beginning of this presentation in the day's YouTube recording., Northwestern University Libraries has been building a "green field" digital repository application since June 2019, code-named "Meadow". Our goal in building Meadow is to provide an internal tool to ingest, modify and publish digital resources to an API that drives our user-facing digital collections frontend. Meadow's development roadmap has focused on complementing NUL's existing production workflows and implementing best practices in digital preservation in a cloud-based environment. Meadow is built with a several languages, tools, and frameworks including, and A presentation given at Samvera Connect 2020 On-line described thus
Keyword:
Architecture, Samvera, Workflow, Connect 2020, Metadata, and Preservation
A presentation given at Samvera Connect 2020 On-line described thus, using a recent major batch update feature as a case study. We’ll explore how our approach allowed us to stay connected to our users and helped keep our development team in sync. Finally, we’ll reflect on what we’ve found most successful in this approach as well as stumbling blocks we encountered along the way. The 'Related URL' below links to beginning of this presentation in the day's YouTube recording., and Over the past year, NUL dev team has implemented and refined a workflow for modular development of repository applications. It starts with addressing a specific user need or problem. Using design-thinking techniques, we next generate visual solutions through rudimentary wire framing, white boarding sessions and architecture discussions. We then move to API design and mocking before starting development with two teams working independently, from the API, outwards. This presentation will demonstrate the iterative approach in action
Keyword:
Workflow, Connect 2020, Samvera, User experience, and API
Forking this Github starter project spins up a webpack React dev environment, along with some tools and commands to bundle your React component to share via NPM. An alternative to Create React App, the project configuration was developed with the aim of exporting and sharing with other React apps in the wild. The video recording of this segment is available at the 'Related URL' below.
A lightning talk at Samvera Virtual Connect 2019 described thus and Avalon Media System is upgrading it's UI component for handling structural metadata editing for an audio or visual work. The user can select and organize timespans in an AV work by manually typing bounding times and titles, or by interacting with a visual representation of the waveform. Technologies used are Peak.js and ReactJS.
Keyword:
Metadata, Lightning talk, Virtual Connect 2019, Avalon, Samvera, and User experience
Northwestern University Libraries is currently running Samvera applications in production. Three of these are developed, maintained, and managed by the Repository & Digital Curation workgroup, * Arch, an Institutional Repository, based on Hyrax 2.4.1 * AVR, Northwestern's audiovisual repository, based on Avalon 6.3 * DONUT, the staff-facing ingest interface for the digital object repository, based on Hyrax 2.4.1 In developing and deploying these applications, we have encountered (and mostly overcome) numerous stumbling blocks relating to performance, scalability, customization, and assumptions about the deployment environment and infrastructure on which the apps will run. While we have found it possible to shoehorn the Samvera stack (as it exists today) into our Amazon Web Services cloud-based deployment environment, we have also started to investigate the rewards and compromises involved in taking a cloud-first approach to our next generation of tools. We have identified several basic tenets for this approach so far, * If AWS offers a native Software-as-a-Service (SaaS) solution for a particular problem, use it (e.g., choose ElasticSearch/Cloud Search over Solr) * Avoid virtual server instances that run 24x7 waiting for requests/work * Do not assume there is a local filesystem to work with * Optimize startup time so that units of work can be spawned and killed as needed * Constantly assess and reassess every unit of work for scalability, repeatability, and idempotence * Keep data portable and code adaptable, but don't over-stress about vendor lock-in In this presentation, members of the Repository Development & Administration Team will present on lessons learned from 7 years of working with Samvera, Avalon, and Hyrax, what the future holds for our next round of in-house development, and the opportunities & compromises our cloud-first approach creates regarding our use of and contributions to the larger Samvera community., and A presentation at Samvera Virtual Connect 2019 described thus
Keyword:
Cloud services, Samvera, and Virtual Connect 2019
Subject:
Samvera Community
Creator:
Klein, Michael B
Contributor:
Quinn, Brendan, Schober, David, Arling, Adam, Shaw, Karen, and Northwestern University
A lightning talk at Samvera Virtual Connect 2018 described thus and Avalon Media System is working towards a release to integrate with Hyrax in support of time-based media formats. This includes creating a Work type to support the needs of audio and video formats and provide an upgrade path for those who have been using Avalon in it’s previous releases as a standalone Samvera product. Join us for a look at the new Audiovisual Work type, specifically how we’re transitioning descriptive metadata from MODS XML to RDF. A video recording of this session is available at the 'Related URL' below.
Keyword:
Avalon, Samvera, Virtual Connect 2018, Lightning talk, Hyrax, and Metadata
Subject:
Avalon Media System and Samvera Community
Creator:
Hardesty, Juliet L and Young, Jennifer
Contributor:
Indiana University, University of Utah, and Northwestern University
A lightning talk at Samvera Virtual Connect 2018 described thus and IIIF Presentation 3.0 pushes beyond only images to support time-based media. This presentation will explain the new possibilities and how the Avalon team is helping to bring those to Hyrax.
Keyword:
Hyrax, Lightning talk, Avalon, Virtual Connect 2018, International Image Interoperability Framework (IIIF), and Samvera
A presentation given at Samvera Connect 2018 described thus, An overview of modern front-end UI component architecture and patterns. Will showcase case studies in development and implementation decisions in Avalon Media System (platform, React/Redux application built on top of Hyrax in AWS). Will make a case for why UI component architecture is important in community-driven, open-source development, how it can directly benefit the Samvera community moving forward. A video recording of this session is available at the 'Related URL' below., and Hyrax/Webpacker/React) and Northwestern University's Digital Collections application (platform
Keyword:
Architecture, Connect 2018, Samvera, and User experience
Over the past two years, Northwestern University Libraries has moved its repository infrastructure and applications to Amazon Web Services. Our initial solution, presented at Samvera Connect 2017, involved AWS CloudFormation, several different deployment platforms, and a lot of manual intervention. In our second phase, we have adopted a fully automated build/configure/deploy system to stand up Fedora, Solr, PostgreSQL, Redis, a Cantaloupe IIIF server, an Avalon Media System instance, a secure CloudFront streaming media distribution, and two Hyrax applications using Terraform, Docker, AWS Elastic Beanstalk, and a whole bunch of homegrown tools and hacks. This presentation will provide an overview of our current system, and hopefully jumpstart some discussions of how these tools can be adopted, standardized, and reused among other members of the Samvera community. A video recording of this session is available at the 'Related URL' below., A presentation given at Samvera Connect 2018, originally titled "My Life in Ops, and Docker, Terraform, AWS, and Learning As We Go", described thus
For the past year, Avalon Media System has worked alongside members of the IIIF Community to co-develop the specifications for IIIF Presentation API version 3. This version moves beyond the two-dimensional image plane to include audio and video within the scope of media which can utilize IIIF to describe and manage content for use and re-use both with Avalon and by any viewer capable of presenting an object with a IIIF manifest. Avalon is excited about the possibilities for incorporating shareable structural metadata, as well as the ability to incorporate metadata along the timeline of time-based media. We will provide an overview of IIIF and the application of IIIF to AV content, including structural metadata and other features derived from the IIIF API. A video recording of this session is available at the 'Related URL' below. and A presentation given at Samvera Connect 2018 described thus
Keyword:
International Image Interoperability Framework (IIIF), Avalon, Connect 2018, and Samvera
Subject:
Avalon Media System and Samvera Community
Creator:
Arling, Adam, Keese, Brian, Whitaker, Maria, and Colvard, Chris
Contributor:
Indiana University, University of Utah, and Northwestern University
A presentation at Samvera Connect 2019 described thus and Northwestern University Libraries (NUL) became a Hydra Partner in early 2012. Over the past 7+ years, we produced bespoke applications locally using the Hydra/Samvera codebase, worked on many iterations of a stand-alone grant-funded Hydra/Samvera product with another Partner institution, contributed effort to the development of Hyrax, implemented Hyrax as a component in a larger repository ecosystem, and shifted our repository services to the cloud. As we have evolved, we have gone through many changes in our local culture, in our user needs, in our codebase, and with our talent. One of the organizational culture changes is the shift of NUL to a learning organization. This change has made us more risk tolerant than in the past. It has allowed NUL to solve its local need of large-scale fast ingestion and description using novel approaches and technologies (Elixir, AWS services, Lambdas, etc). This presentation will discuss how these organizational changes and approaches to technology projects made us privilege the value of Samvera as a community of shared values and ideas over its shared codebase.
Join us for an update on Avalon metadata in Hyrax. The Avalon Media System is an open source system for managing and providing access to collections of digital audio and video. The project is led by the libraries of Indiana University Bloomington and Northwestern University and is funded in part by grants from the Institute of Museum and Library Services and the Andrew W. Mellon Foundation. We are working to incorporate Avalon descriptive, technical, and structural metadata into Hyrax, the open-source repository front end from the Samvera Community, creating an AudiovisualWork that can be added to Hyrax as a gem alongside other work types (like GenericWork and Image). We will share our progress so far, including mappings for bibliographic import functionality and how things look different between Avalon 6 and Avalon in Hyrax. Avalon in Hyrax will also be available as a standalone Hyrax application so we are both letting the Hyrax in and letting the Avalon out! Come see how these two critters are getting along! and A presentation at Samvera Connect 2019 described thus
Keyword:
Hyrax, Metadata, Avalon, Samvera, and Connect 2019
Community and Sustainability", described thus, A presentation at Samvera Connect 2019, originally titled "Avalon Media System, and Over the last two years, the Avalon Media System team at the libraries of Indiana University and Northwestern University has worked toward developing a model of sustainability for a large open source project as part of a grant funded by the Institute of Museum and Library Services (IMLS). As the grant comes to a close, the Avalon team will review the efforts undertaken over the course of the two-year cycle, discussing the challenges faced by the Avalon team, as well as points of success. The Avalon team will reflect upon the experience and how opportunities provided by the grant to take on new technical changes to the system, develop code in partnership, work toward better integration with the the larger Samvera community, and develop a smaller, focused community of Avalon users and stakeholders all pointed us toward how Avalon will proceed in the years going forward. The presentation will focus on our path forward focusing on Avalon on Hyrax, new features in recent releases, additional new features being developed on the current code base, and the challenges of aligning complex projects.
Keyword:
Grants, Avalon, Sustainability, Samvera, and Connect 2019
Subject:
Samvera Community and Avalon Media System
Creator:
Dunn, Jon and Schober, David
Contributor:
Institute of Museum and Library Services, Indiana University, and Northwestern University
A presentation given at Connect 2017 described thus and How can presentation layers in Hyrax applications be extended to fit local needs? This session will showcase two front-end implementations of Hyrax for institutional repositories and discuss design decisions we made for specific use-cases.
Keyword:
Hyrax, Connect 2017, Samvera, and Customization
Subject:
Samvera Community
Creator:
Diaz, Chris, Jaffer, Nabeela, and Arling, Adam
Contributor:
University of Michigan and Northwestern University