1 - 7 of 7
Search Results
2. Making TACOs for Hydras
- Description:
- A recording of a presentation at Samvera Connect 2018 described thus, prototyping a core component of our new architecture to be horizontally scalable, designing a new architecture for our digital library with a wide ranging set of requirements and users, Stanford University Library has a robust digital library system called the Stanford Digital Repository. This repository holds a little under 500 TB of materials in preservation, and a little less than that for online access, from our cultural heritage digitization efforts and institutional repository outputs. These materials are managed across 90+ codebases serving a variety of functions from self-deposit web applications, to a nearly 10 year old parallel processing framework, to a digital repository assets publication mechanism leading into our Blacklight, Spotlight, and Geoblacklight applications - among other services and needs. At the core of this system is a Fedora 3 store. With Fedora 3 now end-of-lifed, and our system suffering from limited to no horizontal scalability options, we’re revisiting our system and architecture. We are writing it from the start with a goal to have data-forward, distributed microservices and some event-driven processing components. TACO, our new core management API, is the heart of this new architecture, and is currently being developed as a prototype. This talk will walk through the process of analysing our current system via a dataflows analysis, then planning how to create ‘seams’ in our current system to migrate towards our new system in an evolutionary fashion instead of a turn-key migration. A video recording of this session is available at the 'Related URL' below., and seeing where community technologies like Hyrax, Blacklight, and IIIF will connect
- Keyword:
- Workflow, Architecture, Repository, Connect 2018, and Samvera
- Subject:
- Samvera Community
- Creator:
- Frost, Hannah and Harlow, Christina
- Contributor:
- Stanford University Libraries and University of Utah
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 10/2018
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Video
3. Deployment with Elastic Container Service
- Description:
- At Stanford libraries we've run hundreds of virtual machines to support dozens of applications. We've found the cost and complexity of patching and maintaining these machines to be untenable. We believe that a serverless infrastructure is our future and so we are using AWS Fargate (Elastic Container Services) and Lambda architecture to reduce our maintenance burden. We will explain the AWS offerings in this space, explain how we can set up a simple distributed system, and point out pitfalls that we've experienced. and A video recording of a presentation at Samvera Connect 2018 described thus
- Keyword:
- Deployment, Connect 2018, and Samvera
- Subject:
- Samvera Community
- Creator:
- Coyne, Justin
- Contributor:
- Stanford University Libraries and University of Utah
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 10/2018
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Video
4. Get A-head on your Repository
- Description:
- A webinar given by Tom Cramer for the DuraSpace 'Hot Topics' series in 2012. A recording of the webinar is available by following the 'Related URL' link below.
- Keyword:
- Webinar, Hydra, and Repository
- Subject:
- Hydra Project
- Creator:
- Cramer, Tom
- Contributor:
- Stanford University Libraries and DuraSpace
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 09/25/2012
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Presentation
5. Box Set: Implementing Admin Sets in Hydra-in-a-Box
- Description:
- A poster presented at Hydra Connect 2016.
- Keyword:
- Connect 2016, Hydra in a Box, and Hydra
- Subject:
- Hydra Project
- Creator:
- Frost, Hannah, Giarlo, Michael J, and Geisler, Gary
- Contributor:
- Stanford University Libraries
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 10/04/2016
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Poster
6. Sustaining a Large-Scale Repository Architecture: Behind the Scenes of the Stanford Digital Repository
- Description:
- In 2006, Stanford Libraries built the Stanford Digital Repository (SDR). The system has served us well—thirteen years later, SDR contains over 2.0 million objects (~500 terabytes of content). We built SDR using open-source software (including Samvera, Fedora, and Blacklight) and an additional ~300,000 lines of custom code. We believe it is among the largest and most complex repository systems in research libraries, and yet the challenges we face are common. We have grown SDR to a point where it is extremely difficult for us to sustain. Some of our foundational technologies are not only aging but are beyond end-of-life. Meanwhile, we are challenged to continue offering a valuable, performant, highly-available repository service to our stakeholders. Over the past two years, we have analyzed the factors complicating sustainability, that work has led to operational changes that improve the current state and a plan for sustaining repository development combining open-source and custom software. Our presentation highlights the reasons SDR became unsustainable and shares areas where we have made improvements and where we go next. We believe the lessons we have learned are widely applicable to institutions that develop their own repository solutions., and A presentation at Samvera Connect 2019 described thus
- Keyword:
- Architecture, Repository, Sustainability, Samvera, and Connect 2019
- Subject:
- Samvera Community
- Creator:
- Coyne, Justin and Giarlo, Michael J
- Contributor:
- Stanford University Libraries
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 10/24/2019
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Presentation
7. Integrating Digitization Workflow with the Stanford Digital Repository
- Description:
- A poster presented at Samvera Connect 2019.
- Keyword:
- Workflow, Repository, Digitization, Samvera, and Connect 2019
- Subject:
- Samvera Community
- Creator:
- Frost, Hannah and Mangiafico, Peter
- Contributor:
- Stanford University Libraries
- Owner:
- rob@scientist.com
- Language:
- English
- Date Modified:
- 07/24/2023
- Date Created:
- 10/23/2019
- Rights Statement Tesim:
- In Copyright
- License Tesim:
- Creative Commons BY Attribution 4.0 International
- Resource Type:
- Poster