Reading Overnight Export Logs

Owned by Wiedeman, Gregory
Jun 18, 2019
2 min read

 

Something didn't update as I expected it to, what happened?

  • Logs are here: \\romeo\SPE\indexing-logs

  • Use Notepad++ or another text editor that reads the line breaks correctly, not Notepad

Collections did not update in ArcLight

  1. Did it Export from ArchivesSpace?

    1. Check the end of \\romeo\SPE\indexing-logs\export.log

    2. Example Log.

      1. 2019-05-13 13:24:01.930813 Exporting Records from ArchivesSpace Connecting to ArchivesSpace Checking for collections updated since 2019-05-13 17:22:18 Querying ArchivesSpace... Found 2 new records! ArchivesSpace URIs: [644, 401] Skipping Office of Student Involvement Records because it is unpublished Exporting Office of the President Records (ua000) Exporting EAD Success! Exporting PDF Success! Commiting changes to Github... Writing static data back to files. Calling script to generate static pages... Static browse pages generate successfully! Finished! Last Export time is 2019-05-13 17:24:02

         

    3. Here the Office of the President exported to EAD and PDF, but the Office of Student Involvement did not.

    4. Logs will also show if certain notes (like a scope note, creator, etc.) are missing


  2. Did it download to the server?

    1. Check the end of \\romeo\SPE\indexing-logs\git.log

    2. Sun May 12 04:00:01 EDT 2019 git pull Already up-to-date. Mon May 13 04:00:01 EDT 2019 git pull Already up-to-date. Tue May 14 04:00:02 EDT 2019 git pull From https://github.com/UAlbanyArchives/collections 05b1da7..fc92e84 master -> origin/master Updating 05b1da7..fc92e84 Fast-forward ua/ua000.xml | 22 +++++++++++----------- ua/ua685.xml | 4 ++-- 2 files changed, 13 insertions(+), 13 deletions(-)

    3. Here, nothing was downloaded on Sunday and Monday, but two collections were updated on Tuesday May 14th.


  3. Did it index into ArcLight?

    1. Check the end of \\romeo\SPE\indexing-logs\index.log

    2. Mon May 13 04:05:01 EDT 2019 Export apap Mon May 13 04:15:02 EDT 2019 Export ua Mon May 13 04:25:02 EDT 2019 Export ndpa Mon May 13 04:35:01 EDT 2019 Export ger Mon May 13 04:45:02 EDT 2019 Export mss Tue May 14 04:05:02 EDT 2019 Export apap /var/www/arclight-UAlbany/lib/arclight/repository.rb:10: warning: already initialized constant Arclight::Repository::FIELDS /usr/local/rvm/gems/ruby-2.4.1@arclight/bundler/gems/arclight-a1ec06251b5a/lib/arclight/repository.rb:10: warning: previous definition of FIELDS was here Loading /opt/lib/collections/apap/apap127.xml into index... Indexed /opt/lib/collections/apap/apap127.xml (in 153.782 secs). /var/www/arclight-UAlbany/lib/arclight/repository.rb:10: warning: already initialized constant Arclight::Repository::FIELDS /usr/local/rvm/gems/ruby-2.4.1@arclight/bundler/gems/arclight-a1ec06251b5a/lib/arclight/repository.rb:10: warning: previous definition of FIELDS was here Loading /opt/lib/collections/apap/apap150.xml into index... Indexed /opt/lib/collections/apap/apap150.xml (in 23.046 secs). /var/www/arclight-UAlbany/lib/arclight/repository.rb:10: warning: already initialized constant Arclight::Repository::FIELDS /usr/local/rvm/gems/ruby-2.4.1@arclight/bundler/gems/arclight-a1ec06251b5a/lib/arclight/repository.rb:10: warning: previous definition of FIELDS was here Loading /opt/lib/collections/apap/apap027.xml into index... Indexed /opt/lib/collections/apap/apap027.xml (in 35.02 secs). Tue May 14 04:15:02 EDT 2019 Export ua

    3. Here, it check each collecting area on Monday, but did not index anything. On Tuesday, apap127, apap150 and apap027 were all indexed successfully.

A Hyrax Digital Object does not show as having Online Content in ArcLight

  1. Check the end of \\romeo\SPE\indexing-logs\processNewUploads.log

  2. 2019-05-13 22:00:09.420742 Checking for New Hyrax Objects Checking for object created since 2019-05-13T02:00:10Z Read Config Data Logged in to Hyrax Found 2 new objects Object 1 of 2 is still under review. Building AIP for ua685_n2VDky4bv3Fpv79qaJGMv3 Reading https://archives.albany.edu/concern/daos/sx61dv08v?format=json Object 2 of 2 Downloading https://archives.albany.edu/downloads/70795g37m Adding New Digital object to http://libstaff/find-it#49468f1e555f023258e3019572f95702 New Digital Object /repositories/2/digital_objects/26730 --> 200 Attached Instance --> 200 200 --> Updated Resource for Export: /repositories/2/resources/635 Writing checksums... AIP Saved!

    3. In this example, 2 new objects were detected.

    1. Object one is still under review and not yet approved.

    2. https://archives.albany.edu/concern/daos/sx61dv08v was updated in ArchivesSpace

Related articles