<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Export Tools | museum-digital: blog</title>
	<atom:link href="https://blog.museum-digital.org/tag/export-tools/feed/" rel="self" type="application/rss+xml" />
	<link>https://blog.museum-digital.org</link>
	<description>A blog on museum-digital and the broader digitization of museum work.</description>
	<lastBuildDate>Sun, 16 Jun 2024 15:25:38 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	

<image>
	<url>https://blog.museum-digital.org/wp-content/uploads/2020/01/cropped-mdlogo-code-512px-32x32.png</url>
	<title>Export Tools | museum-digital: blog</title>
	<link>https://blog.museum-digital.org</link>
	<width>32</width>
	<height>32</height>
</image> 
<atom:link rel="search" type="application/opensearchdescription+xml" title="Search museum-digital: blog" href="https://blog.museum-digital.org/wp-json/opensearch/1.1/document" />	<item>
		<title>Improved Workflow for Working with Loan Objects using EODEM</title>
		<link>https://blog.museum-digital.org/2023/06/04/improved-workflow-for-working-with-loan-objects-using-eodem/</link>
		
		<dc:creator><![CDATA[Joshua Ramon Enslin]]></dc:creator>
		<pubDate>Sun, 04 Jun 2023 16:22:59 +0000</pubDate>
				<category><![CDATA[Importer]]></category>
		<category><![CDATA[musdb]]></category>
		<category><![CDATA[EODEM]]></category>
		<category><![CDATA[Export Tools]]></category>
		<category><![CDATA[Loan management]]></category>
		<category><![CDATA[New Features]]></category>
		<guid isPermaLink="false">https://blog.museum-digital.org/?p=3749</guid>

					<description><![CDATA[For some months, musdb has supported the upcoming EODEM standard for exchanging object information in the context of loans. The developments were covered extensively in a previous blog post. To summarize, the EODEM standard holds significant potential for saving registrars or colleagues taking over similar tasks in a museum a lot of time by providing <a href="https://blog.museum-digital.org/2023/06/04/improved-workflow-for-working-with-loan-objects-using-eodem/" class="more-link">...</a>]]></description>
										<content:encoded><![CDATA[
<p>For some months, musdb has supported the upcoming EODEM standard for exchanging object information in the context of loans. The developments were covered extensively in a <a href="https://blog.museum-digital.org/2023/02/15/eodem-efficiently-exchange-object-information-during-loans/">previous blog post</a>. To summarize, the EODEM standard holds significant potential for saving registrars or colleagues taking over similar tasks in a museum a lot of time by providing for a seamless interoperability of object information between different collection management systems.</p>



<p>The success and wide-spread adoption of EODEM however obviously still depends on a number of factors. On the one hand, developers and software vendors need to implement EODEM import and export functionality in their collection management systems. On the other hand, this implementation needs to be accessible and simple to use.</p>



<p>musdb, again, has had the first condition covered for some months now. Accessibility &#8211; especially for smaller museums with less tech-savvy staff &#8211; was lacking however. Over the last months, it has improved a lot. It is thus now possible to both export and import EODEM data without having to use specialized software beyond one&#8217;s file manager and browser.</p>



<h2 class="wp-block-heading">Exporting EODEM data</h2>



<p>The exporting of EODEM data for loans has been <a href="https://blog.museum-digital.org/2023/02/15/eodem-efficiently-exchange-object-information-during-loans/">described before</a> and remains as simple as ever. Simply link the objects with the outgoing loan and use the respective export option on the loan editing page of the outgoing loan.</p>



<figure class="wp-block-image size-large"><img fetchpriority="high" decoding="async" width="1024" height="514" src="https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1024x514.webp" alt="Screenshot of the loan editing page. An EODEM export is directly available through the sidebar." class="wp-image-3584" srcset="https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1024x514.webp 1024w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-300x151.webp 300w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1536x771.webp 1536w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-2048x1028.webp 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /><figcaption class="wp-element-caption">The most simple way to export a loan&#8217;s object information in EODEM is by navigating to the loan&#8217;s page and clicking the EODEM export button in the sidebar.</figcaption></figure>



<h2 class="wp-block-heading">The Problem of Flexible Imports</h2>



<p>museum-digital&#8217;s import tool offers a rather wide range of selectable &#8220;parsers&#8221; (essentially the format of data to import) and settings for many of these. It may be used for importing five objects at a time without any linked image files &#8211; or 50000 with remote image files to fetch. While the former import will be finished in seconds, the latter may take hours depending on the speed of the remote image server.</p>



<p>To prevent timeouts and allow users to control the importer to its full flexibility, and to allow for an easy automation, the upload workflow works via a WebDAV mount. Here, the import is configured using a plain text configuration file and the import data can be uploaded into respective folders for metadata and media files. Finally, a script checks every four hours, if there are import data in the respective directory for a museum and imports them in the background. This process works wonderfully for large imports and migrations. It is however anything but accessible for small scale imports.</p>



<p>Since EODEM imports follow a pre-defined standard and have a rather narrow use case, we chose to add a direct upload form for EODEM import data on the loan editing page in musdb. The sidebar of that page now features a new box &#8220;Import EODEM data&#8221;. By clicking on it, an overlay opens, prompting the user to upload their EODEM XML files. The XML files are then uploaded into the usual import directory for the museum and the configuration is automatically written with the common settings for EODEM imports.</p>



<figure class="wp-block-image size-large"><img decoding="async" width="1024" height="1003" src="https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Upload.png-1024x1003.webp" alt="" class="wp-image-3751" srcset="https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Upload.png-1024x1003.webp 1024w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Upload.png-300x294.webp 300w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Upload.png-1536x1504.webp 1536w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Upload.png.webp 1800w" sizes="(max-width: 1024px) 100vw, 1024px" /><figcaption class="wp-element-caption">The sidebar of loan editing pages in musdb now features a new upload box, allowing users to upload EODEM data directly from the web interface.</figcaption></figure>



<p>The upload box in the sidebar is now updated and presents a message detailing the remaining workflow: Wait for some time until the import data has been processed. After the import has been finished, the user receives a mail to the mail address entered for their musdb account.</p>



<figure class="wp-block-image size-large"><img decoding="async" width="1024" height="956" src="https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Uploaded.png-1024x956.webp" alt="" class="wp-image-3752" srcset="https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Uploaded.png-1024x956.webp 1024w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Uploaded.png-300x280.webp 300w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Uploaded.png-1536x1434.webp 1536w, https://blog.museum-digital.org/wp-content/uploads/2023/06/20230602_Screenshot-EODEM-Import-Uploaded.png.webp 1800w" sizes="(max-width: 1024px) 100vw, 1024px" /><figcaption class="wp-element-caption">Once an EODEM file (or files) has been uploaded for importing, a message appears in the upload box, notifying the user to wait until the import has been processed. Once that is done, the user will receive a mail to the mail address they entered for their musdb account.</figcaption></figure>



<p>Looking at the imported object data, one may see a small new feature. The importer automatically determines whether it should update or add new objects by way of the inventory number. If two museums then use the same inventory number schema, this may lead to the loan object information overwriting the data of another object in the museum. To prevent such cases &#8211; rare as they may be &#8211; the ID of the loan is automatically prepended to the loan object&#8217;s inventory number.</p>



<p>EODEM imports can thus now be done directly from the web interface and with minimal worry about data loss. The only caveat may be, that EODEM imports done this way don&#8217;t support the import of object images, as this would have required an additional setting to determine if the images were sent together with the import metadata, are located on a web-accessible server, or if they are simply missing.</p>



<h2 class="wp-block-heading">A Glimpse into the Future</h2>



<p>musdb now covers both conditions &#8211; EODEM imports and exports are not only implemented and usable anymore, but they are hopefully very easy to use now as well. The EODEM working group remains close to a release of the final standard, and other implementations are announced for the upcoming versions of some other collection management systems.</p>



<p>It is likely that testing the EODEM import with real-world data from other systems will require some further adjustments despite all standardization. We&#8217;re looking forward to such cases and more users for the EODEM standard both in terms of vendors supporting it and actual museums profiting from it.</p>
]]></content:encoded>
					
		
		
			</item>
		<item>
		<title>EODEM &#8211; Efficiently Exchange Object Information During Loans</title>
		<link>https://blog.museum-digital.org/2023/02/15/eodem-efficiently-exchange-object-information-during-loans/</link>
		
		<dc:creator><![CDATA[Joshua Ramon Enslin]]></dc:creator>
		<pubDate>Wed, 15 Feb 2023 00:06:37 +0000</pubDate>
				<category><![CDATA[Development]]></category>
		<category><![CDATA[musdb]]></category>
		<category><![CDATA[Collection management]]></category>
		<category><![CDATA[EODEM]]></category>
		<category><![CDATA[Export Tools]]></category>
		<category><![CDATA[Imports]]></category>
		<category><![CDATA[Interoperability]]></category>
		<category><![CDATA[Loan management]]></category>
		<guid isPermaLink="false">https://blog.museum-digital.org/?p=3583</guid>

					<description><![CDATA[musdb now provides import and export tools for the EODEM standard, allowing for the simple exchange of loan object information.]]></description>
										<content:encoded><![CDATA[
<p>It is a classic situation. One museum loans objects to another. Along with the objects, the receiving museum gets an Word or Excel file containing information relevant to the object&#8217;s conservation (e.g. minimum and maximum viable temperature). The museum then proceeds copying and pasting the data into their collection management system. This obviously takes a lot of time and provides for a lot of opportunities to make mistakes.</p>



<p>On the other hand, it&#8217;s a very clearly defined situation, that is repeated again and again in a very similar pattern. Which is to say, it is a perfect subject for automation.</p>



<p>Now, some years ago, a working group came together in the context of CIDOC to do exactly that. Since not all museums use the same collection management system, the necessary first step towards automating the exchange of object information was obviously to develop an open standard for the same, that could be implemented in the different collection management applications.</p>



<p>The standard thus developed &#8211; <a href="https://cidoc.mini.icom.museum/working-groups/documentation-standards/eodem-home/">EODEM</a>, short for <em>Exhibition Object Digital Exchange Model</em> &#8211; is now mature enough to have gone into a public beta release phase. We&#8217;re very, very late to the party, but it was time to try our hands on implementing an import and export for EODEM. The import had already been done by <a href="https://blog.museum-digital.org/2023/01/02/new-features-at-museum-digital-november-2022/">November</a>, but by the time of the larger update and re-design of January, we also managed to release an EODEM export.</p>



<p>This blog post will continue explaining how to import and export EODEM data before closing on a general perspective on the usefulness of EODEM at this point in time and in the foreseeable future.</p>



<h2 class="wp-block-heading" id="how-to-use-eodem-in-musdb">How to Use EODEM in musdb?</h2>



<p>As with loans in general, there are two situations in which one might want to use EODEM. The receiving museum can save a lot of time by importing EODEM data, while the sending museum can help out colleagues by exporting it.</p>



<h3 class="wp-block-heading" id="importing-eodem-data">Importing EODEM data</h3>



<p>In the (German language) <a href="https://de.handbook.museum-digital.info/import/importe-selbst-durchfuehren.html">handbook</a>, one can read a lengthy explanation of how to import object data into musdb (a less extensive description can be <a href="https://blog.museum-digital.org/2022/06/04/imports-can-now-be-triggered-by-users/">found in the blog</a> as well, this time in English). In short: One first needs to generate a password to access the import folder using a WebDAV client. After mounting the folder, one can proceed to upload the data. Finally, a configuration file needs to be written to enable the import tool to identify the format of the import data, a mail address which is to be notified when the import is done etc. As the server checks all museums&#8217; import directories for available import data every four hours, the object information will then be automatically imported after some time.</p>



<p>EODEM was developed as an application profile for LIDO 1.1, meaning that it builds upon and extends the LIDO standard for exchanging object information. As such, we could simply integrate EODEM into our regular LIDO import. Hence, users who want to import EODEM data need to set the &#8220;parser&#8221; setting to &#8220;Lido&#8221; in the configuration file.</p>



<p>Depending on the way a museum forms its inventory numbers, EODEM however may present a problem regular LIDO imports do not. If an inventory number in the sending museum (say, in the import data) equals an inventory number of one of the receiving museum&#8217;s own objects, the importer would interpret the duplicate inventory number so as to update the existing record of the inventory number rather than adding a new one. In response to this problem, we added a new setting available in the LIDO parser: <code>prefix_inventory_numbers</code> . By entering a value (e.g. the reference number of the loan) to this setting, the given value will be prefixed to the imported inventory number so as to prevent collisions and allow importing objects safely.</p>



<h3 class="wp-block-heading" id="exporting-eodem-data">Exporting EODEM data</h3>



<p>EODEM data can be exported from musdb the same way any other XML export can be run. It is now listed as an additional export format in the regular export form. The export form is accessible either through the navigation for exporting the whole collection &#8211; which obviously makes little sense in the case of EODEM &#8211; or on the search results page once at least one search parameter is set. One can thus filter the collection for all objects of a given loan, click the export button in the sidebar, possibly adjust the list of exported fields (e.g. to exclude a field one does not actually want to export, but which is usually covered by the EODEM export). Finally, one will receive a ZIP file containing the EODEM-encoded object information. This ZIP can then be sent to the receiving museum.</p>



<p>To both promote and simplify the exchange of loan object information using EODEM, a shortcut has been added in the sidebar of loan editing pages. Clicking on &#8220;Objects (EODEM)&#8221; in the export section of the sidebar directly takes one to the EODEM export settings page for all objects of the given loan.</p>



<figure class="wp-block-image size-large"><img loading="lazy" decoding="async" width="1024" height="514" src="https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1024x514.webp" alt="" class="wp-image-3584" srcset="https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1024x514.webp 1024w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-300x151.webp 300w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-1536x771.webp 1536w, https://blog.museum-digital.org/wp-content/uploads/2023/02/musdb-loans-export-eodem.png-2048x1028.webp 2048w" sizes="auto, (max-width: 1024px) 100vw, 1024px" /><figcaption class="wp-element-caption">The most simple way to export a loan&#8217;s object information in EODEM is by navigating to the loan&#8217;s page and clicking the EODEM export button in the sidebar.</figcaption></figure>



<h2 class="wp-block-heading" id="in-musdb-and-beyond">In musdb and Beyond</h2>



<p>As stated above, we were very late to the party. EODEM has been in development for some years, but we only started seriously looking into it in late 2022 (all credit for developing EODEM thus goes to others; the working group deserves a lot of thanks!).</p>



<p>On the other hand, it turns out that musdb is the first collection management system to actually feature an EODEM import and export in production. For the time being, exchanging EODEM information thus mainly helps in the case of loans between two museums that both use musdb for collection management.</p>



<p>The working group&#8217;s page however provides a <a href="https://cidoc.mini.icom.museum/working-groups/documentation-standards/eodem-home/eodem-who-is-implementing-eodem/">list of software vendors who plan to implement EODEM imports and / or exports</a>. Many of the big names are already listed there, meaning that a timely implementation of the standard in many of the major collection management systems is almost given.</p>



<p>On the other hand, there are many, many more collection management systems than those ten listed at the time. While EODEM is based on LIDO and thus very simple to implement if a collection management system already features a LIDO import / export, it remains to be seen how many will eventually adopt the it. Hopefully it is many, so that we can improve interoperability and soon enough all save some time when working with loan objects.</p>



<p><em>Image credit: </em>&#8220;<a href="https://nat.museum-digital.de/object/263518">Relief zweier sich die Hände reichenden Männer, Seebronn (?)</a>&#8220;, CC BY-SA @ <a href="https://nat.museum-digital.de/institution/193">Landesmuseum Württemberg</a></p>



<div class="wp-block-cgb-cc-by message-body" style="background-color:white;color:black"><img loading="lazy" decoding="async" src="https://blog.museum-digital.org/wp-content/plugins/creative-commons/includes/images/by.png" alt="CC" width="88" height="31"/><p><span class="cc-cgb-name">This content</span> is licensed under a <a href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license.</a> <span class="cc-cgb-text"></span></p></div>
]]></content:encoded>
					
		
		
		<post-thumbnail><url>https://blog.museum-digital.org/wp-content/uploads/2023/02/2_04121136417.webp</url><width>560</width><height>373</height></post-thumbnail>	</item>
		<item>
		<title>&#8220;List Results&#8221; Tool Improved</title>
		<link>https://blog.museum-digital.org/2020/02/03/list-results-tool-improved/</link>
		
		<dc:creator><![CDATA[Joshua Ramon Enslin]]></dc:creator>
		<pubDate>Mon, 03 Feb 2020 15:26:43 +0000</pubDate>
				<category><![CDATA[Development]]></category>
		<category><![CDATA[musdb]]></category>
		<category><![CDATA["List results"]]></category>
		<category><![CDATA[Export Tools]]></category>
		<category><![CDATA[New Features]]></category>
		<guid isPermaLink="false">https://blog.museum-digital.org/?p=841</guid>

					<description><![CDATA[In response to suggestions of colleagues from Brandenburg, we have removed some restrictions from the &#8220;list results&#8221; function of musdb, which also provides the export option to spreadsheets. Since we were at it already, we improved the performance as well. The main visible new addition to the page is a button for exporting all available <a href="https://blog.museum-digital.org/2020/02/03/list-results-tool-improved/" class="more-link">...</a>]]></description>
										<content:encoded><![CDATA[
<p>In response to suggestions of colleagues from Brandenburg, we have removed some restrictions from the &#8220;list results&#8221; function of musdb, which also provides the export option to spreadsheets. Since we were at it already, we improved the performance as well.</p>



<span id="more-841"></span>



<p>The main visible new addition to the page is a button for exporting all available columns of the page to a spreadsheet. It can be found in the top menu, just to the right of the usual button for exporting all currently selected columns to a spreadsheet.</p>



<p>While implementing the button, we ran into two roadblocks. First, we realized, that thus far it had only been possible to export tables with up to 26 columns (since <a href="https://github.com/PHPOffice/PhpSpreadsheet">PHPSpreadsheet</a>, like Excel, names columns as A-Z, and begins at AA after). We fixed this bug and soon ran into a performance problem. While most of musdb had been optimized strongly for an improved performance in 2018, the &#8220;list results&#8221; function had not. Large selections of objects to list thus came to the limits of resources we allow the script to use. Through optimizations of the run database queries, we fixed this problem as well and made the tool much more performant overall. A nice side effect of these reworked database queries is that the list can now also be properly sorted by actors and places.</p>



<p>Next, we worked on improving the user interface a bit. On the one hand, the selection menus for changing which columns are to be displayed are now shown as table headings in their respective column. On the other, tables with more than 10 columns are now horizontally scrollable.</p>



<p>Finally, we added keywords to the list of object information that can be listed using the &#8220;list results&#8221; tool.</p>



<figure class="wp-block-image size-large"><img loading="lazy" decoding="async" width="1024" height="576" src="https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Improved-2020_2-1024x576.jpg" alt="" class="wp-image-723" srcset="https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Improved-2020_2-1024x576.jpg 1024w, https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Improved-2020_2-300x169.jpg 300w, https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Improved-2020_2-1536x864.jpg 1536w, https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Improved-2020_2.jpg 1920w" sizes="auto, (max-width: 1024px) 100vw, 1024px" /><figcaption>At the top right, the button for exporting all available columns as a spreadsheet can be found.</figcaption></figure>



<div class="wp-block-cgb-cc-by message-body" style="background-color:white;color:black"><img loading="lazy" decoding="async" src="https://blog.museum-digital.org/wp-content/plugins/creative-commons/includes/images/by.png" alt="CC" width="88" height="31"/><p><span class="cc-cgb-name">This content</span> is licensed under a <a href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license.</a> <span class="cc-cgb-text"></span></p></div>
]]></content:encoded>
					
		
		
		<post-thumbnail><url>https://blog.museum-digital.org/wp-content/uploads/2020/02/Listendruck-Beitragsbild.jpg</url><width>600</width><height>338</height></post-thumbnail>	</item>
	</channel>
</rss>
