{"id":786,"date":"2021-10-17T20:24:56","date_gmt":"2021-10-17T17:24:56","guid":{"rendered":"https:\/\/users.utu.fi\/taesho\/?page_id=786"},"modified":"2022-06-28T20:41:39","modified_gmt":"2022-06-28T17:41:39","slug":"data-and-scripts","status":"publish","type":"page","link":"https:\/\/users.utu.fi\/taesho\/en\/research\/data-and-scripts\/","title":{"rendered":"Data and scripts"},"content":{"rendered":"<p>I do <strong>not<\/strong> believe in spending years gathering data, then locking it up so no one else can use it. Here&#8217;s an overview of what kind of research data I&#8217;ve gathered and where to get it. Mainly it is Ugandan insect data.<\/p>\n<p>There are also quite a few scripts, most of which won&#8217;t be of any use to other people. But users of the <a href=\"https:\/\/laji.fi\/en\">Finnish Biodiversity Information Facility<\/a> may want to glance at some of the tools.<\/p>\n<h3>FinBif (laji.fi)<\/h3>\n<p>Whenever I pin an insect, it gets a QR code and its own website. You can see all the information on when and where it was collected etc! Take a look at <a href=\"http:\/\/mus.utu.fi\/ZMUT.4920\">http:\/\/mus.utu.fi\/ZMUT.4920<\/a> for an example.<\/p>\n<p>Most of these are <a href=\"https:\/\/laji.fi\/en\/observation\/list?countryId=ML.228&amp;lifeStage=ADULT&amp;teamMemberId=322004&amp;individualCountMax=1\">Ugandan pinned insects<\/a>. Each <a href=\"https:\/\/laji.fi\/en\/observation\/list?target=MX.37602&amp;countryId=ML.228&amp;teamMemberId=322004&amp;includeSubTaxa=false\">Ugandan Malaise sample<\/a> (about 2 dl of insects each) also has a code.<\/p>\n<p>There are also other specimens, such as the <a href=\"https:\/\/laji.fi\/en\/observation\/list?area=Vals%C3%B6rarna&amp;teamMemberId=322004\">insects I collected<\/a> at <a href=\"https:\/\/www.google.com\/maps\/place\/Vals%C3%B6rarna\/@63.4257491,19.9511784,8z\/data=!4m5!3m4!1s0x467d0c6af147a461:0x6e796d70f0d720c7!8m2!3d63.4211756!4d21.0682675\">Vals\u00f6rarna<\/a> in 2021.<\/p>\n<p>All the specimens I&#8217;ve collected (and which have been databased) get updated to <a href=\"https:\/\/bionomia.net\/0000-0002-2256-0098\">Bionomia<\/a>. You can download an overview of these in table format from <a href=\"https:\/\/doi.org\/10.5281\/zenodo.6764739\">Zenodo<\/a>.<\/p>\n<p>Note that most of my insects don&#8217;t show up, because they are not yet databased. FinBif shows the tiny minority that I have finished processing.<\/p>\n<p>If you want the data, you can:<\/p>\n<ol>\n<li>Download it from <a href=\"https:\/\/laji.fi\/en\">laji.fi<\/a>, or<\/li>\n<li>Check what you want from <a href=\"https:\/\/laji.fi\/en\">laji.fi<\/a> (or from <a href=\"https:\/\/bionomia.net\/0000-0002-2256-0098\">Bionomia<\/a> \/ <a href=\"https:\/\/doi.org\/10.5281\/zenodo.6764739\">Zenodo<\/a>), then ask me to send it.<\/li>\n<\/ol>\n<p>I recommend the latter, because I am able to download the data as a ready-to-use Excel or csv file. The laji.fi downloads are not user-friendly yet.<\/p>\n<h3>Zenodo<\/h3>\n<p>Whenever I publish an article, I upload the data to <a href=\"https:\/\/zenodo.org\/\">Zenodo<\/a>. I also upload any scripts used to analyse the data, draw the figures etc.<\/p>\n<p>Most of the uploads are on the <a href=\"https:\/\/zenodo.org\/communities\/uganda2014-2015\/?page=1&amp;size=20\">Ugandan wasps<\/a>. Download these data and scripts and you can repeat any of my articles.<\/p>\n<p>I particularly recommend the background data on our long-term Malaise trapping in <a href=\"https:\/\/doi.org\/10.5281\/zenodo.2225642\">Uganda<\/a> and <a href=\"https:\/\/doi.org\/10.5281\/zenodo.3559053\">Peru<\/a>. What samples did we collect and when? What was the weather like? How many dead trees were there near our traps? Download the datasets and find out! You can even follow my Ugandan GPS tracks or read my research diary.<\/p>\n<p>Some of my older data is in <a href=\"https:\/\/doi.org\/10.6084\/m9.figshare.3172780.v1\">figshare<\/a> instead of Zenodo.<\/p>\n<h3>Other data<\/h3>\n<p>My <a href=\"http:\/\/urn.fi\/URN:NBN:fi-fe2017121155661\">MSc thesis<\/a> data is not (yet) in a permanent repository. You can download the data <a href=\"https:\/\/seafile.utu.fi\/f\/70a2f16bfa11466e98d4\/?raw=1\">here<\/a>. The <a href=\"https:\/\/seafile.utu.fi\/f\/311a9902962246bc87aa\/?raw=1\">raw data<\/a> also includes my field notes. You may find it harder to read than you&#8217;d like.. I&#8217;ve learned quite a bit about data management (and good handwriting) since then.<\/p>\n<p>Then there&#8217;s my Vals\u00f6rarna data. Four prototype insect cameras, which took video of passing-by insects 24\/7 the whole summer of 2021. Great data which could be perfect for figuring out what time of the year or day insects fly! Problem is, I haven&#8217;t found anywhere online which welcomes over 2TB of videos of insects..<\/p>\n<p>Here&#8217;s a sample. Contact me if you want to use these, we&#8217;ll figure something out! I&#8217;ll be publishing an article on this soon, but that will focus on the method instead of the data.<\/p>\n<div class=\"ast-oembed-container \" style=\"height: 100%;\"><iframe loading=\"lazy\" title=\"Vals\u00f6rarna insektkamera (1\/2)(3 2021-07-30 17:16:37 UTC+00)\" width=\"500\" height=\"375\" src=\"https:\/\/www.youtube.com\/embed\/U7pv8ZyFk0U?start=514&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<h3>GitHub<\/h3>\n<p>The scripts I&#8217;ve used to analyse the data for an article go in Zenodo. But there are lots of other tasks I prefer to ask my computer to do, instead of doing them myself.<\/p>\n<p><a href=\"https:\/\/github.com\/tapani-hopkins\/\">GitHub<\/a> has a selection of scripts for handling FinBif data, automatically creating an identification key etc. Not all of them are usable, mind you..<\/p>\n<p>The one truly usable script will analyse the data of our long-term Malaise trapping in Uganda and Peru. Take the wasp data of a subfamily, and the computer will clean it up, draw figures showing when and where the wasps flew.. basically do everything that&#8217;s needed to publish a paper like <a href=\"https:\/\/doi.org\/10.1098\/rsos.190913\">https:\/\/doi.org\/10.1098\/rsos.190913<\/a>. I&#8217;ll link to it when I&#8217;ve got a version that is user-friendly enough to upload.<\/p>\n<p>The scripts are in R or Python. Skilled programmers be warned: I am mostly <a href=\"https:\/\/xkcd.com\/1513\/\">self-taught<\/a>. This shows in my early scripts!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I do not believe in spending years gathering data, then locking it up so no one else can use it. Here&#8217;s an overview of what kind of research data I&#8217;ve gathered and where to get it. Mainly it is Ugandan insect data. There are also quite a few scripts, most of which won&#8217;t be of [&hellip;]<\/p>\n","protected":false},"author":6396,"featured_media":0,"parent":630,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-786","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/pages\/786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/users\/6396"}],"replies":[{"embeddable":true,"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/comments?post=786"}],"version-history":[{"count":8,"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/pages\/786\/revisions"}],"predecessor-version":[{"id":1614,"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/pages\/786\/revisions\/1614"}],"up":[{"embeddable":true,"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/pages\/630"}],"wp:attachment":[{"href":"https:\/\/users.utu.fi\/taesho\/wp-json\/wp\/v2\/media?parent=786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}