Team:Michigan Software/Project

From 2014.igem.org

(Difference between revisions)
(→Description)
 
(87 intermediate revisions not shown)
Line 1: Line 1:
{{Template:Michigan_Software/NavBar}}
{{Template:Michigan_Software/NavBar}}
 +
<html>
 +
<FONT FACE="Segoe UI">
 +
<div class="project_describe">
 +
<font size = "3">
 +
</html>
==Description==
==Description==
-
Choosing apt and reliable protocols for new experiments is a problem that productive wet labs routinely face. However, it is difficult to know in detail which protocols will produce the best results. Experimental practices may differ immensely across laboratories, and precise details of these practices may be lost or forgotten as skilled faculty or students leave the lab to pursue other endeavors. These two realities give rise to a vast number of experimental protocols of which many are left with undocumented experiential knowledge. Furthermore, no tool yet exists to allow wet lab investigators to measure and compare the efficacy of protocols before executing them forthright.
+
<html>
 +
<p>
 +
Choosing reliable protocols for new experiments is a problem laboratories routinely face. Experimental practices differ immensely across laboratories, and precise details of these practices may be lost or forgotten as skilled members leave the lab. Such fragmentation in protocol methods and their documentation often hampers scientific progress. Indeed, there are few well-defined protocols that are generally agreed upon by the scientific community, in part due to the lack of a system that measures a protocol’s success. In turn, the lack of commonly accepted protocols and inadequate documentation affects experimental reproducibility through method inconsistencies across laboratories. Review studies even estimate that only 10-25% of published scientific results are reproducible, and up to 54% of materials/antibodies/organisms are not identifiable for reproducibility studies (<a href=https://peerj.com/articles/148/>https://peerj.com/articles/148/</a>). This is an alarming figure and suggests that many of the results we base continued research and development on are inaccurate or cannot be replicated independently.
-
Such fragmentation in protocol methods and their documentation may to some degree hamper scientific progress. From the immense number of protocols currently in use, there are few well-defined protocols that are generally agreed upon by the scientific community, in part due to the lack of a system that can supply a measure of a protocol’s acceptance compared to its variants. In turn, the lack of commonly accepted protocols and their inadequate documentation has the potential to affect experimental reproducibility through method inconsistencies across laboratories and across succession of investigators.
+
</p>
 +
<br>
 +
<center>
 +
<img src = "https://static.igem.org/mediawiki/2014/2/28/Igem_respondents.png" width=300>
 +
<img src = "https://static.igem.org/mediawiki/2014/e/e1/Experience.png" width=300>
 +
<img src = "https://static.igem.org/mediawiki/2014/b/bd/How_often_difficulty.png" width=300>
 +
</center>
 +
</br>
 +
 
 +
 
 +
To attempt to address these problems, we set out to build a database that integrates a crowd-sourced ratings and comments system to clearly document, rate, elaborate, review, and organize variants of experimental protocols in order to increase the likelihood of reproducible scientific results. This would streamline some of the confusion associated with finding and replicating protocols by creating a database where investigators can upload protocols, comment on them, and even use a rating system to allow the best protocols to rise to the top.  Before starting, we designed a survey (<a href="https://static.igem.org/mediawiki/2014/8/80/Survey.pdf">which you can check out here</a>) to poll a range of scientific researchers on their experiences trying new protocols.  We disseminated it across our networks and over social media to judge the interest and usefulness of our project. For those still interested, the survey will be available <a href=https://docs.google.com/forms/d/1vJEm84jVQEYUNZEV-Cv3PR2OOoPbhpVmu5MrFqH4fjY/viewform?usp=send_form>here</a> for people to take at least through the end of 2014.  So far, we've found that among a diverse and experienced set of respondents, every single scientist has struggled with replicating protocols from other experimenters, with >50% of respondents having difficulty more than 25% of the time.
 +
 
 +
<br>
 +
<center>
 +
<img src = "https://static.igem.org/mediawiki/2014/c/c1/Problems.png" width = 300><br>
 +
</center>
 +
 
 +
Additionally, our survey identified that unclear language and missing steps of protocols as the greatest contributors to the irreproducibility of protocols. Furthermore, 100% of respondents indicated they would use a database like this to browse and download protocols, and over 85% indicated they would upload and maintain their own protocols if such a site existed (<a href="https://2014.igem.org/Team:Michigan_Software/Survey">click here for a complete list of results</a>). With these data and interest in hand, we set out to build ProtoCat.
 +
</p>
 +
</br>
 +
</font>
 +
</div>
 +
</html>
-
In order to address these problems, we set out to build a database that integrates a crowdsourced ratings and comments system to clearly document, rate, elaborate, review, and organize variants of experimental protocols. Such a tool serves as a curator for protocol variants and enables wet lab investigators to compare protocol efficacies. Furthermore, the crowdsourced ratings system quantifies a protocol’s acceptance within the scientific community and can serve as a useful criterion to assist with finding and selecting from common protocols. In addition, a protocol comments system provides an avenue through which experiential knowledge can be passed along. As an extension to the protocol database, we will also develop a dynamic calculator that can run user-defined theoretical calculations for any protocol, such as limiting reagent, yield, or even the monetary cost of the materials used. The calculator further assists investigators in comparing and performing protocols. In all, these tools will help wet lab investigators to document, organize, and compare protocols to assist with scientific experimentation.
 
==Aims==
==Aims==
-
[[Team:Michigan Software/Project/Aims]]
+
<font size = "3">
 +
The aims of this project were threefold:  
 +
<ul>
 +
<li> To start an iGEM software team at the University of Michigan and populate it with a diverse population of students. </li>
 +
<li> To construct useful software for laboratory scientists. We designed the protocol database project based on our own and other's frustrations in identifying reliable and effective scientific protocols. </li>
 +
<li> To use our basic project idea to survey a wide range of scientific students and professionals to determine exactly what the best iteration of this project would do and adapt our goals as such. </li>
 +
</ul>
 +
</font>
==Methods==
==Methods==
 +
Our project is based on Django, a free, open-source web framework, written in Python. Django allows us to create a simple, database-driven website which:
 +
 +
• can be hosted on any server (or locally).
 +
 +
• is modular and can be molded to specific individual needs.
 +
 +
• is built on a well-documented , easy to learn framework.
 +
 +
Our web application can be downloaded from Github and easily installed on any computer with Django/Python. Our implementation uses an embedded SQLite database, although a number of databases can be used.
 +
 +
[[File:concept_map.png]]
 +
==Success==
==Success==
 +
- Formed a brand new iGEM team! On top of that, we all learned new languages for this :)
 +
 +
- Reached out to and engaged the scientific community to create awareness for the problem and prioritize the development of a solution.
 +
 +
- Created ProtoCat, a functional registry for laboratory procedures.
 +
==Future Directions==
==Future Directions==
 +
- Variable protocols with integrated calculators: Our next step is to allow users to create calculator functions for specific tasks, and embed them with the protocol.
 +
 +
- vendor information: allow direct linking to reagents, materials, etc. from vendors.
 +
 +
- in-app purchasing: allow users to directly purchase reagents, materials, etc. that are included in the protocol, through third-party vendors.
 +
 +
- protocol timer
 +
 +
-As far as the team goes, we plan to reach out to more people next year; as fun as this smaller group was, we want to ensure that we have a greater variety of skillsets and thought processes to contribute to the best project possible
 +
{{Template:Michigan_Software/Foot}}

Latest revision as of 01:20, 3 August 2015

Michigan Software

Contents

Description

Choosing reliable protocols for new experiments is a problem laboratories routinely face. Experimental practices differ immensely across laboratories, and precise details of these practices may be lost or forgotten as skilled members leave the lab. Such fragmentation in protocol methods and their documentation often hampers scientific progress. Indeed, there are few well-defined protocols that are generally agreed upon by the scientific community, in part due to the lack of a system that measures a protocol’s success. In turn, the lack of commonly accepted protocols and inadequate documentation affects experimental reproducibility through method inconsistencies across laboratories. Review studies even estimate that only 10-25% of published scientific results are reproducible, and up to 54% of materials/antibodies/organisms are not identifiable for reproducibility studies (https://peerj.com/articles/148/). This is an alarming figure and suggests that many of the results we base continued research and development on are inaccurate or cannot be replicated independently.



To attempt to address these problems, we set out to build a database that integrates a crowd-sourced ratings and comments system to clearly document, rate, elaborate, review, and organize variants of experimental protocols in order to increase the likelihood of reproducible scientific results. This would streamline some of the confusion associated with finding and replicating protocols by creating a database where investigators can upload protocols, comment on them, and even use a rating system to allow the best protocols to rise to the top. Before starting, we designed a survey (which you can check out here) to poll a range of scientific researchers on their experiences trying new protocols. We disseminated it across our networks and over social media to judge the interest and usefulness of our project. For those still interested, the survey will be available here for people to take at least through the end of 2014. So far, we've found that among a diverse and experienced set of respondents, every single scientist has struggled with replicating protocols from other experimenters, with >50% of respondents having difficulty more than 25% of the time.

Additionally, our survey identified that unclear language and missing steps of protocols as the greatest contributors to the irreproducibility of protocols. Furthermore, 100% of respondents indicated they would use a database like this to browse and download protocols, and over 85% indicated they would upload and maintain their own protocols if such a site existed (click here for a complete list of results). With these data and interest in hand, we set out to build ProtoCat.


Aims

The aims of this project were threefold:

  • To start an iGEM software team at the University of Michigan and populate it with a diverse population of students.
  • To construct useful software for laboratory scientists. We designed the protocol database project based on our own and other's frustrations in identifying reliable and effective scientific protocols.
  • To use our basic project idea to survey a wide range of scientific students and professionals to determine exactly what the best iteration of this project would do and adapt our goals as such.

Methods

Our project is based on Django, a free, open-source web framework, written in Python. Django allows us to create a simple, database-driven website which:

• can be hosted on any server (or locally).

• is modular and can be molded to specific individual needs.

• is built on a well-documented , easy to learn framework.

Our web application can be downloaded from Github and easily installed on any computer with Django/Python. Our implementation uses an embedded SQLite database, although a number of databases can be used.

Concept map.png

Success

- Formed a brand new iGEM team! On top of that, we all learned new languages for this :)

- Reached out to and engaged the scientific community to create awareness for the problem and prioritize the development of a solution.

- Created ProtoCat, a functional registry for laboratory procedures.

Future Directions

- Variable protocols with integrated calculators: Our next step is to allow users to create calculator functions for specific tasks, and embed them with the protocol.

- vendor information: allow direct linking to reagents, materials, etc. from vendors.

- in-app purchasing: allow users to directly purchase reagents, materials, etc. that are included in the protocol, through third-party vendors.

- protocol timer

-As far as the team goes, we plan to reach out to more people next year; as fun as this smaller group was, we want to ensure that we have a greater variety of skillsets and thought processes to contribute to the best project possible

contact info: igemsoftware-requests@umich.edu.

Retrieved from "http://2014.igem.org/Team:Michigan_Software/Project"