Tracks/Measurement

From 2014.igem.org

(Difference between revisions)
 
(25 intermediate revisions not shown)
Line 22: Line 22:
<h1>iGEM 2014 Measurement New Track</h1>
<h1>iGEM 2014 Measurement New Track</h1>
 +
 +
<h4>***The signup deadline for the Measurement New Track has now been extended to the 25th of July. Please also sign up for the Measurement Interlab Study.***</h4>
<h2><a  class="anchor" id="Introduction"></a>Introduction</h2>
<h2><a  class="anchor" id="Introduction"></a>Introduction</h2>
Line 205: Line 207:
measurement as a focus area (a measurement award has been given since
measurement as a focus area (a measurement award has been given since
2006).&nbsp; This year we are introducing a medal for measurement, and
2006).&nbsp; This year we are introducing a medal for measurement, and
-
splitting the single prior award into two awards.</p>
+
splitting the single prior award into two awards (<i>Best Characterization Project</i> and <i>Best Innovation in Measurement</i>). Details on these new awards can be found <a href="https://2014.igem.org/Tracks/Measurement#Awards">below</a>. </p>
<p>Teams participating in the Measurement Track in 2014 can also earn a
<p>Teams participating in the Measurement Track in 2014 can also earn a
Measurement Prize by taking part in a group measurement project (the <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">Interlab Study</a>), in which each team
Measurement Prize by taking part in a group measurement project (the <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">Interlab Study</a>), in which each team
Line 215: Line 217:
and later shared, which will allow people to see the
and later shared, which will allow people to see the
tradeoffs between different approaches.</p>
tradeoffs between different approaches.</p>
-
<p>Teams will also be able to compete for two Measurement Awards:</p>
+
 
-
<ul>
+
-
<li><span style="font-weight: bold;">Best Characterization Project</span>
+
-
focuses on <span style="font-style: italic;">performing</span>
+
-
measurement.&nbsp; It will be awarded to the team that best gathers
+
-
high-quality data about the behavior of biological devices, such that this data can aid
+
-
future engineering projects.<br>
+
-
</li>
+
-
<li><span style="font-weight: bold;">Best Innovation in Measurement</span>
+
-
focuses on <span style="font-style: italic;">improving</span>
+
-
measurement.&nbsp; It will be awarded to the team that provides the
+
-
best improvement to quality and/or accessibility of measurement
+
-
techniques.<br>
+
</li>
</li>
</ul>
</ul>
 +
<h2><a class="anchor" id="Details"></a>Details</h2>
<h2><a class="anchor" id="Details"></a>Details</h2>
Line 236: Line 227:
<ol>
<ol>
<li>Earning a Measurement Prize: any team may do this, including teams that compete in other tracks</li>
<li>Earning a Measurement Prize: any team may do this, including teams that compete in other tracks</li>
-
<li>Competing for Measurement Track awards listed above</li>
+
<li>Competing for Measurement Track Awards listed below</li>
</ol>
</ol>
Line 242: Line 233:
<p>
<p>
-
In iGEM 2014, the Measurement Track features an interlab study, in which teams around the world will measure the same systems in order to determine the amount of variation and reliability of various properties and approaches to measurement. Any team that participates in the interlab study (details can be found <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">here</a>) will earn a Measurement Prize.
+
In iGEM 2014, the Measurement Track features an <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">Interlab Study</a>, in which teams around the world will measure the same genetic devices in order to determine the amount of variation and reliability of various properties and approaches to measurement. This is not restricted to the Measurement Track teams - any team from any track that participates in the interlab study will earn a Measurement Prize!
</p>
</p>
-
 
<p>
<p>
-
Your team does not have to compete in the Measurement Track to participate: <b>teams in any track can participate in the interlab study and earn a Measurement Prize</b>. All teams that compete in the Measurement Track, however, are required to participate in the interlab study.
+
Your team does not have to compete in the Measurement Track to participate: <b>teams in any track can participate in the interlab study and earn a Measurement Prize</b>. All teams that compete in the Measurement Track, however, are <b>required</b> to participate in the interlab study.
</p>
</p>
-
 
<p>
<p>
-
For iGEM 2014, all teams participating in the measurement track will take part in interlab study across all participating teams. Interlab studies are an important tool for understanding measurement techniques and for establishing community standards. In an interlab study, every participating laboratory attempts to measure the same things. After all of the measurements from all of the laboratories are gathered together, they are compared to see how similar they are. How close the measurements are to one another indicates how much variation there is in materials, protocols, instruments, or the fundamental nature of the subject. Likewise, a lab may discover that it has a problem if its values are very different from most of the others in the study.
+
<i>Any team that participates in the interlab study will receive a Measurement Prize!</i></p>
-
</p>
+
-
 
+
-
<p>
+
-
Here is how to participate and earn a Measurement Prize:
+
-
</p>
+
-
 
+
-
<ol>
+
-
<li>You need to be a registered iGEM team.</li>
+
-
 
+
-
<li>You will build a set of required devices from your iGEM kit and participate in the interlab study. To participate in the interlab study, you will need to make a set of measurements on these required devices.  Details can be found <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">here</a>. <b><i>Prize criterion: collect all required sets of measurements.</i></li>
+
-
<br>
+
-
<li>In science, it is always important to give information about your methods, so that people know how much to trust your results, and also so that they can replicate and build on them. We have provided a "metrology worksheet" as a template to help you think about what information you need to be able to share about how you make your measurements.
+
-
<br><i>Medal criterion: fill out a metrology worksheet for each of the assays you used in measuring the mystery samples.</i></li>
+
-
 
+
-
<li>Nobody can recognize your contributions or build on top of them if they are not shared. Even if your results are not good, it is important to share them, for a number of reasons. First, sharing what doesn't work helps others avoid wasting time rediscovering the same problem. Second, sharing all the results, both good and bad, helps us know whether good results are actually real or just a fluke, as part of <a href="http://en.wikipedia.org/wiki/Systematic_review">systematic reviews</a>.
+
-
 
+
-
<br><i>Medal criterion: upload all of your measurements and the accompanying metrology worksheets to the iGEM interlab measurement site.</i></li>
+
-
</ol>
+
-
 
+
-
<p>
+
-
Any team that participates in the interlab study and fulfills all four criteria will receive a Measurement Prize.</p>
+
<br>
<br>
Line 280: Line 248:
<ol>
<ol>
<li>Register your team, make a wiki page describing your project, and present a poster and talk at the Jamboree</li>
<li>Register your team, make a wiki page describing your project, and present a poster and talk at the Jamboree</li>
-
<li>Qualify by participating in the interlab study and fulfulling all four medal criteria.</li>
+
<li>Qualify by participating in the <a href="https://2014.igem.org/Tracks/Measurement/Interlab_study">interlab study</a>.</li>
</ol>
</ol>
-
<a  class="anchor" id="Requirements"></a><p>Additional details are given on the <a href="https://2014.igem.org/Wiki/Tracks/MeasurementRequirements">measurement track requirements</a> page.</p>
+
<a  class="anchor" id="Requirements"></a><p>Additional details are given on the <a href="https://2014.igem.org/Requirements">General iGEM Requirements</a> and on the <a href="https://2014.igem.org/Requirements#measurement">Measurement Track Requirements</a> pages.</p>
 +
<h2><a class="anchor" id="Awards"></a>Awards</h2>
<p>
<p>
-
There will be two measurement track awards, “Best Characterization Project” and “Best Innovation in Measurement.
+
Along with the overall <b>Measurement Track Award</b>, there will be two other Measurement Track Awards, <i>Best Characterization Project</i> and <i>Best Innovation in Measurement</i>.  
</p>
</p>
Line 315: Line 284:
<p>
<p>
-
(Note that “Best Innovation in Measurement” replaces the prior “Best BioBrick Measurement Approach” award)
+
(Note that <i>Best Innovation in Measurement</i> replaces the prior <i>Best BioBrick Measurement Approach</i> award.)
</p>
</p>
Line 334: Line 303:
</p>
</p>
<p>
<p>
-
<i>All teams who participate in the inter-lab study will be acknowledged at the Giant Jamboree with a special award!</i><br>
+
<i>All teams who participate in the inter-lab study will be acknowledged at the Giant Jamboree with a Measurement Prize!</i><br>
</p>
</p>
<p>
<p>
Line 341: Line 310:
</li>
</li>
</ul>
</ul>
 +
 +
 +
<h2><a class="anchor" id="Medal Criteria"></a>Medal Criteria</h2>
 +
 +
<p>
 +
<b>Bronze. </b>The following 5 goals must be achieved:<br>
 +
<ol id="criterialist">
 +
<li>Team registration.</li>
 +
<li>Complete Judging form.</li>
 +
<li>Team Wiki.</li>
 +
<li>Present a poster and a talk at the iGEM Jamboree.</li>
 +
<li>Participate in the<a href="https://2014.igem.org/Tracks/Measurement/Interlab_study"> Measurement Interlab Study</a></li>
 +
<li>Document at least one new  standard BioBrick Part or Device used in your project/central to your project and submit this part to the iGEM Registry (submissions must adhere to the iGEM Registry guidelines). A new application of and outstanding documentation (quantitative data showing the Part’s/ Device’s function) of a previously existing BioBrick part in the “Experience” section of that BioBrick’s Registry entry also counts. Please note you must submit this new part to the iGEM Parts Registry</li></ol>
 +
</p>
 +
 +
<p>
 +
<b>Silver</b>: In addition to the Bronze Medal requirements, the following 4 goals must be achieved:<br>
 +
<ol id="criterialist">
 +
<li>Experimentally validate that at least one new BioBrick Part or Device of your own design and construction works as expected.</li>
 +
<li>Document the characterization of this part in the “Main Page” section of that Part’s/Device’s Registry entry.</li>
 +
<li>Submit this new part to the iGEM Parts Registry (submissions must adhere to the iGEM Registry guidelines).</li>
 +
<li>iGEM projects involve important questions beyond the bench, for example relating to (but not limited to) ethics, sustainability, social justice, safety, security, or intellectual property rights.  Articulate at least one question encountered by your team, and describe how your team considered the(se) question(s) within your project. Include attributions to all experts and stakeholders consulted.</li>
 +
</ol>
 +
</p>
 +
 +
<p>
 +
<b>Gold</b>: In addition to the Bronze and Silver Medal requirements, any one or more of the following: <br>
 +
<ol id="criterialist">
 +
<li>Demonstrate a substantial improvement over the state of the art in cost, efficiency, precision, resolution, and/or other relevant capabilities of your measurement technique.</li>
 +
<li>Increase the ease of accessibility and portability of methods to other laboratories of a new measurement technique of your choosing.</li>
 +
<li>Help any registered iGEM team from another school or institution  by, for example, characterizing a part, debugging a construct, or modeling or simulating their system.</li>
 +
<li>iGEM projects involve important questions beyond the bench, for example relating to (but not limited to) ethics, sustainability, social justice, safety, security, or intellectual property rights. <b>Describe</b> an approach that your team used to address at least one of these questions. <b>Evaluate</b> your  approach, including whether it allowed you to answer your question(s), how it influenced the team’s scientific project, and how it might be adapted for others to use (within and beyond iGEM). We encourage thoughtful and creative approaches, and those that draw on past Policy & Practice (formerly Human Practices) activities.</li>
 +
</ol>
 +
</p>
 +
<h2><a  class="anchor" id="Committee"></a>Measurement Track Committee</h2>
<h2><a  class="anchor" id="Committee"></a>Measurement Track Committee</h2>

Latest revision as of 23:06, 5 August 2014

iGEM 2014 Measurement New Track

***The signup deadline for the Measurement New Track has now been extended to the 25th of July. Please also sign up for the Measurement Interlab Study.***

Introduction

Precise measurements lie at the foundation of every scientific discipline, including synthetic biology. The limits of our knowledge are set by how well we can connect observations to reproducible quantities that give insight. Measurement is also an act of communication, allowing researchers to make meaningful comparisons between their observations. The science and technology of measurement are easily overlooked, because measuring devices are so familiar to us, but behind even the simplest devices lies an elaborate infrastructure. Consider a laboratory pipette. How accurate are the volumes it dispenses? How similar is it to other pipettes? How do you know? The answers to these questions are a complex story involving everything from the speed to light in vacuum to the atomic properties of cesium.

In synthetic biology, measurement is a critical challenge that is receiving an increasing amount of attention each year. For example, one of the long-standing goals of both iGEM and synthetic biology at large, is to characterize biological parts, so that they can be more easily used for designing new systems. The aim of the iGEM Measurement Track is to get students informed and excited about these problems, and to highlight the successes that teams are able to achieve in the area of measurement. The Measurement Track also aims to find out what measurement assays teams have available and to lay groundwork for future more complex measurement activities in iGEM.

Measurement Challenges in Synthetic Biology

With all the instruments in our laboratories, why isn't measurement a solved problem in synthetic biology?  Part of the problem is knowing what to measure and in what context.  One way to think about the impact of measurements is in terms of four levels, each building upon the last:

  1. Measurement quantifies a phenomenon that has been experimentally observed.
  2. Quantitative measurements may be used to create a model of how the phenomenon was produced.
  3. Models may be applied to predict what quantitative phenomena will be observed in a new context.
  4. Predictions may be used to inform choices about how to engineer towards desired phenomena.

Instruments, by themselves, only address the first level.  In synthetic biology, many models are constructed, often post-facto. Quantitative predictions, however, are still extremely difficult: an important part of the problem is determining how measurement relates to context, so that we can understand what sorts of things a model can be reasonably expected to predict.

Even when we know what we wish to quantify, it may be impractical to obtain with our current instruments.  For example, many quantitative models describe how the concentration of chemicals in a single cell changes over time.  Behaviors often vary greatly from cell to cell, so it is often desirable to collect data from a large number of individual cells.  Most current instruments, however, cannot readily measure this.  Instead we end up having to make tradeoffs like these:


A mass spectrometer can measure the amount of particular chemicals in a sample, but any cell measured is destroyed, it is difficult to obtain measurement from individual cells, and often difficult to interpret the massive pattern of data produced to quantify particular chemicals of interest. 

A flow cytometer can take vast numbers of individual cell measuremements, but the measurements are of a proxy fluorescent protein rather than the actual chemical of interest and the cells may still be disrupted by running them through the instrument.  Unless calibration controls are run with an experiment, the measurements are relative and non-reproducible.

A fluorimeter is less invasive than a flow cytometer and can measure changing fluorescence over time with little impact on the cells, but still uses a fluorescent proxy.  Its measurements are also of the whole sample rather than individual cells, and also relative to the number of cells in the sample.

A microscope can track and quantify fluorescence from individual cells, but not very many of them, and often needs human help on tracking.
Figure 1: No generally available instrument can measure chemical concentrations in large number of single cells over time.

Relative measurements are a major problem, because they cannot be compared.  If you build models of biological devices using different relative measurements, then you cannot combine the models to predict what will happen when you combine the devices.  If units are relative to a batch of samples or to a laboratory, then you cannot reproduce experimental results: even if two experiments produce the same numbers in a new experiment, if the units are relative you cannot tell whether the results are actually the same or whether they have been uniformly shifted (which might be very important!).

Figure 2: Models using different relative units cannot be compared or connected.  How many "Blue" in the output characterized for Repressor #1 are equal to a "Red" in the input characterized for Repressor #2?

Beyond these core scientific concerns, there are pragmatic problems as well. Instruments are also often very expensive to buy and to operate.  This is an especially big problem for DIY groups and researchers in smaller institutions or developing nations.  Cheaper instruments are sometimes available, but usually produce much less accurate or precise data.  Once you've got the data, you also need to be able to share it effectively, so that everybody can benefit from the information that is being learned.  The community will thus likely also need new tools and data exchange standards to allow for simpler and more effective sharing of measurements and models.

The challenges of measurement in synthetic biology are large and broad.  They cover everything from fundamental biological questions to the need for better cheaper instruments and community data sharing.  But because measurement affects so many things, improvements in any of these areas are likely to have a big impact.

Additional Reading on Measurement and Synthetic Biology

Here are some additional resources that may be interesting and can help you learn more about the lay of the land for measurement in synthetic biology:

Readings on Metrology & Calibration
Readings on Device Characterization
Notes on design of interlab studies
Relative Promoter Units
Agilent 101: An Introduction to Bio-Analytical Measurement TASBE protocols for flow cytometry calibration and transcriptional device characterization
NIST/ISAC interlab study on flow cytometer calibration
A BioBrick "datasheet" proposal
(
Current datasheet for BBa_F2620 in the registry)
SpheroTech Calibration Particles
Predicting cascades from transfer curves

Plans for the Measurement Track in 2014

The 2014 event expands on iGEM's long-running inclusion of measurement as a focus area (a measurement award has been given since 2006).  This year we are introducing a medal for measurement, and splitting the single prior award into two awards (Best Characterization Project and Best Innovation in Measurement). Details on these new awards can be found below.

Teams participating in the Measurement Track in 2014 can also earn a Measurement Prize by taking part in a group measurement project (the Interlab Study), in which each team measures the same properties of several known samples.  We will provide some recommendations for experimental and measurement protocols, but teams are encouraged to use whatever approach will provide the most reliable and accurate measurements with the resources available to them.  All of the results will be collected together and later shared, which will allow people to see the tradeoffs between different approaches.

Details

The measurement track offers two separate opportunities for teams:

  1. Earning a Measurement Prize: any team may do this, including teams that compete in other tracks
  2. Competing for Measurement Track Awards listed below

Earning a Measurement Prize:

In iGEM 2014, the Measurement Track features an Interlab Study, in which teams around the world will measure the same genetic devices in order to determine the amount of variation and reliability of various properties and approaches to measurement. This is not restricted to the Measurement Track teams - any team from any track that participates in the interlab study will earn a Measurement Prize!

Your team does not have to compete in the Measurement Track to participate: teams in any track can participate in the interlab study and earn a Measurement Prize. All teams that compete in the Measurement Track, however, are required to participate in the interlab study.

Any team that participates in the interlab study will receive a Measurement Prize!


Competing in the Measurement Track:

To compete for an award in the measurement track, your team must:

  1. Register your team, make a wiki page describing your project, and present a poster and talk at the Jamboree
  2. Qualify by participating in the interlab study.

Additional details are given on the General iGEM Requirements and on the Measurement Track Requirements pages.

Awards

Along with the overall Measurement Track Award, there will be two other Measurement Track Awards, Best Characterization Project and Best Innovation in Measurement.

Best Characterization Project:

Careful measurement of a large library of devices is necessary to build a solid foundation for engineering biological systems. This award goes to the team that most advances this goal, as judged by:

  • Number of devices characterized in reproducible, non-relative units
  • Precision of characterization
  • Replicability of results
  • Ease of accessibility and portability of results to other laboratories
  • Quality of presentation and documentation

Best Innovation in Measurement:

Our ability to characterize the behavior of devices is limited by the assays that are available. Better measurements will be made easier by improvements in how and what we measure, and how we are able to use those measurements. This award goes to the team that best pushes the frontier of measurement capabilities, as judged by:

  • Degree of improvement over the state of the art in cost, efficiency, precision, resolution, and/or other relevant capabilities.
  • Ease of accessibility and portability of methods to other laboratories
  • Quality of presentation and documentation

(Note that Best Innovation in Measurement replaces the prior Best BioBrick Measurement Approach award.)

Requirements

Measurement teams must meet the general iGEM 2014 requirements. In addition, Measurement teams must meet the following track specific requirements:

  • Interlab Measurement Study: Details for the interlab study can be found here.
    All iGEM teams are invited and encouraged to participate in the first international inter-lab measurement study in synthetic biology. We’re hoping this study will get you excited for iGEM and help prepare you for the summer!

    Please note: All Measurement Track teams are required to participate in the inter-lab study.

    All teams who participate in the inter-lab study will be acknowledged at the Giant Jamboree with a Measurement Prize!

    For any questions, contact measurement@igem.org.

Medal Criteria

Bronze. The following 5 goals must be achieved:

  1. Team registration.
  2. Complete Judging form.
  3. Team Wiki.
  4. Present a poster and a talk at the iGEM Jamboree.
  5. Participate in the Measurement Interlab Study
  6. Document at least one new standard BioBrick Part or Device used in your project/central to your project and submit this part to the iGEM Registry (submissions must adhere to the iGEM Registry guidelines). A new application of and outstanding documentation (quantitative data showing the Part’s/ Device’s function) of a previously existing BioBrick part in the “Experience” section of that BioBrick’s Registry entry also counts. Please note you must submit this new part to the iGEM Parts Registry

Silver: In addition to the Bronze Medal requirements, the following 4 goals must be achieved:

  1. Experimentally validate that at least one new BioBrick Part or Device of your own design and construction works as expected.
  2. Document the characterization of this part in the “Main Page” section of that Part’s/Device’s Registry entry.
  3. Submit this new part to the iGEM Parts Registry (submissions must adhere to the iGEM Registry guidelines).
  4. iGEM projects involve important questions beyond the bench, for example relating to (but not limited to) ethics, sustainability, social justice, safety, security, or intellectual property rights. Articulate at least one question encountered by your team, and describe how your team considered the(se) question(s) within your project. Include attributions to all experts and stakeholders consulted.

Gold: In addition to the Bronze and Silver Medal requirements, any one or more of the following:

  1. Demonstrate a substantial improvement over the state of the art in cost, efficiency, precision, resolution, and/or other relevant capabilities of your measurement technique.
  2. Increase the ease of accessibility and portability of methods to other laboratories of a new measurement technique of your choosing.
  3. Help any registered iGEM team from another school or institution by, for example, characterizing a part, debugging a construct, or modeling or simulating their system.
  4. iGEM projects involve important questions beyond the bench, for example relating to (but not limited to) ethics, sustainability, social justice, safety, security, or intellectual property rights. Describe an approach that your team used to address at least one of these questions. Evaluate your approach, including whether it allowed you to answer your question(s), how it influenced the team’s scientific project, and how it might be adapted for others to use (within and beyond iGEM). We encourage thoughtful and creative approaches, and those that draw on past Policy & Practice (formerly Human Practices) activities.

Measurement Track Committee

We have a great committee to help coordinate the Measurement track in 2014.

Contact: measurement@igem.org
  1. Chair: Jacob Beal, Raytheon BBN Technologies
  2. Traci Haddock, Boston University
  3. Jim Hollenhorst, Agilent Technologies