Variance in multiplex suspension array assays: microsphere size variation impact
© Hanley et al; licensee BioMed Central Ltd. 2007
Received: 15 October 2006
Accepted: 23 August 2007
Published: 23 August 2007
Luminex suspension microarray assays are in widespread use. There are issues of variability of assay readings using this technology.
Methods and results
Size variation is demonstrated by transmission electron microscopy. Size variations of microspheres are shown to occur in stepwise increments. A strong correspondence between microsphere size distribution and distribution of fluorescent events from assays is shown. An estimate is made of contribution of microsphere size variation to assay variance.
A probable significant cause of variance in suspended microsphere assay results is variation in microsphere diameter. This can potentially be addressed by changes in the manufacturing process. Provision to users of mean size, median size, skew, the number of standard deviations that half the size range represents (sigma multiple), and standard deviation is recommended. Establishing a higher sigma multiple for microsphere production is likely to deliver a significant improvement in precision of raw instrument readings. Further research is recommended on the molecular architecture of microsphere coatings.
A suspended microarray assay system uses small particles such as microrods or microspheres that contain some method for identifying a set, often termed a classifier. Classifiers are often 2 (or 3 in the cased of the new Luminex 3-D system) fluorophores dedicated to the task of identifying a particle set, but may be transponders or some other method. An assay used to detect an analyte is bound to the surface of a set of identically classified particles, which are generally in the size range 3–15 microns. These particles are added to a liquid containing the analyte. (In systems such as "smart dust", the assay may be distributed in the field to detect analytes and read differently.) The final step in the assay activates a reporter fluorophore that provides a signal. In systems using fluorophores for classification, the reporter fluorophore is distinct, and will have a significant frequency difference from the classification fluorophores. The particles are run through a flow cytometer, which is generally optimized for the specific system used. For each particle in the mixture, the cytometer identifies the classifier together with the fluorescence reading of the reporter fluorophore. Because the particle classifiers are unique for each analyte, it is possible to multiplex the assays together in a test tube. Additionally, multi-well assay plates can be used, and such assays then become a high throughput system.
In the Luminex system analyzed here, fluid with a sample of microspheres flows up through a probe, which has a tip with 5 very fine holes leading to a single channel at the top. The fluid travels through a system of tubing and valves into the flow cell, where (in the current equipment) two lasers are present. One laser stimulates the two marker fluorophores, and the other stimulates the reporter fluorophore. A system of avalanche photodiodes and photomultiplier tube captures and reads the fluorescence from marker and reporter emissions.
Samples of uncoated microspheres were vortexed, pipetted on to copper grids (Electron Microscopy Sciences, Hatfield, PA) which were carbon coated in the lab prior to use. Images were made by transmission electron microscopy (TEM) using a JEM-1230 (JEOL Ltd. Tokyo, Japan). In total, 23 images with 194 microspheres were obtained. No staining was used since solid polystyrene spheres of 5 microns or larger have high contrast in vacuum. Microspheres were measured on one axis using Adobe Photoshop 5.5 measurement tool. Numbers were overtyped on each measured microsphere using Photoshop. In these TIFF images, 342 pixels = 20 micron. 1 micron = 14.7 pixels. Pixel measurement error, ±1 pixel. Estimated measurement accuracy, ±0.07 micron.
Archival data used for calculation of mean brightness of high fluorescence signal control microspheres. All data is from one instrument to eliminate any inter-instrument calibration issues.
Weighted average of ratios
Heuristics based estimate of probable microsphere size variance
Luminex supplied a specification for the microspheres of a diameter of 5.4–5.8 microns with a mean of 5.6 n. This is a range of 0.4 microns. The specification was used as a guide to the possible range of diameters for this heuristics based calculation. The specification lacks a sigma multiple.
In manufacturing, a standard high level target for tolerances (acceptable variation in measurement for a dimension of a part) is that 6σ (six-sigma) is inside the tolerance . (In this context, σ and s are generally used interchangeably to mean standard deviation.) A 6σ specification means that 1 in 108 items will fall outside of the specified tolerance. (Motorola defines 'six-sigma' for such processes as ≈±4.5 σ, because they assume manufacturing process mean drift of 1.5 σ between machine adjustments.) Six-sigma is used here as a 'best case' that can reasonably be expected for the standard deviation in microsphere sizes. Since a normal distribution is two-tailed from its center, one σ in a direction is 1/12 of the specified full tolerance range of 0.4 microns. Six-sigma is considered the modern target for manufacturing of electronics and precision parts. However, some industrial processes are run at higher than six-sigma.
Using 6σ as the target, the supplied range of 0.4 microns/12 = 0.033 microns as the standard deviation if 6σ were the specification. This establishes a reasonable low boundary for a heuristic estimate.
Similarly, in older school manufacturing (which is still used for certain types of parts) good practice for tolerances is to hold ±3σ (3 sigma). This means that roughly three items per 1,000 will be out of tolerance specification. Using 3σ as the tolerance, it would be expected that the σ on microsphere size is 0.4 microns/6 = 0.066 microns as the standard deviation. This will be the middle of our heuristic range estimate.
Less controlled manufacturing processes have higher reject rates, in the order of 1% to 40% failure to hold tolerance. They will hold somewhere around 1 to 2 σ of manufactured product within a specified tolerance due to intrinsic or extrinsic factors. Thus, 2σ was used as the high boundary. This corresponds to 5% failure to hold tolerance. Thus, using 2σ as the specification, 0.4 microns/4 = 0.1 micron as the standard deviation. This is the high estimate.
Low σ estimate = 0.033 micron
Middle σ estimate = 0.066 micron
High σ estimate = 0.01 micron
Estimate of size based on fluorescent intensity
This experimentally-based estimate first examined the probability that individual microspheres vary significantly in brightness because of random variation in the number of antigens or antibodies bound per microsphere. However, since the sample size (i.e. antigen or antibodies bound) per microsphere is on the order of 105 to 107 , differences in percentage of analyte bound to microspheres as a source of variance should be approximately zero. In cases with very large antigens, the density on the surface of the microspheres may be lower. However, in such cases (e.g. viral particles), multiple antibody binding sites are likely to be available per antigen surface.
An experimentally-based estimate of the standard deviation of microsphere size was developed and termed "combined virtual". This means that the microsphere size variation derived takes all sources of variation into account. The true variation in size may be less depending on what proportion of it is based on microsphere size, and what proportion on electronic/optical system noise. Using the average for the brightest high value control set (Table 1) allows a simple proportion to be established:
F = maximum fluorescent intensity
σ F = standard deviation of maximum fluorescent intensity
B = microsphere surface area
The data for this proportion were a set of values taken from archived Luminex assays. All assays had a high value biotin control microsphere (which serves as a fully occupied, therefore high fluorescent signal, assay) as hown in Table 1.
Table 1 was developed to fill in the equation for calculating the standard deviation in microsphere diameter for Luminex microspheres. It represents 231 well readings, obtaining = 7.40. From the Luminex specification diameter = 5.6 microns, so B = 4π r2 = 4π(5.6/2)2 = 98.52 square microns. Substituting these values into equation 2 gives:σ B = 98.52/7.40 = 13.31 square microns
Thus, the standard deviation of microsphere area corresponds to a sphere of 13.31 microns in area. Such a sphere has a diameter of = 2.06 microns.
By this experimentally-derived method, the microsphere combined virtual size standard deviation (i.e from all sources) ≈ 2.06 microns. This combined estimate of microsphere size σ should be considerably larger than the true microsphere size variation, since no correction has been made for any other sources of variance. This estimate falls far outside the heuristics based estimate of the previous subsection.
Transmission electron microscopy based size estimate
The first author's manufacturing experience and instructional literature on quality control  indicate that the true mean for any manufactured part varies from lot to lot, between machines used for manufacturing; so does the standard deviation. In addition, preliminary indications from TEM (data not shown) suggested that coated microspheres that have been frozen and thawed repeatedly may show greater variance than uncoated microspheres from this sample.
Microspheres measured by TEM had a mean diameter at or above the published mean of 5.6. That the microspheres mean diameter of 6.14 microns was different from the published specification of 5.6 microns is not inherently a problem. If true mean diameter of microspheres, standard deviation and skew were published by lot, then algorithms could correct them relative to each other. Additionally, where standard curves are used to determine concentrations, true microsphere diameter is automatically adjusted for. Where mean diameter becomes a concern is when assays are used with cutoff values, for example to make a diagnosis. However, size variation will always impact precision.
Optimal trimming of data could be based on distribution characteristics
Examining microsphere size distribution again (Figure 2), the primary distribution is seen to occur between 5 and 7 microns. Trimming the high end skew above 7 microns removes approximately 5% of the data points in this sample (10 microspheres). This optimized trimming of data results in a standard deviation of 0.18 microns, a significant improvement over 0.66 microns. The improvement in variance is = 13.45 times.
Such an improvement in variance is probably within reach of an improved algorithm that uses as its input the true size distribution of the microspheres being read. Such a distribution could be developed by quality control sampling of microsphere size, which could be automated. This proposal's relationship to trimmed values is unknown.
How much of the variance in fluorescent intensity is probably due to the microspheres?
The ratio of the standard deviation of microsphere size distribution over the standard deviation of luminance 'combined virtual' is = 0.32. By this measure, roughly 32% of the difference seen in fluorescent intensity readings could be due to variation in microsphere size. Using the formal definition of variance, = 0.10 or 10% of variance probably due to size. Note that total variance (where variance is denoted by V) is composed of:V Microsphere size + V Opto-electronic + V Bench + V Other
Thus, by this estimate, the remaining 68 – 90% of variance is composed of all other sources, with opto-electronic system variance being one component of this remainder. Other experiments (not shown) suggest that bench variance is a quite significant source. Taken together, this suggests that microsphere size is a reasonable target for improvement of assay precision.
Probability of selecting N microspheres significantly outside the mean size
We now discuss a model for the probability of drawing a number of microspheres, N, from a well, all of which are above (or by extension, below) the mean diameter of spheres specified in Luminex literature at 5.6 microns using 5.4 – 5.8 microns as the range.
Relationship of size to brightness
If the entire microsphere sample is above the value given, it will present a distribution of microspheres displaying a higher fluorescent intensity for the same sample. This fluorescent range will be variable, and may be skewed. However, for the sake of simplicity, the center of the distribution will be assumed to be at least 1.3 × σ microns above the value shown. This must be assumed because if all of the microspheres in the sample are above the size specified, the sample will still have a normal distribution of sizes with a mean higher than that of the smallest microsphere. The assumption that the mean of the sample is only 1.3 standard deviations from the edge of its distribution is quite conservative; it can easily be higher.
As an example, a relatively common occurrence for a 100 microsphere count sample is an approximately 22% probability that all microspheres are larger than 5.65 microns (Figure 4). (And by extension, in a balanced normal distribution, 22% are smaller than 5.0 microns.) This would be a microsphere set centered at 5.65 ± (~1.3 × 0.66) microns, or 5.0 – 6.25 microns. (0.66 is the standard deviation from the TEM results.) Using the proposed model, a sample centered exactly on 5.6 microns would have a fluorescent intensity ratio of 1.0 (figure 5), while a sample at 6.26 microns mean diameter would have fluorescent intensity ratio of 1.26 to the nominal mean value, an increase of 26% in fluorescent intensity for the specific microsphere set for the well. Similarly, the same probability exists that all diameters in the sample are or 26% lower. This indicates that roughly 50% (i.e. ≈27% × 2) of results would occupy a range of 26% higher or lower than they should be, from one well to the next.
Comparison of worked example with results
When averaged over an entire plate of 96 wells with a 25-plex assay in each well (data not shown), the mean high side variation from the mean was +59%. The mean low side variation is -56% from the sample mean. These figures were derived from trimmed mean data. This indicates, as expected, that the total summation of variation has an upper and lower bound greater and lower, respectively than the variation in the preceding proposed model (±26%). This is in reasonable agreement with the example workup in relationship of size to brightness above.
Microsphere sizes in TEM data display an exponential regression for outlier sizing
The overall conclusion is that a probable significant cause of variance in suspended microsphere assay results is the variation in microsphere diameter. Lowering the standard deviation of microsphere size and improving the sigma multiple for lot quality control appears likely to be an area for improvement. Doing so will lower the amount of stochastic variance of this type of assay system, and improve the precision of these assays. Provision of accurate mean size, median size, skew and sigma multiple for the size range would be useful to users. Additionally, there is a need for more research into the details of the microparticles used in suspended microarray assay systems, how surfaces are coated and the molecular architecture resulting from various coating protocols.
Approximate density of antibody per microsphere
It was decided to provide this workup as an appendix because there is no other published estimate of binding sites that describes how the estimate was done.
According to Luminex, carboxylation sites are present on the polystyrene molecules prior to forming the microspheres . Consequently, an overabundance and even distribution of binding sites should be expected.
At its base, each antibody (Ab) is 52 angstroms in diameter, 150 angstroms at the top and 160 angstroms long.
160 angstroms = 0.016 microns, i.e. 0.006 of the radius of a microsphere.
50 angstroms is 0.005 microns. A circle 160 angstroms in diameter is assigned as the region on the surface of a microsphere for each attachment. This seems a reasonable value for now, since the length of each Ab is such a tiny percentage of the radius of the sphere. There will be no significant difference in size on the surface from the base to the ends of the Y in the antibody in terms of the radian angle needed. It is set to 160 to give 5 angstroms minimum clearance on a side.
Surface area of a sphere is 4π r2 which for the Luminex microspheres ~4π * 2.82 = 98.52 microns2. 1 micron = 105 angstroms. 1 micron2 = 1010 angstroms2.
This Ab circle occupies an area of π r2 for the Ab. That is π 0.0082 = 0.00020106 microns2. Adding the size of the triangular section required to tile the surface, this becomes 0.000222 microns298.52 microns2/2.22 10-4 = 4.4438 × 105
Maximum probable number of Ab per microsphere ~ 4.8 × 10 5 .
However, if one assumes that the Abs can crowd somewhat, by removing the triangular section, a larger number of roughly 4.8 × 107 is obtained. This larger number is quite reasonable since the geometry of antibodies allows it.
±2 to 4 orders of magnitude isabout as good as can be expected by this method given the unknowns.
Maximum total is roughly 4.8 × 10 5 /6.02 × 10 23 = 7.37 × 10 -19 moles of detection per microsphere.
A figure supplied by Luminex is 6.7 × 105 binding sites per microsphere. In discussion with Luminex chief of R&D, the methods used are roughly equivalent to those used in this appendix, and shows good agreement.
The Luciw lab is thanked for providing sample microspheres. David Gardner is thanked for coordination between laboratories relative to the transmission electron microscopy work. Elizabeth Reay is thanked for editing. This work was supported by BW Education and Forensics of Cheyenne, Wyoming, and KonnectWorld, Inc. of Davis, California.
- Pyzdek T: The Six Sigma handbook : a complete guide for greenbelts, blackbelts, and managers at all levels. 2001, New York, New York, McGraw-HillGoogle Scholar
- Iannone MA, Consler TG: Effect of Microsphere Binding Site Density on the Apparent Affinity of an Interaction Partner. Cytometry Part A. 2006, 69A: 374-383. 10.1002/cyto.a.20270.View ArticleGoogle Scholar
- Smith B: Making war on defects - Six Sigma Design . IEEE Spectrum. 1993, 30 (9): 43-47. 10.1109/6.275174.View ArticleGoogle Scholar
- Jacobson JW, Oliver KG, Weiss C, Kettman J: Analysis of Individual Data from Bead-Based Assays ("Bead Arrays"). Cytometry Part A. 2006, 69A: 384-390. 10.1002/cyto.a.20293.View ArticleGoogle Scholar
- Jacobsen JW: Conversation at xMap 2006 that carboxylation chemistry is added to the polystyrene molecules prior to forming the beads.Edited by: Hanley B. 2006, Dallas, TX ,Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.