Method, system, and computer program product for the processing of self-monitoring blood glucose(smbg)data to enhance diabetic self-management

<u>FIELD OF THE INVENTION</u>

The present system relates generally to Glycemic Control of individuals with diabetes, and more particularly to a computer-based system and method for evaluation of predicting glycosylated hemoglobin (HbA_1c and HbA₁) and risk of incurring hypoglycemia.

<u>BACKGROUND OF THE INVENTION</u>

Extensive studies, including the Diabetes Control and Complications Trial (DCCT) (<i>See</i><nplcit id="ncit0001" npl-type="s"><text>DCCT Research Group: The Effect Of Intensive Treatment Of Diabetes On The Development And Progression Of Long-Term Complications Of Insulin-Dependent Diabetes Mellitus. New England Journal of Medicine, 329: 978-986, 1993</text></nplcit>), the Stockholm Diabetes Intervention Study <i>(See</i><nplcit id="ncit0002" npl-type="s"><text>Reichard P, Phil M: Mortality and Treatment Side Effects During Long-term Intensified Conventional Insulin Treatment in the Stockholm Diabetes Intervention Study. Diabetes, 43: 313-317, 1994</text></nplcit>), and the United Kingdom Prospective Diabetes Study <i>(See</i><nplcit id="ncit0003" npl-type="s"><text>UK Prospective Diabetes Study Group: Effect of Intensive Blood Glucose Control With Metformin On Complications In Patients With Type 2 Diabetes (UKPDS 34). Lancet, 352: 837-853, 1998</text></nplcit>), have repeatedly demonstrated that the most effective way to prevent the long term complications of diabetes is by strictly maintaining blood glucose (BG) levels within a normal range using intensive insulin therapy.

However, the same studies have also documented some adverse effects of intensive insulin therapy, the most acute of which is the increased risk of frequent severe hypoglycemia (SH), a condition defined as an episode of neuroglycopenia which precludes self-treatment and requires external help for recovery <i>(See</i><nplcit id="ncit0004" npl-type="s"><text>DCCT Research Group: Epidemiology of Severe Hypoglycemia In The Diabetes Control and Complications Trial. American Journal of Medicine, 90: 450-459, 1991</text></nplcit>, and <nplcit id="ncit0005" npl-type="s"><text>DCCT Research Group: Hypoglycemia in the Diabetes Control and Complications Trial. Diabetes, 46: 271-286, 1997</text></nplcit>). Since SH can result in accidents, coma, and even death, patients and health care providers are discouraged from pursuing intensive therapy. Consequently, hypoglycemia has been identified as a major barrier to improved glycemic control <nplcit id="ncit0006" npl-type="s"><text>(Cryer PE: Hypoglycemia is the Limiting Factor in the Management Of Diabetes. Diabetes Metab Res Rev, 15: 42-46, 1999</text></nplcit>).

Thus, patients with diabetes face a life-long optimization problem of maintaining strict glycemic control without increasing their risk of hypoglycemia. A maj or challenge related to this problem is the creation of simple and reliable methods that are capable of evaluating both patients' glycemic control and their risk of hypoglycemia, and that can be applied in their everyday environments.

It has been well known for more than twenty years that glycosylated hemoglobin is a marker for the glycemic control of individuals with Diabetes Mellitus (Type I or Type II). Numerous researchers have investigated this relationship and have found that glycosylated hemoglobin generally reflects the average BG levels of a patient over the previous two months. Since in the majority of patients with diabetes the BG levels fluctuate considerably over time, it was suggested that the real connection between integrated glucose control and HbA_1c would be observed only in patients known to be in stable glucose control over a long period of time.

Early studies of such patients produced an almost deterministic relationship between the average BG level in the preceding 5 weeks and HbA_1c, and this curvilinear association yielded a correlation coefficient of 0.98 (<i>See</i><nplcit id="ncit0007" npl-type="s"><text>Aaby Svendsen P, Lauritzen T, Soegard U, Nerup J (1982). Glycosylated Hemoglobin and Steady-State Mean Blood Glucose Concentration in Type 1 (Insulin-Dependent) Diabetes, Diabetologia, 23, 403-405</text></nplcit>). In 1993 the DCCT concluded that HbA_1c was the "logical nominee" for a gold-standard glycosylated hemoglobin assay, and the DCCT established a linear relationship between the preceding mean BG and HbA_1c (See <nplcit id="ncit0008" npl-type="s"><text>Santiago JV (1993). Lessons from the Diabetes Control and Complications Trial, Diabetes, 42, 1549-1554</text></nplcit>).

Guidelines were developed indicating that an HbA_1c of 7% corresponds to a mean BG of 8.3 mM (150 mg/dl), an HbA_1c of 9% corresponds to a mean BG of 11.7 mM (210 mg/dl), and a 1% increase in HbA_1c corresponds to an increase in mean BG of 1.7 mM (30 mg/dl, 2). The DCCT also suggested that because measuring the mean BG directly is not practical, one could assess a patient's glycemic control with a single, simple test, namely HbA_1c. However, studies clearly demonstrate that HbA_1c is not sensitive to hypoglycemia.

Indeed, there is no reliable predictor of a patient's immediate risk of SH from any data. The DCCT concluded that only about 8% of future SH could be predicted from known variables such as the history of SH, low HbA_1c, and hypoglycemia unawareness. One recent review details the current clinical status of this problem, and provides options for preventing SH, that are available to patients and their health care providers <i>(See</i><nplcit id="ncit0009" npl-type="s"><text>Bolli, GB: How To Ameliorate The Problem of Hypoglycemia In Intensive As Well As Nonintensive Treatment Of Type I Diabetes. Diabetes Care, 22, Supplement 2: B43-B52, 1999</text></nplcit>).

Contemporary home BG monitors provide the means for frequent BG measurements through Self-Monitoring of BG (SMBG). However, the problem with SMBG is that there is a missing link between the data collected by the BG monitors, and HbA_1c and hypoglycemia. In other words, there are currently no reliable methods for evaluating HbA_1c and recognizing imminent hypoglycemia based on SMBG readings (<i>See</i><nplcit id="ncit0010" npl-type="s"><text>Bremer T and Gough DA: Is blood glucose predictable from previous values? A solicitation for data. Diabetes 48:445-451, 1999</text></nplcit>).

Thus, an object of this invention is to provide this missing link by proposing three distinct, but compatible, algorithms for evaluating HbA_1c and the risk of hypoglycemia from SMBG data, to be used to predict the short-term and long-term risks of hypoglycemia, and the long-term risk of hyperglycemia.

The inventors have previously reported that one reason for a missing link between the routinely available SMBG data and the evaluation of HbA_1c and the risk of hypoglycemia, is that the sophisticated methods of data collection and clinical assessment used in diabetes research, are infrequently supported by diabetes-specific and mathematically sophisticated statistical procedures:

Responding to the need for statistical analyses that take into account the specific distribution of BG data, the inventors developed a symmetrizing transformation of the blood glucose measurement scale <i>(See</i><nplcit id="ncit0011" npl-type="s"><text>Kovatchev BP, Cox DJ, Gonder-Frederick LA and WL Clarke (1997). Symmetization of the Blood Glucose Measurement Scale and Its Applications, Diabetes Care, 20, 1655-1658</text></nplcit>) that works as the follows. The BG levels are measured in mg/dl in the United States, and in mmol/L (or mM) in most other countries. The two scales are directly related by 18 mg/dl = 1 mM. The entire BG range is given in most references as 1.1 to 33.3 mM, and this is considered to cover practically all observed values. According to the recommendations of the DCCT (<i>See</i><nplcit id="ncit0012" npl-type="s"><text>DCCT Research Group (1993) The Effect Of Intensive Treatment of Diabetes On the Development and Progression of Long-Term Complications of Insulin-Dependent Diabetes Mellitus. New England Journal of Medicine, 329, pp 978-986</text></nplcit>) the target BG range - also known as the euglycemic range- for a person with diabetes is 3.9 to 10 mM, hypoglycemia occurs when the BG falls below 3.9 mM, and hyperglycemia is when the BG rises above 10 mM. Unfortunately, this scale is numerically asymmetric -- the hyperglycemic range (10 to 33.3mM) is wider than the hypoglycemic range (1.1 to 3.9mM), and the euglycemic range (3.9 to 10mM) is not centered within the scale. The inventors correct this asymmetry by introducing a transformation, <i>f(BG)</i>, which is a continuous function defined on the BG range <i>[1.1, 33.3],</i> having the two-parameter analytical form: <maths id="math0001" num=""><math display="block"><mi mathvariant="italic">f</mi><mfenced><mi mathvariant="italic">BG</mi><mi mathvariant="italic">α</mi><mi mathvariant="italic">β</mi></mfenced><mo>=</mo><mfenced open="[" close="]" separators=""><msup><mfenced separators=""><mi mathvariant="italic">ln</mi><mfenced><mi mathvariant="italic">BG</mi></mfenced></mfenced><mi mathvariant="italic">α</mi></msup><mo>-</mo><mi mathvariant="italic">β</mi></mfenced><mo>,</mo><mi mathvariant="italic">α</mi><mo>,</mo><mi mathvariant="italic">β</mi><mo>&gt;</mo><mn mathvariant="italic">0</mn></math><img file="EP1534121B1_D0001.tif" /></maths> and which satisfies the assumptions: <maths id="math0002" num=""><math display="block"><mi mathvariant="normal">A</mi><mo>⁢</mo><mn>1</mn><mo>:</mo><mi mathvariant="italic">f</mi><mfenced><mn mathvariant="italic">33.3</mn><mi mathvariant="italic">α</mi><mi mathvariant="italic">β</mi></mfenced><mo>=</mo><mo>-</mo><mi mathvariant="italic">f</mi><mfenced><mn mathvariant="italic">1.1</mn><mi mathvariant="italic">α</mi><mi mathvariant="italic">β</mi></mfenced></math><img file="EP1534121B1_D0002.tif" /></maths> and <maths id="math0003" num=""><math display="block"><mi mathvariant="normal">A</mi><mo>⁢</mo><mn>2</mn><mo>:</mo><mi mathvariant="italic">f</mi><mfenced><mn mathvariant="italic">10.0</mn><mi mathvariant="italic">α</mi><mi mathvariant="italic">β</mi></mfenced><mo>=</mo><mo>-</mo><mi mathvariant="italic">f</mi><mfenced><mn mathvariant="italic">3.9</mn><mi mathvariant="italic">α</mi><mi mathvariant="italic">β</mi></mfenced><mn>.</mn></math><img file="EP1534121B1_D0003.tif" /></maths>

Next, <i>f(.)</i> is multiplied by a third scaling parameter to fix the minimum and maximum values of the transformed BG range at <maths id="math0004" num=""><math display="inline"><mo>-</mo><msqrt><mn>10</mn></msqrt></math><img file="EP1534121B1_D0004.tif" /></maths>and <maths id="math0005" num=""><math display="inline"><msqrt><mn>10</mn></msqrt></math><img file="EP1534121B1_D0005.tif" /></maths> respectively. These values are convenient since a random variable with a standard normal distribution has 99.8% of its values within the interval <maths id="math0006" num=""><math display="inline"><mfenced open="[" close="]" separators=""><mo>-</mo><msqrt><mn>10</mn></msqrt><mo>,</mo><msqrt><mn>10</mn></msqrt></mfenced><mn>.</mn></math><img file="EP1534121B1_D0006.tif" /></maths> If BG is measured in mmol/l, when solved numerically with respect to the assumptions A1 and A2, the parameters of the function <i>f(BG</i>, <i>α,β)</i> are <i>α = 1.026, β = 1.861,</i> and the sealing parameter is <i>γ = 1.794.</i> If BG is measured in mg/dl instead, the parameters are computed to be <i>α</i> = 1.084, <i>β = 5.381,</i> and <i>γ = 1.509.</i>

Thus, when BG is measured in mmol/l, the symmetrizing transformation is <i>f(BG) = 1.794[(ln(BG))^1.026-1.861],</i> and when BG is measured in mg/dl the symmetrizing transformation <i>isf(BG) = 1.509[(ln(BG))^1.084-5.381].</i>

On the basis of the symmetrizing transformation <i>f(.)</i> the inventors introduced the Low BG Index - a new measure for assessing the risk of hypoglycemia from SMBG readings <i>(See</i><nplcit id="ncit0013" npl-type="s"><text>Cox DJ, Kovatchev BP, Julian DM, Gonder-Frederick LA, Polonsky WH, Schlundt DG, Clarke WL: Frequency of Severe Hypoglycemia In IDDM Can Be Predicted From Self-Monitoring Blood Glucose Data. Journal of Clinical Endocrinology and Metabolism, 79: 1659-1662, 1994</text></nplcit>, and <nplcit id="ncit0014" npl-type="s"><text>Kovatchev BP, Cox DJ, Gonder-Frederick LA Young-Hyman D, Schlundt D, Clarke WL. Assessment of Risk for Severe Hypoglycemia Among Adults With IDDM: Validation of the Low Blood Glucose Index, Diabetes Care 21:1870-1875,1998</text></nplcit>). Given a series of SMBG data the Low BG Index is computed as the average of 10. <i>f(BG)²</i> taken for values of <i>f(BG)</i> &lt;0 and 0 otherwise. Also suggested was a High BG Index, computed in a symmetrical to the Low BG Index manner, however this index did not find its practical application.

Using the Low BG Index in a regression model the inventors were able to account for 40% of the variance of SH episodes in the subsequent 6 months based on the SH history and SMBG data, and later to enhance this prediction to 46% <i>(See</i><nplcit id="ncit0015" npl-type="s"><text>Kovatchev BP, Straume M, Farhi LS, Cox DJ: Estimating the Speed of Blood Glucose Transitions and its Relationship With Severe Hypoglycemia. Diabetes, 48: Supplement 1, A363, 1999</text></nplcit>).

In addition, the inventors developed some data regarding HbA_1c and SMBG (<i>See</i><nplcit id="ncit0016" npl-type="b"><text>Kovatchev BP, Cox DJ, Straume M, Farhy LS. Association of Self-monitoring Blood Glucose Profiles with Glycosylated Hemoglobin. In: Methods in Enzymology, vol. 321: Numerical Computer Methods, Part C, Michael Johnson and Ludvig Brand, Eds., Academic Press, NY; 2000</text></nplcit>).

These developments became a part of the theoretical background of this invention. In order to bring this theory into practice, several key theoretical components, among other things, as described in the following sections, were added. In particular, three methods were developed for employing the evaluation of HbA_1c, long-term and short-term risk for hypoglycemia. The development of these methods was, but not limited thereto, based on detailed analysis of data for 867 individuals with diabetes that included more than 300,000 SMBG readings, records of severe hypoglycemia and determinations of HbA_1c.

<patcit id="pcit0001" dnum="EP0881495A1"><text>EP 0 881 495 A1</text></patcit> discloses a diabetes management based on a method for monitoring the effectiveness of diabetes treatment. The method predicts the level of the HbA_1c component of glycosylated haemoglobin in the blood of a patient. The underlying mathematical model predicts the behavior of the HbA_1c component relative to the blood glucose level using previous measurements of both components (HbA_1c and blood glucose level). The model updates each time a new level is measured and applies subsequently the updated model to predict further HbA_1c levels between measurements of that level using measurements of blood glucose level obtained since the last HbA_1c measurement.

The inventors have therefore sought to improve upon the aforementioned limitations associated with the conventional methods, and thereby provide simple and reliable methods that are capable of evaluating both patients' glycemic control and the risk for hypoglycemia, and that can be applied to their everyday environments.

<u>SUMMARY OF THE INVENTION</u>

The invention relates to a method as defined in claim 1, a system defined in claim 2, and a computer program product as defined in claim 23.

Preferred embodiments of the invention are defined in dependent claims.

<u>BRIEF DESCRIPTION OF THE DRAWINGS</u>

The foregoing and other objects, features and advantages of the present invention, as well as the invention itself, will be more fully understood from the following description of preferred embodiments, when read together with the accompanying drawings in which: <ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001"><b>FIG. 1</b></figref> graphically presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within one month after the SMBG assessment for each of the 15 categories of risk level defmed by the Low BG Index of Example No. 1.</li><li><figref idref="f0002"><b>FIG. 2</b></figref> graphically presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within three months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index of Example No. 1.</li><li><figref idref="f0003"><b>FIG. 3</b></figref> graphically presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index of Example No. 1.</li><li><figref idref="f0004"><b>FIG. 4</b></figref> graphically presents the empirical and theoretical probabilities for 2 or more moderate (dashed line) and sever (black line) hypoglycemic episodes within three months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index of Example No. 1.</li><li><figref idref="f0005"><b>FIG. 5</b></figref> graphically presents the empirical and theoretical probabilities for 2 or more moderate (dashed line) and severe (black line) hypoglycemic episodes within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index of Example No. 1.</li><li><figref idref="f0006"><b>FIG. 6</b></figref> is a functional block diagram for a computer system for implementation of the present invention.</li><li><figref idref="f0007 f0008 f0009"><b>FIGS. 7-9</b></figref> are schematic block diagrams of alternative variations of the present invention related processors, communication links, and systems.</li><li><figref idref="f0010"><b>FIG. 10</b></figref> graphically presents the empirical and theoretical probabilities for 3 or more moderate (dashed line) and severe (black line) hypoglycemic episodes within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index of Example No. 1.</li><li><figref idref="f0011"><b>FIG. 11</b></figref> graphically shows the analysis of the residuals of this model showed a close to normal distribution of the residuals for Training Data set 1 of Example No. 1.</li><li><figref idref="f0012"><b>FIG. 12</b></figref> graphically shows the analysis of the residuals of this model showed a close to normal distribution of the residuals 1 of Example No. 1</li><li><figref idref="f0013"><b>FIG. 13</b></figref> graphically shows a statistical evidence for that is given by the normal probability plot 1 of Example No. 1.</li><li><figref idref="f0014"><b>FIG. 14</b></figref> graphically presents the smoothed dependence between the hit rate and the ratio <b>R_ud</b> expressed in percentage in Example No. 1.</li><li><figref idref="f0015"><b>FIG. 15</b></figref> graphically presents the dependence between the prediction period and the corresponding hit rate in Example No. 1.</li><li><figref idref="f0016"><b>FIGS. 16 (A)</b></figref><b>-(B)</b> graphically present a one-month risk for significant hypoglycemia in T1DM predicted by the LBGI for ANOVA of number of severe hypoglycemic episodes by risk group (F=7.2, p&lt;0.001) and ANOVA of number of moderate hypoglycemic episodes by risk group (F=13.9, p&lt;0.001) in Example No. 2.</li><li><figref idref="f0017"><b>FIGS. 17 (A)</b></figref><b>-(B)</b> graphically present a 3-month risk for significant hypoglycemia in T1DM predicted by the LBGI for ANOVA of number of severe hypoglycemic episodes by risk group (F=9.2, p&lt;0.001) and ANOVA of number of moderate hypoglycemic episodes by risk group (F=14.7, p&lt;0.001) in Example No. 2.</li><li><figref idref="f0018"><b>FIGS. 18 (A)</b></figref><b>-(B)</b> graphically present a one-month risk for significant hypoglycemia in T2DM predicted by the LBGI for ANOVA of number of severe hypoglycemic episodes by risk group (F=6.0, p&lt;0.005) and ANOVA of number of moderate hypoglycemic episodes by risk group (F=25.1, p&lt;0.001) in Example No. 2.</li><li><figref idref="f0019"><b>FIGS. 19 (A)</b></figref><b>-(B)</b> graphically present a 3-month risk for significant hypoglycemia in T2DM predicted by the LBGI for ANOVA of number of severe hypoglycemic episodes by risk group (F=5.3, p&lt;0.01) and ANOVA of number of moderate hypoglycemic episodes by risk group (F=20.1, p&lt;0.001) in Example No. 2.</li></ul>

<u>DETAILED DESCRIPTION OF THE INVENTION</u>

The invention makes possible, but not limited thereto, the creation of precise methods for the evaluation of diabetics' glycemic control, and include, firmware and software code to be used in computing the key components of the method. The inventive methods for evaluating HbA_1c, the long-term probability of SH, and the short-term risk of hypoglycemia, are also validated based on the extensive data collected, as will be discussed later in this document. Finally, the aspects of these methods can be combined in structured display or matrix.

<u>I. Evaluating HbA</u>_<u>1c</u>

The invention includes a method, system, and computer program product for evaluating HbA_1c from a predetermined period of collected SMBG data, for example 4-6 weeks. In one embodiment, the invention provides a computerized (or other type) method and system for evaluating the HbA_1c of a patient based on BG data collected over a predetermined duration. The method includes evaluating the HbA_1c of a patient based on BG data collected over a first predetermined duration, the method comprising: preparing the data for estimating HbA_1c using a predetermined sequence of mathematical formulas. The mathematical formulas defined as: pre-processing of the data; estimating HbA_1c using at least one of four predetermined formulas; and validation of the estimate via sample selection criteria. The first predetermined duration can be about 60 days, or alternatively the first predetermined duration ranges from about 45 days to about 75 days, or from about 45 days to about 90 days, or as desired. The preprocessing of the data for each patient comprise: conversion of plasma to whole blood BG mg/dl; conversion of BG measured in mg/dl to units of mmol/l; and computing Low Blood Glucose Index (RLO1) and High Blood Glucose Index (RHI1). The preprocessing of the data for each patient uses a predetermined mathematical formulas defined as: conversion of plasma to whole blood BG mg/dl via BG=PLASBG (mg/dl) /1.12; conversion of BG measured in mg/dl to units of mmol/l) via BGMM=BG/18; and computing Low Blood Glucose Index (RLO1) and High Blood Glucose Index (RHI1). The preprocessing of the data further uses a predetermined mathematical formula defined as: Scale=[ln(BG)]^1.0845 - 5.381, wherein BG is measured in units of mg/dl; Risk1 = 22.765(Scale)², wherein RiskLO=Risk1 if (BG is less than about 112.5) and therefore risk of LBGI exists, otherwise RiskLO=0; RiskHI=Risk1 if (BG is greater than about 112.5) and therefore risk of HBGI exists, otherwise RiskHI=0; BGMM1 = average of BGMM per patient; RLO1 = average of RiskLO per patient; RHI1 = average of RiskHI per patient; L06 = average of RiskLO computed only for readings during the night, otherwise missing if there are no readings at night; N06, N12, N24 are percentage of SMBG readings in time intervals; NC1 = total number of SMBG readings in the first predetermined duration; and NDAYS = number of days with SMBG readings in the first predetermined duration. The N06, N12, N24 are percentage of SMBG readings in time intervals of about 0-6:59 hour time period; about 7-12:59 hour time period, and about 18-23:59 hour time period, respectively, or other desired percentages and number of intervals.

The method further comprises assigning a group depending on the patient's computed High BG Index using a predetermined mathematical formula. This formula may be defined as: if (RHI1 is ≤about 5.25 or if RHI1 is ≥about 16) then the assigned group= 0; if (RHI1 is &gt; about 5.25 and if RHI1 is &lt; about 7.0) then the assigned group=1; if (RHI1 is ≥about 7.0 and if RHI1 is &lt; about 8.5) then the assign group=2; and if (RHI1 is ≥about 8.5 and if RHI1 is &lt;about 16) then the assigned group=3.

Next, the method may further include providing estimates using a predetermined mathematical formula defined as: E0 = 0.55555*BGMM1+2.95; E1 = 0.50567*BGMM1+0.074*L06+2.69; E2 = 0.55555*BGMM1-0.074*L06+2.96; E3 = 0.44000*BGMM1+0.035*L06+3.65; and if (Group = 1) then EST2=E1, or if (Group = 2) then EST2=E2, or if (Group = 3) then EST2=E3, otherwise EST2=E0.

The method comprise providing further correction of the estimates using a predetermined mathematical formula defined as: if (missing(L06)) EST2=E0, if (RLO1 is ≤about 0.5 and RHI1 is ≤about 2.0) then EST2=E0-0.25; if (RLO1 is ≤about 2.5 and RHI1 is &gt; about 26) then EST2=E0-1.5*RLO1; and if ((RLO1/RHI1) is ≤about 0.25 and L06 is &gt; about 1.3) then EST2=EST2-0.08.

The estimation of the HbA_1c of a patient based on BG data collected over the first predetermined duration can be accomplished by estimating HbA_1c using at least one of four predetermined mathematical formulas defmed as: <ol id="ol0001" compact="compact" ol-style=""><li>a) HbA1c = the EST2 defined above or as corrected above;</li><li>b) HbA_1c = 0.809098*BGMM1 + 0.064540*RL01 - 0.1516733*RHI1 + 1.873325, wherein BGMM1 is the average BG (mmol/l), RLO1 is the Low BG Index, RHI1 is the High BG Index;</li><li>c) HbA1c = 0.682742*HBA0 + 0.054377*RHI1 + 1.553277, wherein HBA0 is a previous reference HbA1c reading taken about a second predetermined period prior to the estimate, wherein RHI1 = is the High BG Index; or</li><li>d) HbA1c = 0.41046*BGMM + 4.0775 wherein BGMM1 is the average BG (mmol/l). The second predetermined duration can be about three months; about 2.5 months to about 3.5 months; or about 2.5 months to six months, or as desired.</li></ol>

The validation of the estimate using sample selection criteria of HbA1c estimate is achieved only if the first predetermined duration sample meets at least one of the following four criteria: <ul id="ul0002" list-style="none" compact="compact"><li>a) a test frequency criterion wherein if the first predetermined duration sample contains an average of at least about 1.5 to about 2.5 tests per day; b) an alternative test frequency criterion only if the predetermined duration sample contains at least a third predetermined sample period with readings with an average frequency of about 1.8 readings/day (or other desired average frequency);</li><li>c) a randomness of data criterion-1 wherein the HbA1c estimate is validated or displayed only if the ratio (RLO1/RHI1&gt;= about 0.005), wherein: RLO1 is the Low BG Index, RHI1 is the High BG Index; or</li><li>d) a randomness of data criterion wherein HbA1c estimate is validated or displayed only if the ratio (NO6 &gt;= about 3%), and wherein N06 is the percentage of readings during the night. The third predetermined duration can be at least 35 days, range from about 35 days to about 40 days, or from about 35 days to about as long as the first predetermined duration, or as desired.</li></ul>

<u>II. Long-term Probability for Severe Hypoglycemia (SH).</u>

Another aspect includes a method, system, and computer program product for estimating the long-term probability for severe hypoglycemia (SH). This method uses SMBG readings from a predetermined period, for example about 4-6 weeks, and predicts the risk of SH within the following approximate 6 months. In one embodiment, the invention provides a computerized method (or other type) and system for evaluating the long term probability for severe hypoglycemia (SH) of a patient based on BG data collected over a predetermined duration. The method for evaluating the long term probability for severe hypoglycemia (SH) or moderate hypoglycemia (MH) of a patient based on BG data collected over a predetermined duration comprises: computing LBGI based on the collected BG data; and estimating the number of future SH episodes using a predetermined mathematical formula based on the computed LBGI. The computed LBGI is mathematically defined from a series of BG readings <i>x₁</i>, <i>x₂</i>, ... <i>x_n</i> taken at time points <i>t₁, t₂,</i> ..., <i>t_n</i> as: <maths id="math0007" num=""><math display="block"><mi mathvariant="italic">LBGI</mi><mo>=</mo><mfrac><mn>1</mn><mi>n</mi></mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>n</mi></munderover></mstyle><mi mathvariant="italic">lbgi</mi><mfenced separators=";"><msub><mi>x</mi><mi>i</mi></msub><mn>2</mn></mfenced><mo>,</mo><mspace width="1em" /><mi>where</mi><mo>:</mo><mi mathvariant="italic">lbgi</mi><mfenced separators=";"><mi mathvariant="italic">BG</mi><mi mathvariant="italic">a</mi></mfenced><mo>=</mo><mn mathvariant="italic">10.</mn><mo>⁢</mo><mi mathvariant="italic">f</mi><mo>⁢</mo><msup><mfenced><mi mathvariant="italic">BG</mi></mfenced><mi mathvariant="italic">a</mi></msup><mspace width="1em" /><mi>if</mi><mspace width="1em" /><mi mathvariant="italic">f</mi><mfenced><mi mathvariant="italic">BG</mi></mfenced><mo>&gt;</mo><mn mathvariant="italic">0</mn><mspace width="1em" /><mi>and</mi><mspace width="1em" /><mn mathvariant="italic">0</mn></math><img file="EP1534121B1_D0007.tif" /></maths> otherwise, and a = about 2, representing a weighting parameter (or other weighting parameter as desire).

A predetermined risk categories(RCAT) is defined, whereby each of the risk categories(RCAT) represent a range of values for LBGI; and the LBGI is assigned to at least one of said risk categories(RCAT). The risk categories(RCAT) are defined as follows: <ul id="ul0003" list-style="none" compact="compact"><li>category 1, wherein said LBGI is less than about 0.25;</li><li>category 2, wherein said LBGI is between about 0.25 and about 0.50;</li><li>category 3, wherein said LBGI is between about 0.50 and about 0.75;</li><li>category 4, wherein said LBGI is between about 0.75 and about 1.0;</li><li>category 5, wherein said LBGI is between about 1.0 and about 1.25;</li><li>category 6, wherein said LBGI is between about 1.25 and about 1.50;</li><li>category 7, wherein said LBGI is between about 1.5 and about 1.75;</li><li>category 8, wherein said LBGI is between about 1.75 and about 2.0;</li><li>category 9, wherein said LBGI is between about 2.0 and about 2.5;</li><li>category 10, wherein said LBGI is between about 2.5 and about 3.0</li><li>category 11, wherein said LBGI is between about 3.0 and about 3.5;</li><li>category 12, wherein said LBGI is between about 3.5 and about 4.25;</li><li>category 13, wherein said LBGI is between about 4.25 and about 5.0;</li><li>category 14, wherein said LBGI is between about 5.0 and about 6.5; and</li><li>category 15, wherein said LBGI is above about 6.5.</li></ul>

Next, the probability of incurring a select number of SH episodes is defined respectively for each of said assigned risk categories(RCAT). Defining a probability of incurring a select number of SH episodes within a next first predetermined duration respectively for each of said assigned risk categories(RCAT), using the formula: <i>F(x) = 1 -exp(-a.x^b)</i> for any <i>x&gt;0</i> and 0 otherwise, wherein: a = about -4.19 and b = about 1.75 (a and/or b may be other desired values). The first predetermined duration can be about one month; range from about 0.5 months to about 1.5 months, or ranges from about 0.5 months to about 3 months, or as desired.

Also, the probability of incurring a select number of SH episodes within a next second predetermined duration respectively for each of said assigned risk categories(RCAT) is defined, using the formula: <i>F(x)</i> = <i>1 - exp(-a.x^b)</i> for any <i>x&gt;0</i> and <i>0</i> otherwise, wherein: a = about -3.28 and b = about 1.50 (a and/or b may be other desired values). The second predetermined duration can be about three months, range from about 2 months to about 4 months, or about 3 months to about 6 months, or as desired.

Further, a probability of incurring a select number of SH episodes within the next third predetermined duration is defined respectively for each of the assigned risk categories(RCAT), using the formula: <i>F(x) = 1 - exp(-a.x^b)</i> for any <i>x&gt;0</i> and 0 otherwise, wherein: a = about -3.06 and b = about 1.45 (a and/or b may be other desired values). The third predetermined duration can be about 6 months, range from about 5 months to about 7 months, or range from about 3 months to about 9 months, or as desired.

Alternatively, a probability of incurring a select number of MH episodes within the next first predetermined period (ranges of about 1 month, about 0.5-1.5 months, about 0.5-3 months, or as desired) is defined respectively for each of said assigned risk categories(RCAT), using the formula: <i>F(x) = 1 - exp(-a.x^b)</i> for any <i>x&gt;0</i> and 0 otherwise, wherein: a = about -1.58 and b = about 1.05 (a and/or b may be other desired values).

Alternatively, a probability of incurring a select number of MH episodes within the next second predetermined period (ranges of about 3 months, about 2-4 months, about 3-6 months, or as desired) is defined respectively for each of said assigned risk categories(RCAT), using the formula: <i>F(x) = 1 - exp(a.x^b)</i> for any <i>x&gt;0</i> and 0 otherwise, wherein: a = about -1.37 and b = about 1.14 (a and/or b may be other desired values).

Alternatively, a probability of incurring a select number of MH episodes within the next third predetermined period (ranges of about 6 months, about 5-7 months, about 3-9 months, or as desired) is defined respectively for each of said assigned risk categories(RCAT), using the formula: <i>F(x) = 1-exp(-a.x^b)</i> for any <i>x&gt;0</i> and 0 otherwise, wherein: a = about -1.37 and b = about 1.35 (a and/or b may be other desired values).

Moreover, classifications of risk for future significant hypoglycemia of the patient are assigned. The classifications are defined as follows: minimal risk, wherein said LBGI is less than about 1.25; low risk, wherein said LBGI is between about 1.25 and about 2.50; moderate risk, wherein said LBGI is between about 2.5 and about 5; and high risk, wherein said LBGI is above about 5.0 (other classification ranges can be implemented as desired).

<u>III. Short-term Probability for Severe Hypoglycemia (SH).</u>

Still yet another aspect includes a method, system, and computer program product for identifying 24-hour periods (or other select periods) of increased risk of hypoglycemia. This is accomplished through the computation of the short-term risk of hypoglycemia using SMBG readings collected over the previous 24 hours. In one embodiment, the invention provides a computerized method and system for evaluating the short term risk for severe hypoglycemia (SH) of a patient based on BG data collected over a predetermined duration. The method for evaluating the short term probability for severe hypoglycemia (SH) of a patient based on BG data collected over a predetermined duration comprises: computing scale values based on said collected BG data; and computing the low BG risk value (RLO) for each BG data. The computed RLO(BG) is mathematically defined as: Scale = [ln(BG)]^1.0845 - 5.381, wherein BG is measured in units of mg/dl; Risk = 22.765(Scale)²; if (BG is less than about 112.5) then: RLO(BG)=Risk, otherwise RLO(BG)= 0. Alternatively, the computed RLO(BG) is mathematically defined as: Scale=[ln(BG)]^1.026 -1.861, wherein BG is measured in units of mmol/l; Risk = 32.184(Scale)²; if (BG is ≤about 112.5) then: RLO(BG) = Risk, otherwise RLO(BG) = 0.

LBGI can be computed based on the collected BG data. The computed LBGI is mathematically defined from a series of BG readings <i>x₁, x₂, ... x_n</i> taken at time points <i>t₁, t₂,</i> ..., <i>t_n</i> as: <maths id="math0008" num=""><math display="block"><mi mathvariant="italic">LBGI</mi><mo>=</mo><mfrac><mn>1</mn><mi>n</mi></mfrac><mstyle displaystyle="true"><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>n</mi></munderover></mstyle><mi mathvariant="italic">lbgi</mi><mfenced separators=";"><msub><mi>x</mi><mi>i</mi></msub><mn>2</mn></mfenced><mo>,</mo><mspace width="1em" /><mi>where</mi><mo>:</mo><mi mathvariant="italic">lbgi</mi><mfenced separators=";"><mi mathvariant="italic">BG</mi><mi mathvariant="italic">a</mi></mfenced><mo>=</mo><mi>RLO</mi><mfenced><mi>BG</mi></mfenced><mn>.</mn></math><img file="EP1534121B1_D0008.tif" /></maths>

Provisional LBGI can be computed based on the collected BG data. The computed provisional LBGI is mathematically defined from mathematically defined as: LBGI(1) = RLO(<i>x₁</i>); RLO2(1) = 0; LBGI(J)= ((j-1)/j) * LBGI (j-1) + (1/j) * RLO(<i>x_j</i>); and RLO2(j)=((j-1)/j)*RLO2(j-1) + (1/j)*(RLO(<i>x_j</i>)-LBGI(j))².

SBGI can be computed using a mathematical formula defined as: <maths id="math0009" num=""><math display="inline"><mi>SBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>=</mo></math><img file="EP1534121B1_D0009.tif" /></maths><maths id="math0010" num=""><math display="inline"><msqrt><mfenced separators=""><mi mathvariant="italic">RLO</mi><mo>⁢</mo><mn>2</mn><mfenced><mi>n</mi></mfenced></mfenced></msqrt><mn>.</mn></math><img file="EP1534121B1_D0010.tif" /></maths>

Next, the invention provides a qualification or warning of upcoming short term SH. The qualification or warning is provided if: (LBGI(150) ≥2.5 and LBGI(50) ≥ (1.5*LBGI(150) and SBGI(50) ≥ SBGI(150)) then said issue of warning is qualified or provided, or RLO ≥(LBGI(150)+1.5*SBGI(150)) then said issue of warning is qualified or provided, otherwise, a warning is not necessarily qualified or provided.

Alternatively, Next, the invention provides a qualification or warning of upcoming short term SH. The qualification or warning is provided if: <ul id="ul0004" list-style="none" compact="compact"><li>(LBGI(n) ≥α and SBGI(n) ge (β)) then said issue of warning is qualified or provided, and/or (RLO(n) ≥(LBGI(n)+γ*SBGI(n))) then said issue of warning is qualified or provided; otherwise a warning is not necessarily qualified or provided, wherein α, β, and γ are threshold parameters.</li></ul>

The threshold parameters α, β, and γ are defined as α = about 5, β = about 7.5, γ = about 1.5. Other possible parameter combinations are presented in the table below. The values may be approximations of the values presented below as well as any intermediate combination of values in the table below. <tables id="tabl0001" num="0001"><table frame="all"><tgroup cols="6"><colspec colnum="1" colname="col1" colwidth="14mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="14mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="14mm" /><colspec colnum="6" colname="col6" colwidth="14mm" /><thead><row><entry align="center" valign="middle">α</entry><entry align="center" valign="middle">β</entry><entry align="center" valign="middle">γ</entry><entry align="center" valign="middle">α</entry><entry align="center" valign="middle">β</entry><entry align="center" valign="middle">γ</entry></row></thead><tbody><row><entry valign="middle" align="char" char="." charoff="13">6.4</entry><entry valign="middle" align="char" char="." charoff="13">8.2</entry><entry valign="middle" align="char" char="." charoff="13">1.5</entry><entry valign="middle" align="char" char="." charoff="13">5.0</entry><entry valign="middle" align="char" char="." charoff="13">7.5</entry><entry valign="middle" align="char" char="." charoff="13">1.3</entry></row><row><entry valign="middle" align="char" char="." charoff="13">6.0</entry><entry valign="middle" align="char" char="." charoff="13">7.5</entry><entry valign="middle" align="char" char="." charoff="13">1.5</entry><entry valign="middle" align="char" char="." charoff="13">4.9</entry><entry valign="middle" align="char" char="." charoff="13">7.0</entry><entry valign="middle" align="char" char="." charoff="13">1.2</entry></row><row><entry valign="middle" align="char" char="." charoff="13">5.5</entry><entry valign="middle" align="char" char="." charoff="13">7.5</entry><entry valign="middle" align="char" char="." charoff="13">1.5</entry><entry valign="middle" align="char" char="." charoff="13">4.8</entry><entry valign="middle" align="char" char="." charoff="13">7.0</entry><entry valign="middle" align="char" char="." charoff="13">1.2</entry></row></tbody></tgroup></table></tables>

<u>IV. Exemplary Systems</u>

The method of the invention may be implemented using hardware, software or a combination thereof and may be implemented in one or more computer systems or other processing systems, such as personal digit assistants (PDAs), or directly in blood glucose self-monitoring devices (SMBG memory meters) equipped with adequate memory and processing capabilities. In an example embodiment, the invention was implemented in software running on a general purpose computer <b>900</b> as illustrated in <figref idref="f0006"><b>FIG. 6</b></figref><b>.</b> Computer system <b>600</b> includes one or more processors, such as processor <b>604</b> Processor <b>604</b> is connected to a communication infrastructure <b>606</b> (e.g., a communications bus, cross-over bar, or network). Computer system <b>600</b> may include a display interface <b>602</b> that forwards graphics, text, and other data from the communication infrastructure <b>606</b> (or from a frame buffer not shown) for display on the display unit <b>630.</b>

Computer system <b>600</b> also includes a main memory <b>608,</b> preferably random access memory (RAM), and may also include a secondary memory <b>610.</b> The secondary memory <b>610</b> may include, for example, a hard disk drive <b>612</b> and/or a removable storage drive <b>614,</b> representing a floppy disk drive, a magnetic tape drive, an optical disk drive, a flash memory, etc. The removable storage drive <b>614</b> reads from and/or writes to a removable storage unit <b>618</b> in a well known manner. Removable storage unit <b>618,</b> represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive <b>614.</b> As will be appreciated, the removable storage unit <b>618</b> includes a computer usable storage medium having stored therein computer software and/or data.

In alternative embodiments, secondary memory <b>610</b> may include other means for allowing computer programs or other instructions to be loaded into computer system <b>600.</b> Such means may include, for example, a removable storage unit <b>622</b> and an interface <b>620.</b> Examples of such removable storage units/interfaces include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as a ROM, PROM, EPROM or EEPROM) and associated socket, and other removable storage units <b>622</b> and interfaces <b>620</b> which allow software and data to be transferred from the removable storage unit <b>622</b> to computer system <b>600.</b>

Computer system <b>600</b> may also include a communications interface <b>624.</b> Communications interface <b>624</b> allows software and data to be transferred between computer system <b>600</b> and external devices. Examples of communications interface <b>624</b> may include a modem, a network interface (such as an Ethernet card), a communications port (e.g., serial or parallel, etc.), a PCMCIA slot and card, a modem, etc. Software and data transferred via communications interface <b>624</b> are in the form of signals <b>628</b> which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface <b>624.</b> Signals <b>628</b> are provided to communications interface <b>624</b> via a communications path (i.e., channel) <b>626.</b> Channel <b>626</b> carries signals <b>628</b> and may be implemented using wire or cable, fiber optics, a phone line, a cellular phone link, an RF link, an infrared link, and other communications channels.

In this document, the terms "computer program medium" and "computer usable medium" are used to generally refer to media such as removable storage drive <b>614,</b> a hard disk installed in hard disk drive <b>612,</b> and signals <b>628.</b> These computer program products are means for providing software to computer system <b>600.</b> The invention includes such computer program products.

Computer programs (also called computer control logic) are stored in main memory <b>608</b> and/or secondary memory <b>610.</b> Computer programs may also be received via communications interface <b>624.</b> Such computer programs, when executed, enable computer system <b>600</b> to perform the features of the present invention as discussed herein. In particular, the computer programs, when executed, enable processor <b>604</b> to perform the functions of the present invention. Accordingly, such computer programs represent controllers of computer system <b>600.</b>

In an embodiment where the invention is implemented using software, the software may be stored in a computer program product and loaded into computer system <b>600</b> using removable storage drive <b>614,</b> hard drive <b>612</b> or communications interface <b>624.</b> The control logic (software), when executed by the processor <b>604,</b> causes the processor <b>604</b> to perform the functions of the invention as described herein.

In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of the hardware state machine to perform the functions described herein will be apparent to persons skilled in the relevant art(s).

In yet another embodiment, the invention is implemented using a combination of both hardware and software.

In an example software embodiment of the invention, the methods described above were implemented in SPSS control language, but could be implemented in other programs such as, but not limited to, C++ programming language or other programs available to those skilled in the art.

<figref idref="f0007 f0008 f0009"><b>FIGS. 7-9</b></figref> show block diagrammatic representation of alternative embodiments of the invention. Referring <figref idref="f0007"><b>FIG. 7</b></figref><b>,</b> there is shown a block diagrammatic representation of the system <b>710</b> essentially comprises the glucose meter <b>728</b> used by a patient <b>712</b> for recording, inter alia, insulin dosage readings and measured blood glucose ("BG") levels, Data obtained by the glucose meter <b>728</b> is preferably transferred through appropriate communication links <b>714</b> or data modem <b>732</b> to a processing station or chip, such as a personal computer <b>740,</b> PDA, or cellular telephone, or via appropriate Internet portal. For instance, data stored may be stored within the glucose meter <b>728</b> and may be directly downloaded into the personal computer <b>740</b> through an appropriate interface cable and then transmitted via the Internet to a processing location. An example is the ONE TOUCH monitoring system or meter by LifeScan, Inc. which is compatible with IN TOUCH software which includes an interface cable to down load the data to a personal computer.

The glucose meter is common in the industry and includes essentially any device that can functions as a BG acquisition mechanism. The BG meter or acquisition mechanism, device, tool, or system includes various conventional methods directed toward drawing a blood sample (e.g. by fingerprick) for each test, and a determination of the glucose level using an instrument that reads glucose concentrations by electromechanical or claorimetric methods. Recently, various methods for determining the concentration of blood analytes without drawing blood have been developed. For example, <patcit id="pcit0002" dnum="US5267152A"><text>U.S. Pat. No. 5,267,152 to Yang et al.</text></patcit> describes a noninvasive technique of measuring blood glucose concentration using near-IR radiation diffuse-reflection laser spectroscopy. Similar near-IR spectrometric devices are also described in <patcit id="pcit0003" dnum="US5086229A"><text>U.S. Pat. No. 5,086,229 to Rosenthal et al.</text></patcit> and <patcit id="pcit0004" dnum="US4975581A"><text>U.S. Pat. No. 4,975,581 to Robinson et al.</text></patcit>

<patcit id="pcit0005" dnum="US5139023A"><text>U.S. Pat. No. 5,139,023 to Stanley</text></patcit> describes a transdermal blood glucose monitoring apparatus that relies on a permeability enhancer (e.g., a bile salt) to facilitate transdermal movement of glucose along, a concentration gradient established between interstitial fluid and a receiving medium. <patcit id="pcit0006" dnum="US5036861A"><text>U.S. Pat. No. 5,036,861 to Sembrowich</text></patcit> describes a passive glucose monitor that collects perspiration through a skin patch, where a cholinergic agent is used to stimulate perspiration secretion from the eccrine sweat gland. Similar perspiration collection devices are described in <patcit id="pcit0007" dnum="US5076273A"><text>U.S. Pat. No. 5,076,273 to Schoendorfer </text></patcit>and <patcit id="pcit0008" dnum="US5140985A"><text>U.S. Pat. No. 5,140,985 to Schroeder</text></patcit>.

In addition, <patcit id="pcit0009" dnum="US5279543A"><text>U.S. Pat. No. 5,279,543 to Glikfeld</text></patcit> describes the use of iontophoresis to noninvasively sample a substance through skin into a receptacle on the skin surface. Glikfeld teaches that this sampling procedure can be coupled with a glucose-specific biosensor or glucose-specific electrodes in order to monitor blood glucose. Moreover, International Publication No. <patcit id="pcit0010" dnum="WO9600110A"><text>WO 96/00110 to Tamada</text></patcit> describes an iontophoretic apparatus for transdermal monitoring of a target substance, wherein an iontophoretic electrode is used to move an analyte into a collection reservoir and a biosensor is used to detect the target analyte present in the reservoir. Finally, <patcit id="pcit0011" dnum="US6144869A"><text>U.S. Pat. No. 6,144,869 to Berner</text></patcit> describes a sampling system for measuring the concentration of an analyte present.

Further yet, the BG meter or acquisition mechanism may include indwelling catheters and subcutaneous tissue fluid sampling.

The computer or PDA <b>740</b> includes the software and hardware necessary to process, analyze and interpret the self-recorded diabetes patient data in accordance with predefined flow sequences (as described above in detail) and generate an appropriate data interpretation output. Preferably, the results of the data analysis and interpretation performed upon the stored patient data by the computer <b>740</b> are displayed in the form of a paper report generated through a printer associated with the personal computer <b>740.</b> Alternatively, the results of the data interpretation procedure may be directly displayed on a video display unit associated with the computer <b>740.</b>

<figref idref="f0008"><b>FIG. 8</b></figref> shows a block diagrammatic representation of an alternative embodiment having a diabetes management system that is a patient-operated apparatus <b>810</b> having a housing preferably sufficiently compact to enable apparatus <b>810</b> to be hand-held and carried by a patient. A strip guide for receiving a blood glucose test strip (not shown) is located on a surface of housing <b>816.</b> Test strip is for receiving a blood sample from the patient <b>812.</b> The apparatus includes a microprocessor <b>822</b> and a memory <b>824</b> connected to microprocessor <b>822.</b> Microprocessor <b>822</b> is designed to execute a computer program stored in memory <b>824</b> to perform the various calculations and control functions as discussed in great detail above. A keypad <b>816</b> is connected to microprocessor <b>822</b> through a standard keypad decoder <b>826.</b> Display <b>814</b> is connected to microprocessor <b>822</b> through a display driver <b>830.</b> Microprocessor <b>822</b> communicates with display driver <b>830</b> via an interface, and display driver <b>830</b> updates and refreshes display <b>814</b> under the control of microprocessor <b>822.</b> Speaker <b>854</b> and a clock <b>856</b> are also connected to microprocessor <b>822.</b> Speaker <b>854</b> operates under the control of microprocessor <b>822</b> to emit audible tones alerting the patient to possible future hypoglycemia. Clock <b>856</b> supplies the current date and time to microprocessor <b>822.</b>

Memory <b>824</b> also stores blood glucose values of the patient <b>812,</b> the insulin dose values, the insulin types, and the parameter values used by microprocessor <b>822</b> to calculate future blood glucose values, supplemental insulin doses, and carbohydrate supplements. Each blood glucose value and insulin dose value is stored in memory <b>824</b> with a corresponding date and time. Memory <b>824</b> is preferably a non-volatile memory, such as an electrically erasable read only memory (EEPROM).

Apparatus <b>810</b> also includes a blood glucose meter <b>828</b> connected to microprocessor <b>822.</b> Glucose meter <b>828</b> is designed to measure blood samples received on blood glucose test strips and to produce blood glucose values from measurements of the blood samples. As mentioned previously, such glucose meters are well known in the art. Glucose meter <b>828</b> is preferably of the type which produces digital values which are output directly to microprocessor <b>822.</b> Alternatively, blood glucose meter <b>828</b> may be of the type which produces analog values. In this alternative embodiment, blood glucose meter <b>828</b> is connected to microprocessor <b>822</b> through an analog to digital converter (not shown).

Apparatus <b>810</b> further includes an input/output port <b>834,</b> preferably a serial port, which is connected to microprocessor <b>822.</b> Port <b>834</b> is connected to a modem <b>832</b> by an interface, preferably a standard RS232 interface. Modem <b>832</b> is for establishing a communication link between apparatus 810 and a personal computer 840 or a healthcare provider computer 838 through a communication network 836. Specific techniques for connecting electronic devices through connection cords are well known in the art. Another alternative example is "bluetooth" technology communication.

Alternatively, <figref idref="f0009"><b>FIG. 9</b></figref> shows a block diagrammatic representation of an alternative embodiment having a diabetes management system that is a patient-operated apparatus 910, similar as shown in <figref idref="f0008"><b>FIG. 8</b></figref><b>,</b> having a housing preferably sufficiently compact to enable the apparatus 910 to be hand-held and carried by a patient. For example, a separate or detachable glucose meter or BG acquisition mechanism/module 928. There are already self-monitoring devices that are capable of directly computing Algorithms 1, 2, 3 and displaying the results to the patient without transmitting the data to anything else. Examples of such devices are ULTRA SMART by Lifescan Inc., Milpitas, CA and FREESTYLE TRACKER by Therasense, Alameda, CA.

Accordingly, the embodiments described herein are capable of being implemented over data communication networks such as the internet, making evaluations, estimates, and information accessible to any processor or computer at any remote location, as depicted in <figref idref="f0006 f0007 f0008 f0009"><b>FIGS. 6-9</b></figref> and/or <patcit id="pcit0012" dnum="US5851186A"><text>U.S. Pat. No. 5,851,186 to Wood</text></patcit>. Alternatively, patients located at remote locations may have the BG data transmitted to a central healthcare provider or residence, or a different remote location.

In summary, the invention proposes a data analysis computerized (or non-computerized) method and system for the simultaneous evaluation of the two most important components of glycemic control in individuals with diabetes: HbA1c and the risk of hypoglycemia. The method, while using only routine SMBG data, provides, among other things, three sets of output.

The potential implementations of the method, system, and computer program product of the invention is that it provides the following advantages, but are not limited thereto. First, the invention enhances existing home BG monitoring devices by producing and displaying: 1) estimated categories for HbA1c, 2) estimated probability for SH in the subsequent six months, and 3) estimated short-term risk of hypoglycemia (i.e. for the next 24 hours). The latter may include warnings, such as an alarm, that indicates imminent hypoglycemic episodes. These three components can also be integrated to provide continuous information about the glycemic control of individuals with diabetes, and to enhance the monitoring of their risk of hypoglycemia.

As an additional advantage, the invention enhances existing software or hardware that retrieves SMBG data. Such software or hardware is produced by virtually every manufacturer of home BG monitoring devices and is customarily used by patients and health care providers to interpret SMBG data. The methods and system of the invention can be directly incorporated into existing home blood glucose monitors, or used for the enhancement of software that retrieves SMBG data, by introducing a data interpretation component capable of predicting both HbA1c and periods of increased risk of hypoglycemia.

Still yet another advantage, the invention evaluates the accuracy of home BG monitoring devices, both in the low and high BG ranges, and over the entire BG scale.

Moreover, another advantage, the invention evaluates the effectiveness of various treatments for diabetes

Further still, as patients with diabetes face a life-long optimization problem of maintaining strict glycemic control without increasing their risk of hypoglycemia, the present invention alleviates this related problem by use of its simple and reliable methods, i.e., the invention is capable of evaluating both patients' glycemic control and their risk of hypoglycemia, and at the same time applying it in their everyday environments.

Additionally, the invention provides the missing link by proposing three distinct, but compatible, algorithms for evaluating HbA1c and the risk of hypoglycemia from SMBG data, to be used to predict the short-term and long-term risks of hypoglycemia, and the long-term risk of hyperglycemia.

Another advantage, the invention evaluates the effectiveness of new insulin or insulin delivery devices. Any manufacturer or researcher of insulin or insulin delivery devices can utilize the embodiments of the invention to test the relative success of proposed or tested insulin types or device delivery designs.

Finally, another advantage, the invention evaluates the effectiveness of drugs that are adjunct to insulin therapy.

<u>EXAMPLES OF INVENTION</u>

<u>I. EXAMPLE NO. 1</u>

This Example No. 1 consists of three algorithms for simultaneous evaluation, from routine SMBG data, of the two most important components of glycemic control in diabetes, HbA_1c and risk for hypoglycemia. This method pertains directly to enhancement of existing home BG monitoring devices by introducing an intelligent data interpretation component capable of predicting both HbA_1c and periods of increased risk for hypoglycemia. The data analysis method has three components (algorithms): <ul id="ul0005" list-style="none"><li>■ <b>Algorithm 1:</b> Evaluation of HbA_1c;</li><li>■ <b>Algorithm 2:</b> Evaluation of long-term risk for severe hypoglycemia (SH), and</li><li>■ <b>Algorithm 3:</b> Evaluation of short-term (within 24-48 hours) risk for hypoglycemia.</li></ul>

Algorithm 1 and 2 provide uninterrupted monitoring and information about the overall glycemic control of an individual with Type 1 or Type 2 diabetes mellitus (T1DM, T2DM), covering both the high and the low end of the BG scale. Algorithm 3 is supposed to be activated when Algorithm 2 indicates an increased long-term risk for hypoglycemia. Upon activation, Algorithm 3 requires more frequent monitoring (4 times a day) and provides 24 to 48-hour forecast of the risk for moderate/severe hypoglycemia.

Another important objective of Example 1 was to test with existing data a number of hypotheses and ideas that could potentially lead to alternative algorithms estimating HbA_1c and computing risk for hypoglycemia in a manner that is conceptually different from the one proposed in the invention disclosure. The goal was to find potentially better solutions, or simply to verify that certain ideas do not lead to better results, which is essential for optimization and promptness of the analysis of the data that are currently being collected in Example No. 2 of the study.

<u>DATA SETS</u>

In order to ensure that the results of our optimization can be generalized to population level, Algorithms 1 and 2 were first optimized using training data sets and then tested for accuracy using an unrelated test data set. For Algorithm 3 we currently have only one data set containing parallel SMBG and records of SH. A detailed description of the patient population follows: <ol id="ol0002" ol-style=""><li>(1) <u>Training Data set 1</u>: Ninety-six patients with T1DM, who were diagnosed at least 2 years prior to the study. Forty-three of these patients reported at least two episodes of severe hypoglycemia in the past year and 53 patients reported no such episodes during the same period. There were 38 males and 58 females. The mean age was 35±8 yr., mean duration of disease 16±10 yr., mean insulin units/kg per day 0.58±0.19, and mean HbA_1c was 8.6±1.8%. These subjects collected approximately 13,000 SMBG readings over 40-45-day period. The frequency of SMBG was approximately 3 reading/day. This data collection was followed by 6 months of monthly diaries of moderate and severe hypoglycemic episodes. This data set was used as a training data set for Algorithm 1 (no prior HbA_1c) and for Algorithm 2.</li><li>(2) <u>Training Data set:</u> Eighty-five patients with T1DM, diagnosed at least 2 years prior to the study, all of whom reported SH episodes in the past year. There were 44 males and 41 females. The mean age was 44±10 years, mean duration of disease 26±11 yr., mean insulin units/kg per day 0.6±0.2, the mean baseline HbA_1c was 7.7±1.1%, and the mean 6-month HbA_1c was 7.4±1% (6-month HbA_1c available for 60 subjects). These subjects collected approximately 75,500 SMBG readings during the 6 months between the two HbA_1c assays. The frequency of SMBG in Data set 2 was higher - 4-5 readings per day. In addition, during the 6 months of SMBG the subjects kept diaries of moderate and severe hypoglycemic episodes by date and time of their occurrence, resulting in 399 SH episodes. This data set was used as a training data set for Algorithm 1 (with prior HbA_1c) and for all analyses concerning Algorithm 3.</li><li>(3) The <u>Test Data Set</u> that we used contains data for N=600 subjects, 277 with T1DM and 323 with T2DM, all of whom used insulin to manage their diabetes. These data were collected by Amylin Pharmaceuticals, San Diego, CA and included 6-8 months of SMBG data (approximately 300,000 readings), accompanied by baseline and 6-month HbA_1c determinations and some demographic data. These subjects were participating in a clinical trial investigating the effects of pramlintide (in doses of 60 to 120 micrograms) on metabolic control. The subjects' use pramlintide was randomized across the T1DM and T2DM groups (Table 1).</li></ol><tables id="tabl0002" num="0002"><table frame="all"><title><u><b>Table 1:</b> Demographic characteristics of the subjects in the Test Data Set.</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="49mm" /><colspec colnum="2" colname="col2" colwidth="30mm" /><colspec colnum="3" colname="col3" colwidth="30mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><thead><row><entry><i>Variable</i></entry><entry align="center" valign="middle"><b>T1DM - Mean(SD)</b></entry><entry align="center" valign="middle"><b>T2DM-Mean(SD)</b></entry><entry align="center" valign="middle"><b>p-level</b></entry></row></thead><tbody><row><entry valign="middle">Age (years)</entry><entry align="center" valign="middle">38.0 (13.4)</entry><entry align="center" valign="middle">58.1 (9.4)</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">Gender: Male/Female</entry><entry align="center" valign="middle">136/141</entry><entry align="center" valign="middle">157/166</entry><entry align="center" valign="middle">Ns</entry></row><row><entry valign="middle">Baseline HbA_1c</entry><entry align="center" valign="middle">9.74 (1.3)</entry><entry align="center" valign="middle">9.85 (1.3)</entry><entry align="center" valign="middle">Ns</entry></row><row><entry valign="middle">HbA_1c at month 6</entry><entry align="center" valign="middle">8.77 (1.1)</entry><entry align="center" valign="middle">8.98 (1.3)</entry><entry align="center" valign="middle">0.04</entry></row><row><entry valign="middle">Duration of diabetes (years)</entry><entry align="center" valign="middle">14.6 (9.8)</entry><entry align="center" valign="middle">13.5 (7.6)</entry><entry align="center" valign="middle">Ns</entry></row><row><entry valign="middle">Age at onset (years)</entry><entry align="center" valign="middle">23.4 (12.8)</entry><entry align="center" valign="middle">44.6 (10.4)</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle"># SMBG readings / subject / day</entry><entry align="center" valign="middle">3.2 (1.1)</entry><entry align="center" valign="middle">2.9 (0.9)</entry><entry align="center" valign="middle">&lt; 0.005</entry></row></tbody></tgroup></table></tables>

<b>Table 1</b> presents demographic characteristics and comparison of T1DM vs. T2DM subjects. For the first 6 months of the study the average HbA_1c declined significantly in both T1DM and T2 DM groups, perhaps due to the use of medication, which is out of the scope of this presentation (<b>Table 1</b>). This relatively rapid change in HbA_1c allowed for a better estimation of the predictive ability of Algorithm 1. In all data sets SMBG was performed using Lifescan ONE TOUCH II or ONE TOUCH PROFILE meters.

<u>ALGORITHM 1: EVALUATION OF HBA</u>_<u>1C</u>

Example No. 1 provides for, but not limited thereto, an optimization of the prediction of HbA_1c (<i>Algorithm 1</i>) through: (1) Weighting higher the more proximal SMBG; (2) Weighting higher more prolonged high BG events: (3) Calibrating the High BG Index with an earlier HbA_1c, and (4) Incorporating other patient variables, such as age, gender and duration of disease.

Algorithm 1 includes an optimal function of SMBG data that evaluates subsequent HbA_1c, as well as recommendations for the optimal duration of the data collection period and the optimal frequency of self-monitoring during that period. It is essential to note, however, that the broader goal of Algorithm 1 is to evaluate the status of patients' glycemic control. Although HbA_1c is the accepted "gold standard" for evaluation of glycemic control, currently it is unclear whether another measure, such as average SMBG or High BG Index, would not be a better predictor of long-term complications in diabetes than HbA_1c. Until this issue is clarified, the goal of Algorithm 1 will be to estimate HbA_1c. In order to approximate as closely as possible future real applications of Algorithm 1 we proceeded as follows: <ol id="ol0003" ol-style=""><li>(1) First, several optimal functions using different independent variables, optimal duration, and optimal frequency of SMBG were derived from two <i>training data sets</i> 1 and 2, collected in our previous studies involving patients with T1DM;</li><li>(2) Then, all coefficients were fixed and Algorithm 1 was applied to the much larger <i>test data set</i> containing data for both T1DM and T2DM subjects collected under very different conditions in a clinical trial conducted by Amylin Pharmaceuticals.</li><li>(3) Detailed estimation of the preciseness of Algorithm 1 for various optimal functions was made using the <i>test data set only.</i></li></ol>

This separation of <i>training</i> and <i>test</i> data sets allows us to claim that the estimated preciseness of Algorithm 1 can be generalized to any other data of subjects with T1DM or T2DM. Moreover, since the Amylin data (test data set) were collected from subjects who were undergoing treatment to lower their HbA_1c, and therefore exhibited unusually large variation of their HbA_1c over the 6-month period of observation, we can claim that Algorithm 1 is predictive not only of relatively constant HbA_1c, but also of large and unusually rapid changes in HbA_1c. Along these same lines, Algorithm 1 would be most useful for patients who have their goal to optimize their HbA_1c, which is presumably the patient group most likely to be interested in purchasing a meter with advanced features such as continuous evaluation of HbA_1c.

<u>Summary of the Results</u>

<ul id="ul0006" list-style="none" compact="compact"><li>■ The optimal SMBG data collection period is 45 days;</li><li>■ The optimal frequency of SMBG is 3 reading per day;</li><li>■ Two optimal HbA_1c estimating functions were developed: <i>F1</i> - using only SMBG data, and <b><i>F2</i></b> - using SMBG data plus an HbA_1c reading taken approximately 6 months prior to the HbA_1c that is being predicted;</li><li>■ The evaluation of the accuracy of HbA_1c prediction in the <i>test data set</i> (N=573 subjects) was done by several criteria that are detailed in the following pages (<b>Table 2</b>). Here we will mention that in T1DM the overall accuracy (within 20% of measured HbA_1c) of <b><i>F1</i></b> was 96.5% and the overall accuracy of <b><i>F2</i></b> was 95.7%. For T2DM the overall accuracy of <b><i>F1</i></b> was 95.9%, the overall accuracy of <b><i>F2</i></b> was 98.4%. Thus, the accuracy of both <b><i>F1</i></b> and <b><i>F2</i></b> is comparable to a direct measurement of HbA_1c;</li><li>■ Most importantly, for patients whose HbA_1c changed 2 or more units from their baseline reading (N=68), the accuracy of <b><i>F1</i></b> in predicting this change was 100% in both T1DM and T2DM, while the accuracy of <i>F2</i> was 71 % and 85% in T1DM and T2DM respectively;</li><li>■ Both <b><i>F1</i></b> and <b><i>F2</i></b> provided substantially more accurate estimation of HbA_1c at 6 months than the original HbA_1c estimate at month 0. Using the average BG as a direct estimate of HbA_1c is not accurate as well;</li><li>■ A number of alternative approaches were tested, such as selecting specific times of the day (postprandial reading) for evaluation of HbA_1c, different weighting of SMBG readings according to the elapsed time between each SMBG reading and HbA_1c determination, separate evaluation of subjects with different average blood glucose-to HbA_1c ratio, etc. While some of these alternative approaches achieved certain better results than the two functions proposed above, none was better overall. We can conclude that the optimal functions <b><i>F1</i></b> and <b><i>F2</i></b> will be used in future applications of Algorithm 1.</li></ul>

<u>Detailed Results <i>- Test Data Set</i></u>

The most important part of the evaluation of Algorithm 1 is the evaluation of its performance on a data that are not related to the data used for its development and optimization. From the test data set, the data of 573 subjects, N=254 with T1DM and N=319 with T2DM, were complete enough to be used for the evaluation of Algorithm 1.

<b><i><u>Optimal Algorithm 1:</u></i></b> For each subject, a 45-day subset of his/her SMBG reading was selected. This subset had a starting date of approximately 75 days before the subject's 6-month HbA_1c assay and ending date approximately 30 days before that assay. Since in this data set the time of HbA_1c assay is known only approximately, the elapsed time between last SMBG reading taken into analysis and HbA_1c is not exact. This time period was selected through sequential optimization of its duration and its ending point (how long before HbA_1c). The optimal duration was 45 days. The optimal ending time was 1 month prior to HbA_1c. In other words, a 45-day SMBG would predict the values of HbA_1c approximately one month ahead. However, the prediction of any other HbA_1c value between days 45 and 75 is almost as good - the differences are numerical rather than of clinical significance. Similarly, the difference between a 45-day monitoring period and a 60-day monitoring period is not great. However, monitoring periods shorter than 45 days cause a rapid decline in predictive power.

The optimal estimation functions are linear and are given by the formulas: <ul id="ul0007" list-style="none" compact="compact"><li><u>Estimate 1</u> - Without prior knowledge of HbA_1c: <maths id="math0011" num=""><math display="block"><mi mathvariant="normal">F</mi><mo>⁢</mo><mn mathvariant="normal">1</mn><mo>=</mo><mn mathvariant="normal">0.809098</mn><mo>*</mo><mi>BGMM</mi><mo>⁢</mo><mn mathvariant="normal">1</mn><mo>+</mo><mn mathvariant="normal">0.064540</mn><mo>*</mo><mi>LBGI</mi><mo>⁢</mo><mn mathvariant="normal">1</mn><mo>-</mo><mn>0.151673</mn><mo>*</mo><mi>RHI</mi><mo>⁢</mo><mn>1</mn><mo>+</mo><mn mathvariant="normal">1.873325</mn></math><img file="EP1534121B1_D0011.tif" /></maths></li><li><u>Estimate 2</u> - Knowing a prior HbA_1c (approximately 6 months ago). <maths id="math0012" num=""><math display="block"><mi mathvariant="normal">F</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mo>=</mo><mn mathvariant="normal">0.682742</mn><mo>*</mo><mi>HBA</mi><mo>⁢</mo><mn mathvariant="normal">0</mn><mo>+</mo><mn mathvariant="normal">0.054377</mn><mo>*</mo><mi>RHI</mi><mo>⁢</mo><mn mathvariant="normal">1</mn><mo>+</mo><mn mathvariant="normal">1.553277</mn></math><img file="EP1534121B1_D0012.tif" /></maths></li></ul>

In these formulas BGMM1 is the average blood glucose computed from the 45 days of SMBG readings; LBGI1 and RHI1 are the Low and the High BG Indices computed from the same readings, and HBA0 is the baseline HbA_1c reading that is used for Estimate 2 only. The values of the coefficients are optimized using the training data set and relevant statistics and plots are presented in section Detailed Results - Training data set.

The functions <b><i>F1</i></b> and <b><i>F2</i></b> produce point estimates of HbA_1c, i.e. each function produces an estimated value of HbA_1c. Interval estimates can be obtained by using the regression error estimates presented in section Detailed Results - Training data set. However, applied to the test data set, these interval estimates will not be true 90% or 95% confidence intervals for HbA_1c because they are originally derived from the training data set and are only applied to the test data (see also the statistical note in the next section).

<b><i><u>Evaluation of the accuracy of Algorithm 1:</u></i> Tables 2A and 2B</b> present results from the evaluation of the optimal Algorithm 1 with data from the test data set for subjects with T1DM and T2DM, respectively. Several criteria were used: <ol id="ol0004" ol-style=""><li>(1) Absolute deviation (AERR) of Estimated from measured HbA_1c;</li><li>(2) Absolute percent deviation (PERR) of Estimated from measured HbA_1c;</li><li>(3) Percent Estimates within 20% of measured HbA_1c (HIT 20),</li><li>(4) Percent readings within 10 of measured HbA_1c (HIT 10), and</li><li>(5) Percent readings outside of a 25%-zone around measured HbA_1c (MISS 25).</li></ol><tables id="tabl0003" num="0003"><table frame="all"><title><u><b>Table 2A:</b> Accuracy of Algorithm 1 in T1DM (N=254 subjects).</u></title><tgroup cols="6"><colspec colnum="1" colname="col1" colwidth="22mm" /><colspec colnum="2" colname="col2" colwidth="15mm" /><colspec colnum="3" colname="col3" colwidth="15mm" /><colspec colnum="4" colname="col4" colwidth="23mm" /><colspec colnum="5" colname="col5" colwidth="22mm" /><colspec colnum="6" colname="col6" colwidth="17mm" /><thead><row><entry valign="middle" /><entry align="center" valign="middle"><b>F1</b></entry><entry align="center" valign="middle"><b>F2</b></entry><entry align="center" valign="middle"><b>Average BG</b></entry><entry align="center" valign="middle"><b>Prior HbA_1c</b></entry><entry align="center" valign="middle"><b>P-value</b></entry></row></thead><tbody><row><entry valign="middle">AERR</entry><entry align="center" valign="middle">0.77</entry><entry align="center" valign="middle">0.61</entry><entry align="center" valign="middle">1.68</entry><entry align="center" valign="middle">1.1</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">PERR (%)</entry><entry align="center" valign="middle">8.3</entry><entry align="center" valign="middle">7.1</entry><entry align="center" valign="middle">19.4</entry><entry align="center" valign="middle">12.8</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">HIT20 (%)</entry><entry align="center" valign="middle">96.5</entry><entry align="center" valign="middle">95.7</entry><entry align="center" valign="middle">61.0</entry><entry align="center" valign="middle">81.0</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">HIT10(%)</entry><entry align="center" valign="middle">65.4</entry><entry align="center" valign="middle">75.5</entry><entry align="center" valign="middle">29.9</entry><entry align="center" valign="middle">48.2</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">MISS 25 (%)</entry><entry align="center" valign="middle">2.4</entry><entry align="center" valign="middle">1.6</entry><entry align="center" valign="middle">28.4</entry><entry align="center" valign="middle">9.9</entry><entry align="center" valign="middle" /></row></tbody></tgroup></table></tables><tables id="tabl0004" num="0004"><table frame="all"><title><u><b>Table 2B:</b> Accuracy of Algorithm 1 in T2DM (N=319 subjects).</u></title><tgroup cols="6"><colspec colnum="1" colname="col1" colwidth="23mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="14mm" /><colspec colnum="4" colname="col4" colwidth="23mm" /><colspec colnum="5" colname="col5" colwidth="23mm" /><colspec colnum="6" colname="col6" colwidth="16mm" /><thead><row><entry valign="middle" /><entry align="center" valign="middle"><b>F1</b></entry><entry align="center" valign="middle"><b>F2</b></entry><entry align="center" valign="middle"><b>Average BG</b></entry><entry align="center" valign="middle"><b>Prior HbA_1c</b></entry><entry align="center" valign="middle"><b>P</b>-<b>value</b></entry></row></thead><tbody><row><entry valign="middle">AERR</entry><entry align="center" valign="middle">0.72</entry><entry align="center" valign="middle">0.57</entry><entry align="center" valign="middle">1.92</entry><entry align="center" valign="middle">0.87</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">PERR (%)</entry><entry align="center" valign="middle">7.6</entry><entry align="center" valign="middle">6.4</entry><entry align="center" valign="middle">20.9</entry><entry align="center" valign="middle">11.7</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">HIT20 (%)</entry><entry align="center" valign="middle">95.9</entry><entry align="center" valign="middle">98.4</entry><entry align="center" valign="middle">56.4</entry><entry align="center" valign="middle">82.8</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">HIT10 (%)</entry><entry align="center" valign="middle">70.2</entry><entry align="center" valign="middle">79.3</entry><entry align="center" valign="middle">29.5</entry><entry align="center" valign="middle">53.3</entry><entry align="center" valign="middle">&lt; 0.001</entry></row><row><entry valign="middle">MISS 25 (%)</entry><entry align="center" valign="middle">1.2</entry><entry align="center" valign="middle">0.6</entry><entry align="center" valign="middle">36.7</entry><entry align="center" valign="middle">8.2</entry><entry align="center" valign="middle">&lt; 0.001</entry></row></tbody></tgroup></table></tables>

The first two columns in <b>Tables 2A and 2B</b> present the results for the optimal functions <b><i>F1</i></b> and <b><i>F2</i></b> respectively. The third column presents the accuracy of the estimation if the average BG (in mmol/l) was taken as an estimate of HbA_1c. The fourth column presents the same accuracy measures computed using the HbA_1c assay at time 0 as an estimate of HbA_1c at 6 months. It is evident that for both T1DM and T2DM <b><i>F2</i></b> is a little better overall estimate of HbA_1c than <b><i>F1</i></b>. Most importantly, both <b><i>F1</i></b> and <b><i>F2</i></b> are substantially better estimates of HbA_1c than its earlier value, or than the average BG. This is especially true for the % estimates that fell outside of the 25% accuracy zone. The difference between the performance of <b><i>F1</i></b> and <b><i>F2</i></b> and the estimate from a prior HbA_1c assay is highly significant (column 4).

<u>Statistical Note:</u> It is important to note that it is not appropriate to evaluate the accuracy of Algorithm 1 using traditional, regression-type criteria, such as R² or F and p values from ANOVA table. This is because the parameter estimates were derived from another unrelated data set (the training data) and are only applied to this test data set. Thus, statistical assumptions for the underlying model are violated (for example in the test data set the sum of the residuals will not be zero) and therefore R², F, and p lose their statistical meaning.

Further evaluation of the accuracy of Algorithm 1 in the test data set was done by reviewing the T1DM and T2DM subjects who had a substantial change in their SMBG reading from the baseline to 6-month follow-up. <b>Tables 3A and 3B</b> present list of the T1DM and T2DM subjects who had an absolute change in their HbA_1c equal to or greater than 2 units. In each subject group 34 subjects had such a change in HbA_1c. Algorithm 1, function F1, predicted 100% of such changes in both T1DM and T2DM. The predictive power of F2 was diminished due to the inclusion of baseline HbA_1c in the equation (which partially pulls the estimates back to the baseline value of HbA_1c) and was 71% in T1DM and 85% in T2DM. The baseline HbA_1c was outside of the 20% zone from 6-month HbA_1c for all but 2 subjects: <tables id="tabl0005" num="0005"><table frame="none"><title><b><u>Table 3A: T1DM subjects who experienced change in their HbA</u>_<u>1c</u></b><u>&gt;= <b>2 units</b>.</u></title><tgroup cols="9" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="18mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="14mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="14mm" /><colspec colnum="6" colname="col6" colwidth="14mm" /><colspec colnum="7" colname="col7" colwidth="14mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="14mm" /><thead><row><entry align="center" valign="top">ID HBA0</entry><entry align="center" valign="top">HBA0</entry><entry align="center" valign="top">HBA6</entry><entry align="center" valign="top">DHBA</entry><entry align="center" valign="top">F1</entry><entry align="center" valign="top">F2</entry><entry align="center" valign="top">HIT F1</entry><entry align="center" valign="top">HIT F2</entry><entry align="center" valign="top">HIT</entry></row></thead><tbody><row><entry align="right">6504</entry><entry align="char" char="." charoff="26">12.0</entry><entry align="char" char="." charoff="26">7.0</entry><entry align="char" char="." charoff="13">5.00</entry><entry align="char" char="." charoff="13">6.82</entry><entry align="char" char="." charoff="26">9.90</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6613</entry><entry align="char" char="." charoff="26">10.5</entry><entry align="char" char="." charoff="26">6.8</entry><entry align="char" char="." charoff="13">3.70</entry><entry align="char" char="." charoff="13">8.02</entry><entry align="char" char="." charoff="26">9.37</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">4003</entry><entry align="char" char="." charoff="26">12.4</entry><entry align="char" char="." charoff="26">8.9</entry><entry align="char" char="." charoff="13">3.50</entry><entry align="char" char="." charoff="13">8.45</entry><entry align="char" char="." charoff="26">10.73</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6204</entry><entry align="char" char="." charoff="26">11.0</entry><entry align="char" char="." charoff="26">7.5</entry><entry align="char" char="." charoff="13">3.50</entry><entry align="char" char="." charoff="13">7.29</entry><entry align="char" char="." charoff="26">9.45</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3709</entry><entry align="char" char="." charoff="26">13.0</entry><entry align="char" char="." charoff="26">9.7</entry><entry align="char" char="." charoff="13">3.30</entry><entry align="char" char="." charoff="13">8.99</entry><entry align="char" char="." charoff="26">11.54</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">4701</entry><entry align="char" char="." charoff="26">12.8</entry><entry align="char" char="." charoff="26">9.5</entry><entry align="char" char="." charoff="13">3.30</entry><entry align="char" char="." charoff="13">9.50</entry><entry align="char" char="." charoff="26">11.61</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3614</entry><entry align="char" char="." charoff="26">11.9</entry><entry align="char" char="." charoff="26">8.7</entry><entry align="char" char="." charoff="13">3.20</entry><entry align="char" char="." charoff="13">8.24</entry><entry align="char" char="." charoff="26">10.30</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3602</entry><entry align="char" char="." charoff="26">11.5</entry><entry align="char" char="." charoff="26">8.3</entry><entry align="char" char="." charoff="13">3.20</entry><entry align="char" char="." charoff="13">7.93</entry><entry align="char" char="." charoff="26">9.94</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6008</entry><entry align="char" char="." charoff="26">11.3</entry><entry align="char" char="." charoff="26">8.3</entry><entry align="char" char="." charoff="13">3.00</entry><entry align="char" char="." charoff="13">9.30</entry><entry align="char" char="." charoff="26">10.53</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3723</entry><entry align="char" char="." charoff="26">13.0</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="13">2.90</entry><entry align="char" char="." charoff="13">8.80</entry><entry align="char" char="." charoff="26">11.46</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">7010</entry><entry align="char" char="." charoff="26">12.7</entry><entry align="char" char="." charoff="26">9.8</entry><entry align="char" char="." charoff="13">2.90</entry><entry align="char" char="." charoff="13">8.09</entry><entry align="char" char="." charoff="26">10.89</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6208</entry><entry align="char" char="." charoff="26">11.5</entry><entry align="char" char="." charoff="26">8.7</entry><entry align="char" char="." charoff="13">2.80</entry><entry align="char" char="." charoff="13">8.42</entry><entry align="char" char="." charoff="26">10.09</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6202</entry><entry align="char" char="." charoff="26">10.6</entry><entry align="char" char="." charoff="26">7.8</entry><entry align="char" char="." charoff="13">2.80</entry><entry align="char" char="." charoff="13">7.91</entry><entry align="char" char="." charoff="26">9.37</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3924</entry><entry align="char" char="." charoff="26">9.9</entry><entry align="char" char="." charoff="26">7.2</entry><entry align="char" char="." charoff="13">2.70</entry><entry align="char" char="." charoff="13">7.71</entry><entry align="char" char="." charoff="26">8.72</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">8211</entry><entry align="char" char="." charoff="26">11.0</entry><entry align="char" char="." charoff="26">8.3</entry><entry align="char" char="." charoff="13">2.70</entry><entry align="char" char="." charoff="13">8.76</entry><entry align="char" char="." charoff="26">10.32</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6012</entry><entry align="char" char="." charoff="26">9.3</entry><entry align="char" char="." charoff="26">6.7</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="13">7.82</entry><entry align="char" char="." charoff="26">8.35</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3913</entry><entry align="char" char="." charoff="26">11.0</entry><entry align="char" char="." charoff="26">8.4</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="13">7.88</entry><entry align="char" char="." charoff="26">9.54</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6701</entry><entry align="char" char="." charoff="26">11.2</entry><entry align="char" char="." charoff="26">8.6</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="13">8.75</entry><entry align="char" char="." charoff="26">10.07</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">2307</entry><entry align="char" char="." charoff="26">10.6</entry><entry align="char" char="." charoff="26">8.1</entry><entry align="char" char="." charoff="13">2.50</entry><entry align="char" char="." charoff="13">7.95</entry><entry align="char" char="." charoff="26">9.27</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3516</entry><entry align="char" char="." charoff="26">11.8</entry><entry align="char" char="." charoff="26">9.3</entry><entry align="char" char="." charoff="13">2.50</entry><entry align="char" char="." charoff="13">7.76</entry><entry align="char" char="." charoff="26">10.03</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">5808</entry><entry align="char" char="." charoff="26">9.6</entry><entry align="char" char="." charoff="26">7.2</entry><entry align="char" char="." charoff="13">2.40</entry><entry align="char" char="." charoff="13">7.61</entry><entry align="char" char="." charoff="26">8.52</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">2201</entry><entry align="char" char="." charoff="26">11.8</entry><entry align="char" char="." charoff="26">9.5</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="13">8.90</entry><entry align="char" char="." charoff="26">10.71</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">4010</entry><entry align="char" char="." charoff="26">12.4</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="13">8.57</entry><entry align="char" char="." charoff="26">11.15</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6210</entry><entry align="char" char="." charoff="26">11.9</entry><entry align="char" char="." charoff="26">9.6</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="13">8.33</entry><entry align="char" char="." charoff="26">10.40</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">4904</entry><entry align="char" char="." charoff="26">11.3</entry><entry align="char" char="." charoff="26">9.1</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="13">8.63</entry><entry align="char" char="." charoff="26">10.29</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6709</entry><entry align="char" char="." charoff="26">10.3</entry><entry align="char" char="." charoff="26">8.1</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="13">7.83</entry><entry align="char" char="." charoff="26">9.04</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6619</entry><entry align="char" char="." charoff="26">9.5</entry><entry align="char" char="." charoff="26">7.3</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="13">7.64</entry><entry align="char" char="." charoff="26">8.57</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3921</entry><entry align="char" char="." charoff="26">10.9</entry><entry align="char" char="." charoff="26">8.8</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="13">7.20</entry><entry align="char" char="." charoff="26">9.19</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6603</entry><entry align="char" char="." charoff="26">11.0</entry><entry align="char" char="." charoff="26">8.9</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="13">8.18</entry><entry align="char" char="." charoff="26">9.89</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">7415</entry><entry align="char" char="." charoff="26">10.6</entry><entry align="char" char="." charoff="26">8.5</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="13">7.94</entry><entry align="char" char="." charoff="26">9.27</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">6515</entry><entry align="char" char="." charoff="26">9.8</entry><entry align="char" char="." charoff="26">7.8</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="13">7.13</entry><entry align="char" char="." charoff="26">8.54</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3611</entry><entry align="char" char="." charoff="26">10.3</entry><entry align="char" char="." charoff="26">8.3</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="13">8.36</entry><entry align="char" char="." charoff="26">9.23</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry align="right">3732</entry><entry align="char" char="." charoff="26">13.2</entry><entry align="char" char="." charoff="26">11.2</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="13">9.30</entry><entry align="char" char="." charoff="26">11.99</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry></row><row><entry align="right">7409</entry><entry align="char" char="." charoff="26">10.0</entry><entry align="char" char="." charoff="26">8.0</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="13">7.99</entry><entry align="char" char="." charoff="26">9.04</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row></tbody></tgroup></table></tables><tables id="tabl0006" num="0006"><table frame="bottom"><title><b><u>Table 3B: T2DM subjects who experienced change</u><u>in their HbA</u>_<u>1c</u></b><u><b>&gt;= 2 units</b>.</u></title><tgroup cols="9" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="18mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="14mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="14mm" /><colspec colnum="6" colname="col6" colwidth="14mm" /><colspec colnum="7" colname="col7" colwidth="14mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="14mm" /><thead><row><entry align="center" valign="top">ID HBA0</entry><entry align="center" valign="top">HBA0</entry><entry align="center" valign="top">HBA6</entry><entry align="center" valign="top">DHBA</entry><entry align="center" valign="top">F1</entry><entry align="center" valign="top">F2</entry><entry align="center" valign="top">HIT F1</entry><entry align="center" valign="top">HIT F2</entry><entry align="center" valign="top">HIT</entry></row></thead><tbody><row><entry>6754</entry><entry align="char" char="." charoff="26">10.8</entry><entry align="char" char="." charoff="26">7.0</entry><entry align="char" char="." charoff="13">3.80</entry><entry align="char" char="." charoff="26">6.90</entry><entry align="char" char="." charoff="26">9.03</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6361</entry><entry align="char" char="." charoff="26">11.3</entry><entry align="char" char="." charoff="26">7.6</entry><entry align="char" char="." charoff="13">3.70</entry><entry align="char" char="." charoff="26">8.51</entry><entry align="char" char="." charoff="26">10.20</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6270</entry><entry align="char" char="." charoff="26">12.0</entry><entry align="char" char="." charoff="26">8.6</entry><entry align="char" char="." charoff="13">3.40</entry><entry align="char" char="." charoff="26">7.85</entry><entry align="char" char="." charoff="26">10.03</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6264</entry><entry align="char" char="." charoff="26">11.1</entry><entry align="char" char="." charoff="26">7.8</entry><entry align="char" char="." charoff="13">3.30</entry><entry align="char" char="." charoff="26">8.31</entry><entry align="char" char="." charoff="26">9.70</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6355</entry><entry align="char" char="." charoff="26">11.8</entry><entry align="char" char="." charoff="26">8.6</entry><entry align="char" char="." charoff="13">3.20</entry><entry align="char" char="." charoff="26">7.99</entry><entry align="char" char="." charoff="26">9.90</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3961</entry><entry align="char" char="." charoff="26">10.8</entry><entry align="char" char="." charoff="26">8.0</entry><entry align="char" char="." charoff="13">2.80</entry><entry align="char" char="." charoff="26">9.13</entry><entry align="char" char="." charoff="26">9.73</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6555</entry><entry align="char" char="." charoff="26">11.1</entry><entry align="char" char="." charoff="26">8.3</entry><entry align="char" char="." charoff="13">2.80</entry><entry align="char" char="." charoff="26">8.11</entry><entry align="char" char="." charoff="26">9.55</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>8052</entry><entry align="char" char="." charoff="26">11.7</entry><entry align="char" char="." charoff="26">8.9</entry><entry align="char" char="." charoff="13">2.80</entry><entry align="char" char="." charoff="26">7.68</entry><entry align="char" char="." charoff="26">9.80</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>5356</entry><entry align="char" char="." charoff="26">9.7</entry><entry align="char" char="." charoff="26">7.0</entry><entry align="char" char="." charoff="13">2.70</entry><entry align="char" char="." charoff="26">6.75</entry><entry align="char" char="." charoff="26">8.20</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3966</entry><entry align="char" char="." charoff="26">10.3</entry><entry align="char" char="." charoff="26">7.7</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="26">8.08</entry><entry align="char" char="." charoff="26">9.07</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>908</entry><entry align="char" char="." charoff="26">9.5</entry><entry align="char" char="." charoff="26">6.9</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="26">7.47</entry><entry align="char" char="." charoff="26">8.23</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6554</entry><entry align="char" char="." charoff="26">10.7</entry><entry align="char" char="." charoff="26">8.1</entry><entry align="char" char="." charoff="13">2.60</entry><entry align="char" char="." charoff="26">8.16</entry><entry align="char" char="." charoff="26">9.42</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>2353</entry><entry align="char" char="." charoff="26">11.1</entry><entry align="char" char="." charoff="26">8.7</entry><entry align="char" char="." charoff="13">2.40</entry><entry align="char" char="." charoff="26">8.99</entry><entry align="char" char="." charoff="26">9.90</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>4064</entry><entry align="char" char="." charoff="26">11.3</entry><entry align="char" char="." charoff="26">8.9</entry><entry align="char" char="." charoff="13">2.40</entry><entry align="char" char="." charoff="26">7.89</entry><entry align="char" char="." charoff="26">9.88</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6351</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="26">7.7</entry><entry align="char" char="." charoff="13">2.40</entry><entry align="char" char="." charoff="26">7.92</entry><entry align="char" char="." charoff="26">8.63</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>7551</entry><entry align="char" char="." charoff="26">12.2</entry><entry align="char" char="." charoff="26">9.8</entry><entry align="char" char="." charoff="13">2.40</entry><entry align="char" char="." charoff="26">9.17</entry><entry align="char" char="." charoff="26">11.02</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6358</entry><entry align="char" char="." charoff="26">8.4</entry><entry align="char" char="." charoff="26">6.1</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="26">7.00</entry><entry align="char" char="." charoff="26">7.32</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3965</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="26">7.8</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="26">7.83</entry><entry align="char" char="." charoff="26">8.64</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>914</entry><entry align="char" char="." charoff="26">11.1</entry><entry align="char" char="." charoff="26">8.8</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="26">9.57</entry><entry align="char" char="." charoff="26">10.33</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>1603</entry><entry align="char" char="." charoff="26">10.2</entry><entry align="char" char="." charoff="26">7.9</entry><entry align="char" char="." charoff="13">2.30</entry><entry align="char" char="." charoff="26">8.02</entry><entry align="char" char="." charoff="26">8.88</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>1708</entry><entry align="char" char="." charoff="26">10.8</entry><entry align="char" char="." charoff="26">8.6</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="26">7.62</entry><entry align="char" char="." charoff="26">9.24</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3761</entry><entry align="char" char="." charoff="26">12.4</entry><entry align="char" char="." charoff="26">10.2</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="26">9.13</entry><entry align="char" char="." charoff="26">10.86</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3768</entry><entry align="char" char="." charoff="26">11.2</entry><entry align="char" char="." charoff="26">9.0</entry><entry align="char" char="." charoff="13">2.20</entry><entry align="char" char="." charoff="26">8.29</entry><entry align="char" char="." charoff="26">9.74</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>326</entry><entry align="char" char="." charoff="26">10.3</entry><entry align="char" char="." charoff="26">8.2</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">7.45</entry><entry align="char" char="." charoff="26">8.78</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>109</entry><entry align="char" char="." charoff="26">9.3</entry><entry align="char" char="." charoff="26">7.2</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">7.70</entry><entry align="char" char="." charoff="26">8.18</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>1501</entry><entry align="char" char="." charoff="26">11.9</entry><entry align="char" char="." charoff="26">9.8</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">8.52</entry><entry align="char" char="." charoff="26">10.18</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>3964</entry><entry align="char" char="." charoff="26">13.7</entry><entry align="char" char="." charoff="26">11.6</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">10.08</entry><entry align="char" char="." charoff="26">12.65</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry></row><row><entry>4352</entry><entry align="char" char="." charoff="26">12.2</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">9.51</entry><entry align="char" char="." charoff="26">11.14</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>7858</entry><entry align="char" char="." charoff="26">12.1</entry><entry align="char" char="." charoff="26">10.0</entry><entry align="char" char="." charoff="13">2.10</entry><entry align="char" char="." charoff="26">9.53</entry><entry align="char" char="." charoff="26">11.01</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>4256</entry><entry align="char" char="." charoff="26">10.6</entry><entry align="char" char="." charoff="26">8.6</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="26">8.76</entry><entry align="char" char="." charoff="26">9.69</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>4752</entry><entry align="char" char="." charoff="26">10.1</entry><entry align="char" char="." charoff="26">8.1</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="26">8.51</entry><entry align="char" char="." charoff="26">8.87</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6556</entry><entry align="char" char="." charoff="26">11.1</entry><entry align="char" char="." charoff="26">9.1</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="26">8.72</entry><entry align="char" char="." charoff="26">9.68</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>6562</entry><entry align="char" char="." charoff="26">7.9</entry><entry align="char" char="." charoff="26">5.9</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="26">7.07</entry><entry align="char" char="." charoff="26">7.04</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row><row><entry>8255</entry><entry align="char" char="." charoff="26">10.9</entry><entry align="char" char="." charoff="26">8.9</entry><entry align="char" char="." charoff="13">2.00</entry><entry align="char" char="." charoff="26">8.90</entry><entry align="char" char="." charoff="26">9.87</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">100.00</entry><entry align="char" char="." charoff="38">.00</entry></row></tbody></tgroup><tgroup cols="9" rowsep="0"><colspec colnum="1" colname="col1" colwidth="18mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="14mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="14mm" /><colspec colnum="6" colname="col6" colwidth="14mm" /><colspec colnum="7" colname="col7" colwidth="14mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="14mm" /><tbody><row><entry namest="col1" nameend="col9" align="justify"><b><u>In Tables 3A and 3B:</u></b> ID - subject's ID number; HBA0 - baseline HbA_1c; HBA6 - measured 6-month HbA_1c; DHBA - absolute difference between baseline and 6-month HBA_1c; F1- Estimated HbA_1c by Function <b><i>F1</i></b>, SMBG data only; F2 - Estimated HbA_1c by Function <b><i>F2</i></b> using prior HbA_1c assay; Hit F 1 = 100 if <b><i>F1</i></b> is within 20% of 6-month Hba_1c reading, 0 otherwise; Hit F2 = 100 if <b><i>F2</i></b> is within 20% of 6-month Hba_1c reading, 0 otherwise, and Hit HbA0 =100 if baseline HbA_1c is within 20% of 6-month Hba_1c reading, 0 otherwise.</entry></row></tbody></tgroup></table></tables>

<u>Detailed Results <i>- Training Data Set</i></u>

This section describes the steps to optimization of Algorithm 1. This optimization included two parts: (1) Assuming that no previous HbA_1c reading is available, and (2) Assuming that a prior HbA_1c could be used for prediction of HbA_1c.

Several different functions were considered for description of the relationship between SMBG data and HbA_1c. Optimal, in terms of accuracy and simplicity of computation, appeared to be a linear function of the average of SMBG readings, Low and High BG Indices, if no prior HbA_1c reading is used and another linear function of a prior HbA_1c and the High BG Index. Nonlinear relationships did not enhance the goodness-of-fit of the models and therefore are not considered for practical application.

<b><i><u>Training Data set 1- No prior HbA</u>_<u>1c</u></i></b> A linear regression model was used to optimize the coefficient of function <b><i>F1</i>.</b> The optimal coefficients were presented in the previous section. Here we give data about the goodness-of-fit of the model: <tables id="tabl0007" num="0007"><table frame="none"><tgroup cols="2" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="19mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><tbody><row><entry>Multiple R</entry><entry>.71461</entry></row><row><entry>R Square</entry><entry>.51067</entry></row></tbody></tgroup></table></tables>

Analysis of Variance

<tables id="tabl0008" num="0008"><table frame="none"><tgroup cols="4" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="21mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="27mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><thead><row><entry align="center" valign="top" /><entry align="center" valign="top">DF</entry><entry align="center" valign="top">Sum of Squares</entry><entry align="center" valign="top">Mean Square</entry></row></thead><tbody><row><entry>Regression</entry><entry align="center">3</entry><entry align="char" char="." charoff="21">154.57097</entry><entry align="char" char="." charoff="15">51.52366</entry></row><row><entry>Residual</entry><entry align="center">90</entry><entry align="char" char="." charoff="21">148.10903</entry><entry align="char" char="." charoff="15">1.64566</entry></row></tbody></tgroup></table></tables><tables id="tabl0009" num="0009"><table frame="none"><tgroup cols="2"><colspec colnum="1" colname="col1" colwidth="23mm" colsep="0" /><colspec colnum="2" colname="col2" colwidth="27mm" colsep="0" /><tbody><row><entry>F = 31.30889</entry><entry>Signif F = .0000</entry></row></tbody></tgroup></table></tables> Analysis of the residuals of this model showed a close to normal distribution of the residuals (see <figref idref="f0011"><b>FIG. 11</b></figref>). The SD of the residuals was 1.2 (the mean is 0 by definition). Therefore we can accept that this model described the data well.

<b><i><u>Training Data set 2 - Prior HbA</u>_<u>1c</u><u>:</u></i></b> Again, a linear regression model was used to optimize the coefficient of function <b><i>F2</i></b>. The optimal coefficients were presented in the previous section. Here we give data about the goodness-of-fit of the model: <tables id="tabl0010" num="0010"><table frame="none"><tgroup cols="2" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="19mm" /><colspec colnum="2" colname="col2" colwidth="16mm" /><tbody><row><entry>Multiple R</entry><entry align="char" char="." charoff="0">.86907</entry></row><row><entry>R Square</entry><entry align="char" char="." charoff="0">.75528</entry></row></tbody></tgroup></table></tables>

Analysis of Variance

<tables id="tabl0011" num="0011"><table frame="none"><tgroup cols="4" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="21mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="27mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><thead><row><entry valign="top" /><entry valign="top">DF</entry><entry align="center" valign="top">Sum of Squares</entry><entry align="center" valign="top">Mean Square</entry></row></thead><tbody><row><entry>Regression</entry><entry>4</entry><entry align="char" char="." charoff="14">38.70237</entry><entry align="char" char="." charoff="8">9.67559</entry></row><row><entry>Residual</entry><entry>54</entry><entry align="char" char="." charoff="14">12.54000</entry><entry align="char" char="." charoff="8">.23222</entry></row></tbody></tgroup></table></tables><tables id="tabl0012" num="0012"><table frame="none"><tgroup cols="2"><colspec colnum="1" colname="col1" colwidth="23mm" colsep="0" /><colspec colnum="2" colname="col2" colwidth="27mm" colsep="0" /><tbody><row><entry>F = 41.66522</entry><entry>Signif F = .0000</entry></row></tbody></tgroup></table></tables>

Analysis of the residuals of this model showed a close to normal distribution of the residuals (see <figref idref="f0012"><b>FIG.12</b></figref>). The SD of the residuals was 0.47. Therefore we can accept that this model described the data well.

In addition, comparing the models without and with a prior HbA 1 c, we can conclude that if a prior HbA_1c is available for inclusion in the computations, the resulting model is substantially better both in terms of R² and in terms of residual error.

However, as we saw in the previous section, a prior HbA_1c does not contribute to the overall accuracy of prediction in an unrelated dataset and, in certain cases when HbA_1c changed substantially, is even obstructing the ability of the algorithm to account for rapid changes. Thus, we can conclude that, even if a prior HbA_1c maybe better from a statistical point of view, it may not have a sufficient practical utility to justify an inclusion of input of a reading in future meters. We also don't know what could be the elapsed time between an HbA1c assay and SMBG profile that would still render the HBA1c input useful. Perhaps this depends on the change of HBA1c during that time period - as we saw in the previous section, a change of 2 HbA_1c units makes a prior HbA_1c reading completely useless.

<u>The Ratio of SMBG to HbA</u>_<u>1c</u>

We will now present an alternative way to improve the statistical accuracy of the model fit and to keep a reasonable clinical applicability. It turns out that the ratio between the average of 45 days of SMBG readings and HbA_1c is a measure that has an almost perfect normal distribution (as evidenced by Kolmogorov-Smirnov test) and, most importantly, identifies three groups of subjects for whom this ratio is below 1.0, between 1.0 and 1.2, and above 1.2. Each of the first two groups accounts for approximately 40% of the subjects, the third group accounts for approximately 20% of the subjects. This is valid for both T1DM and T2DM and is observed in the training as well as in the test data sets. In addition, this ratio seems to be pretty stable over time and is perhaps a measure that reflects patients SMBG habits (for example, if SMBG is performed mostly at times when BG is low, the resulting average will underestimate HbA_1c and the corresponding ratio will be below 1.0). Keeping in mind that this is just a hypothesis that cannot be validated with the available data, we make some analyses that seem to demonstrate certain utility in knowing each person's ratio at some point of time. This may seem equivalent to knowing a prior HbA_1c, and it is perhaps equivalent in terms of data input, however the use of the ratio is very different than the use of a prior HbA_1c. Instead of being included directly into the prediction formula, the ratio is used to classify the person into using one of three different prediction formulas. These new formulas do not include HbA_1c directly and therefore do not suffer by the inertia of prediction that such inclusion may cause. In addition the average HbA_1c is not substantially different between the three groups defined by the ratio and is not correlated to the ratio, so the reason for different ratios in different persons must be unrelated to HbA_1c.

If we first classify the subjects in three groups according to their ratio and perform separate regression in the training data set, the goodness-of fit of the regression models increases substantially: (1) In group 1 (Ratio &lt; 1.0) we get Multiple R=0.86 and R²=0.73; (2) In group 2 (Ration between 1.0 and 1.2) the fit is almost perfect, R=0.97, R²=0.94, and (3) In group 3 (ratio &gt; 1.2) the fit is worst R=0.69, R²=0.47. Since all three regression models do not include a prior HbA_1c, we can conclude that the goodness-of-fit increases dramatically for about 80% of the subjects, remains the same for the rest 20% of the subjects, and these subjects for whom the fit will be worse can be identified in advance.

Further, separating the test data set in three groups according to the subject's ratio, we get prediction accuracy similar to the accuracy we have achieved before <b>(Tables 4A and 4B)</b>: <tables id="tabl0013" num="0013"><table frame="all"><title><u><b>Table 4A:</b> Accuracy of Algorithm 1 in T1DM (N=254 subjects).</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="22mm" /><colspec colnum="2" colname="col2" colwidth="22mm" /><colspec colnum="3" colname="col3" colwidth="28mm" /><colspec colnum="4" colname="col4" colwidth="22mm" /><thead><row>&lt;entry /&gt;<entry align="center"><b>Ratio &lt; 1.0</b></entry><entry align="center"><b>1.0 ≤ Ratio ≤ 1.2</b></entry><entry align="center"><b>Ratio &gt; 1.2</b></entry></row></thead><tbody><row><entry valign="bottom">AERR</entry><entry align="center" valign="bottom">0.70</entry><entry align="center" valign="bottom">0.63</entry><entry align="center" valign="bottom">0.74</entry></row><row><entry valign="bottom">PERR (%)</entry><entry align="center" valign="bottom">7.8</entry><entry align="center" valign="bottom">7.4</entry><entry align="center" valign="bottom">7.9</entry></row><row><entry valign="bottom">HIT20 (%)</entry><entry align="center" valign="bottom">93.8</entry><entry align="center" valign="bottom">93.0</entry><entry align="center" valign="bottom">95.5</entry></row><row><entry valign="bottom">HIT10 (%)</entry><entry align="center" valign="bottom">68.8</entry><entry align="center" valign="bottom">73.4</entry><entry align="center" valign="bottom">72.7</entry></row><row><entry valign="bottom">MISS 25 (%)</entry><entry align="center" valign="bottom">3.1</entry><entry align="center" valign="bottom">2.6</entry><entry align="center" valign="bottom">0.0</entry></row></tbody></tgroup></table></tables><tables id="tabl0014" num="0014"><table frame="all"><title><u><b>Table 4B:</b> Accuracy of Algorithm 1 in T2DM (N=319 subjects).</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="22mm" /><colspec colnum="2" colname="col2" colwidth="22mm" /><colspec colnum="3" colname="col3" colwidth="28mm" /><colspec colnum="4" colname="col4" colwidth="22mm" /><thead><row>&lt;entry /&gt;<entry align="center"><b>Ratio &lt; 1.0</b></entry><entry align="center"><b>1.0 ≤ Ratio ≤ 1.2</b></entry><entry align="center"><b>Ratio &gt; 1.2</b></entry></row></thead><tbody><row><entry valign="bottom">AERR</entry><entry align="center" valign="bottom">0.63</entry><entry align="center" valign="bottom">0.68</entry><entry align="center" valign="bottom">0.89</entry></row><row><entry valign="bottom">PERR (%)</entry><entry align="center" valign="bottom">7.6</entry><entry align="center" valign="bottom">7.8</entry><entry align="center" valign="bottom">8.8</entry></row><row><entry valign="bottom">HIT20 (%)</entry><entry align="center" valign="bottom">97.4</entry><entry align="center" valign="bottom">95.0</entry><entry align="center" valign="bottom">95.3</entry></row><row><entry valign="bottom">HIT10 (%)</entry><entry align="center" valign="bottom">67.2</entry><entry align="center" valign="bottom">65.3</entry><entry align="center" valign="bottom">57.7</entry></row><row><entry valign="bottom">MISS 25 (%)</entry><entry align="center" valign="bottom">0.0</entry><entry align="center" valign="bottom">1.7</entry><entry align="center" valign="bottom">0.0</entry></row></tbody></tgroup></table></tables>

In short, knowing the SMBG-to HBA1c ratio for each subject and using separate estimates accordingly, seem to improve the statistical performance of the models without losing clinical accuracy.

<u>Other hypotheses and ideas that were tested</u>

We have tested a number of other hypotheses and ideas which may prove useful at least for prompt and more focused analysis of the data that are collected by Example No. 2. A brief account of the results follows: <ol id="ol0005" ol-style=""><li>(1) HbA_1c is most associated (correlated) with SMBG readings taken in the afternoon hours - from 12 noon to 6 p.m. and least associated with fasting SMBG readings (4 a.m. - 8a.m.). However, it does not follow that taking only postprandial SMBG readings would improve the prediction of HbA_1c. on the contrary, the prediction would become worse if the [relatively small but important] contribution of all hours throughout the day is ignored. It is possible to improve a the prediction of HbA_1c a little if different hours throughout the day get different weighting, however the improvement is not sufficient to justify this additional complication of the model;</li><li>(2) The relationship between HbA_1c and average SMBG is substantially stronger in T2DM compared to T1DM, even if the two groups are matched by HBA_1c. In terms of direct correlation, in T1DM the coefficient is about 0.6 while in T2DM the coefficient is about 0.75 throughout the studies;</li><li>(3) Experiments with different weighting of SMBG reading dependent on the elapsed time between SMBG and HBA_1c assay (such as weighting higher more proximal results) did not yield better prediction of HBA_1c;</li><li>(4) Inclusion of demographic variables, such as age, duration of diabetes, gender, etc., does not improve the prediction of HBA1c;</li><li>(5) The simplest possible linear relationship between HbA_1c and average SMBG (measured in mmol/l) is given by the formula: HbA_1c = 0.41046*BGMM+ 4.0775. Although statistically inferior to the formulas <b><i>F1</i></b> and <b><i>F2</i></b>, this formula provides HbA_1c estimates that are about 95% accurate in both T1DM and T2DM (in terms of deviation less than 20% from HbA_1c assay) and maybe useful if the computation of the Low and High BG Indices presents an issue for incorporation in a meter (however, the prediction of hypoglycemia cannot be done without computing the Low BG Index and therefore this formula might be useful only for meters that include Algorithm 1 but not include Algorithms 2 and 3).</li></ol>

<b>ALGORITHM 2: EVALUATION of LONG-TERM RISK</b> for <b>SH.</b>

Example No. 1 provides for, but not limited thereto, an expansion of Algorithm 2 to include estimating individual probabilities for <i>biochemical significant hypoglycemia</i> (BSH, defined as BG reading &lt;= 39 mg/dl) or <i>biochemical moderate hypoglycemia</i> (BMH, defines as 39 mg/dl &lt; BG reading &lt;= 55 mg/dl). In addition, we planned to evaluate whether Algorithm 2 predicts better occurrence of nocturnal (midnight to 7:00am) SH, compared to daytime SH.

Algorithm 2 is a classification algorithm. That is, based on SMBG data for a subject, it classifies the subject in a certain risk category for future BSH or MSH. In order to approximate as closely as possible future real applications of Algorithm 2 we proceeded as follows: <ul id="ul0008" list-style="none" compact="compact"><li>(4) First, several optimal classification variables and optimal classification categories optimal duration, and optimal frequency of SMBG were derived from <i>training data set 1</i>;</li><li>(5) Then, the test data set was split into two sections: first 45 days, and the rest of the data. The optimal parameters of Algorithm 2 were applied to the first 45-day portion of the data and the so estimated probabilities for future BSH or MSH were used to predict BSH and MSH in the second portion of the data;</li><li>(6) Detailed estimation of the preciseness of Algorithm 2, was made using <i>test data only.</i></li></ul>

This separation of <i>training</i> and <i>test</i> data sets allows us to claim that the estimated preciseness of Algorithm 2 can be generalized to any other data of subjects with T1DM or T2DM. Moreover, since the Amylin data were collected from subjects who were undergoing intensive treatment, we can speculate that Algorithm 2 is tested and proven useful in subjects with changing and increasing risk for hypoglycemia.

<u>Summary of the Results</u>

<ul id="ul0009" list-style="none"><li>■ The optimal SMBG data collection period needed for estimation of the probability for future BSH or BMH is 40 to 45 days. The optimal frequency of SMBG is 3 to 4 readings per day. Larger number of readings does not lead to a substantial increase of the predictive power of Algorithm 2. With less than 3 reading per day the predictive power declines. However, this requirement refers to average number of readings per day for the 45-day observation period, it does not necessarily mean that 3-4 readings need to be performed every day;</li><li>■ The relationship between predictor variables and future SH and MH is strictly nonlinear. Consequently, linear methods are not applicable for optimal prediction, although an R²=50% can be achieved by a direct linear model (in comparison, the best result in the DCCT was 8% prediction of future SH);</li><li>■ A separate prediction of nocturnal SH is generally weaker than prediction of daytime SH;</li><li>■ Fifteen risk categories for future BSH and BMH were identified. The best separation of categories was achieved on the basis of the Low BG Index alone, although combinations between the low BG Index and other variables worked similarly well;</li><li>■ Although the frequencies of BSH and BMH were different between T1DM and T2DM (see <b>Table 5</b>), the conditional frequencies, given a risk category, were not different between T1DM and T2DM. This allowed for unified approach to the risk of SH and MH;</li><li>■ Various <i>empirical probabilities</i> for future were computed and compared for the 15 risk categories. All comparisons were highly significant, p's &lt; 0.0005.</li><li>■ These empirical probabilities were approximated by a two-parameter Weibull distributions yielding <i>theoretical probabilities</i> for future BSH and BMH in each risk category.</li><li>■ The goodness-of-fit of these approximation was very good - all coefficients of determination were above 85%, some as high as 98% (see <figref idref="f0001 f0002 f0003 f0004 f0005"><b>FIGS. 1-5</b></figref><b>and</b><figref idref="f0009 f0010"><b>9-10</b></figref>).</li></ul>

<u>Detailed Results <i>- Test Data Set</i></u>

<u><b><i>Identifying personal risk categories for SH</i>/<i>MH:</i></b></u> The data for all 600 subjects were used for these analyses. The Low BG Index (LBGI was computed for each subject from his/her first 45 days of SMBG data collection. Then, the LBGI for was classified in one of the 15 optimal risk categories (variable RCAT ranging from 0 to 14) as derived in training data set 1. These risk categories are defined by the inequalities: <ul id="ul0010" list-style="none" compact="compact"><li>if (LBGI le 0.25) RCAT=0.</li><li>if (LBGI gt 0.25 and LBGI le 0.5) RCAT=1.</li><li>if (LBGI gt 0.50 and LBGI le 0.75) RCAT=2.</li><li>if (LBGI gt 0.75 and LBGI le 1.00) RCAT=3.</li><li>if (LBGI gt 1.00 and LBGI le 1.25) RCAT=4.</li><li>if (LBGI gt 1.25 and LBGI le 1.50) RCAT=5.</li><li>if (LBGI gt 1.50 and LBGI le 1.75) RCAT=6.</li><li>if (LBGI gt 1.75 and LBGI le 2.00) RCAT=7.</li><li>if (LBGI gt 2.00 and LBGI le 2.50) RCAT=8.</li><li>if (LBGI gt 3.00 and LBGI le 3.50) RCAT=9.</li><li>if (LBGI gt 3.50 and LBGI le 4.00) RCAT=10.</li><li>if (LBGI gt 4.00 and LBGI le 4.50) RCAT=11.</li><li>if (LBGI gt 4.50 and LBGI le 5.25) RCAT=12.</li><li>if (LBGI gt 5.25 and LBGI le 6.50) RCAT=13.</li><li>if (LBGI gt 6.50) RCAT=14.</li></ul>

<b><i><u>Observed frequency of BSH and BMH:</u></i></b> For each subject, any occurrences of BSH and BMH registered by SMBG were counted for 1-month, 3-month, and 6-month periods following the initial 45-day data collection. <b>Table 5A</b> presents the observed frequencies of 0, &gt;=1, &gt;=2, and &gt;= 3 BSH and BMH for T1DM, <b>Table 5B</b> presents the same data for T2DM: <tables id="tabl0015" num="0015"><table frame="all"><title><u><b>Table 5A:</b> Observed frequency of BSH and BMH in T1DM</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="37mm" /><colspec colnum="2" colname="col2" colwidth="16mm" /><colspec colnum="3" colname="col3" colwidth="19mm" /><colspec colnum="4" colname="col4" colwidth="19mm" /><colspec colnum="5" colname="col5" colwidth="16mm" /><colspec colnum="6" colname="col6" colwidth="19mm" /><colspec colnum="7" colname="col7" colwidth="19mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle">BSH (BG ≤ 39 mg/dl)</entry><entry namest="col5" nameend="col7" align="center" valign="middle">BMH (39 mg/dl &lt; BG ≤ 55 mg/dl)</entry></row><row><entry valign="middle" /><entry align="center" valign="middle">1 month</entry><entry align="center" valign="middle">3 months</entry><entry align="center" valign="middle">6 months</entry><entry align="center" valign="middle">1 month</entry><entry align="center" valign="middle">3 months</entry><entry align="center" valign="middle">6 months</entry></row></thead><tbody><row><entry valign="middle">Average # / Subject</entry><entry align="center" valign="middle">0.82</entry><entry align="center" valign="middle">1.77</entry><entry align="center" valign="middle">2.74</entry><entry align="center" valign="middle">3.64</entry><entry align="center" valign="middle">8.33</entry><entry align="center" valign="middle">12.93</entry></row><row><entry valign="middle">% Ss with 0 episodes</entry><entry align="center" valign="middle">62.8</entry><entry align="center" valign="middle">50.8</entry><entry align="center" valign="middle">46.6</entry><entry align="center" valign="middle">25.2</entry><entry align="center" valign="middle">18.0</entry><entry align="center" valign="middle">17.7</entry></row><row><entry valign="middle">% Ss with ≥ 2 episodes</entry><entry align="center" valign="middle">18.8</entry><entry align="center" valign="middle">33.1</entry><entry align="center" valign="middle">38</entry><entry align="center" valign="middle">64.3</entry><entry align="center" valign="middle">75.6</entry><entry align="center" valign="middle">77.1</entry></row><row><entry valign="middle">% Ss with ≥ 3 episodes</entry><entry align="center" valign="middle">9.8</entry><entry align="center" valign="middle">23.3</entry><entry align="center" valign="middle">28.2</entry><entry align="center" valign="middle">50.8</entry><entry align="center" valign="middle">68.0</entry><entry align="center" valign="middle">71.1</entry></row></tbody></tgroup></table></tables><tables id="tabl0016" num="0016"><table frame="all"><title><u><b>Table 5B:</b> Observed frequency of BSH and BMH in T2DM</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="37mm" /><colspec colnum="2" colname="col2" colwidth="16mm" /><colspec colnum="3" colname="col3" colwidth="19mm" /><colspec colnum="4" colname="col4" colwidth="19mm" /><colspec colnum="5" colname="col5" colwidth="16mm" /><colspec colnum="6" colname="col6" colwidth="19mm" /><colspec colnum="7" colname="col7" colwidth="19mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle">BSH (BG ≤ 39 mg/dl)</entry><entry namest="col5" nameend="col7" align="center" valign="middle">BMH (39 mg/dl &lt; BG ≤ 55 mg/dl)</entry></row><row><entry valign="middle" /><entry align="center" valign="middle">1 month</entry><entry align="center" valign="middle">3 months</entry><entry align="center" valign="middle">6 months</entry><entry align="center" valign="middle">1 month</entry><entry align="center" valign="middle">3 months</entry><entry align="center" valign="middle">6 months</entry></row></thead><tbody><row><entry valign="middle">Average # / Subject</entry><entry align="center" valign="middle">0.18</entry><entry align="center" valign="middle">0.53</entry><entry align="center" valign="middle">0.76</entry><entry align="center" valign="middle">1.11</entry><entry align="center" valign="middle">2.93</entry><entry align="center" valign="middle">4.59</entry></row><row><entry valign="middle">% Ss with 0 episodes</entry><entry align="center" valign="middle">91.4</entry><entry align="center" valign="middle">84.9</entry><entry align="center" valign="middle">81.3</entry><entry align="center" valign="middle">73.0</entry><entry align="center" valign="middle">61.1</entry><entry align="center" valign="middle">55.8</entry></row><row><entry valign="middle">% Ss with ≥ 2 episodes</entry><entry align="center" valign="middle">3.6</entry><entry align="center" valign="middle">8.6</entry><entry align="center" valign="middle">10.1</entry><entry align="center" valign="middle">18.1</entry><entry align="center" valign="middle">26.7</entry><entry align="center" valign="middle">30.3</entry></row><row><entry valign="middle">% Ss with ≥ 3 episodes</entry><entry align="center" valign="middle">1.5</entry><entry align="center" valign="middle">5.9</entry><entry align="center" valign="middle">7.4</entry><entry align="center" valign="middle">13.9</entry><entry align="center" valign="middle">21.4</entry><entry align="center" valign="middle">25.8</entry></row></tbody></tgroup></table></tables>

<u><b><i>Nocturnal BSH and BMH</i></b></u> represented approximately 15% of all episodes registered by SMBG. As in the training data set the correlation between nocturnal episodes and all predictor variables was weaker. We conclude that a targeted prediction of nocturnal episodes would be ineffective.

<u><b><i>Empirical Probabilities for future BSH and BMH:</i></b></u> Certain empirical probabilities for future BSH and BMH were computed in each of the 15 risk categories. These probabilities include: (1) Probabilities for at least one BSH or BMH within the next 1 month, 3 months, and 6 months; (2) Probabilities for at least two BSH or BMH within the next 3 months and 6 months, and (3) Probabilities for at least three BSH or BMH within the next 6 months. Of course, it is possible to compute any other combinations probabilities upon request.

A most important conclusion from this analysis was that, given a risk category, the probabilities for future BSH and BMH did not differ significantly between T1DM and T2DM. This allows for an unified approach to empirical and theoretical estimation of these probabilities in both T1DM and T2DM. Consequently, the data for T1DM and T2DM patients were combined for the following analyses.

<figref idref="f0001 f0002 f0003 f0004 f0005"><b>FIGS. 1-5</b></figref><b>and</b><figref idref="f0009 f0010"><b>9-10</b></figref>present scatter-plots of the six computed empirical probabilities plotted along the 15 risk categories. The empirical probabilities for BSH are presented by black triangles, while the empirical probabilities for BMH are presented by red squares.

All sets of empirical probabilities were compared across the 15 risk categories using univariate ANOVAs, and all p-levels were below 0.0005. Therefore, we observe highly significant differences between the frequencies of BSH and BMH episodes in the different risk categories.

<b><i><u>Theoretical Probabilities for future BSH and BMH:</u></i></b> In order to be able to use direct-formula estimation of the probabilities for future BSH and BMH, we approximated the empirical probabilities using two-parameter Weibull probability distribution. The Weibull distribution function is given by the formula: <maths id="math0013" num=""><math display="block"><mi mathvariant="italic">F</mi><mfenced><mi mathvariant="italic">x</mi></mfenced><mo>=</mo><mn mathvariant="italic">1</mn><mo>-</mo><mi mathvariant="italic">exp</mi><mfenced separators=""><mo>-</mo><mi mathvariant="italic">a</mi><mn mathvariant="italic">.</mn><msup><mi mathvariant="italic">x</mi><mi mathvariant="italic">b</mi></msup></mfenced><mspace width="1em" /><mi>for</mi><mspace width="1em" /><mi>any</mi><mspace width="1em" /><mi>x</mi><mo>&gt;</mo><mn mathvariant="italic">0</mn><mspace width="1em" /><mi>and</mi><mspace width="1em" /><mn mathvariant="italic">0</mn><mspace width="1em" /><mi>otherwise</mi></math><img file="EP1534121B1_D0013.tif" /></maths>

<u>Statistical Note:</u> The parameters a and b are greater than 0 and are called scale and shape parameter, respectively. In the special case b=1, Weibull's distribution becomes exponential. This distribution is frequently used in engineering problems as the distribution of randomly occurring technical failures that are not completely unrelated to each other (If the failures are completely unrelated, then they would form a Poisson process that would be described by an exponential distribution, e.g. b=1). The situation here is remotely similar - we need to describe the distribution of events (failures) that are not completely independent and tend to occur in clusters as evidenced by our previous research.

Each set of empirical probabilities was approximated by the theoretical formula given above. The parameters were estimated using nonlinear least squares (with initial parameter estimates given by a linear double-logarithmic model). The goodness-of-fit of each model was evaluated by its coefficient of determination (D²). This statistics has a meaning similar to that of R² in linear regression, however R² is not applicable to nonlinear models.

the model fits are presented in <figref idref="f0001 f0002 f0003 f0004 f0005 f0006">FIGS. 1-6</figref> as black lines for the probabilities of BSH and as dashed lines for the probabilities of BMH. Above each figure we present the parameter estimates for the corresponding models, thus we give direct formulas for computing probabilities of 0, &gt;=1, &gt;=2, &gt;=3 BSH or BMS episodes in periods of 1 month, 3 months, and 6 months following initial SMBG. Some of these formulas, or their versions, can be included in monitoring devices or software as indicators of risk for SH and MH.

The values of <i>D²</i> (and its square root D) are given below each figure as indicators of the preciseness of approximation. All values are above 85% and some reach 98%, which demonstrates that the approximation is very good and confirms that theoretical, instead of empirical probabilities could be used in future studies/application.

The theoretical probabilities for one or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0001"><b>FIG. 1</b></figref><b>:</b><maths id="math0014" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">1.5839</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.0483</mn></mfenced></math><img file="EP1534121B1_D0014.tif" /></maths><maths id="math0015" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">4.1947</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.7472</mn></mfenced></math><img file="EP1534121B1_D0015.tif" /></maths>

<figref idref="f0001"><b>FIG. 1</b></figref> presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within one month after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index. Since the models are nonlinear, the goodness-of-fit is evaluated by their coefficient of determination <b>D²,</b> an analog of R² in linear models. The coefficients of determination and their square roots are as follows: <maths id="math0016" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">96</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">98</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0016.tif" /></maths><maths id="math0017" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">87</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">93</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0017.tif" /></maths>

The theoretical probabilities for one or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0002"><b>FIG. 2</b></figref><b>:</b><maths id="math0018" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">1.3731</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.1351</mn></mfenced></math><img file="EP1534121B1_D0018.tif" /></maths><maths id="math0019" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">3.2802</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.5050</mn></mfenced></math><img file="EP1534121B1_D0019.tif" /></maths>

<figref idref="f0002"><b>FIG. 2</b></figref> presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within three months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index.

The coefficients of determination and their square roots are as follows: <maths id="math0020" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">93</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">97</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0020.tif" /></maths><maths id="math0021" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">87</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">93</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0021.tif" /></maths>

The theoretical probabilities for one or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0003">FIG. 3</figref>: <maths id="math0022" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">1.3721</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.3511</mn></mfenced></math><img file="EP1534121B1_D0022.tif" /></maths><maths id="math0023" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">1</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">3.0591</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.4549</mn></mfenced></math><img file="EP1534121B1_D0023.tif" /></maths>

<figref idref="f0003"><b>FIG. 3</b></figref> presents the empirical and theoretical probabilities for moderate (dashed line) and severe (black line) hypoglycemia within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index.

The coefficients of determination and their square roots are as follows: <maths id="math0024" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">86</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">93</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0024.tif" /></maths><maths id="math0025" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">89</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">95</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0025.tif" /></maths>

The theoretical probabilities for two or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0004"><b>FIG. 4</b></figref><b>:</b><maths id="math0026" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn>2</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">1.6209</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.0515</mn></mfenced></math><img file="EP1534121B1_D0026.tif" /></maths><maths id="math0027" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn>2</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">4.6862</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.8580</mn></mfenced></math><img file="EP1534121B1_D0027.tif" /></maths>

<figref idref="f0004"><b>FIG. 4</b></figref> presents the empirical and theoretical probabilities for 2 or more moderate (dashed line) and severe (black line) hypoglycemic episodes within three months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index.

The coefficients of determination and their square roots are as follows: <maths id="math0028" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">98</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">99</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0028.tif" /></maths><maths id="math0029" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">90</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">95</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0029.tif" /></maths>

The theoretical probabilities for two or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0005"><b>FIG. 5</b></figref><b>:</b><maths id="math0030" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">2</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">1.7081</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.1955</mn></mfenced></math><img file="EP1534121B1_D0030.tif" /></maths><maths id="math0031" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn>2</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">4.5241</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.9402</mn></mfenced></math><img file="EP1534121B1_D0031.tif" /></maths>

<figref idref="f0005"><b>FIG. 5</b></figref> presents the empirical and theoretical probabilities for 2 or more moderate (dashed line) and severe (black line) hypoglycemic episodes within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index.

The coefficients of determination and their square roots are as follows: <maths id="math0032" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">98</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">99</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0032.tif" /></maths><maths id="math0033" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">89</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">95</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0033.tif" /></maths>

The theoretical probabilities for three or more moderate or severe hypoglycemic episodes are given by the formulas as shown in <figref idref="f0009">FIG. 9</figref>: <maths id="math0034" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>MH</mi><mo>&gt;</mo><mo>=</mo><mn>3</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">2.0222</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">1.2091</mn></mfenced></math><img file="EP1534121B1_D0034.tif" /></maths><maths id="math0035" num=""><math display="block"><mi mathvariant="normal">P</mi><mfenced separators=""><mi>SH</mi><mo>&gt;</mo><mo>=</mo><mn mathvariant="normal">3</mn></mfenced><mo>=</mo><mn mathvariant="normal">1</mn><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mi>exp</mi><mfenced separators=""><mo>-</mo><mn mathvariant="normal">5.5777</mn></mfenced><mo>*</mo><mi>Risk</mi><mo>*</mo><mo>*</mo><mn mathvariant="normal">2.2467</mn></mfenced></math><img file="EP1534121B1_D0035.tif" /></maths>

<figref idref="f0010"><b>FIG. 10</b></figref> presents the empirical and theoretical probabilities for 3 or more moderate (dashed line) and severe (black line) hypoglycemic episodes within six months after the SMBG assessment for each of the 15 categories of risk level defined by the Low BG Index.

The coefficients of determination and their square roots are as follows: <maths id="math0036" num=""><math display="block"><mi>SH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">97</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">99</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0036.tif" /></maths><maths id="math0037" num=""><math display="block"><mi>MH Model</mi><mo>:</mo><msup><mi mathvariant="bold">D</mi><mn mathvariant="bold">2</mn></msup><mo>=</mo><mn mathvariant="bold">90</mn><mo>%</mo><mo>,</mo><mi mathvariant="bold">D</mi><mo>=</mo><mn mathvariant="bold">95</mn><mo>%</mo><mn>.</mn></math><img file="EP1534121B1_D0037.tif" /></maths>

<u>Detailed Results <i>- Training Data Set</i></u>

The training data set contained SMBG data followed by monthly diaries of severe hypoglycemia. As opposed to the test data set where BSH and BMH were identified by cutoff BG values, the monthly diaries contained report of symptomatic severe episodes defined as unconsciousness, stupor, inability for self-treatment, or significant cognitive impairment due to hypoglycemia. Within 6 months following SMBG the subjects reported on average 2.24 such episodes per person with 67% of the subjects reporting no such episodes. From a statistical point of view, this alone makes the distribution of SH episodes substantially skewed and unsuitable for application of linear methods. Nevertheless linear regression could be used to evaluate the relative contribution of various variables to the prediction of SH, but not for building the final model. We performed the following three analyses: <ol id="ol0006" ol-style=""><li>(1) <u>No knowledge of SH history</u>: Ignoring any knowledge of history of SH, we used regression to predict future SH from baseline HbA_1c and SMBG characteristics such as average BG, Low BG Index, and estimated BG risk rate of change (all variables are described in the original invention disclosure). As repeatedly found before, HbA_1c and average BG did not have any contribution to the forecast of SH. The final regression model included the Low BG Index and the BG risk rate of change and had the following goodness-of-fit: <img file="EP1534121B1_D0038.tif" /></li><li>(2) <u>Knowledge of prior SH:</u> When we included the number of SH episodes in the previous year as reported in a screening questionnaire, this variable accounted for an additional 11 % of the variance of future SH: <img file="EP1534121B1_D0039.tif" /></li><li>(3) Without knowledge of the number of prior SH, just knowing whether a person had or did not have prior SH, we were able to account for 45% of the variance of future SH using only SMBG variables;</li><li>(4) Finally, two separate linear models accounted for 55% of the variance in daytime SH vs. 25% of the variance in nocturnal SH. The direct correlations of all predictor variables with nocturnal SH were also weaker. Nocturnal episodes represented 30% of all SH.</li></ol>

We conclude that a linear predictive model could directly account for about 40 to 50% of the variance of future SH. However, such a model is not well balanced in terms of its residual errors (which is due to the highly skewed distribution of the number of SH episodes across the diabetic population). A statistical evidence for that is given by the normal probability plot of <figref idref="f0013"><b>FIG. 13</b></figref>, which shows a substantial deviation of the standardized residuals from their expected values:

Thus, we adopt another approach to predicting SH based on classification of subjects into risk categories using their SMBG data and estimation of the probabilities for subsequent SH in these categories. We attempted various classification models maximizing the difference between the risk categories and trying to achieve a maximum resolution of risk evaluation (in terms of maximal number of categories).

The best results were achieved by the classification based on the Low BG Index alone that had 15 risk categories (presented in the beginning of the previous section).

In addition to its best separation between categories, this result has other advantages as well: (1) No prior knowledge of history of SH is required; (2) The calculation is relatively simple and does not require tracking of temporal variables such as BG rate of change, and (3) The classification appeared to be equally applicable to both T1DM and T2DM patients (which is coherent with no requirements for knowledge of prior SH).

<i><u>ALGORITHM 3: EVALUATION of SHORT-TERM RISK FOR HYPOGLYCEMIA</u></i>

Example No. 1 provides for, but not limited thereto, an optimization of <i>Algorithm</i> 3 in terms of: <ol id="ol0007" compact="compact" ol-style=""><li>(1) Utilization of baseline long-term risk (from <i>Algorithm 2</i>) and HbA_1c (from <i>Algorithm 1</i>);</li><li>(2) Risk criterion/threshold for hypoglycemia alert;</li><li>(3) Frequency of SMBG;</li><li>(4) Whether a hypoglycemia alert should be issued if an increased risk for hypoglycemia is detected and there is no SMBG for certain period of time, and</li><li><i>(5)</i> Contribution of demographic variables such as history of severe hypoglycemia.</li></ol>

Introduction

As opposed to Algorithms 1 and 2, which have a longer history of development, Algorithm 3 deals with a proposition that was, until recently, considered impossible. In fact, there is still a general perception that prediction of any future BG value (hypoglycemia in particular) is not possible on the basis of previously known values (<nplcit id="ncit0017" npl-type="s"><text>Bremer T and Gough DA. Is blood glucose predictable from previous values? A solicitation for data. Diabetes, 1999, 48: 445-451</text></nplcit>.). Our previous work, reported in one manuscript and presented in detail in the invention disclosure available to Lifescan, Inc. disputes this general perception. In order to explain the basis for this dispute and to clarify the reasoning behind Algorithm 3, we include the following paragraph.

<b><i><u>Our "philosophy" in quantifying characteristics of diabetes</u>:</i></b> Hormonal interactions are governed by dynamic-control biochemical networks that have a more or less complex structure of principal nodes and conduits, depending on the studied endocrine system. Diabetes disrupts the network control of insulin-glucose dynamics at various levels. For example, in T1DM the natural production of insulin is completely eliminated, while in T2DM the utilization of insulin in the cell is obstructed by a greater insulin resistance. In T1DM (and frequently in T2DM) some form of external insulin replacement is required, which makes the control system vulnerable to imperfect external factors, including the timing and amount of pill or insulin injection, food eaten, physical activity, etc. This frequently leads to extreme BG excursions into hypoglycemia and hyperglycemia. In many, but not in all cases, hypoglycemia triggers an endocrine response, known as counterregulation. Thus, in mathematical terms, BG fluctuations over time are the measurable result of the action of a complex dynamic system, influenced by a number of internal and external factors. However, it is well known from the theory of dynamical systems that when the complexity of control increases, a purely deterministic system evolves to display random macro-behavior. Consequently, within short periods of time (minutes) the BG fluctuations observed at a human level would be <i>nearly-deterministic,</i> while over longer periods of time the fluctuations would be <i>nearly-random,</i> including extreme transitions, such as SH episodes. Thus, <i>stochastic modeling and statistical inference</i> are most appropriate for analysis of the system over longer periods of time- a paradigm adopted by Algorithms 1 and 2 that use our originally developed measures, such as the LBGI and HBGI, to predict, after a certain observation period, a range of values, or a probability of an event. Over short periods of time BG fluctuations can be modeled and predicted using <i>deterministic networks,</i> which would be the case with future intelligent insulin-delivery devices linked to continuous monitoring.

Algorithm 3 operates in an intermediate time scale of a few hours to a few days and therefore requires a <i>combination of statistical inference and deterministic modeling.</i> The former will be used to assess the baseline risk for SH for an individual, while the latter will be used for a dynamical tracking of individual parameters and forecast of SH episodes prior to their occurrence. When implemented in a device Algorithm 3 would work as follows: <ol id="ol0008" ol-style=""><li>(1) The device collects certain baseline information for the subject and establishes individual baseline parameters;</li><li>(2) Then, the device begins tracking a certain set of properties of the SMBG data;</li><li>(3) The device is equipped with a decision-making rule that decides when to raise a flag for upcoming SH and when to lower this flag if the data indicate that the threat is reduced;</li><li>(4) When the flag is raised, we assume that the subject is warned for SH in the following 24 hours (prediction time).</li></ol>

This dynamical prediction creates theoretical problems at both the level of model parameter optimization and at the level of evaluation of the preciseness of the optimal solution. We will begin with clarifying the second problem, as it is most important for understanding the action of Algorithm 3.

<u><b><i>Evaluating the preciseness of Algorithm 3:</i></b></u> While Algorithms 1 and 2 employ a static forecast and the criterion for evaluation of these algorithms is theoretically apparent - a better predictive value, with Algorithm 3 the optimization criterion is no longer straightforward. This is because by increasing the percentage of predicted SH episodes, we unavoidably increases the number of "raised flags," which in turn increases the number of potential "false alarms." The matter is additionally complicated by the fact that a "false alarm" is not clearly defined. In its pure form, a false alarm would be a raised flag that is not followed by and SH episode. However, SH could be avoided if the person perceives symptoms and takes an appropriate action. Thus, even if the biochemical potential for SH may present, an event may not occur. In order to deal with this problem we adopt the following optimization criterion: <ol id="ol0009" ol-style=""><li>(1) Maximize the prediction of upcoming SH within 24 hours;</li><li>(2) Minimize the ratio <b>R_ud</b> of duration periods of "flag up" to "flag down".</li></ol>

While the first of these two points is clear, the second may need an additional explanation. Looking from the perspective of an implementation of Algorithm 3 in a meter, at every SMBG determination the meter decides whether to raise a flag or not to raise a flag for upcoming SH. When the flag is raised, it may stay up for some time (along several subsequent SMBG readings) until a decision is made to take the flag down. Thus, we will have an alternating process of "flag up" and "flag down" with the changes happening at points of SMBG. The ratio <b>R_ud</b> referred to in point (2) above, is the average time for a person, counted while the flag is up, divided to the average time counted while the flag is down.

Our previous best result presented in the Invention disclosure was a prediction of 44% of SH episodes within 24 hours, and <b>R_ud</b>=1:7, e.g. one day of high-risk alert was alternating with 7 days of no alert. Since at that time we assumed that the warning period was at least 24 hours, the algorithm was optimized to raise a flag no more frequently than once a week. Given that this analysis was done using data for subjects who were experiencing high rate of SH episodes, this ratio was considered acceptable.

During Example No. 1 of this study we had to use the same data set for refinement of Algorithm 3 since there is no other data available that include simultaneous SMBG records and records of SH. We also used a similar criterion to evaluate the preciseness of Algorithm 3. However, we <i>changed substantially everything else.</i> The tracking of the data, the parameter estimation, all threshold values and the decision-making rule are no longer the same. These changes were caused by a new idea that SH is preceded by certain "depletion" of the body's reserves to counterregulate and that this <i>depletion can be tracked by using SMBG data.</i> The exact implementation of this idea is described in the section "Decision-making Rule." Since the decision-making rule involves a continuous criterion and a somewhat artificial cutoff, several solutions are presented and one is selected as optimal for further investigation. However, upon presentation of these results, we may decide to select another solution to be implemented in future applications of Algorithm 3.

<u>Summary</u><u>of the Results</u>

First, it is important to note that all results presented below go well beyond statistical significance. As we will see in a few examples in the next section, the observed differences are <i>always</i> highly significant (with p-values below any imaginable significance level). The point of Algorithm 3 is to predict occurrence of SH episodes on an individual basis. The results are: <ol id="ol0010" ol-style=""><li>(1) The minimum baseline observation period is 50 SMBG readings taken over approximately two weeks with a frequency of 3-4 readings a day. After this time each subject is classified in one of two risk groups that later use different decision-making rules;</li><li>(2) From the 6 months of data that we have we find that it is sufficient to make this group assignment once in the beginning of observation. Thus, we can assume that about every 6 months the meter would use 50 reading to reevaluate its owner's group assignment;</li><li>(3) The optimal lag of SMBG tracking is 100 to 150 readings taken with a frequency of 3-4 readings per day. In other words, the optimal decision-making criterion would be based on a computation using all 150 readings in a meter's memory. This was done to simulate the memory capacity of ONE TOUCH ULTRA. In general, good results are achieved using a lag of only 20 readings taken over a week, but a longer lag yields better prediction;</li><li>(4) The decision-making rules is based on a new computational procedure that tracks subjects Low BG Index and other related parameters using "provisional mean" computation. Special software was designed to implement this procedure and to process the data that we had available. From a programming point of view, the code needed for implementation of this procedure is only about 20 lines, which includes the computation of the LBGI;</li><li>(5) Several decision-making rules (using various parameters) were investigated. Regardless of the frequency of SMBG, these rules achieved prediction of SH within 24 hours anywhere from 43.4% with <b>R_ud=</b>1:25 to 53.4% with <b>R_ud</b>=1:7. Thus, compared to our previous result, the prediction of SH within 24 hours increased by 10%;</li><li>(6) As an optimal solution for further investigation we choose the decision-making rule that predicted 50% of SH within 24 hours and had <b>R_ud</b>=1:10. The following results refer to this optimal solution under different conditions:</li><li>(7) The optimal frequency of SMBG is 4 readings per day. If this frequency is achieved, the prediction of SH within 24 hours increases to 57.2% with the same <b>R_ud</b>=1:10. Other frequencies of SMBG are investigated and reported as well;</li><li>(8) If we extend the prediction period to 36, or 48 hours, the prediction of SH increases to 57% and 63% respectively, with the same <b>R_ud=</b>1:10;</li><li>(9) Utilizing baseline information increases substantially the prediction of SH. In fact, the 10% increase over our previous version of Algorithm 3 is entirely due to the use of baseline tracking. However, this baseline tracking is now modeled as a two-week period of self-calibration of the meter that does not use any additional input from the subject; .</li><li>(10) Personal/demographic information, such as history of SH or prior HbA_1c, does not contribute to a better short-term prediction of SH;</li><li>(11) Raising a flag whenever there is a prolonged period of no SMBG activity is not justified. The only times when the meter would issue warning for upcoming SH would be the times of usage. This is because a major part of the prediction of SH is based on the recurrence (clustering) of very low BGs. An assessment of this recurrence is presented in an abstract (<nplcit id="ncit0018" npl-type="s"><text>Kovatchev et al. Recurrent Hypoglycemia and Severe Hypoglycemia (SH) in T1DM Patients With History of Multiple SH) prepared for the June 2002 ADA meeting (See Appendix</text></nplcit>).</li></ol>

<u>Detailed Description of the Data Processing</u>

The meter stores SMBG readings together with the date and exact time (hour, minute, second) of each reading. Thus, in Training Data set 2 we have for each subject a certain temporal sequence of SMBG records. During the study, a total of 75,495 SMBG readings (on average 4.0±1.5 per subject per day) were downloaded from the participants' memory meters. From subjects' monthly diaries, we had the date and time of SH episodes that had occurred. Subjects reported 399 (4.7±6.0 per subject) SH episodes. Sixty-eight (80%) of the participants experienced one or more episodes of SH. These subjects did not differ from those who did not experience SH (the remaining 20% of the subjects) in terms of any of their demographic characteristics.

<i><u><b>Pre-Processing of the</b> Data:</u></i> Special software was developed for <i>pre-processing of the data.</i> This included: (1) Assembling of the memory meter data for each subject into a continuous 6-8-month sequence of BG readings, and (2) Matching of each subject's records of SH with this sequence by date and time. The latter was performed as follows: for each SMBG reading the time (hours/minutes) until the nearest SH episode, and the time elapsed from the latest SH episode, were computed. Thus, it was possible to: (1) time 24-hour, 48-hour, etc. periods backward and forward from each SH episode, and (2) time periods between SMBG readings. Due to the nature of SH (stupor, unconsciousness), no SMBG was performed exactly at the time of SH, thus SH episodes for the purposed of Algorithm 3 do not include biochemical significant hypoglycemia that was used for Algorithm 2. The average per SH episode minimum elapsed time between SH and the nearest preceding SMBG reading was 5.2±4.1 hours; 29 SH episodes (7%) were preceded by a SMBG reading within 15 minutes. For each SH episode, we counted how many SMBG readings were performed within 24h, 36h, 48h, and 72h prior to that episode.

<i><b><u>Computing of Baseline Risk Values and Self-Calibration</u></b>:</i> The Low BG Index for each subject is computed on his/her first SNBG readings. It was determined that the minimum number of reading required to compute a baseline LBGI is 50 taken over approximately 2 weeks. Therefore for each new meter we need to anticipate an initial two-week self-calibration period during which the meter would be scanning the overall risk for SH of its owner. After the initial period, the person is classified into one of two risk groups: Low-moderate risk (LBGI ≤ 3.5, LM Group) or moderate-to-high risk (LBGI &gt; 3.5, MH Group). Our test data show that a more precise classification would not be necessary. This classification allows for different decision-making rules to be used in the LM and MH groups and raises the hit rate of the algorithm by approximately 10% as compared to its original hit rate presented in the invention disclosure.

With the test data re-calibration of the baseline risk was not necessary. Thus, we can assume that if the person does not undergo changes in treatment, re-calibration would be performed approximately every 6 months. This is consistent with the results of Algorithm 2 showing that the long-term prediction of SH is quite valid for 6 months after the initial observation period.

However, if the person experiences rapid changes in his/her glycemic control, re-calibration maybe required more frequently. The decision for re-calibration can probably be automated and based on observed increasing differences between the running risk value (see the next paragraph) and the baseline LBGI. However, the available data do not allow us to clarify this issue since the subjects that we observed did not have substantial changes in their risk for hypoglycemia.

<i><b><u>Computing SMBG Parameters</u></b>:</i> After the pre-processing step, another piece of software was designed to compute SMBG parameters that would be used for prediction of imminent SH. This software included: (1) Computing of a Low BG Risk value (RLO) for each BG reading that is done by the following code (here BG is measured in mg/dl, if the units are mmol/l the coefficients are different): <pre listing-type="program-listing"> scale=(ln(bg))**1.08405 - 5.381 risk=22.765*scale*scale if (bg_1 le 112.5) then RLO=risk else RLO=0 endif</pre> (2) For each SMBG reading with a sequential number <i>n</i>, BG(n), computing of a running value of the LBGI(n), and another statistics, SBGI(n) that is the standard deviation of the low BG risk values. These two parameters were computed with a certain lag (<i>k</i>) backwards from each SMBG reading, e.g. included that reading, BG(n), and (k-1) readings taken prior to BG(n). (3) The computation of LBGI(n) and SBGI(n) used a <i>new provisional means procedure</i> that is based on the following recursive code: <ul id="ul0011" list-style="none" compact="compact"><li>Initial values at <i>n-k</i> (or at the max (1,n-k) to be exact in order to account for meter readings with a sequential number less than k): <maths id="math0038" num=""><math display="block"><mi>LBGI</mi><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">n</mi><mo>-</mo><mi mathvariant="normal">k</mi></mfenced><mo>=</mo><mi>rlo</mi><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">n</mi><mo>-</mo><mi mathvariant="normal">k</mi></mfenced></math><img file="EP1534121B1_D0040.tif" /></maths><maths id="math0039" num=""><math display="block"><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">n</mi><mo>-</mo><mi mathvariant="normal">k</mi></mfenced><mo>=</mo><mn mathvariant="normal">0</mn></math><img file="EP1534121B1_D0041.tif" /></maths></li><li>Values for any consecutive iterationj between <i>n-k</i> and <i>n</i>: <maths id="math0040" num=""><math display="block"><mi>LBGI</mi><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>=</mo><mfenced separators=""><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>LBGI</mi><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>+</mo><mfenced separators=""><mn mathvariant="normal">1</mn><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>RLO</mi><mfenced><mi mathvariant="normal">j</mi></mfenced></math><img file="EP1534121B1_D0042.tif" /></maths><maths id="math0041" num=""><math display="block"><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>=</mo><mfenced separators=""><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>rlo</mi><mo>⁢</mo><mn>2</mn><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>+</mo><mfenced separators=""><mn mathvariant="normal">1</mn><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mfenced separators=""><mi>RLO</mi><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>-</mo><mi>LBGI</mi><mfenced><mi mathvariant="normal">j</mi></mfenced></mfenced><mo>*</mo><mo>*</mo><mn mathvariant="normal">2</mn></math><img file="EP1534121B1_D0043.tif" /></maths></li><li>After this cycle is completed we have the value of LBGI (n) and we compute <maths id="math0042" num=""><math display="block"><mi>SBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>=</mo><mi>sqrt</mi><mfenced separators=""><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mfenced><mi mathvariant="normal">n</mi></mfenced></mfenced></math><img file="EP1534121B1_D0044.tif" /></maths></li></ul> Since the maximum of <i>n</i> is 150 for ONE TOUCH ULTRA meters, the search for an optimal lag k was performed within the range of k=10 to k=150. Although the difference in performance was not significant, the optimal lag was determined to be <i>k=150</i> (see the next section for examples).

<b><i><u>Decision-Making Rule:</u></i></b> At each SMBG reading the procedure decides whether to raise a flag warning for upcoming SH, or not. If the flag is raised, the procedure decides whether to bring it down. These decisions depend on three threshold parameters, α, β, γ that work as follows:

For subject at low-to-moderate risk (LM group): <maths id="math0043" num=""><math display="block"><mtable columnalign="left"><mtr><mtd><mi>FLAG</mi><mo>=</mo><mn mathvariant="normal">0</mn></mtd></mtr><mtr><mtd><mi>if</mi><mspace width="1em" /><mfenced separators=""><mi>LBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>≥</mo><mi mathvariant="normal">α and SBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>≥</mo><mi mathvariant="normal">β</mi></mfenced><mspace width="1em" /><mi>FLAG</mi><mo>=</mo><mn mathvariant="normal">1</mn></mtd></mtr><mtr><mtd><mi>if</mi><mspace width="1em" /><mfenced separators=""><mi>RLO</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>≥</mo><mfenced separators=""><mi>LBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>+</mo><mi mathvariant="normal">γ</mi><mo>*</mo><mi>SBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced></mfenced></mfenced><mspace width="1em" /><mi>FLAG</mi><mo>=</mo><mn mathvariant="normal">1</mn></mtd></mtr></mtable></math><img file="EP1534121B1_D0045.tif" /></maths>

For subjects in the moderate-to-high risk group only the second if-statement is active. In other words, the flag is raised (e.g. becomes equal to 1) if both the running value of LBGI(n) and its standard deviation SBGI(n) exceed certain threshold values, and is also raised if the current value of the low BG risk RLO(n) exceeds the value of LBGI(n) plus γ standard deviations.

<i><u>An heuristic explanation:</u></i> The values of LBGI(n) and SBGI(n) reflect slower changes in risk for hypoglycemia - it takes a few days of SMBG to substantially change these values. Since elevated LBGI(n) means more frequent and extreme recent hypoglycemia, we can conclude that LBGI(n) and SBGI(n) reflect a persistent depletion (or lack of replenishment) of counterregulatory reserves over the course of several days. In addition, SBGI(n) is a marker of the stability of the system - a larger SBGI(n) indicates that a subjects' BG fluctuations increase and therefore the control system becomes unstable and vulnerable to extreme aberrations. Thus, the first logical expression reflects the notion that SH occurs whenever the couterregulatory defenses are exhausted and the controls (external or internal) become unstable. The second logical expression accounts for acute changes in the low BG risk, triggering a flag whenever the current Low BG risk value suddenly becomes greater than its running average. The fact that for subjects in the moderate-to-high risk group only the second logical expression is relevant goes along with these subjects' eventual "permanent depletion" and "permanent instability" status. Since these subjects continuously run low BG values, and their BG is unstable, any acute hypoglycemic episode would be capable of triggering SH. In general, a flag for severe hypoglycemia is raised either after a period of low unstable BG, or after an acute hypoglycemic event that deviates substantially (in a risk space) from the latest running risk average (that maybe already high). It follows that SH episodes that are not preceded by any of these warning signs will remain unaccounted for by this algorithm. Below in <b>Table 5C</b> we present a sample output that illustrates the action of Algorithm 3 for several subjects: <tables id="tabl0017" num="0017"><table frame="all"><title><b>Table 5C:</b> A Sample Output that Illustrates the Action of Algorithm 3 for Several Subjects:</title><tgroup cols="6" colsep="0" rowsep="0"><colspec colnum="1" colname="col1" colwidth="19mm" /><colspec colnum="2" colname="col2" colwidth="19mm" /><colspec colnum="3" colname="col3" colwidth="19mm" /><colspec colnum="4" colname="col4" colwidth="19mm" /><colspec colnum="5" colname="col5" colwidth="19mm" /><colspec colnum="6" colname="col6" colwidth="71mm" colsep="1" /><thead><row><entry valign="top">ID</entry><entry valign="top">BG</entry><entry valign="top">SH</entry><entry valign="top">FLAG</entry><entry valign="top">TIME</entry><entry valign="top">Here α=5, β=7.5, γ=1.5</entry></row></thead><tbody><row><entry>135</entry><entry align="right">70</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">53.75</entry><entry morerows="7">For subject # 135 the first flag is raised about 30 hours prior to SH and stays up for the next reading whish is taken 16 hours later and 14 hour prior to SH. This latter reading and the two readings that follow are within 24 hours prior to SH, so we consider this episode to be predicted. Nevertheless, the flag is brought up again about 8 hours and 20 minutes prior to SH.</entry></row><row><entry>135</entry><entry align="right">77</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">41.09</entry></row><row><entry>135</entry><entry align="right">124</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">35.02</entry></row><row><entry>135</entry><entry align="right">51</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">30.44</entry></row><row><entry>135</entry><entry align="right">50</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">14.72</entry></row><row><entry>135</entry><entry align="right">66</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">&lt; 24h</entry><entry align="char" char="." charoff="28">10.60</entry></row><row><entry>135</entry><entry align="right">49</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">8.30</entry></row><row><entry>135</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="char" char="." charoff="28" /></row><row>&lt;entry /&gt;<entry align="right" /><entry align="char" char="." charoff="10" /><entry align="right" /><entry align="char" char="." charoff="28" />&lt;entry /&gt;</row><row>&lt;entry /&gt;<entry align="right" /><entry align="char" char="." charoff="10" /><entry align="right" /><entry align="char" char="." charoff="28" />&lt;entry /&gt;</row><row><entry>135</entry><entry align="right">97</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">140.05</entry><entry morerows="5">A second SH episode for this subject is flagged 36 minutes in advance.</entry></row><row><entry>135</entry><entry align="right">130</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">25.17</entry></row><row><entry>135</entry><entry align="right">59</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">20.20</entry></row><row><entry>135</entry><entry align="right">76</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">5.23</entry></row><row><entry>135</entry><entry align="right">41</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">.62</entry></row><row><entry>135</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="char" char="." charoff="28" /></row><row>&lt;entry /&gt;<entry align="right" /><entry align="char" char="." charoff="10" /><entry align="right" /><entry align="char" char="." charoff="28" />&lt;entry /&gt;</row><row><entry>219</entry><entry align="right">200</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">40.72</entry><entry morerows="7">This subject gets two warnings-approximately 28.7 and 11.2 hours prior to this SH episode.</entry></row><row><entry>219</entry><entry align="right">64</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">37.88</entry></row><row><entry>219</entry><entry align="right">43</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">28.73</entry></row><row><entry>219</entry><entry align="right">225</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">16.22</entry></row><row><entry>219</entry><entry align="right">38</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">11.18</entry></row><row><entry>219</entry><entry align="right">43</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">&lt; 24h</entry><entry align="char" char="." charoff="28">10.87</entry></row><row><entry>219</entry><entry align="right">75</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">&lt; 24h</entry><entry align="char" char="." charoff="28">4.52</entry></row><row><entry>219</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="char" char="." charoff="28" /></row><row>&lt;entry /&gt;<entry align="right" /><entry align="char" char="." charoff="10" /><entry align="right" /><entry align="char" char="." charoff="28" />&lt;entry /&gt;</row><row><entry>222</entry><entry align="right">156</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">19.08</entry><entry morerows="5">This subject gets a warnings approximately 4 hours and 45 minutes prior to this SH episode.</entry></row><row><entry>222</entry><entry align="right">176</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">13.23</entry></row><row><entry>2.22</entry><entry align="right">83</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">9.72</entry></row><row><entry>222</entry><entry align="right">66</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">7.83</entry></row><row><entry>222</entry><entry align="right">42</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">4.75</entry></row><row><entry>222</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="char" char="." charoff="28" /></row><row>&lt;entry /&gt;<entry align="right" /><entry align="char" char="." charoff="10" /><entry align="right" /><entry align="char" char="." charoff="28" />&lt;entry /&gt;</row><row><entry>223</entry><entry align="right">228</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">18.80</entry><entry morerows="5" rowsep="1">This subject experienced two recurrent SH episodes within 12 hours. The flag is raised approximately 6 hours before the first episode and therefore we consider both episodes to be in the predicted risk high-risk 24-hour time period.</entry></row><row><entry>223</entry><entry align="right">149</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">.00</entry><entry align="char" char="." charoff="28">14.15</entry></row><row><entry>223</entry><entry align="right">41</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">1.00</entry><entry align="char" char="." charoff="28">5.85</entry></row><row><entry>223</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="char" char="." charoff="28" /></row><row><entry>223</entry><entry align="right">110</entry><entry align="char" char="." charoff="10">.00</entry><entry align="right">&lt; 24H</entry><entry align="char" char="." charoff="28">6.00</entry></row><row rowsep="1"><entry>223</entry><entry align="right" /><entry align="char" char="." charoff="10">1.00</entry><entry align="right" /><entry align="right" /></row></tbody></tgroup></table></tables>

Each line of this output presents an SMBG reading, or an SH episode (without a reading). ID is subject's ID number, BG is BG level in mg/dl, SH=1 whenever SH episode occurs. FLAG=1 if Algorithm 3 decides to raise the flag; TIME is the time to the nearest SH episode in hours.

<b><i><u>Optimizing the of Lag of the Provisional Means Procedure</u>:</i></b> In a prior publication we have reported that in the period 48 to 24 hours before SH the average BG level decreased and the BG variance increased. In the 24-hour period immediately preceding SH average BG level dropped further, the variance of BG continued to increase, and there was a sharp increase in the LBGI. In the 24-hour period following SH, average BG level normalized, however the BG variance remained greatly increased. Both the average BG and its variance returned to baseline levels within 48 hours after SH (see <nplcit id="ncit0019" npl-type="s"><text>Kovatchev et al. Episodes of Severe Hypoglycemia in Type 1 Diabetes are Preceded, and Followed, within 48 Hours by Measurable Disturbances in Blood Glucose. J of Clinical Endocrinology and Metabolism, 85: 4287-4292, 2000</text></nplcit>). We now use these observations to optimize the lag of the provisional means procedure, k, employed by Algorithm 3 on the basis of the deviations in the average values of LBGI(n) and SBGI(n) observed within 24 hour prior to SH. In short, the lag for computing LBGI(n) and SBGI(n) was chosen to maximize the difference that these measures display within 24 hours prior to SH compared to the rest of the study, excluding periods immediately after SH when the system is out of balance. The optimal lag was found to be <i>k</i>=150. <b>Tables 6A and 6B</b> present the means of LBGI(n) and SBGI(n) for several values of the parameter k. and for both subject groups, low-moderate risk and moderate-high risk. It is evident that the difference between various values of <i>k is</i> not great, thus in a practical application any value of <i>k</i> ≥ 10 would be appropriate. However, based on the current data we would recommend k=150, and all further computations use this lag. This recommendation is also based on the reduced variance in LBGI(n) and SBGI(n) at larger lag values, that is reflected by larger t-values below: <tables id="tabl0018" num="0018"><table frame="all"><title><u><b>Table 6A:</b> LBGI(n) within 24 hour prior to SH vs. the rest of the time for different lags:</u></title><tgroup cols="9"><colspec colnum="1" colname="col1" colwidth="15mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="23mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="16mm" /><colspec colnum="6" colname="col6" colwidth="23mm" /><colspec colnum="7" colname="col7" colwidth="23mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="16mm" /><thead><row><entry rowsep="0" valign="middle"><b>LBGI</b></entry><entry namest="col2" nameend="col5" align="center" valign="middle">Low-moderate risk (LM Group)</entry><entry namest="col6" nameend="col9" align="center" valign="middle">Moderate-high risk (MH Group)</entry></row><row><entry valign="middle" /><entry align="center" valign="middle">24h prior SH</entry><entry align="center" valign="middle">Rest of the time</entry><entry align="center" valign="middle">t</entry><entry align="center" valign="middle">p</entry><entry align="center" valign="middle">24h prior SH</entry><entry align="center" valign="middle">Rest of the time</entry><entry align="center" valign="middle">t</entry><entry align="center" valign="middle">p</entry></row></thead><tbody><row><entry valign="middle">k=10</entry><entry valign="middle" align="char" char=".">4.99</entry><entry valign="middle" align="char" char=".">3.32</entry><entry align="center" valign="middle">9.2</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.94</entry><entry valign="middle" align="char" char=".">5.28</entry><entry valign="middle" align="char" char="." charoff="26">11.0</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=20</entry><entry valign="middle" align="char" char=".">4.73</entry><entry valign="middle" align="char" char=".">3.34</entry><entry align="center" valign="middle">9.4</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.56</entry><entry valign="middle" align="char" char=".">5.32</entry><entry valign="middle" align="char" char="." charoff="26">11.0</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=30</entry><entry valign="middle" align="char" char=".">4.54</entry><entry valign="middle" align="char" char=".">3.35</entry><entry align="center" valign="middle">9.1</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.50</entry><entry valign="middle" align="char" char=".">5.34</entry><entry valign="middle" align="char" char="." charoff="26">11.3</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=50</entry><entry valign="middle" align="char" char=".">4.53</entry><entry valign="middle" align="char" char=".">3.34</entry><entry align="center" valign="middle">9.8</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.54</entry><entry valign="middle" align="char" char=".">5.36</entry><entry valign="middle" align="char" char="." charoff="26">11.7</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=100</entry><entry valign="middle" align="char" char=".">4.45</entry><entry valign="middle" align="char" char=".">0.29</entry><entry align="center" valign="middle">11.2</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.53</entry><entry valign="middle" align="char" char=".">5.40</entry><entry valign="middle" align="char" char="." charoff="26">12.3</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=150*</entry><entry valign="middle" align="char" char=".">4.46</entry><entry valign="middle" align="char" char=".">3.26</entry><entry align="center" valign="middle">12.1</entry><entry align="center" valign="middle">&lt;.000...</entry><entry valign="middle" align="char" char=".">6.56</entry><entry valign="middle" align="char" char=".">5.41</entry><entry valign="middle" align="char" char="." charoff="26">12.9</entry><entry align="center" valign="middle">&lt;.000...</entry></row></tbody></tgroup></table></tables><tables id="tabl0019" num="0019"><table frame="all"><title><u><b>Table 6B:</b> SBGI(n) within 24 hour prior to SH vs. the rest of the time for different lags:</u></title><tgroup cols="9"><colspec colnum="1" colname="col1" colwidth="15mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="23mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="16mm" /><colspec colnum="6" colname="col6" colwidth="23mm" /><colspec colnum="7" colname="col7" colwidth="23mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="16mm" /><thead><row><entry rowsep="0" valign="middle"><b>SBGI</b></entry><entry namest="col2" nameend="col5" align="center" valign="middle">Low-moderate risk (LM Group)</entry><entry namest="col6" nameend="col9" align="center" valign="middle">Moderate-high risk (MH Group)</entry></row><row><entry valign="middle" /><entry align="center" valign="middle">24h prior SH</entry><entry align="center" valign="middle">Rest of the time</entry><entry align="center" valign="middle">t</entry><entry align="center" valign="middle">p</entry><entry align="center" valign="middle">24h prior SH</entry><entry align="center" valign="middle">Rest of the time</entry><entry align="center" valign="middle">t</entry><entry align="center" valign="middle">p</entry></row></thead><tbody><row><entry valign="middle">k=10</entry><entry valign="middle" align="char" char=".">7.50</entry><entry valign="middle" align="char" char=".">5.35</entry><entry align="center" valign="middle">9.0</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">9.64</entry><entry align="center" valign="middle">7.78</entry><entry valign="middle" align="char" char="." charoff="26">11.4</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=20</entry><entry valign="middle" align="char" char=".">8.31</entry><entry valign="middle" align="char" char=".">6.28</entry><entry align="center" valign="middle">10.1</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">10.36</entry><entry align="center" valign="middle">8.91</entry><entry valign="middle" align="char" char="." charoff="26">10.7</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=30</entry><entry valign="middle" align="char" char=".">8.50</entry><entry valign="middle" align="char" char=".">6.68</entry><entry align="center" valign="middle">9.5</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">10.82</entry><entry align="center" valign="middle">9.38</entry><entry valign="middle" align="char" char="." charoff="26">11.5</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=50</entry><entry valign="middle" align="char" char=".">8.78</entry><entry valign="middle" align="char" char=".">7.04</entry><entry align="center" valign="middle">10.0</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">11.30</entry><entry align="center" valign="middle">9.80</entry><entry valign="middle" align="char" char="." charoff="26">12.3</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=100</entry><entry valign="middle" align="char" char=".">9.19</entry><entry valign="middle" align="char" char=".">7.33</entry><entry align="center" valign="middle">11.7</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">11.69</entry><entry align="center" valign="middle">10.18</entry><entry valign="middle" align="char" char="." charoff="26">13.5</entry><entry align="center" valign="middle">&lt;.000...</entry></row><row><entry valign="middle">k=150*</entry><entry valign="middle" align="char" char=".">9.42</entry><entry valign="middle" align="char" char=".">7.42</entry><entry align="center" valign="middle">13.7</entry><entry align="center" valign="middle">&lt;.000...</entry><entry align="center" valign="middle">11.88</entry><entry align="center" valign="middle">10.33</entry><entry valign="middle" align="char" char="." charoff="26">15.1</entry><entry align="center" valign="middle">&lt;.000...</entry></row></tbody></tgroup><tgroup cols="9" rowsep="0"><colspec colnum="1" colname="col1" colwidth="15mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="23mm" /><colspec colnum="4" colname="col4" colwidth="14mm" /><colspec colnum="5" colname="col5" colwidth="16mm" /><colspec colnum="6" colname="col6" colwidth="23mm" /><colspec colnum="7" colname="col7" colwidth="23mm" /><colspec colnum="8" colname="col8" colwidth="14mm" /><colspec colnum="9" colname="col9" colwidth="16mm" /><tbody><row><entry namest="col1" nameend="col9" align="justify">* Optimal solution</entry></row></tbody></tgroup></table></tables>

As seen in <b>Tables 6A and 6B</b> both LBGI and SBGI become highly significantly elevated in the 24-hour periods preceding SH. Thus, one is tempted to run a direct discriminant or logistic model to predict upcoming SH. Unfortunately such standard statistics don't work very well, although both models are highly statistically significant. The discriminant model (that worked better than logistic regression) predicted correctly 52.6% of upcoming SH episodes. However, its flag-up to flag-down ratio was quite poor - <b>R_ud=</b>1:4. Therefore this model was biased towards the larger amount of data points, a bias that is to be expected in any statistical procedure. Consequently, we had to employ the decision-making rule presented above.

<b>Accuracy</b> of <b>Prediction of Severe Hypoglycemia</b>

<b><u><i>Optimization of the Threshold Parameters α, β, and γ</i>:</u></b> Below we present a detailed account of the predictive power of Algorithm 3 using various combinations of its threshold parameters α, β, and γ. Since the relationship between these parameters and the desired outcome (high prediction of SH and minimal ratio <b>R_ud</b>) is quite complex, the optimization procedure that we used did not reach a single solution. Also, it seems that there is no need for a single solution either. It is probably a business, rather than mathematical decision, what would be an acceptable % of prediction of SH, given a "flag up" to "flag down" ratio. Thus, we do not claim that any of the presented below solution is optimal. However, in order to explore this subject further, we accept that a 50% prediction of future SH with <b>R_ud</b> = 1:10 is a base for investigating other than 24 hours prediction periods as well as various requirements for the number of SMBG readings per day required for a better risk profile.

<b>Table 7</b> presents the performance of Algorithm 3 at several combinations of the values of α, β, and γ that are representative for the relationship between the percentage of predicted SH (hit rate) and the ratio <b>R_ud</b> which we could call "annoyance index." <b>Table 7</b> also includes the average total time (in days) per subject spent in alert vs. no-alert status during the study, i.e. the summary result from the alternating process of warning - no-warning periods that a subject would experience using this algorithm which illustrates the meaning of the ratio <b>R_ud.</b><tables id="tabl0020" num="0020"><table frame="all"><title><u><b>Table 7:</b> Prediction of SH: Hits, Annoyance Index, and Average Times:</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="15mm" /><colspec colnum="2" colname="col2" colwidth="15mm" /><colspec colnum="3" colname="col3" colwidth="15mm" /><colspec colnum="4" colname="col4" colwidth="15mm" /><colspec colnum="5" colname="col5" colwidth="15mm" /><colspec colnum="6" colname="col6" colwidth="17mm" /><colspec colnum="7" colname="col7" colwidth="21mm" /><thead><row><entry align="center" /><entry align="center" /><entry align="center" /><entry align="center" /><entry align="center" /><entry namest="col6" nameend="col7" align="center">Total for study (days)</entry></row><row><entry align="center">α</entry><entry align="center">β</entry><entry align="center">γ</entry><entry align="center">% Hit</entry><entry align="center"><b>R_ud</b></entry><entry align="center">Flag up</entry><entry align="center">Flag Down</entry></row></thead><tbody><row><entry valign="bottom" align="char" char="." charoff="13">6.4</entry><entry valign="bottom" align="char" char="." charoff="13">8.2</entry><entry valign="bottom" align="char" char="." charoff="13">1.5</entry><entry valign="bottom" align="char" char="." charoff="25">43.4</entry><entry align="center" valign="bottom">1 : 25</entry><entry align="center" valign="bottom">7.8</entry><entry valign="bottom" align="char" char="." charoff="26">198.9</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">6.0</entry><entry valign="bottom" align="char" char="." charoff="13">7.5</entry><entry valign="bottom" align="char" char="." charoff="13">1.5</entry><entry valign="bottom" align="char" char="." charoff="25">45.2</entry><entry align="center" valign="bottom">1 : 20</entry><entry align="center" valign="bottom">9.6</entry><entry valign="bottom" align="char" char="." charoff="26">197.3</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">5.5</entry><entry valign="bottom" align="char" char="." charoff="13">7.5</entry><entry valign="bottom" align="char" char="." charoff="13">1.5</entry><entry valign="bottom" align="char" char="." charoff="25">47.2</entry><entry align="center" valign="bottom">1 : 15</entry><entry align="center" valign="bottom">12.9</entry><entry valign="bottom" align="char" char="." charoff="26">194.1</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">5.0</entry><entry valign="bottom" align="char" char="." charoff="13">7.5</entry><entry valign="bottom" align="char" char="." charoff="13">1.5</entry><entry valign="bottom" align="char" char="." charoff="25">49.9</entry><entry align="center" valign="bottom">1 : 10</entry><entry align="center" valign="bottom">19.0</entry><entry valign="bottom" align="char" char="." charoff="26">190.1</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">5.0</entry><entry valign="bottom" align="char" char="." charoff="13">7.5</entry><entry valign="bottom" align="char" char="." charoff="13">1.3</entry><entry valign="bottom" align="char" char="." charoff="25">51.3</entry><entry align="center" valign="bottom">1 : 9.5</entry><entry align="center" valign="bottom">19.5</entry><entry valign="bottom" align="char" char="." charoff="26">185.7</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">4.9</entry><entry valign="bottom" align="char" char="." charoff="13">7.0</entry><entry valign="bottom" align="char" char="." charoff="13">1.2</entry><entry valign="bottom" align="char" char="." charoff="25">53.1</entry><entry align="center" valign="bottom">1 : 8.4</entry><entry align="center" valign="bottom">21.6</entry><entry valign="bottom" align="char" char="." charoff="26">182.0</entry></row><row><entry valign="bottom" align="char" char="." charoff="13">4.8</entry><entry valign="bottom" align="char" char="." charoff="13">7.0</entry><entry valign="bottom" align="char" char="." charoff="13">1.2</entry><entry valign="bottom" align="char" char="." charoff="25">53.4</entry><entry align="center" valign="bottom">1 : 7</entry><entry align="center" valign="bottom">25.5</entry><entry valign="bottom" align="char" char="." charoff="26">178.2</entry></row></tbody></tgroup></table></tables>

The highlighted solution is used for all further analyses. Given that the participants in this study experienced 4.7 SH episodes on average, 19 days of high-alert periods seem to be acceptable, if these alerts would prevent 50% of SH. In addition, high-alert periods tend to come in clusters. Therefore we can assume that in practice, long and relatively calm periods will alternate with a few days of high-risk warnings. The last line in <b>Table 7</b> presents a solution with a <b>R_ud</b> =1:7, which is equivalent to the solution presented in the invention disclosure. However, the current solution has almost 10% higher hit rate, 53.4% compared to 44% in our previous algorithm. When the hit rate is comparable to our previous algorithm, the annoyance ratio is below 1:20, i.e. three times better.

<figref idref="f0014"><b>FIG. 14</b></figref> presents the smoothed dependence between the hit rate and the ratio <b>R_ud</b> expressed in percentage. It is evident that the ratio between "flag up" and "flag down" increases rapidly when the hit rate of Algorithm 3 increases. Thus, given these data it maybe unjustified to pursue parameter combinations resulting in a higher than 50% hit rate:

<b><i><u>Alternative Prediction Periods:</u></i></b> In the beginning of the description of Algorithm 3 we made the basic assumption that an SH episode would be considered predicted if the flag is raised within the 24-hour period of time preceding this episode. This assumption resulted in the hit rates reported in the previous section. We will now present computations of the hit rate based on other prediction periods ranging from 12 to 72 hours. Throughout this experiment the parameters α, β, and γ remain fixed at 5.0, 7.5, and 1.5 respectively, i.e. at their values in the solution highlighted of <b>Table 7.</b> Therefore the flag-up rate remains the same as in this solution with <b>R_ud</b>=1:10, and only the hit rate changes since we change the definition of a hit. <figref idref="f0015"><b>FIG. 15</b></figref> presents the dependence between the prediction period and the corresponding hit rate.

It is evident that the hit rate increases rapidly with the increase of the prediction period to about 24 hours and then the increase of the hit rate gradually slows down. Therefore, we can conclude that 24 hours ahead is an optimal and a reasonable forecast period.

<b><i><u>Optimal Number of SMBG Readings Per Day.</u></i></b> Finally we experiment with the requirement of how many readings per day are needed in order to produce an optimal forecast of SH.

As we said in the beginning, all reported SH episodes were 399. Of these episodes 343 had any SMBG reading available in the preceding 24 hours (additional 3 episodes had any reading within the preceding 48 hours and additional 4 episodes had any reading within the preceding 72 hours). It follows that more than 50 SH episodes (14%) did not have any reasonable preceding SMBG reading that would help with their prediction. The 343 episodes that had at least one prior SMBG reading within 24 hours were used for the computation of the hit rates in the previous section. The other episodes were naturally excluded from the computation.

Further analysis shows that the hit rate increases rapidly with the number of readings taken before an SH episode. However, if we impose a strict requirement for a certain number of readings to be available in order to consider an SH episode, we see that the number of SH episodes that meet this requirement rapidly decreases <b>(Table 8).</b> This is due to subjects' non-compliance with the study requirements and is maybe a good reason to incorporate in future meters some sort of a warning message that Algorithm 3 will not be useful and would be switched off if there are no SMBG readings taken at an appropriate rate.

<b>Table 8</b> presents the number of SH episodes that had available certain number of preceding SMBG readings and the hit rate of Algorithm 3 for these episodes. The highlighted row of the table contains the optimal solution from <b>Table 7</b> that was used as a base for all subsequent computations. All hit rates are given in terms of a 24-hour prediction period, i.e. flag within the 24 hours preceding SH. We can conclude that with an increased subjects' compliance the accuracy of Algorithm 3 in prediction SH would increase substantially. With 5 SMBG reading per day the accuracy is up 10% from its base of 50% hit: <tables id="tabl0021" num="0021"><table frame="all"><title><u><b>Table 8:</b> Performance of Algorithm 3, Given a Certain Number of Prior SMBG Readings</u></title><tgroup cols="3"><colspec colnum="1" colname="col1" colwidth="58mm" /><colspec colnum="2" colname="col2" colwidth="71mm" /><colspec colnum="3" colname="col3" colwidth="37mm" /><thead><row><entry valign="middle">Number of Preceding SMBG Readings</entry><entry align="center" valign="middle">SH episodes that satisfy the requirement in column 1(% of total number of SH)</entry><entry align="center" valign="middle">Hit Rate</entry></row></thead><tbody><row><entry valign="middle">At least 1 within 24 hours</entry><entry align="center" valign="middle">343 (86%)</entry><entry align="center" valign="middle">49.9%</entry></row><row><entry valign="middle">At least 3 within 24 hours</entry><entry align="center" valign="middle">260 (65%)</entry><entry align="center" valign="middle">54.2%</entry></row><row><entry valign="middle">At least 4 within 24 hours</entry><entry align="center" valign="middle">180 (45%)</entry><entry align="center" valign="middle">57.2%</entry></row><row><entry valign="middle">At least 5 within 24 hours</entry><entry align="center" valign="middle">103 (26%)</entry><entry align="center" valign="middle">64.1%</entry></row><row><entry valign="middle">At least 4 within 36 hours</entry><entry align="center" valign="middle">268 (67%)</entry><entry align="center" valign="middle">52.6%</entry></row><row><entry valign="middle">At least 5 within 36 hours</entry><entry align="center" valign="middle">205 (51%)</entry><entry align="center" valign="middle">54.6%</entry></row><row><entry valign="middle">At least 6 within 36 hours</entry><entry align="center" valign="middle">146 (37%)</entry><entry align="center" valign="middle">60.3%</entry></row><row><entry valign="middle">At least 7 within 36 hours</entry><entry align="center" valign="middle">107 (27%)</entry><entry align="center" valign="middle">60.7%</entry></row><row><entry valign="middle">At least 6 within 48 hours</entry><entry align="center" valign="middle">227 (57%)</entry><entry align="center" valign="middle">53.3%</entry></row><row><entry valign="middle">At least 7 within 48 hours</entry><entry align="center" valign="middle">187 (47%)</entry><entry align="center" valign="middle">54.0%</entry></row><row><entry valign="middle">At least 8 within 48 hours</entry><entry align="center" valign="middle">143 (36%)</entry><entry align="center" valign="middle">55.9%</entry></row><row><entry valign="middle">At least 9 within 48 hours</entry><entry align="center" valign="middle">107 (27%)</entry><entry align="center" valign="middle">59.8%</entry></row></tbody></tgroup></table></tables>

<u>Other Potential Enhancements That Were Tested</u>

The attempts to increase the predictive power of Algorithm 3 by inclusion of external parameters, such as number of SH episodes in the previous year, or baseline HbA1c were unsuccessful. Evidently, the short-term prediction of SH is mainly dependent on current or recent events. However, a limitation of this study is that all participating subjects had a history of ≥ 2 SH episodes in the previous year.

Finally, we tested whether an alert for SH should be issued if an increased risk for hypoglycemia is detected and there is no SMBG for certain period of time. This was done in an attempt to predict at least some of the SH episodes that were not preceded by any SMBG readings. This was not successful, generating predominantly false alarms. This result comes as an additional confirmation of the importance of compliance with an SMBG protocol comprised of sufficiently frequent SMBG readings.

<u>Appendix: Abstract</u>

Example No. 1 evaluates the frequency of recurrent hypoglycemia and SH (defined as stupor or unconsciousness that preclude self-treatment) following a low blood glucose (BG&lt;3.9mmol/l) episode.

Eighty-five patients (41 female) with T1DM and history of &gt;2 episodes of SH in the last year performed SMBG 3-5 times per day for 6 to 8 months and recorded in diaries any SH episodes by date and time. Subjects' average age was 44±10 years, duration of diabetes 26±11 years, HbA_1c 7.7±1.1%.

All SMBG readings (n=75,495) were merged by date and time with subjects' SH episodes (n=399; SH events generally do not have a corresponding SMBG reading). For each SMBG reading, or SH episode, the elapsed time since the nearest previous low BG (&lt;3.9mmol/l) was computed. <b>Table 9</b> below presents the percentage of readings in 3 hypoglycemic ranges: BG&lt;1.9mmol/l, 1.9-2.8mmol/l, and 2.8-3.9mmol/l, as well as the percentage of SH episodes, that were preceded by a Low BG reading (BG&lt;3.9mmol/l) within 24 hours, 24-48 hours, 48-72 hours, and more than 72 hours. The last column presents Runs tests rejecting the hypotheses that the days containing low BG readings (or SH episodes) are randomly distributed across time. The negative Z-values of the tests show "clustering" of days with and without hypoglycemic readings or SH episodes. <tables id="tabl0022" num="0022"><table frame="all"><title><b>Table 9:</b> Percentage of hypoglycemia/SH preceded by a low BG:</title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="25mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="15mm" /><colspec colnum="4" colname="col4" colwidth="15mm" /><colspec colnum="5" colname="col5" colwidth="14mm" /><colspec colnum="6" colname="col6" colwidth="14mm" /><colspec colnum="7" colname="col7" colwidth="16mm" /><thead><row><entry morerows="1" align="center" valign="middle">BG</entry><entry morerows="1" align="center" valign="middle">&lt; 24h.</entry><entry morerows="1" align="center" valign="middle">24-48h.</entry><entry morerows="1" align="center" valign="middle">48-72h.</entry><entry morerows="1" align="center" valign="middle">&gt; 72h.</entry><entry namest="col6" nameend="col7" align="center" valign="middle">Runs Test</entry></row><row><entry align="center" valign="middle">Z</entry><entry align="center" valign="middle">p-level</entry></row></thead><tbody><row><entry align="center" valign="middle">&lt;3.9 mmol/l</entry><entry align="center" valign="middle">50%</entry><entry align="center" valign="middle">21%</entry><entry align="center" valign="middle">10%</entry><entry align="center" valign="middle">19%</entry><entry valign="middle" align="char" char=".">-13.6</entry><entry align="center" valign="middle">&lt;.0001</entry></row><row><entry align="center" valign="middle">2.8-3.9 mmol/l</entry><entry align="center" valign="middle">52%</entry><entry align="center" valign="middle">20%</entry><entry align="center" valign="middle">10%</entry><entry align="center" valign="middle">18%</entry><entry valign="middle" align="char" char=".">-18.3</entry><entry align="center" valign="middle">&lt;.0001</entry></row><row><entry align="center" valign="middle">1.9-2.8 mmol/l</entry><entry align="center" valign="middle">55%</entry><entry align="center" valign="middle">20%</entry><entry align="center" valign="middle">7%</entry><entry align="center" valign="middle">18%</entry><entry valign="middle" align="char" char=".">-14.7</entry><entry align="center" valign="middle">&lt;.0001</entry></row><row><entry align="center" valign="middle">SH</entry><entry align="center" valign="middle">64%</entry><entry align="center" valign="middle">11%</entry><entry align="center" valign="middle">6%</entry><entry align="center" valign="middle">19%</entry><entry valign="middle" align="char" char=".">-11.1</entry><entry align="center" valign="middle">&lt;.0001</entry></row></tbody></tgroup></table></tables>

We conclude that more than half of all hypoglycemic SMBG readings and approximately 2/3rds of all SH episodes, are preceded by at least one hypoglycemic reading within the previous 24 hours. In addition, hypoglycemic events tend to appear in clusters. Thus, an initial hypoglycemic episode may be a warning sign for upcoming recurrent hypoglycemia.

<u>II. EXAMPLE NO. 2</u>

This method uses routine self-monitoring blood glucose (SMBG) data and pertains directly to enhancement of home SMBG devices by introducing intelligent data interpretation logic, capable of predicting both HbA_1c and periods of increased risk for significant hypoglycemia. The method has two components: (1) Algorithm 1 estimating HbA_1c, and (2) Algorithms 2 &amp; 3 predicting long-term and short-term (within 24 hours) significant hypoglycemia, respectively. In this report we describe the steps of development, optimization and validation of the HbA_1c estimation Algorithm 1, as well as its accuracy in estimating laboratory acquired HbA_1c.

<u>Objective:</u>

The primary goal was to reach an accuracy of 95% of measurements within ±1 HbA_1c unit of a laboratory reference, which is the National Glycohemoglobin Standardization Program (NGSP) Criterion for accuracy for HbA_1c assays.

<u>Methods:</u>

<u>Subjects:</u> SMBG data was captured for 100 subjects with Type 1 and 100 subjects with Type 2 diabetes mellitus (T1DM, T2DM) for 6 months and 4 months respectively, with HbA_1c tests taken at months 0, 3 and 6 in T1DM and months 0, 2 and 4 in T2DM.

<u>Development and Optimization of Algorithm 1:</u> The Training Data Set consisted of SMBG and HbA_1c data collected up to month 3 for T1DM and up to month 2 for T2DM. These Training Data were used for optimization of Algorithm 1 and for evaluation of a number of <i>sample selection criteria</i> that would ensure better accuracy. The sample selection criteria are requirements for any SMBG sample collected by the meter, which, if met, ensure accurate estimation of HbA_1c from that sample. Consequently, the meter will scan every SMBG sample and if the sample selection criteria are met, will compute and display HbA_1c estimate. After analyzing various cut points the following criteria were selected: <ol id="ol0011" compact="compact" ol-style=""><li><i>1. Test Frequency:</i> In order to generate an estimate of HbA_1c, the meter will require an average of 2.5 tests or more per day over the last 60 days, e.g. a total of 150 SMBG readings over the past two months. It is important to note that this is an average per day, testing every day is not required.</li><li>2. <i>Randomness of data:</i> Certain 60-day samples with only post-prandial testing, or insufficient nighttime tests (&lt;3% of sample) are to be excluded. In addition a safeguard against highly concentrated testing at one modal time of day was incorporated. These criteria are described in detail in the report.</li></ol>

<b>Results:</b> Prospective Validation and Accuracy of Algorithm 1:

The algorithm, including the sample selection criteria, was then applied to Test Data Set 1, which included SMBG and HbA_1c data for two months prior to T1DM and T2DM subjects' last HbA_1c, and to an independent Test Data Set 2 consisting of 60 T1DM subjects who participated in a previous NIH study. The estimates obtained by Algorithm 1 were compared to reference HbA_1c levels for validation purposes. In Test Data Set 1 the algorithm reached the NGSP criteria with an <i>accuracy of 95.1%</i> within ±1 Hba_1c unit of the lab reference. In Test Data Set 2 the algorithm reached the NGSP criteria as well with an <i>accuracy of 95.5%</i> within ±1 Hba_1c unit of the lab reference. Investigation of the sample selection criteria showed that 72.5% of all subjects would generate such an accurate estimate every day, and 94% of all subjects would generate such an accurate an estimate about once every 5 days.

<b><u>Conclusion:</u></b> Routine SMBG data allow for accurate estimate of HbA_1c that meets the NGSP criterion for accuracy of <i>direct</i> HbA_1c assays.

<u>SUBJECTS &amp; INCLUSION CRITERION</u>

We have consented 100 subjects with Type 1 Diabetes (T1DM) and 100 subjects with Type 2 Diabetes (T2DM). One hundred seventy-nine subjects, 90 with T1DM and 89 with T2DM, completed significant portions of the SMBG data collection. The data of these 179 subjects were used for testing Algorithms 2 and 3. However, the testing of Algorithm 1 required that the subjects had not only SMBG data, but HbA_1c data and SMBG records taken in the 60 days prior to SMBG. At month 3 of this study (month 2 for T2DM), 153 subjects (78 with T1DM) had completed HbA_1c data and SMBG data meeting the above criterion. In addition, we used for testing of Algorithm 1 data for N=60 subjects with T1DM who participated in our previous NIH study (NIH). The demographic characteristics of all subjects are presented in <b>Table 10.</b><tables id="tabl0023" num="0023"><table frame="all"><title><u><b>Table 10:</b> Demographic characteristics of the subjects:</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="99mm" /><colspec colnum="2" colname="col2" colwidth="21mm" /><colspec colnum="3" colname="col3" colwidth="19mm" /><colspec colnum="4" colname="col4" colwidth="21mm" /><thead><row><entry><i>Variable</i></entry><entry align="center" valign="middle"><b><i>T1DM</i></b></entry><entry align="center" valign="middle"><b>T2DM</b></entry><entry align="center" valign="middle"><b><i>NIH</i></b></entry></row></thead><tbody><row><entry valign="middle">Age (years)</entry><entry align="center" valign="middle">41.5 (11.6)</entry><entry align="center" valign="middle">50.9 (8.1)</entry><entry align="center" valign="middle">44.3 (10.0)</entry></row><row><entry valign="middle">Gender: % Male</entry><entry align="center" valign="middle">41%</entry><entry align="center" valign="middle">43%</entry><entry align="center" valign="middle">46%</entry></row><row><entry valign="middle">Duration of diabetes (years)</entry><entry align="center" valign="middle">20.1 (10.1)</entry><entry align="center" valign="middle">11.7 (8.2)</entry><entry align="center" valign="middle">26.4 (10.7)</entry></row><row><entry valign="middle">Body mass index</entry><entry align="center" valign="middle">25.4 (4.7)</entry><entry align="center" valign="middle">34.2 (8.1)</entry><entry align="center" valign="middle">24.3 (3.4)</entry></row><row><entry valign="middle">Baseline HbA_1c</entry><entry align="center" valign="middle">7.5 (1.1)</entry><entry align="center" valign="middle">8.5 (2.1)</entry><entry align="center" valign="middle">7.6 (1.0)</entry></row><row><entry valign="middle">Second HbA_1c</entry><entry align="center" valign="middle">7.3 (1.2)</entry><entry align="center" valign="middle">7.9 (1.6)</entry><entry align="center" valign="middle">7.4 (0.8)</entry></row><row><entry valign="middle">Third HbA_1c</entry><entry align="center" valign="middle">7.0 (0.9)</entry><entry align="center" valign="middle">7.5 (1.1)</entry><entry align="center" valign="middle">-</entry></row><row><entry valign="middle"># SMBG readings / subject / day</entry><entry align="center" valign="middle">5.4 (2.3)</entry><entry align="center" valign="middle">3.5 (0.8)</entry><entry align="center" valign="middle">4.1 (1.9)</entry></row><row><entry valign="middle"># Days with SMBG readings in the 2 months preceding second HbA_1c</entry><entry align="center" valign="middle">56.9 (5.4)</entry><entry align="center" valign="middle">57.3 (4.3)</entry><entry align="center" valign="middle">37.5 (14.3)</entry></row></tbody></tgroup></table></tables>

<i><u>OBSERVED METER ERRORS</u></i>

Our investigation showed that the <i>major reason for incomplete data</i> within 60 days prior to HbA_1c assays, or elsewhere, was not subject noncompliance, but <i>meter failure.</i> The time and date of the ONE TOUCH ULTRA meter could "jump" to a random date/time (e.g. November 2017), apparently if the patient depressed the "M" button for too long. We were checking the date/time of each meter upon return and we found that such event occurred in 60 meters throughout the course of the study. The time/date shift affected 15,280 readings, or approximately 10% of all readings. We stored these readings separately and had a student review them. In many, but not in all cases he was able to restore the date/time sequence of the readings. This error, together with a few meters lost in the mail, reduced the number of subjects with good data for Algorithm 1 analyses from 179 to 141. The data of 12 subjects were restored, which brought the final count to 153 subjects, 78 with T1DM and 75 with T2DM, who had uninterrupted time sequence of data prior to HbA_1c, suitable for testing of Algorithm 1.

<i><u>PROCEDURE</u></i>

All subjects signed IRB-approved consent forms and attended orientation meetings where they were introduced to the ONE TOUCH ULTRA meter and completed screening questionnaires. Immediately after the introductory meeting all subjects visited a UVA laboratory and had blood drawn for baseline HbA_1c. T1DM subjects were followed for 6 months with laboratory HbA_1c assays at months 3 and 6; T2DM subjects were followed for 4 months with laboratory HbA_1c assays at months 2 and 4. Self-monitoring (SMBG) data were regularly downloaded from the meters and stored in databases. Parallel recording of significant hypoglycemic and hyperglycemic episodes was done by an automated e-mail/telephone tracking system every two weeks.

<i><u>DATA STORAGE AND CLEANING</u></i>

The raw data from ONE TOUCH ULTRA were stored in InTouch databases separately for T1DM and T2DM subjects. These raw data were cleaned for subject and meter errors using custom developed software and, in some cases, manual data cleaning (see Meter Errors above). When correction was not possible, the data was discarded.

In order to ensure that the results of our optimization can be generalized to population level, the algorithms were first optimized using a training data set and then validated using test data sets.

The <u>Training Data set</u> included 60 days of SMBG data taken prior to T1DM subjects' 3-month HbA_1c determination. This data set was used to optimize the formulas for Algorithm 1. The data of T2DM subjects collected prior to their 2-month HbA_1c were used to identify Sample Selection Criteria, which were not apparent in T1DM data. However, T2DM subjects' data were <i>not used</i> for optimization of Algorithm 1 formulas. The file containing these data is PASS01.DAT.

<u>Test Data Set 1</u> included 60 days of SMBG data taken prior to T1DM subjects' 6-month HbA_1c determination, and T2DM subjects' 4-month HbA_1c. Below we will refer to these data as <i>Data Set 1.</i> The file containing these data is PASS02.DAT.

<u>Test Data Set 2</u> contained data for N=60 subjects with T1DM from a previous NIH study. These data were collected using ONE TOUCH PROFILE meters. Below we will refer to these data as <i>Data Set 2.</i> The file containing these data is HAT0.XLS.

<u>The variables in PASS01.DAT, PASS02.DAT, and HAT0.XLS are as follows:</u><ul id="ul0012" list-style="none" compact="compact"><li>ID, MONTH, DAY, HOUR, YEAR - self-explanatory ID number and time of reading.</li><li>PLASBG - BG as recorded by One Touch Ultra (N/A in HAT0.DAT because One Touch Profile was used).</li><li>RISKLO, RISKHI - control variables representing the result of data transformation (see below).</li><li>BG and BGMM - BG converted to whole blood BG, and then presented in mmol/l (see below).</li></ul>

The aggregated (per subject) data, HbA_1c, its estimate, and estimation errors are stored in Excel files PASS1.XLS and PASS2.XLS.

<u>The variables in PASS1.XLS, PASS2.XLS, and HAT1.XLS are as follows:</u><ul id="ul0013" list-style="none" compact="compact"><li>ID, TYPE (of diabetes)</li><li>HBA1 - reference baseline HbA1c value</li><li>HBA2 - reference HbA1c at 3 months(2 months for T2DM)- this is to be predicted;</li><li><b><i>EST2 and ERR2 - Estimate of HbA1c and its error;</i></b></li></ul>

Control variables (all variables used by Algorithm 1): <ul id="ul0014" list-style="none" compact="compact"><li><b><i>BGMM1 - average BG in mmol</i>/<i>l (see Part 2 below);</i></b></li><li>RLO1, RHI1 - low and high BG indices (see Part 2 below);</li><li>L06 - low BG index at night - computed on readings between midnight and 6:59 a.m. (i.e. if(0.leHOUR.le.6));</li><li>NC1 = number of SMBG readings in the past 60 days;</li></ul>

NDAYS = number of days with SMBG readings in the past 60 days. <ul id="ul0015" list-style="none" compact="compact"><li>N06 - % of SMBG readings in time intervals 0-6:59; 7-12:59;</li><li>EXCLUDE = 0,1 - samples suggested for exclusion by the algorithm, if EXCLUDE=1.</li></ul>

The files PASS01.DAT and PASS1.XLS can be matched by subject's ID number. Similarly, files PASS02.DAT and PASS2.XLS and HAT0.XLS and HAT1.XLS can be matched by subject's ID number. The raw data and all second-generation data files were transmitted to LifeScan, Inc.

DEVELOPMENT OF ALGORITHM 1

<i>Formula Derivation:</i>

Most of the exploration and the development of Algorithm 1 occurred during Example No. 1 of this project. Example No. 1 did not include data collection. Instead, we used a data set collected in a clinical trial by Amylin Pharmaceuticals. Example No. 1 suggested three possible formulas for estimation of HbA1c from SMBG data: (1) A formula using average SMBG, Low and High BG Indices; (2) A formula using average SMBG and a previous reference HbA1c reading, and (3) A simple linear formula using average SMBG only (see Example No. 1).

Another objective criterion for accuracy of HbA_1c estimation was set forward (in Example No. 1 we used least squares estimation, % error, and absolute error to evaluate the accuracy of each formula). This new requirement translated into a different optimization criterion for Algorithm 1, e.g. the formulas were no longer optimized to produce minimal sum of squares of the errors (least squares estimation), but to fit the estimates within an uniform ±1 band from reference HbA_1c.

In order to do so we analyzed the errors of our first linear model (formula Example No. 1) with respect to this uniform fit, using <i>the Training Data for TIDM subjects only.</i> We found that these errors were positively correlated (r=0.3) with subjects' High BG Index and used this relationship to correct our first linear model. We found that it was best using the High BG Index as a categorical variable, splitting the subject sample into groups with increasing High BG Index, and introducing corrections to the linear model within each group. The idea was to introduce corrections using the Low BG Index within each particular group, not throughout the whole sample as it was suggested in Example No. 1. This change was dictated by the different scheme of optimization based on the NGSP criterion.

Thus, based on Training Data for T1DM subjects, we finalized the following Algorithm 1:

<u>Part 1- Pre-Processing of the data:</u>

<ul id="ul0016" list-style="none" compact="compact"><li>BG=PLASBG/1.12 (converts plasma to whole blood BG, which is used throughout).</li><li>BGMM=BG/18 (converts BG to mmol/l).</li></ul>

The following lines compute Low and High BG Index for each SMBG reading: <ul id="ul0017" list-style="none" compact="compact"><li>COM SCALE=(1n(BG))**1.08405 - 5.381.</li><li>COM RISK1=22.765*SCALE*SCALE.</li><li>COM RISKLO=0.</li><li>IF(BGle 112.5) RISKLO=RISK1.</li><li>COM RISKHI=0.</li><li>IF (BG gt 112.5) RISKHI=RISK1.</li></ul>

The following lines aggregate the data per subject: <ul id="ul0018" list-style="none" compact="compact"><li>BGMM1 = average (BGMM) per subject;</li><li>RLO1 = average (RISKLO) per subject;</li><li>RHI1 = average (RISKHI) per subject;</li><li>L06 = average (RISKLO) computed only for readings during the night, missing if there are no readings at night.</li><li>N06, N12, N24 - % of SMBG readings in time intervals 0-6:59; 7-12:59, and 18-23:59, e.g. if(0.le.HOUR.le.6)), if(7.le.HOUR.le.12)), and if(18.le.HOUR.le.24)), respectively.</li><li>NC1 = total number of SMBG readings in the past 60 days;</li><li>NDAYS = number of days with SMBG readings in the past 60 days.</li></ul>

<u>Part 2 - Estimation Procedure:</u>

This estimation procedure is based on the linear model from our Example No. 1: <maths id="math0044" num=""><math display="block"><msub><mi>HbA</mi><mrow><mn mathvariant="normal">1</mn><mo>⁢</mo><mi mathvariant="normal">c</mi></mrow></msub><mo>=</mo><mn mathvariant="normal">0.41046</mn><mo>*</mo><mi>BGMM</mi><mo>+</mo><mn mathvariant="normal">4.0775.</mn></math><img file="EP1534121B1_D0046.tif" /></maths>

Analyzing the errors of this formula we found that the errors depend on the High BG Index. Thus, we classified all subjects on the base of their High BG Index, and then introduced corrections to the linear model within each category as follows: <ol id="ol0012" compact="compact" ol-style=""><li>A. Each subject is assigned a group depending on his/her High BG Index: <ul id="ul0019" list-style="none" compact="compact"><li>if (RHI1 le 5.25 or RHI1 ge 16) GRP=0.</li><li>if (RHI1 gt 5.25 and RHI1 lt 7.0) GRP=1.</li><li>if (RHI1 ge 7.0 and RHI1 lt 8.5) GRP=2.</li><li>if (RHI1 ge 8.5 and RHI1 lt 16) GRP=3.</li></ul></li><li>B. For each group we have the following estimates: <ul id="ul0020" list-style="none" compact="compact"><li>E0=0.55555*BGMM1+2.95.</li><li>E1=0.50567*BGMM1+0.074*L06+2.69.</li><li>E2=0.55555*BGMM1-0.074*L06+2.96.</li><li>E3=0.44000*BGMM1+0.035*L06+3.65. <ul id="ul0021" list-style="none" compact="compact"><li>EST2=E0.</li><li>if (GRP eq 1) EST2=E1.</li><li>if (GRP eq 2) EST2=E2.</li><li>if (GRP eq 3) EST2=E3.</li></ul></li></ul></li><li>C. Corrections for some rarely occurring outliers: <ul id="ul0022" list-style="none" compact="compact"><li>if (missing(L06)) EST2=E0.</li><li>if (RLO1 le 0.5 and RHI1 le 2.0) EST2=E0-0.25.</li><li>if (RLO1 le 2.5 and RHI1 gt 26) EST2=E0-1.5*RL01.</li><li>if ((RLO1/RHI1) le 0.25 and L06 gt 1.3) EST2=EST2-0.08.</li></ul></li></ol>

<i><u>ACCURACY CRITERIA</u></i>

In order to evaluate the accuracy of Algorithm 1 we use several standard criteria: <ol id="ol0013" ol-style=""><li>1) NGSP Accuracy Criterion requires at least 95% of all estimates to be within ±1 HbA_1c unit from reference HbA_1c.</li><li>2) Average absolute deviation of Estimated from measured HbA_1c;</li><li>3) Average percent deviation of Estimated from measured HbA_1c.</li></ol>

<b><u>Important Note:</u></b> The NGSP accuracy criterion is designed for testing of devices that measure HbA_1c directly. Here we apply this criterion to estimates of HbA_1c from SMBG data. However, the goal of such estimates is not to replace HbA_1c laboratory measurement, it is to <i>assist patients and physicians</i> in the day-to-day management of diabetes. As opposed to laboratory measurement, the estimates utilize data that are available anyway and are available on a daily basis, without requiring special equipment or visit at the physician's office.

To illustrate how other direct measures of HbA_1c agree with traditional laboratory measures, we tested blood sample from 21 IDDM patients and analyzed for HbA_1c with both the DCA 2000 and the clinical laboratory. Out of these 21 tests there was one large error of 2.5 units HbA_1c. <b>Table 11</b> presents the accuracy results of this FDA approved office device: <tables id="tabl0024" num="0024"><table frame="all"><title><u><b>Table 11:</b> Accuracy of DCA 2000 in T1DM:</u></title><tgroup cols="2"><colspec colnum="1" colname="col1" colwidth="59mm" /><colspec colnum="2" colname="col2" colwidth="30mm" /><thead><row>&lt;entry /&gt;<entry align="center"><b>DCA 2000</b></entry></row></thead><tbody><row><entry valign="bottom">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="bottom">95.2%</entry></row><row><entry valign="bottom">Average absolute error (units HbA_1c)</entry><entry align="center" valign="bottom">0.45</entry></row><row><entry valign="bottom">Average percent error</entry><entry align="center" valign="bottom">5.7%</entry></row></tbody></tgroup></table></tables>

<i><u>SAMPLE SELECTION CRITERIA</u></i>

<u>Formula Derivation:</u>

The estimation of HBA1c uses 60 consecutive days of SMBG. We will refer to such 60 consecutive days of SMBG as <i>sample.</i> Each person generates numerous samples in the course of his/her SMBG. In fact, each new measurement brings about a new sample, slightly different than the previous one. Thus, it is a natural assumption that the meter should have some control points for the quality of SMBG sample data from which HbA_1c is to be estimated.

Therefore, after the general algorithm formula was optimized, it was then applied to the entire Training Data Set (data for T1DM and T2DM subjects) in order to investigate conditions under which a SMBG sample would result in an inaccurate estimation of HbA_1c.

This investigation concentrated on the following patterns occurring in SMBG that would result in inaccurate estimation: <ol id="ol0014" compact="compact" ol-style=""><li>1) Infrequent SMBG - certain number of reading is needed over two months in order to estimate HbA1c. Ifthis number is not achieved, the estimation maybe inaccurate;</li><li>2) Patterns of SMBG skewed towards hyperglycemia occurring when subjects test predominantly after meals, or use oral medications with a primary concern of high BG;</li><li>3) Skewed temporal patterns of SMBG, e.g. testing predominantly at a few fixed times each day, which does not yield a good daily profile of a subject's BG fluctuations.</li></ol>

After investigating such patterns, we selected optimal sample selection criteria based on the most accurate and least exclusionary cut points. For a detailed description of the programming logic and statements for coding purposes please refer to Appendix A.

<u>Final Sample Selection Criteria:</u>

<b><u>Criterion 1. Test Frequency:</u></b> The algorithm will require that a 60-day sample contain an average of at least 2.5 tests per day, e.g. at least 150 SMBG readings over the last 60 days to generate an HbA1c estimate (NC1 &gt;=150).

<u>Criterion 2. Randomness of Data:</u>

2a) <u><i>Oral Therapy</i> / <i>Postprandial Testing:</i></u> (RLO1/RHI1 &gt;=0.005). In some SMBG samples the distribution of SMBG appeared to be very skewed towards hyperglycemia. This happened predominantly in T2DM subjects, who appeared to measure only at high BG. We have hypothesized that these samples contained no testing at low glucose ranges. Our investigation showed that about 1/3^rd of such samples would result in an overestimate of HbA_1c (2/3^rds would still result in accurate estimates). Based on that we recommend the meter to display no results, if a skewed sample is encountered, which in terms of computation is formulated as LBGI to be at least ½% of the HBGI.

2b) <i><u>Testing during the night:</u></i> (N06 &gt;=3%). This criterion ensures that at least some of nighttime glycemia is accounted for. This criterion requires that 3% of all the readings occur at night (between midnight and 7:00 am). <u><i>In other words,</i></u> a sample will be acceptable <i>if at least 5 out of 150 readings,</i> taken over 2 months, are during the night. Note that patients are often advised to test at night, so this criterion promotes good management.

2c) <i><u>Safeguard against highly abnormal testing patterns:</u></i> A sample will not result in an estimate if more than 3/4 of its readings occur in any one daily 6-hour interval. For example, if 80% of all tests in a sample occur right after breakfast, an estimate will not be produced. This criterion was requested by LifeScan, Inc. as a safeguard against people trying to "beat the algorithm", and it would allow us to thereby defend the validity, especially with clinicians.

<u>Accuracy in the Training Data Set with Sequentially Employed Sample Selection:</u>

The following tables describe the impact of the selected sample selection criteria on the accuracy and number of exclusions in the Training Data Set. Note that the accuracy of the final version of Algorithm 1 developed as a part of this study (Final Algorithm), and the accuracy of the simplest linear function that has been developed in Example No. 1 and included in the Example No. 1, (see First Linear Model).

For each model we present its accuracy without any sample selection criteria and with sequentially applied sample selection Criterion 1 - Test Frequency, # readings NR≥150, and Criterion 2 - Randomness of Data, as described above.

As seen in all tables, the accuracy of Algorithm 1 improves with sequentially applied sample selection criteria and reaches the NGSP required 95% after applying all criteria. These latter results are highlighted in the tables. <tables id="tabl0025" num="0025"><table frame="all"><title><b><u>Table 12A:</u></b><u>Final Sample Selection Criteria in Training Data Set - all subjects:</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="24mm" /><colspec colnum="2" colname="col2" colwidth="25mm" /><colspec colnum="3" colname="col3" colwidth="21mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><colspec colnum="5" colname="col5" colwidth="26mm" /><colspec colnum="6" colname="col6" colwidth="21mm" /><colspec colnum="7" colname="col7" colwidth="26mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">93%</entry><entry align="center" valign="middle">93%</entry><entry align="center" valign="middle">95.5%</entry><entry align="center" valign="middle">83%</entry><entry align="center" valign="middle">83%</entry><entry align="center" valign="middle">90%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.54</entry><entry align="center" valign="middle">0.53</entry><entry align="center" valign="middle">0.47</entry><entry align="center" valign="middle">0.61</entry><entry align="center" valign="middle">0.59</entry><entry align="center" valign="middle">0.52</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">7.2%</entry><entry align="center" valign="middle">7.2%</entry><entry align="center" valign="middle">6.8%</entry><entry align="center" valign="middle">8.2%</entry><entry align="center" valign="middle">8.2%</entry><entry align="center" valign="middle">7.6%</entry></row><row><entry valign="middle"># of subjects with absolute error &gt; 1</entry><entry align="center" valign="middle">11</entry><entry align="center" valign="middle">9</entry><entry align="center" valign="middle">5</entry><entry align="center" valign="middle">26</entry><entry align="center" valign="middle">22</entry><entry align="center" valign="middle">11</entry></row></tbody></tgroup></table></tables><tables id="tabl0026" num="0026"><table frame="all"><title><u><b>Table 12B:</b> Final Sample Selection Criteria in Training Data Set - T1DM:</u> The coefficients of Algorithm 1 were optimized in this sample, which explains the high accuracy even without sample selection.</title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="23mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="24mm" /><colspec colnum="4" colname="col4" colwidth="23mm" /><colspec colnum="5" colname="col5" colwidth="24mm" /><colspec colnum="6" colname="col6" colwidth="26mm" /><colspec colnum="7" colname="col7" colwidth="25mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion-% within ±1 HbA_1c unit</entry><entry align="center" valign="middle">96%</entry><entry align="center" valign="middle">96%</entry><entry align="center" valign="middle">96%</entry><entry align="center" valign="middle">86%</entry><entry align="center" valign="middle">88%</entry><entry align="center" valign="middle">90%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.46</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.54</entry><entry align="center" valign="middle">0.53</entry><entry align="center" valign="middle">0.51</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">6.3%</entry><entry align="center" valign="middle">6.6%</entry><entry align="center" valign="middle">6.5%</entry><entry align="center" valign="middle">7.7%</entry><entry align="center" valign="middle">7.8%</entry><entry align="center" valign="middle">7.6%</entry></row></tbody></tgroup></table></tables><tables id="tabl0027" num="0027"><table frame="all"><title><u><b>Table 12C:</b> Final Sample Selection Criteria in Training Data Set - T2DM:</u> The Sample Selection Criterion 2 (Randomness of data) was developed primarily using this sample, which explains the 5% increase in accuracy when this criterion is applied.</title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="23mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="24mm" /><colspec colnum="4" colname="col4" colwidth="23mm" /><colspec colnum="5" colname="col5" colwidth="24mm" /><colspec colnum="6" colname="col6" colwidth="26mm" /><colspec colnum="7" colname="col7" colwidth="25mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion-% within ±1 HbA_1c unit</entry><entry align="center" valign="middle">89%</entry><entry align="center" valign="middle">90%</entry><entry align="center" valign="middle">95%</entry><entry align="center" valign="middle">80%</entry><entry align="center" valign="middle">79%</entry><entry align="center" valign="middle">91%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.63</entry><entry align="center" valign="middle">0.62</entry><entry align="center" valign="middle">0.52</entry><entry align="center" valign="middle">0.68</entry><entry align="center" valign="middle">0.66</entry><entry align="center" valign="middle">0.53</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">8.2%</entry><entry align="center" valign="middle">8.0%</entry><entry align="center" valign="middle">7.3%</entry><entry align="center" valign="middle">8.7%</entry><entry align="center" valign="middle">8.5%</entry><entry align="center" valign="middle">7.5%</entry></row></tbody></tgroup></table></tables>

<u>Frequency of Sample Exclusion in the Training Data:</u>

The meter has a chance of estimating HbA_1c at every new reading. If a sample does not meet the selection criteria, then the meter would not display a HbA_1c estimate and would: <ol id="ol0015" ol-style=""><li>(a) Wait until an appropriate sample is accumulated, or</li><li>(b) If an appropriate sample is not accumulated, e.g. is a person has a permanently skewed measurement pattern, the meter could issue a prompt for SMBG pattern correction.</li></ol>

Our investigation shows that the <i>majority of subjects (&gt;95%) would get at least 10 HbA_1c estimates over 60 days (as long as they measure frequently enough),</i> and only 2% of the subjects would get no estimate due to skewed measurement patterns. These 2% of subjects would need to be prompted to correct their measurement pattern. Complete results of this investigation are given below:

We computed how many days (out of 60) a meter would not be able to show HbA_1c results to a person due to samples that do not meet the selection criteria: <ol id="ol0016" compact="compact" ol-style=""><li>1) For 72.5% of all subjects the meter will be able to report HbA_1c<i>every day;</i></li><li>2) For additional 7.5% of all subjects the meter will be able to report HbA_1c on 45 to 59 days (out of 60);</li><li>3) For additional 10% of all subjects the meter will be able to report HbA_1c on 12 to 44 days;</li><li>4) For 9 subjects (5.9%) the meter would not be able to report HbA_1c unless they change SMBG pattern.</li></ol><b><u>Important Note:</u></b> Most of these subjects would not get an estimate because they did not meet the Test Frequency Criterion 1, e.g. their samples always had less than 150 readings. Therefore, at least 94% of all subject will get at least one HbA_1c estimate about every 5 days without changing their measurement pattern (this includes T1DM and T2DM).

If we require at least 150 readings for 60 days, only 3 subjects would not get HbA_1c estimate: <ol id="ol0017" compact="compact" ol-style=""><li>1) 95.6% will get at least 10 HbA_1c estimates over 60 days;</li><li>2) 2.2% will not get any estimates.</li></ol>

Thus, approximately <i>98% of the subjects who measure on average 2.5 times a day will get HbA_1c</i> estimate over 60 days, &gt; 95% will get estimate at least once a week. We conclude that the Sample Selection Criterion 2 - Randomness of Data has, over time, a minimal impact on the display of HbA_1c estimates. Only about 2% of the subjects would need to be prompted to improve their SMBG pattern.

It should be noted that the sample selection criteria are applicable to improve the accuracy of <i>any formula estimating HbA_1c.</i> The selection criteria are independent from any particular algorithm/formula and are applied before the estimation begins. For example, when applied, the sample selection criteria improve the accuracy of the latest Algorithm 1 developed as part of this study, <i>and</i> the accuracy of our first linear model presented in Example No. 1.

In addition, examining the effect of some other sample selection criteria reveals ways we can improve the accuracy further, should that be desirable. For example, when one of the original test frequency criteria was applied to the data, it demonstrated some incremental utility. This criterion is described further in Appendix E.

<i><u>PROSPECTIVE VALIDATION OF ALGORITHM 1:</u></i>

<u>Accuracy in Test Data Set 1:</u>

The algorithm, including the final sample selection criteria, was then applied to Test Data Set 1 (SMBG for two months prior to last HbA_1c for T1DM 1 and T2DM subjects) to generate HbA_1c estimates. These estimates were then compared to reference HbA_1c in order to prospectively validate Algorithm 1. <b>Table 13</b> presents a summary of the results of this validation. A more detailed account of the impact of each of the sample selection criteria' on the accuracy of the algorithm and can be found in Appendix C. <tables id="tabl0028" num="0028"><table frame="all"><title><u><b>Table 13:</b> Accuracy of Algorithm 1 Applied Prospectively:</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="59mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="20mm" /><colspec colnum="4" colname="col4" colwidth="20mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm with Criteria 1 and 2</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>All Subjects</b></entry><entry align="center" valign="middle"><b>T1DM</b></entry><entry align="center" valign="middle"><b>T2DM</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">95.1%</entry><entry align="center" valign="middle">97%</entry><entry align="center" valign="middle">93%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.38</entry><entry align="center" valign="middle">0.54</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">6.2%</entry><entry align="center" valign="middle">5.4%</entry><entry align="center" valign="middle">7.4%</entry></row></tbody></tgroup></table></tables>

<u>Accuracy in Test Data Set 2:</u>

Another independent NIH data set (N=60 subjects with T1DM) was used to validate the results with similar accuracy of 95.5% within 1 HbA_1c percent units of the lab reference <b>(Table 14):</b><tables id="tabl0029" num="0029"><table frame="all"><title><u><b>Table 14:</b> Accuracy of Algorithm 1 in Independent NIH Data Set:</u></title><tgroup cols="2"><colspec colnum="1" colname="col1" colwidth="60mm" /><colspec colnum="2" colname="col2" colwidth="47mm" /><thead><row><entry valign="middle" /><entry align="center" valign="middle"><b>All Subjects (T1DM)</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">95.5%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.42</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">5.9%</entry></row></tbody></tgroup></table></tables>

<u>Comparison of Accuracy of Algorithm 1 to FDA-approved Office Device:</u>

As shown in <b>Table 15</b> below, the accuracy of Algorithm 1 is comparable to the accuracy of HbA_1c assays used in physicians' offices. As described in the Accuracy Criteria section, the DCA 2000 data was taken to illustrate how other direct measures of HbA_1c agree with laboratory measures. We analyzed for HbA_1c blood samples from 21 T1DM patients with both the DCA 2000 and the clinical laboratory. Out of these 21 tests there was one large error of 2.5 units HbA_1c: <tables id="tabl0030" num="0030"><table frame="all"><title><u><b>Table 15:</b> Accuracy of DCA 2000 in T1DM compared to Algorithm 1:</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="58mm" /><colspec colnum="2" colname="col2" colwidth="24mm" /><colspec colnum="3" colname="col3" colwidth="33mm" /><colspec colnum="4" colname="col4" colwidth="33mm" /><thead><row><entry valign="middle" /><entry align="center" valign="middle"><b>DCA 2000</b></entry><entry align="center" valign="middle"><b>TEST DATA SET 1</b></entry><entry align="center" valign="middle"><b>TEST DATA SET 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within +1 HbA_1c unit</entry><entry align="center" valign="middle">95.2%</entry><entry align="center" valign="middle">95.1%</entry><entry align="center" valign="middle">95.5%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.42</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">5.7%</entry><entry align="center" valign="middle">6.2%</entry><entry align="center" valign="middle">5.9%</entry></row></tbody></tgroup></table></tables>

<u>Frequency of Sample Exclusion in the Test Data:</u>

As we discussed as part of the development of Algorithm 1, the meter has a chance of estimating HbA_1c at every new reading. If a sample does not meet the selection criteria, then the meter would not display a HbA_1c.

We used Test Data Sets 1 and 2 to prospectively estimate the frequency of sample exclusion. In order to do so, we computed on how many days (out of 60) a meter would be able to show HbA_1c results to a person, e.g. on how many days a person would have samples meeting the sample selection criteria. <b>Tables 16A and 16B</b> present summaries of these results for Test Data Sets 1 and 2. We include data for all subjects, and separately for subjects who measured on average 1.5 times/day (90 SMBG readings over 60 days) and 2.5 times/day (150 SMBG readings over 60 days): <tables id="tabl0031" num="0031"><table frame="all"><title><u><b>Table 16A:</b> Frequency of Sample Exclusion in Test Data Set 1:</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="43mm" /><colspec colnum="2" colname="col2" colwidth="34mm" /><colspec colnum="3" colname="col3" colwidth="45mm" /><colspec colnum="4" colname="col4" colwidth="45mm" /><thead><row><entry valign="top" /><entry align="center" valign="top">All subjects (N=148)</entry><entry align="center" valign="top">Subjects who measured on average ≥ 1.5 times/ day (N=146)</entry><entry align="center" valign="top">Subjects who measured on average ≥ 2.5 times/ day (N=130)</entry></row></thead><tbody><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>every day</u></i>;</entry><entry align="center" valign="middle">69.6%</entry><entry align="center" valign="middle">72.6%</entry><entry align="center" valign="middle">77.7%</entry></row><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>once every</u></i><u><i>3 days</i>;</u></entry><entry align="center" valign="middle">87.8%</entry><entry align="center" valign="middle">91.1%</entry><entry align="center" valign="middle">93.1%</entry></row><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>once a</u></i><u><i>week</i>;</u></entry><entry align="center" valign="middle">91.9%</entry><entry align="center" valign="middle">95.5%</entry><entry align="center" valign="middle">96.9%</entry></row></tbody></tgroup></table></tables><tables id="tabl0032" num="0032"><table frame="all"><title><b><u>Table 16B:</u></b><u>Frequency of Sample Exclusion in Test Data Set 2:</u></title><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="44mm" /><colspec colnum="2" colname="col2" colwidth="32mm" /><colspec colnum="3" colname="col3" colwidth="45mm" /><colspec colnum="4" colname="col4" colwidth="45mm" /><thead><row><entry valign="top" /><entry align="center" valign="top">All subjects (N=60)</entry><entry align="center" valign="top">Subjects who measured on average ≥ 1.5 times/ day (N=55)</entry><entry align="center" valign="top">Subjects who measured on average ≥ 2.5 times/ day (N=30)</entry></row></thead><tbody><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>every day</u>;</i></entry><entry align="center" valign="middle">51.7%</entry><entry align="center" valign="middle">83.6%</entry><entry align="center" valign="middle">80.0%</entry></row><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>once every</u><u>3 days;</u></i></entry><entry align="center" valign="middle">95.0%</entry><entry align="center" valign="middle">100.0%</entry><entry align="center" valign="middle">100.0%</entry></row><row><entry valign="middle">Percent of subjects to whom the meter will be able to report HbA_1c<i><u>once a</u><u>week;</u></i></entry><entry align="center" valign="middle">96.7%</entry><entry align="center" valign="middle">100.0%</entry><entry align="center" valign="middle">100.0%</entry></row></tbody></tgroup></table></tables>

<u>Conclusion:</u>

<b>Tables 13 - 16</b> demonstrate that the meter would be able to produce an accurate estimate of HbA_1c, meeting the 95% NGSP accuracy criterion, on average once a week, for &gt; 96% of those who measure on average 2.5 times a day.

<i><u>APPENDIX A - SOFTWARE LOGIC FOR SAMPLE SELECTION CRITERIA</u></i>

Sample Selection Criteria - some SMBG samples are suggested for exclusion by the algorithm, or a message is issued to the subj ects to correct their SMBG pattern. The sample selection criteria are programmed as follows: <ul id="ul0023" list-style="none" compact="compact"><li><b><u>Criterion 1. Test Frequency:</u></b> The algorithm will require that a 60-day sample contain an average of at least 2.5 tests per day, e.g. at least 150 SMBG readings over the last 60 days to generate an HbA_1c estimate: <ul id="ul0024" list-style="none" compact="compact"><li>EXCLUDE=0.</li><li>if (NC1 &gt;=150) EXCLUDE=1.</li></ul></li><li><b><u>Criterion 2. Randomness of Data:</u></b><ul id="ul0025" list-style="none" compact="compact"><li>2a) <u><i>Oral Therapy</i> / <i>Postprandial Testing:</i></u> In some SMBG samples the distribution of SMBG appeared to be very skewed towards hyperglycemia. This happened predominantly in T2DM subjects, who appeared to measure only at high BG. We have hypothesized that these samples contained no testing at low glucose ranges. Our investigation showed that about 1/3^rd of such samples would result in an overestimate of HbA_1c (2/3^rds would still result in accurate estimates). Based on that we recommend the meter to display no results, if a skewed sample is encountered, which in terms of computation is formulated as LBGI to be at least ½% of the HBGI. <ul id="ul0026" list-style="none" compact="compact"><li>if (RLO1/RHI1 lt 0.005) EXCLUDE=1.</li></ul></li><li>2b) <i><u>Testing during the night:</u></i> (NO6 &gt;=3%). This criterion ensures that at least some of nighttime glycemia is accounted for. This criterion requires that 3% of all the readings occur at night (between midnight and 7:00 am). <i><u>In other words</u>,</i> a sample will be acceptable if <i>at least 5 out of 150 readings,</i> taken over 2 months, are during the night. Note that patients are often advised to test at night, so this criterion promotes good management. <ul id="ul0027" list-style="none" compact="compact"><li>if (N06 le 3.0) EXCLUDE=1.</li></ul></li><li>2c) <i><u>Safeguard against highly abnormal testing patterns:</u></i> A sample will not result in an estimate if more than 3/4 of its readings occur in any one daily 6-hour interval. For example, if 80% of all tests in a sample occur right after breakfast, an estimate will not be produced. This criterion was requested by LifeScan, Inc. as a safeguard against people trying to "beat the algorithm", and it would allow us to thereby defend the validity, especially with clinicians. In our data there are <i>no samples</i> that are so highly abnormal to trigger this criterion (See the Appendix B - Criterion 2c for detailed information). In terms of software implementation, the following frequencies will need to be computed from SMBG data: <ul id="ul0028" list-style="none" compact="compact"><li>M12 - % SMBG readings from 6:00 am to noon (Breakfast)</li><li>M18 - % SMBG readings from Noon to 6:00 pm (Lunch)</li><li>M24 - % SMBG readings from 6:00 pm to 12:00 (Dinner)</li></ul><ul id="ul0029" list-style="none" compact="compact"><li>M06 - % SMBG readings from 12:00 to 6:00 am (Nighttime)</li><li>M15 - % SMBG readings from 9:00 am to 3:00 pm</li><li>M21 - % SMBG readings from 3:00 pm to 9:00 pm</li><li>M03 - % SMBG readings from 9:00 pm to 3:00 am</li></ul><ul id="ul0030" list-style="none" compact="compact"><li>M09 - % SMBG readings from 3:00 am to 9:00 am</li></ul> Then for any combination of (i,j) listed above: <ul id="ul0031" list-style="none" compact="compact"><li>if (Mij gt 75.0) EXCLUDE=1.</li></ul></li></ul></li></ul>

<i><u>APPENDIX B - SAMPLE SELECTION CRITERION 2C</u></i>

The criterion was suggested by LifeScan, Inc. as a Safeguard against highly abnormal testing patterns. The intent of this criterion is to prevent people from being able to "beat" the algorithm.

Basically, the criteria stipulate that <i>You will not get an estimate if more than 3</i>/<i>4 of your readings (or other desired number) occur in any one daily 6 hour interval or other desired interval).</i>

So, for example, if more than 3/4 of the tests occur after dinner, they will not get an estimate. This will give us more support to a general claim that people who do not test randomly will not be included in the calculation. I understand that the specific calculation and coding for this may seem complex, but the key here is that we may have to only put "You must test randomly throughout the day" or something similar as a broad claim to cover all of our exclusion criteria (except the test frequency). If we are required to, we can simply put a more exact definition in fine print such as "No daily 6 hour interval can have more than 75% of all the readings." This safeguard, along with our other criteria, may improve the clinical acceptance of the algorithm.

More detail:

The 4 six hour intervals defined as follows: <ul id="ul0032" list-style="none" compact="compact"><li>6:00 am to noon (Breakfast)</li><li>Noon to 6:00 pm (Lunch)</li><li>6:00 pm to 12:00 (Dinner)</li><li>12:00 to 6:00 am (Nighttime)</li></ul>

This criteria could be run twice with different time intervals in order to prevent people from concentrating testing around the cutpoints for the following six hour intervals, and thereby inappropriately still meeting this first criteria. For example if they had 40 % at 11:50 pm and 40% at 12:10 pm, they would still have clustered testing but get by on the first pass of intervals, but not on the second pass of intervals.

Second set of intervals:

<ul id="ul0033" list-style="none" compact="compact"><li>9:00 am to 3:00 pm</li><li>3:00 pm to 9:00 pm</li><li>9:00 pm to 3:00 am</li><li>3:00 am to 9:00 pm</li></ul>

Note that alternatively, from a coding standpoint, one could apply the following instead for the same result: <ul id="ul0034" list-style="none" compact="compact"><li>No 18-hour period would have less than 25% of the readings.</li></ul>

You would have to run this against every 18-hour period staged by 3 hours: <ul id="ul0035" list-style="none" compact="compact"><li>9:00 am to 3:00 am</li><li>12:00 noon to 6:00 am</li><li>3:00 pm to 9:00 am</li><li>6:00 pm to 12:00 noon</li><li>9:00 pm to 3:00 pm</li><li>12:00 midnight to 6:00 pm</li><li>3:00 am to 9:00 pm</li><li>6:00 am to 12:00 midnight</li></ul>

<i><u>APPENDIX C - INCREMENTAL EFFECT OF SAMPLE SELECTION CRITERIA ON ACCURACY OF ALGORITHM 1 IN TEST DATA SET 1</u></i>

As described in the development of the algorithm, the following tables refer to Algorithm 1 developed as a part of this study (Final Algorithm), and the accuracy of the simplest linear function that has been developed in Example No. 1 and included in the Example No. 1, (see First Linear Model). The tables present the accuracy of Algorithm 1 in Test Data Set 1 without sample exclusion and with sequential application of the two sample selection criteria: <ul id="ul0036" list-style="none" compact="compact"><li>Criterion 1 - Test Frequency, # readings NR≥150, and</li><li>Criterion 2 - Randomness of Data, as described under Sample Selection Criteria:</li></ul><tables id="tabl0033" num="0033"><table frame="all"><title><u><b>Table 17A:</b> Accuracy of Algorithm - all subjects:</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="24mm" /><colspec colnum="2" colname="col2" colwidth="25mm" /><colspec colnum="3" colname="col3" colwidth="21mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><colspec colnum="5" colname="col5" colwidth="26mm" /><colspec colnum="6" colname="col6" colwidth="21mm" /><colspec colnum="7" colname="col7" colwidth="26mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">86%</entry><entry align="center" valign="middle">91%</entry><entry align="center" valign="middle">95.1%</entry><entry align="center" valign="middle">83%</entry><entry align="center" valign="middle">85%</entry><entry align="center" valign="middle">89%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.56</entry><entry align="center" valign="middle">0.48</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.59</entry><entry align="center" valign="middle">0.54</entry><entry align="center" valign="middle">0.49</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">7.4%</entry><entry align="center" valign="middle">6.7%</entry><entry align="center" valign="middle">6.2%</entry><entry align="center" valign="middle">7.8%</entry><entry align="center" valign="middle">7.5%</entry><entry align="center" valign="middle">7.0%</entry></row><row><entry valign="middle"># of subjects with absolute error &gt; 1</entry><entry align="center" valign="middle">21</entry><entry align="center" valign="middle">10</entry><entry align="center" valign="middle">5</entry><entry align="center" valign="middle">25</entry><entry align="center" valign="middle">16</entry><entry align="center" valign="middle">11</entry></row></tbody></tgroup></table></tables><tables id="tabl0034" num="0034"><table frame="all"><title><u><b>Table 17B:</b> Accuracy of Algorithm 1 in T1DM:</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="24mm" /><colspec colnum="2" colname="col2" colwidth="25mm" /><colspec colnum="3" colname="col3" colwidth="21mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><colspec colnum="5" colname="col5" colwidth="26mm" /><colspec colnum="6" colname="col6" colwidth="21mm" /><colspec colnum="7" colname="col7" colwidth="26mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">90%</entry><entry align="center" valign="middle">95%</entry><entry align="center" valign="middle">97%</entry><entry align="center" valign="middle">90%</entry><entry align="center" valign="middle">93%</entry><entry align="center" valign="middle">95%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.40</entry><entry align="center" valign="middle">0.38</entry><entry align="center" valign="middle">0.49</entry><entry align="center" valign="middle">0.45</entry><entry align="center" valign="middle">0.43</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">6.1%</entry><entry align="center" valign="middle">5.6%</entry><entry align="center" valign="middle">5.4%</entry><entry align="center" valign="middle">6.9%</entry><entry align="center" valign="middle">6.7%</entry><entry align="center" valign="middle">6.4%</entry></row></tbody></tgroup></table></tables><tables id="tabl0035" num="0035"><table frame="all"><title><u><b>Table 17C:</b> Accuracy of Algorithm 1 in T2DM:</u></title><tgroup cols="7"><colspec colnum="1" colname="col1" colwidth="24mm" /><colspec colnum="2" colname="col2" colwidth="25mm" /><colspec colnum="3" colname="col3" colwidth="21mm" /><colspec colnum="4" colname="col4" colwidth="25mm" /><colspec colnum="5" colname="col5" colwidth="26mm" /><colspec colnum="6" colname="col6" colwidth="21mm" /><colspec colnum="7" colname="col7" colwidth="26mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b><u>Final Algorithm</u></b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b><u>First Linear Model</u></b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry><entry align="center" valign="middle"><b>No sample exclusion</b></entry><entry align="center" valign="middle"><b>Criterion 1</b></entry><entry align="center" valign="middle"><b>Criteria 1 and 2</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">81%</entry><entry align="center" valign="middle">86%</entry><entry align="center" valign="middle">93%</entry><entry align="center" valign="middle">76%</entry><entry align="center" valign="middle">76%</entry><entry align="center" valign="middle">81%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.68</entry><entry align="center" valign="middle">0.59</entry><entry align="center" valign="middle">0.54</entry><entry align="center" valign="middle">0.69</entry><entry align="center" valign="middle">0.64</entry><entry align="center" valign="middle">0.57</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">8.6%</entry><entry align="center" valign="middle">8.0%</entry><entry align="center" valign="middle">7.4%</entry><entry align="center" valign="middle">8.7%</entry><entry align="center" valign="middle">8.6%</entry><entry align="center" valign="middle">7.8%</entry></row></tbody></tgroup></table></tables>

<i><u>APPENDIX D - ALTERNATIVE TESTING FREQUENCY CRITERION</u></i>

A superior Testing Frequency criterion may contribute more significantly to the accuracy of Algorithm 1. This is because reasons for employing the Testing Frequency Criterion 1 were based not solely on data analysis, but on other considerations. If Criterion 1 requiring 150 readings in 2 months is found too restrictive, an alternative solution maybe used. This is the original Testing Frequency criterion, which required 35 days (out of 60) with SMBG readings with an average frequency of 1.8 readings/day, e.g. a total of 63 readings taken over 35 out of 60 days. <b>Table 18</b> demonstrates that with this original relaxed testing frequency criterion, plus Criterion 2 (randomness of data), the accuracy of Algorithm 1 exceeds 95%: <tables id="tabl0036" num="0036"><table frame="all"><title><u><b>Table 18:</b> Accuracy of Algorithm 1 using alternative Testing Frequency Criterion (35 of reading/1.8 readings/day) and the Randomness of</u><u>Data Criterion:</u></title><tgroup cols="8"><colspec colnum="1" colname="col1" colwidth="20mm" /><colspec colnum="2" colname="col2" colwidth="21mm" /><colspec colnum="3" colname="col3" colwidth="21mm" /><colspec colnum="4" colname="col4" colwidth="21mm" /><colspec colnum="5" colname="col5" colwidth="21mm" /><colspec colnum="6" colname="col6" colwidth="21mm" /><colspec colnum="7" colname="col7" colwidth="21mm" /><colspec colnum="8" colname="col8" colwidth="23mm" /><thead><row><entry valign="middle" /><entry namest="col2" nameend="col4" align="center" valign="middle"><b>Training Data Set</b></entry><entry namest="col5" nameend="col7" align="center" valign="middle"><b>Test Data Set 1</b></entry><entry morerows="1" align="center" valign="middle"><b>Test Data Set 2</b></entry></row><row><entry valign="middle" /><entry align="center" valign="middle"><b>All Ss</b></entry><entry align="center" valign="middle"><b>T1DM</b></entry><entry align="center" valign="middle"><b>T2DM</b></entry><entry align="center" valign="middle"><b>All Ss</b></entry><entry align="center" valign="middle"><b>T1DM</b></entry><entry align="center" valign="middle"><b>T2DM</b></entry></row></thead><tbody><row><entry valign="middle">NGSP criterion - % within ±1 HbA_1c unit</entry><entry align="center" valign="middle">95%</entry><entry align="center" valign="middle">96%</entry><entry align="center" valign="middle">94%</entry><entry align="center" valign="middle">95%</entry><entry align="center" valign="middle">97%</entry><entry align="center" valign="middle">92%</entry><entry align="center" valign="middle">100%</entry></row><row><entry valign="middle">Average absolute error (units HbA_1c)</entry><entry align="center" valign="middle">0.48</entry><entry align="center" valign="middle">0.44</entry><entry align="center" valign="middle">0.55</entry><entry align="center" valign="middle">0.46</entry><entry align="center" valign="middle">0.39</entry><entry align="center" valign="middle">0.55</entry><entry align="center" valign="middle">0.40</entry></row><row><entry valign="middle">Average percent error</entry><entry align="center" valign="middle">6.8%</entry><entry align="center" valign="middle">6.3%</entry><entry align="center" valign="middle">7.6%</entry><entry align="center" valign="middle">6.3%</entry><entry align="center" valign="middle">5.5%</entry><entry align="center" valign="middle">7.2%</entry><entry align="center" valign="middle">5.5%</entry></row></tbody></tgroup></table></tables><b><u>Important Note:</u></b> In addition, this alternative criterion screens out samples, which have big chunk of missing data, e.g. if SMBG was discontinued for 4 weeks and then the person comes back, HbA_1c estimate should not be displayed. A clear example of such a pattern occurred in Test Data Set 2 - the subject who had the largest error in his/her HbA_1c estimate had collected 159 readings over only 30 out of 60 days. Thus, it is possible for a subject to meet the requirement of 150 readings with readings collected quickly over a few days, which may result in inaccurate HbA_1c estimation.

<i><u>EXEMPLARY DEFINITIONS FOR EXAMPLE NO. 2 (BUT NOT LIMITED THERETO)</u></i>

<ol id="ol0018" ol-style=""><li>1) Severe hypoglycemia (SH) is identified as low blood glucose (BG) resulting in stupor, seizure, or unconsciousness that precludes self-treatment;</li><li>2) Moderate hypoglycemia (MH) is identified as severe neuroglycopenia disrupting subject's activity, but not precluding self-treatment;</li><li>3) Biochemical severe hypoglycemia (BSH) is defined as plasma BG reading &lt;= 39 mg/dl;</li><li>4) Biochemical moderate hypoglycemia (BMH) is defines as plasma BG reading between 39 and 55 mg/dl.</li><li>5) All of the above will be referred to as <i><u>significant hypoglycemia.</u></i></li></ol>

ADDITIONAL OBJECTIVES

The data from this Example were used to validate prospectively the following algorithms: <ul id="ul0037" list-style="none"><li><b>Algorithm 2 -</b> a classification algorithm using 30-45 days of SMBG data for a subject, to classify this subject in a certain risk category for future significant hypoglycemia. The classification is temporary, e.g. when a subjects' SMBG pattern changes, the classification changes as well;</li><li><b>Algorithm 3 -</b> a data tracking/decision-making algorithm that uses a sequence of SMBG data to make a decision whether to raise a flag for upcoming (within 24 hours) significant hypoglycemia. We now describe in detail Algorithms 1&amp;2 and the results of their testing</li></ul>

<i><u>SUBJECTS</u></i>

We have consented 100 subjects with Type 1 Diabetes (T1DM) and 100 subjects with Type 2 Diabetes (T2DM). One hundred seventy-nine subjects, 90 with T1DM and 89 with T2DM, completed significant portions of the SMBG data collection.

<i><u>PROCEDURE</u></i>

All subjects signed an IRB-approved consent forms and attended orientation meetings where they were introduced to the ONE TOUCH ULTRA meter and completed screening questionnaires. Immediately after the introductory meeting all subjects visited a UVA laboratory and had blood drawn for baseline HbA_1c. T1DM subjects were followed for 6 months with laboratory HbA_1c assays at months 3 and 6; T2DM subjects were followed for 4 months with laboratory HbA_1c assays at months 2 and 4. Self-monitoring (SMBG) data were regularly downloaded from the meters and stored in databases. Parallel recording of significant hypoglycemic and hyperglycemic episodes was done by a custom-designed automated e-mail/telephone tracking system contacting all participants in two-week intervals. <b>Table 19</b> present summaries of the SMBG and Severe Hypoglycemia Moderate Hypoglycemia [SH/MH] data collection. <tables id="tabl0037" num="0037"><table frame="all"><title><b><u>Table 19:</u></b><u>Data collection summary</u></title><tgroup cols="3"><colspec colnum="1" colname="col1" colwidth="30mm" /><colspec colnum="2" colname="col2" colwidth="37mm" /><colspec colnum="3" colname="col3" colwidth="37mm" /><thead><row><entry><i>Variable</i></entry><entry align="center" valign="middle"><i><b>T1DM</b> (N=90 subjects)</i></entry><entry align="center" valign="middle"><b>T2DM</b> (N=89 subjects)</entry></row></thead><tbody><row><entry valign="middle"># SH episodes</entry><entry align="center" valign="middle">88</entry><entry align="center" valign="middle">24</entry></row><row><entry valign="middle"># MH episodes</entry><entry align="center" valign="middle">1,660</entry><entry align="center" valign="middle">190</entry></row><row><entry valign="middle"># SMBG readings</entry><entry align="center" valign="middle">92,737</entry><entry align="center" valign="middle">35,306</entry></row><row><entry valign="middle"># BSH episodes</entry><entry align="center" valign="middle">1,039</entry><entry align="center" valign="middle">39</entry></row><row><entry valign="middle"># BMH episodes</entry><entry align="center" valign="middle">5,179</entry><entry align="center" valign="middle">283</entry></row></tbody></tgroup></table></tables>

No significant changes were made to the formulas of Algorithms 2 and 3. These formulas remain practically identical to the formulas presented in the report from Example No. 1 of March 2002. The only two changes include: (a) a correction of a typo in the list of risk categories for SH/MH (Example No. 1) and (b) change in one line of Algorithm 3 (Example No. 1). The reason for the latter is explained below.

Since Algorithms 1 and 2 remain unchanged, we can consider the entire Example No. 2 data collection as a prospective testing of these algorithms.

<i><u>FORMULAS for ALGORITHM 2</u></i>

Algorithm 2 proceeds as follows: <ol id="ol0019" compact="compact" ol-style=""><li>1) Based on one month of SMBG data, each subject is classified into one of 15 risk categories (RCAT) depending on his/her Low BG Index (LBGI) as follows: <ul id="ul0038" list-style="none" compact="compact"><li>if (LBGI le 0.25) RCAT=0.</li><li>if (LBGI gt 0.25 and LBGI le 0.50) RCAT=1.</li><li>if (LBGI gt 0.50 and LBGI le 0.75) RCAT=2.</li><li>if (LBGI gt 0.75 and LBGI le 1.00) RCAT=3.</li><li>if (LBGI gt 1.00 and LBGI le 1.25) RCAT=4.</li><li>if (LBGI gt 1.25 and LBGI le 1.50) RCAT=5.</li><li>if (LBGI gt 1.50 and LBGI le 1.75) RCAT=6.</li><li>if (LBGI gt 1.75 and LBGI le 2.00) RCAT=7.</li><li>if (LBGI gt 2.00 and LBGI le 2.50) RCAT=8.</li><li>if (LBGI gt 2.50 and LBGI le 3.00) RCAT=9.</li><li>if (LBGI gt 3.00 and LBGI le 3.50) RCAT=10.</li><li>if (LBGI gt 3.50 and LBGI le 4.25) RCAT=11.</li><li>if (LBGI gt 4.25 and LBGI le 5.00) RCAT=12.</li><li>if (LBGI gt 5.00 and LBGI le 6.50) RCAT=13.</li><li>if (LBGI gt 6.50) RCAT=14.</li></ul></li><li>2) The theoretical probability for future significant hypoglycemia are computed through a two-parameter Weibull probability distribution, with a distribution function given by the formula: <ul id="ul0039" list-style="none" compact="compact"><li><i>F(x) = 1 - exp(-a.x^b)</i> for any <i>x</i>&gt;<i>0</i> and 0 otherwise. The parameters of this distribution depend on the desired duration of the prediction and are described in the report from Example No. 1. If implemented in a meter, this step would provide a continuous-type estimation of the risk for significant hypoglycemia, e.g. "50% within the next month."</li></ul></li><li>3) Each subject is classified at minimal, low, moderate, or high risk for future significant hypoglycemia: These ranges are defined as follows: Minimal risk (LBGI≤1.25); Low risk (1.25&lt;LBGI≤2.5); Moderate risk (2.5&lt;LBGI≤5), and High risk (LBGI&gt;5). If implemented in a meter, this step would provide a discrete-type estimation of the risk for significant hypoglycemia, e.g. "high risk within the next month."</li></ol>

<i><u>FORMULASfor ALGORITHM 3</u></i>

First, in order to avoid the computing of baseline risk values presented in the Example No. 1 Report description of Algorithm 3, we have modified one line in the code. Now Algorithm 3 uses the results from Algorithm 2 instead. This change was introduced for the presentation of sample results for two subjects on October 28, 2002. At this time it appeared that it was more convenient to have a simple Excel spreadsheet to demonstrate the action of Algorithm 3, which was possible if the computation of baseline values was avoided. This step did not change the accuracy of Algorithm 3 and therefore was left as a permanent change facilitating the programming of Algorithm 3. No other changes were introduced to Algorithm 3 after October 28, 2002. Here we present the formulas of Algorithm 3 as given in the report from Example No. 1, with the changed line marked. 1) Computing of a Low BG Risk value (RLO) for each BG reading that is done by the following code (here BG is measured in mg/dl, if the units are mmol/l the coefficients are different): <pre listing-type="program-listing"> scale=(ln(bg))**1.08405 - 5.381 risk=22.765*scale*scale 5.381 if (bg_1 le 112.5) then RLO=risk else RLO=0 endif</pre> 2) For each SMBG reading we compute a running value of the LBGI(n), and another statistics, SBGI(n) that is the standard deviation of the low BG risk values. These two parameters were computed with a certain lag (n) backwards from each SMBG reading, e.g. included that reading and (n-1) readings taken prior to that reading. 3) The computation of LBGI(n) and SBGI(n) used a provisional means procedure that is based on the following recursive code: Initial values at <i>n</i> (or at the max(1,n-k) to be exact in order to account for meter readings with a sequential number less than <i>k</i>): <maths id="math0045" num=""><math display="block"><mi>LBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>=</mo><mi>rlo</mi><mfenced><mi mathvariant="normal">n</mi></mfenced></math><img file="EP1534121B1_D0047.tif" /></maths><maths id="math0046" num=""><math display="block"><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>=</mo><mn mathvariant="normal">0</mn></math><img file="EP1534121B1_D0048.tif" /></maths> Values for any consecutive iteration <i>j</i> between <i>n</i> and <i>1</i>, counted backwards: <maths id="math0047" num=""><math display="block"><mi>LBGI</mi><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>=</mo><mfenced separators=""><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>LBGI</mi><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>+</mo><mfenced separators=""><mn mathvariant="normal">1</mn><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>RLO</mi><mfenced><mi mathvariant="normal">j</mi></mfenced></math><img file="EP1534121B1_D0049.tif" /></maths><maths id="math0048" num=""><math display="block"><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>=</mo><mfenced separators=""><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mo>⁢</mo><mfenced separators=""><mi mathvariant="normal">j</mi><mo>-</mo><mn mathvariant="normal">1</mn></mfenced><mo>+</mo><mfenced separators=""><mn mathvariant="normal">1</mn><mo>/</mo><mi mathvariant="normal">j</mi></mfenced><mo>*</mo><mfenced separators=""><mi>RLO</mi><mfenced><mi mathvariant="normal">j</mi></mfenced><mo>-</mo><mi>LBGI</mi><mfenced><mi mathvariant="normal">j</mi></mfenced></mfenced><mo>*</mo><mo>*</mo><mn mathvariant="normal">2</mn></math><img file="EP1534121B1_D0050.tif" /></maths> After this cycle is completed we have the value of LBGI(n) and we compute <maths id="math0049" num=""><math display="block"><mi>SBGI</mi><mfenced><mi mathvariant="normal">n</mi></mfenced><mo>=</mo><mi>sqrt</mi><mfenced separators=""><mi>rlo</mi><mo>⁢</mo><mn mathvariant="normal">2</mn><mfenced><mi mathvariant="normal">n</mi></mfenced></mfenced></math><img file="EP1534121B1_D0051.tif" /></maths> From this computation we save two sets of values: for <i>n=150</i> and for <i>n=50</i> (e.g. for the last 150 and the last 50 observations). 4) <u>Decision-Making Rule</u>: At each SMBG reading the procedure decides whether to raise a flag warning of upcoming SH. If the flag is raised, the procedure decides whether or not to lower the flag. These decisions depend on three threshold parameters, α, β, γ that work as follows:

For subject at low-to-moderate risk (LM group): <ul id="ul0040" list-style="none" compact="compact"><li>FLAG=0.</li><li>if (LBGI(150) ge 2.5 and LBGI(50) ge (1.5*LBGI(150) and SBGI(50) ge SBGI(150)) FLAG=1.</li><li>if (RLO ge (LBGI(150)+1.5*SBGI(150)) FLAG=1.</li></ul>

In other words, at each SMBG reading the flag could be raised if one of two conditions is met: <ol id="ol0020" ol-style=""><li>1) The subject to be at a moderate of high risk for SH based on Algorithm 2 classification from the last 150 trials and the LBGI and SD of LBGI to increase over the last 50 trials;</li><li>2) Or, to have a surge in the Low BG Index as determined by the second inequality.</li></ol>

The heuristic explanation of these statements was presented in the report from Example No. 1. As described above the first "if" statement has been changed from its original form to avoid the use of baseline LBGI and to utilize the output from Algorithm 2.

As described in the report from Example No. 1, once the flag is raised it remains raised for 24 hours. In order to evaluate the accuracy of Algorithm 3 we use the technique proposed before - we compute two measures: <ol id="ol0021" ol-style=""><li>1) The % predicted upcoming SH/MH episodes within 24 hours, and</li><li>2) The ratio <b>R_ud</b> of duration periods of "flag up" to "flag down" (annoyance index). While the % predicted episodes of SH needs to be high, the ratio <b>R_ud</b> needs to be low. This is because by increasing the percentage of predicted SH episodes, we unavoidably increases the number of "raised flags," which in turn increases the number of potential "false alarms." Since a "false alarm" is not clearly defined (see report from Example No. 1), we will use <b>R_ud</b> as an indicator of the utility of Algorithm 3.</li></ol>

Our previous best result presented in the report from Example No. 1 was a prediction of 50% of SH/MH episodes within 24 hours, and <b>R_ud</b>=1:10, e.g. one day of high-risk alert was alternating with 10 days of no alert. Here we will keep the same flag up/down ratio and will compute the % predicted within 24 hours SH and MH episodes separately for T1DM and T2DM subjects. For this prediction we will not use BSH and BMH episodes since these were recorded by the meter and therefore are a part of the prediction function.

<i><u>EVALUATION OF RISK FOR SIGNIFICANT HYPOGLYCEMIA WITHIN 1-3 MONTHS: ACCURACY OF ALGORITHM 2</u></i>

We have evaluated the predictive power of Algorithm 2 as follows: <ol id="ol0022" ol-style=""><li>1) First, we have computed the LBGI from one month of SMBG data and classified each subject at Minimal, Low, Moderate, and High risk for significant hypoglycemia as described above.</li><li>2) Then, during the following 1-3 months we counted for each subject the number of prospectively recorded SH, BSH, MH, and BMH episodes.</li></ol>

The <figref idref="f0016 f0017 f0018 f0019"><b>FIGS.</b> 16-19</figref> below present the number of SH, BSH, MH, and BMH episodes per subject observed prospectively for 1 month, or 3 months, following a month of SMBG, separately for T1DM and T2DM. Statistical comparisons are included as well.

In addition, a <i>direct linear regression</i> using the LBGI, history of SH as reported in the screening questionnaires in terms of number of episodes in the past year, and baseline HBA_1c, predicted significantly (R²=0.62, F=48, p&lt;0.0001) the total number of upcoming in the next 3 months significant hypoglycemic episodes (SH+MH+BSH+BMH). The predictive variables, in order of their significance were: 1) LBGI (t=8.2, p&lt;0.0001) accounting alone for 55% of the variance of future significant hypoglycemia (e.g. R²=0.55); 2) History of SH (t=3.6, p=0.0005) accounting for additional 5% variance, and HbA1c (t=2.2, p=0.03) accounting for additional 2% variance. This confirms previous results that the LBGI is a most significant predictor of future hypoglycemia, while the contribution of HbA_1c to that prediction is modest.

The <i>theoretical probabilities</i> for future significant hypoglycemia computed by the Weibull model had an excellent agreement with the prospectively observed significant hypoglycemic episodes - for both severe and moderate episodes the coefficients of determination were above 90%.

<i><u>PREDICTION OF UPCOMING (WITHIN 24 HOURS) SIGNIFICANT HYPOGLYCEMIA: ACCURACY OF ALGORITHM 3</u></i>

The tables below present the accuracy of the short-term prediction (within 24 hours) of SH and MH episodes separately for T1DM and T2DM subjects. Each line of Tables 20 and 21 presents the percent predicted episodes, if a certain number of SMBG readings were available in the 24-hour period used for the prediction. For example, the first line in each table presents the % predicted episodes regardless of whether there were any SMBG readings in the 24 hours preceding an episode. It is seen that the accuracy of the prediction increases with the number of readings preceding an episode. <i>Thus, if a person measures 3 or more times a day, the meter could warn about, and potentially help avoid, more than half of significant hypoglycemic episodes.</i>

<b><u>Important Note:</u></b> For the purposes of accuracy assessment of Algorithm 3 we use only SH and MH episodes recorded by the independent from SMBG e-mail/telephone system, which required each participant to report SH and MH by date and time every two weeks. As our interviews showed, sometimes the participants used for their reports the time and date of the last SMBG reading preceding an episode, instead of the actual time/date of that episode, because looking at the meter was helping their recollection. As a result, there were a number of episodes for which the time elapsed from the closest preceding SMBG reading to the time of the episode, was close to zero. In order to account for such suspicious time recording Column 3 in each table presents the accuracy of Algorithm 3 restricted only to episodes for which the lead warning time was <i>at least 15 minutes.</i> Given that the average lead warning time was 11 hours, we conclude that in most cases, the warning would come early enough to prompt adequate self-treatment.

In <b>Tables 20 and 21</b> the Annoyance Index is set to <b>R_ud</b> &gt;=10 to match the report from Example No. 1. <tables id="tabl0038" num="0038"><table frame="all"><title><u><b>Table 20:</b> Accuracy of Algorithm 3 in T1DM.</u></title><tgroup cols="5"><colspec colnum="1" colname="col1" colwidth="36mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="38mm" /><colspec colnum="4" colname="col4" colwidth="39mm" /><colspec colnum="5" colname="col5" colwidth="39mm" /><thead><row><entry namest="col1" nameend="col2" align="left" valign="top"><b>R_ud =10.2</b></entry><entry align="center" valign="middle">% Predicted <b>SH+MH</b> Episodes</entry><entry align="center" valign="middle">% Predicted <b>SH</b> Episodes</entry><entry align="center" valign="middle">% Predicted <b>SH+MH</b> Episodes with warning time &gt; 15 minutes</entry></row></thead><tbody><row><entry namest="col1" nameend="col2" align="left" valign="middle">No restrictions</entry><entry align="center" valign="middle">53%</entry><entry align="center" valign="middle">48%</entry><entry align="center" valign="middle">49%</entry></row><row><entry morerows="2" valign="middle">Minimum number of SMBG readings in the 24 hours preceding the episode.</entry><entry align="center" valign="middle"><b>3</b></entry><entry align="center" valign="middle">55%</entry><entry align="center" valign="middle">58%</entry><entry align="center" valign="middle">52%</entry></row><row><entry align="center" valign="middle"><b>4</b></entry><entry align="center" valign="middle">59%</entry><entry align="center" valign="middle">60%</entry><entry align="center" valign="middle">55%</entry></row><row><entry align="center" valign="middle"><b>5</b></entry><entry align="center" valign="middle">63%</entry><entry align="center" valign="middle">60%</entry><entry align="center" valign="middle">59%</entry></row></tbody></tgroup></table></tables><tables id="tabl0039" num="0039"><table frame="all"><title><u><b>Table 21:</b> Accuracy of Algorithm 3 in T2DM.</u></title><tgroup cols="5"><colspec colnum="1" colname="col1" colwidth="36mm" /><colspec colnum="2" colname="col2" colwidth="14mm" /><colspec colnum="3" colname="col3" colwidth="38mm" /><colspec colnum="4" colname="col4" colwidth="39mm" /><colspec colnum="5" colname="col5" colwidth="39mm" /><thead><row><entry namest="col1" nameend="col2" align="left" valign="top"><b>R_ud=10.0</b></entry><entry align="center" valign="middle">% Predicted <b>SH+MH</b> Episodes</entry><entry align="center" valign="middle">% Predicted <b>SH</b> Episodes</entry><entry align="center" valign="middle">% Predicted <b>SH+MH</b> Episodes with warning time &gt; 15 minutes</entry></row></thead><tbody><row><entry namest="col1" nameend="col2" align="left" valign="middle">No restrictions</entry><entry align="center" valign="middle">52%</entry><entry align="center" valign="middle">38%</entry><entry align="center" valign="middle">48%</entry></row><row><entry morerows="2" valign="middle">Minimum number of SMBG readings in the 24 hours preceding the episode.</entry><entry align="center" valign="middle"><b>3</b></entry><entry align="center" valign="middle">57%</entry><entry align="center" valign="middle">60%</entry><entry align="center" valign="middle">53%</entry></row><row><entry align="center" valign="middle"><b>4</b></entry><entry align="center" valign="middle">64%</entry><entry align="center" valign="middle">64%</entry><entry align="center" valign="middle">59%</entry></row><row><entry align="center" valign="middle"><b>5</b></entry><entry align="center" valign="middle">73%</entry><entry align="center" valign="middle">73%</entry><entry align="center" valign="middle">68%</entry></row></tbody></tgroup></table></tables>

The invention may be embodied in other specific forms without departing from essential characteristics thereof. The foregoing embodiments are therefore to be considered in all respects illustrative rather than limiting of the invention described herein. Scope of the invention is thus indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.