Clinical UM Guideline

This document addresses the use of practitioner-prescribed software applications for health management purposes when used on a mobile device (e.g., mobile phone, laptop, smartwatch, or tablet) with the intent to evaluate, diagnose or treat an illness, injury, disease or its symptoms. This document does not address mobile-based software applications (MSAs) that are used in the function or control of another FDA-cleared or approved stand-alone hardware medical device. This document also does not address MSAs accessible to the general public for download (including direct-to-consumer [DTC] or “over the counter” applications), applications that promote general wellness, or applications operated by a healthcare practitioner in a clinical setting for remote health monitoring.

Note: Some benefit plans may exclude coverage of consumer wearable or personal mobile devices (such as a smart phone, smart watch, or other personal tracking devices), including any software or applications. DTC applications are generally excluded from benefit plan coverage.

Note: Please see the following related document for additional information:

• MED.00145 Digital Therapy Devices for Treatment of Amblyopia

Medically Necessary:

Mobile-based health management applications are considered medically necessary when all of the following criteria in I and II have been met:

1. Criteria to evaluate the mobile software application (MSA):
   1. The MSA has been approved or cleared by the Food and Drug Administration (FDA); and
   2. There is credible scientific evidence which permits reasonable conclusions regarding the impact of the MSA on health outcomes; and
   3. The MSA has been proven materially to improve the net health outcome or be as beneficial as any established alternative;
      AND
2. Criteria to evaluate the appropriateness of the MSA for the individual:
   1. The MSA has been prescribed by a healthcare practitioner; and
   2. There is documentation supporting that the MSA was ordered for a covered purpose such as preventing, evaluating, diagnosing or treating an illness, injury, disease or its symptoms, and in accordance with generally accepted standards of medical practice;* and
   3. The requested MSA is not primarily for the convenience of the individual, prescribing clinician, caregiver, or other healthcare provider.

*Generally accepted standards of medical practice means standards that are based on credible scientific evidence published in peer-reviewed medical literature generally recognized by the relevant medical community, physician specialty society recommendations and the views of physicians practicing in relevant clinical areas, and any other relevant factors.

Not Medically Necessary:

Mobile-based health management applications are considered not medically necessary when the criteria above have not been met.

The following codes for treatments and procedures applicable to this guideline are included below for informational purposes. Inclusion or exclusion of a procedure, diagnosis or device code(s) does not constitute or imply member coverage or provider reimbursement policy. Please refer to the member's contract benefits in effect at the time of service to determine coverage or non-coverage of these services as it applies to an individual member.

When services may be Medically Necessary when criteria are met:

When services are Not Medically Necessary:
For the procedure codes listed above when criteria are not met.

When services are also Not Medically Necessary:

Estimates report over 85% of adults living in the United States (US) own a smartphone (Pew Research Center, 2021). “Health-related mobile applications available to consumers on top app stores worldwide now surpass 350,000, with more than 90,000 digital health apps added in 2020 — an average of more than 250 apps per day.” (Institute for Human Data Science [IQVIA], 2021). Examples of medical mobile device software applications (MSAs) currently available include applications that purport to perform cognitive behavior therapy, augment weight loss goals, identify a suspicious nevi (mole), or even distinguish between normal cardiac sinus rhythm and potentially dangerous arrhythmias. Transforming a personal mobile device, such as a smartphone, into a medical device has the potential for far-reaching implications on the diagnosis and management of many diseases and disorders in addition to promoting general health and wellness. Despite the enormous effort to develop and disseminate digital health innovations, evidence of efficacy, or even a widely accepted framework for evaluation of efficacy, currently remains lacking. According to IQVIA (2021),

…independent organizations continue to highlight the need for larger and more robust randomized controlled trials (RCTs) that follow patients for longer times and report between-group differences in benefit, assessments of usability, and user-retention to determine the durability of their clinical effect, and evidence of cost-effectiveness that can be analyzed versus standard of care.

The US Food and Drug Administration (FDA) Center for Devices and Radiologic Health (CDRH), is among one of several groups leading development of a framework for evaluating the burgeoning number of MSAs anticipated to reach market as part of the expanding digital health innovation arena. The framework is detailed in their guideline entitled, “Policy for device software functions and mobile medical applications” (FDA, 2019).

A number of additional MSAs are in the developmental pipeline for FDA approval or clearance, including those developed by Click Therapeutics, Inc., a company developing and seeking FDA approval for several digital software solutions to aid in the management of diverse conditions including but not limited to insomnia, acute coronary syndrome, migraine and overactive bladder.

The FDA’s regulatory oversight of software functions includes the following subsets:

1. Software functions that are an extension of one or more medical devices by connecting to such device(s) for purposes of controlling the device(s) or analyzing medical device data.
   Examples of software functions that control medical devices include: software that provides the ability to control inflation and deflation of a blood pressure cuff through a mobile platform and mobile apps that control the delivery of insulin on an insulin pump by transmitting control signals to the pumps from the mobile platform.

Device software functions of these types are considered accessories to the connected device and not addressed by this document.

2. Software functions (typically, mobile apps) that transform the mobile platform into a regulated medical device by using attachments, display screens, or sensors or by including functionalities similar to those of currently regulated medical devices.
   Examples of these types of software functions include: a software function that uses a mobile platform for medical device functions, such as attachment of a blood glucose strip reader to a mobile platform to function as a glucose meter; or attachment of electrocardiograph (ECG) electrodes to a mobile platform to measure, store, and display ECG signals; a software function that uses the built-in accelerometer on a mobile platform to collect motion information for monitoring sleep apnea; a software function that uses sensors (internal or external) on a mobile platform for creating electronic stethoscope function is considered to transform the mobile platform into an electronic stethoscope.

Mobile software functions of this type are addressed by this document when the ancillary hardware device is intended to function solely in conjunction with the mobile device application.

3. Software functions that become a regulated medical device by performing patient-specific analysis and providing patient-specific diagnosis, or treatment recommendations. These types of functions are similar to or perform the same function as those types of software devices that have been previously cleared or approved.
   Examples of software functions that perform sophisticated analysis or interpret data (electronically collected or manually entered) from another medical device include: software functions that use patient-specific parameters and calculate dosage or create a dosage plan for radiation therapy; Computer Aided Detection software (CAD) image processing software; and radiation therapy treatment planning software.

These types of software are addressed by this document when they operate on a mobile device, have received FDA clearance or approval, are clinician-prescribed, and when the intent of the MSA is to evaluate, diagnose or treat an illness, injury, disease or its symptoms.

In January 2019, the FDA released its publication, “Developing a Software Precertification Program.” In it, an innovative plan is described, to reimagine the way the government administers oversight and approval in the digital device arena that is more efficient than the traditional device approval pathway. The FDA is basing the Pre-Cert pilot program's criteria on five principles of excellence: safety, quality, clinical responsibility, cybersecurity responsibility, and proactive culture. The paradigm shift in the FDA approval process for digital innovation lies in the focus on the manufacturer rather than on the device itself, when a product meets the definition of software as a medical device. The current Pre-Cert pilot program, has enrolled nine companies, out of over 100 applicants, to test the novel approval pathway (Apple, Fitbit, Johnson & Johnson, Pear Therapeutics, Phosphorus, Roche, Samsung, Tidepool and Verily). The FDA is currently considering two levels of precertification based on how a company meets the excellence principles and whether it has demonstrated a track record in delivering safe and effective software products. The FDA completed a Pilot Pre-Cert program, intended to determine whether the results align with the results of the traditional approval pathway and satisfy the FDA's established regulatory requirements for safety and effectiveness. As a result of challenges faced during the pilot, the FDA determined the approach explored was not practical to implement under current statutory and regulatory authorities and concluded, “the modern medical device landscape could benefit from a new regulatory paradigm, which would require a legislative change” (FDA, 2022).

In addition to the FDA’s innovative program underway to evaluate the safety and effectiveness of digital health applications, a number of other organizations, both global and national, have also initiated tandem efforts to develop a framework for evaluation of products in this burgeoning field (Agency for Healthcare Research and Quality, 2022; American Medical Association, 2018; American Psychiatric Association, 2019; World Health Organization, 2019). At this time, no single framework has been adopted for evaluation of medical mobile applications by medical or regulatory bodies and a recent study asserts “the need for a more rigorous and inclusive approach to clinical research supporting FDA-authorized prescription digital therapeutics” (Kumar, 2023).

Some MSAs, particularly those that operate with an ancillary hardware medical device, may be intended to replace a service rendered in the healthcare setting. Use of MSAs should not be substantiated primarily for the convenience of the individual, prescribing clinician, caregiver, or other healthcare provider; for example, in cases where appropriate alternatives for the indicated health service(s) are geographically accessible, and/or when the individual has concurrent ambulatory or hospital care needs. However, use of MSAs may be appropriate when they are in accordance with generally accepted standards of medical practice, the MSA has been proven materially to be as beneficial as the established alternative, and credible scientific evidence permits reasonable conclusions regarding the impact of the MSA on health outcomes.

Practitioner-prescribed, FDA cleared or approved, MSAs (not an all-inclusive list)

AspyreRx^™, Better Therapeutics, Inc

AspyreRx is a prescription-only digital therapeutic device intended to provide cognitive behavioral therapy to individuals 18 years or older with type 2 diabetes. The device targets behavior to aid in the management of type 2 diabetes in individuals who are under the care of a healthcare provider. The application provides cognitive behavioral therapy intended as a treatment for adjunctive use with standard of care.

AspyreRx was evaluated in an RCT which enrolled 669 adults with type 2 diabetes and an HbA1c of 7 to < 11% (Hsia, 2022). Study participants were randomly assigned to receive access to AspyreRx (n=326) or a control application (n=343), both were adjunct to standard of care. After 90 days of access to AspyreRx, change in HbA1c was -0.28% (95% confidence interval [CI], -0.41 to -0.15) in the intervention group and +0.11% (95% CI, -0.02 to 0.23) in the control group (treatment group difference 0.39%; p<0.0001). Though statistically significant, the minimal clinically important difference (MCID) in HbA1c established in the peer-reviewed literature is 0.5%, this study did not attain that difference (Santos, 2023). Hypoglycemia was reported by 2 subjects in the AspyreRx group and none in the control group. No adverse events in either group were attributed to AspyreRx use. Further study is warranted.

BlueStar^®Rx, WellDoc^®

BlueStar is a digital health platform for type 2 diabetes that provides tailored guidance driven by artificial intelligence and is focused on six critical dimensions of chronic disease care, which apply to diabetes as well as many other conditions like high blood pressure, pre-diabetes, and heart failure.

BlueStar was evaluated in a randomized controlled trial (RCT) which enrolled 163 individuals with type 2 diabetes whose HbA1c levels were poorly controlled or abnormal at the time of enrollment. Enrolled primary care practices (PCP) were randomized to one of four study groups: control-usual care (n=56), coach-only (n=23), coach PCP portal (n=22), and coach PCP portal with decision support (n=62). Participants who were randomized to use an MSA to help manage their diabetes in addition to usual care, improved HbA1c by an average 1.9%, compared with a 0.7% improvement in those randomized to usual care alone, a difference of 1.2% (p<0.001) over the 12-month study period (Quinn, 2011). The study’s limitations include a small sample size in the study arms and an acknowledged randomization failure (“[coach portal with decision support] patients had higher baseline glycated hemoglobin than [usual care] (9.9 vs. 9.2%, p=0.04”) that may have inflated the observed effect size.

Agarwal and colleagues (2020) conducted a multicenter, pragmatic RCT to determine if BlueStar application usage leads to improved HbA1c levels among diverse participants across diverse clinical scenarios. In total, 223 study participants were randomized to either the ‘immediate treatment group’ (ITG; n=110 [received the BlueStar intervention for 6 months]) or the wait-list control group (WLC; n=113 [received usual care for the first 3 months and then received the intervention for 3 months]). The primary outcome was HbA1c levels at 3-month follow-up. Secondary outcomes assessed disease self-management, experience of care, and self-reported health utilization. At 3 months, the mean difference in HbA1c levels between the ITG and WLC groups was not statistically significant (mean difference = -0.42; 95% CI, -1.05 to 0.21; p=0.19). Similarly, there was no effect on secondary outcomes and BlueStar usage was found to vary significantly across clinical sites (median of 9 versus 36 log-ins over 14 weeks at the lowest, versus highest usage sites, respectively). Evidence of BlueStar’s clinical efficacy remains to be established in addition to defining factors that may affect individual and site-specific variations that impact the application’s usage as recommended. 

Canvas Dx^™, Cognoa, Inc

Canvas Dx is used by healthcare providers as an aid in the diagnosis of Autism Spectrum Disorder (ASD) for individuals ages 18 months through 72 months who are at risk for developmental delay. The device is not intended for use as a stand-alone diagnostic device but as an adjunct to the diagnostic process. In 2022, Megerian and colleagues conducted a double-blinded, cohort study which tested the accuracy of CanvasDx. This study compared the diagnostic agreement of the device to two or more independent specialists in a cohort of 425 children (aged 18-72 months) who had developmental delay concerns (425 study completers, 36% female, 29% ASD prevalence). The PPV was determined to be 80.8% (95% CI, 70.3%-88.8%) and NPV was 98.3% (95% CI, 90.6%-100%). Of those who received a determinate output (ASD positive or negative [31.8%]) sensitivity was 98.4% (95% CI, 91.6%-100%) and specificity was 78.9% (95% CI, 67.6%-87.7%). Of 711 children originally consented to participate in the study, 286 (40%) dropped out. There is insufficient data to help us understand whether use of the Canvas Dx application increases time to diagnosis in a real-world setting, in a manner that is likely to improve clinically relevant ASD outcomes.

d-Nav Insulin Guidance System^®, Hygieia

The d-Nav Insulin Guidance System was evaluated in a multicenter RCT of 181 individuals with uncontrolled type 2 diabetes. Participants were randomized to either d-Nav and healthcare professional support (intervention group; n=93) or healthcare professional support alone (control group; n=88). The primary outcome of interest was to compare average change in HbA1c from baseline to 6 months. Safety was assessed by the frequency of hypoglycemic events. The mean decrease in HbA1c from baseline to 6 months was 1.0% in the intervention group, and 0.3% in the control group (p<0.0001). The difference in frequency of hypoglycemic events between the groups was not statistically significant (Bergenstal, 2019). Current data is limited to a single study of small sample size and long-term data of net health outcomes is lacking.

Drowzle^® Pro, Resonea

Drowzle Pro is a mobile software system that records and analyzes respiratory patterns during sleep to facilitate the in-home screening of obstructive sleep apnea (OSA).

Drowzle was evaluated in a longitudinal cohort study of 59 individuals who were administered a clinically indicated polysomnography (PSG) in a sleep lab where investigators compared the DROWZLE algorithm to PSG results. Investigators found the algorithm provided a sensitivity of 93.7%, specificity of 63.0%, negative predictive value of 89.5%, and positive predictive value of 75.0%, in the detection of moderate and severe OSA among individuals compared to PSG scores (Narayan, 2019). Studies evaluating real-world application are lacking, as is data describing how screening results impact diagnosis and management of OSA as compared to generally accepted standards of medical practice.

EndeavorRx^™, Akili Interactive

EndeavorRx is a game-based therapeutic intervention designed to improve cognitive function in children aged 8-12 who have been diagnosed with ADHD through a video game-like interface via at-home play for 25 min per day, 5 days per week for 4 weeks.

EndeavorRx was evaluated in an RCT which enrolled 348 children (8-12 years old) diagnosed with ADHD to receive treatment with either EndeavorRx (n=108) or a digital control intervention (n=168). Enrolled children were ineligible if they were already receiving medical therapy for ADHD. The mean change from baseline on the Test of Variables of Attention (TOVA) Attention Performance Index (API) was 0.93 in the EndeavorRx group and 0.03 in the control group (Adjusted p<0.050); there were no differences between groups on secondary measures. There were no serious adverse events or discontinuations. Treatment-related adverse events were mild and included frustration (3%) and headache (2%). Compliance averaged 83% of expected sessions played (Kollins, 2020). Study limitations included the enrollment of only children with an objective baseline deficit in attentional function and those not currently receiving medical treatment for ADHD, thus representing a small subset of the ADHD population. In addition, the study-period was limited to 28 days of follow-up. It is unclear whether the treatment resulted in the improvement of clinically meaningful outcomes or benefits commensurate to generally accepted standards of medical practice.

In 2021, Kollins and colleagues conducted a multi-center, open-label study of EndeavorRx as an adjunct to pharmacotherapy in a cohort of 8-14-year-old study participants with ADHD on stimulant medication (n=130) and not on any medication for ADHD (n=76). The enrolled participants used EndeavorRx for 4 weeks, followed by a 4-week pause and another 4-week treatment. The primary outcome of interest was change in ADHD-related impairment after 4 weeks as measured by the Impairment Rating Scale (IRS). IRS showed a statistically significant improvement in both cohorts (p<0.001) after 4 weeks. However, it is unclear whether treatment with EndeavorRx generates a clinically meaningful benefit as the minimum clinically important difference (MCID) in childhood ADHD symptoms for the IRS has not been established. Durability of effect also remains to be determined.

FibriCheck^®, Qompium, NV

FibriCheck is indicated for self-testing by individuals who have been diagnosed with, or are susceptible to developing, atrial fibrillation and who would like to monitor and record their heart rhythms on an intermittent basis. At present, only a pilot study with limited study participant numbers is published in the peer-reviewed literature (Beerten, 2021). While additional peer-reviewed evidence is available addressing diagnostic validity and performance, there is limited evidence to determine a meaningful impact on clinical outcomes.

Freespira^®, PaloAlto Health Sciences, Inc

Freespira is intended for the treatment of post-traumatic stress disorder (PTSD), panic disorder, panic attacks and other panic symptoms. Treatment entails two 17-minute in home sessions daily for 4 weeks under the supervision of a licensed healthcare provider.

Freespira was evaluated in a multicenter, single arm trial of 69 adults with panic disorder who received 4 weeks of Capnometry Guided Respiratory Intervention (CGRI) using Freespira, which provides feedback of end-tidal CO2 (PETCO2) and respiration rate (RR) via a custom sensor device. This intervention is delivered via home use following initial training by a clinician and provides remote monitoring of client adherence and progress by the clinician. Outcomes were assessed immediately post-treatment and at 2- and 12-month follow-up. CGRI was associated with a response rate of 83% and a remission rate of 54%, in addition to large decreases in panic severity. Similar decreases were found in functional impairment and in global illness severity. Gains were largely sustained at follow-up. PETCO2 moved from the slightly hypocapnic range to the normocapnic range (Tolin, 2017).

In 2020, Kaplan and colleagues evaluated the impact of Freespira over a 12-month period in a cohort of 51 individuals enrolled at a single center. In total, 45 (87%) completed the 4-week, twice-daily Freespira home device treatments and at least 15 of the 56 protocol-specified therapy sessions. By study-end (12 months) just 22 participants were available for complete analysis. Overall, the cohort’s Panic Disorder Severity Scale (PDSS) score fell from a baseline median of 14.4 (standard deviation [SD]=3.8) to 4.4 (SD=4.5) at 12 months, and 82% of the cohort reported a PDSS decrease of ≥ 40% (clinically significant) whereas 86% were free from panic attacks.

Currently available evidence evaluation of Freespira lacks comparison to generally accepted standards of medical practice, is limited by small sample sizes despite the prevalence of panic disorder in the general population and is subject to bias from loss to follow-up (Ostacher, 2021).

Halo^™ AF Detection System, LIVMOR, Inc

Halo is a wearable smartwatch device for intermittently monitoring pulse rhythms to detect atrial fibrillation (AF).

While there is no published peer-reviewed evidence at this time evaluating the Halo device, a retrospective propensity-matched cohort study was published in 2021 (Wang) which included 125 individuals with AF using wearables to monitor heart rate and rhythm and 500 with AF who did not use wearables. Study participants were followed for 90 days to compare pulse rate and healthcare use between individuals who wore wearables and those who did not. The study found that prior to propensity matching, those who use wearables were, on average, significantly younger (p<0.001) and healthier (composite score of congestive heart failure, hypertension, diabetes, prior ischemic event, vascular disease, age, and gender; p<0.001). After matching, study participants using wearables were found to have similar pulse rates, to those who did not, but utilized significantly more healthcare. In particular, there was a significant difference in receipt of a cardiac ablation, with 17.6% (n=22) in the wearables group compared to 7.4% (n=37; p=0.001) having received an ablation. The study authors conclude, “Given the increasing use of wearables by patients with AF, prospective, randomized, long-term evaluation of the associations of wearable technology with health outcomes and health care use is needed.”

Home Vision Monitor^® (HVM; previously myVisionTrack), Vital Art and Science, LLC

Home Vision Monitor is intended for the detection and characterization of central 3 degrees metamorphopsia (visual distortion) in individuals with maculopathy, including age-related macular degeneration and diabetic retinopathy, and as an aid in monitoring progression of disease factors causing metamorphopsia.

Korot and colleagues (2021) studied the Home Vision Monitor in a cohort study of 417 individuals to evaluate uptake and engagement of the application but no published studies have evaluated clinically meaningful outcomes related to use of the software.

Insulia^®, Voluntis, Inc.

Insulia (formerly called Diabeo-Basal, Franc, 2019) is a Software program that recommends basal insulin doses for adults with Type 2 diabetes treated with long-acting insulin analogs as an aid in the management of diabetes based on the treatment plan created by a healthcare provider.

Insulia was evaluated in a 13-month RCT which enrolled a total of 191 participants with inadequately controlled type 2 diabetes who were randomized into three groups: group 1 (standard care, n=63), group 2 (interactive voice response system, n=64) and group 3 (Diabeo-BI app software, n=64). At 4 months follow-up, HbA1c reduction was significantly higher in the telemonitoring groups (p<0.002). Fasting blood glucose was reached by twice as many subjects in the telemonitoring groups as in the control group, and insulin doses were also titrated to higher levels. No severe hypoglycemia was observed in the telemonitoring groups and mild hypoglycemia frequency was similar in all groups (Franc, 2019). Current data is limited to a short period of evaluation, and the comparison arms sample sizes were limited.

In 2020, Franc and colleagues published results of a multicenter RCT to investigate the efficacy of the Diabeo app software (Insulia) in a real word study (TELESAGE study). This open-label trial enrolled 665 individuals who were randomized into one of three parallel study arms: standard of care, Diabeo alone, or Diabeo+telemonitoring. The primary outcome was reduction in HbA1c levels at 12-month follow-up. Participants who used Diabeo one or more times a day demonstrated a significant and meaningful reduction in HbA1c levels compared to the standard of care arm after a 12-month follow-up (mean difference -0.41% in Diabeo alone arm [p=0.001] and -0.51% for Diabeo+telemonitoring arm [p≤0.001]). Adherence rates across all three study arms were very low. In the intention-to-treat population, HbA1c changes and incidence of hypoglycemia were comparable between arms. In this trial, intention-to-treat analyses showed no meaningful benefit, despite post-hoc exploratory analyses demonstrating statistical significance.

iSageRx, AmalgamRx, Inc.

iSageRx is indicated for the management of type 2 diabetes by calculating appropriate long-acting basal insulin doses for titrating insulin levels based on a clinician-prescribed, individualized titration plan. Currently, there is no published peer-reviewed evidence evaluating iSageRx, beyond an abstract, which permits reasonable conclusions regarding impact on health outcomes (Grdinovac, 2019).

MamaLift Plus™

MamaLift Plus is a prescription-only digital therapeutic designed to provide components of CBT for use in the treatment of mild to moderate postpartum depression. In 2024, MamaLift Plus received clearance for marketing by the FDA for individuals 22 years of age and older diagnosed with mild to moderate postpartum depression, as an adjunct to clinician-managed outpatient care. The mobile or tablet-based application’s self-guided, interactive treatment modules are designed for daily use over a period of 8 to 9 consecutive weeks (FDA, 2024).

MamaLift Plus clearance was based on unpublished results from the SuMMER (Supporting Maternal Mental health & Emotional Regulation) clinical trial (NCT05958095). SuMMER was a sham-controlled, RCT which enrolled 141 participants across 33 states. Study participants were randomized 2:1 to MamaLift Plus and treatment as usual (TAU) or the sham control arm (a digital placebo arm plus TAU). The study was powered to enroll 210 study participants with a planned interim analysis to meet a deadline for FDA input; as a result, the study was stopped at the enrollment of 141 participants. The primary outcome was a 4-point change on the Edinburgh Postnatal Depression Scale (EPDS) scale, which is considered a clinically significant change. Two follow-up assessments were planned for week-4 and week-8 (study-end). Report of study outcomes are pending peer-reviewed publication. Several methodological concerns are worth noting: the study was unblinded, treatment as usual was not tracked, and missing data handled was not mentioned in the protocol (missing rates are higher in the sham arm). The long‐term benefit of treatment with MamaLift Plus plus TAU on recurrent depression has not been evaluated in studies lasting beyond 8 weeks. The ability of MamaLift Plus to prevent potential depression relapse or recurrent depressive episodes after treatment discontinuation has not been studied.

Mobile Insulin Dosing System (MIDS), Glooko, Inc.

MIDS is indicated for the management of type 2 diabetes by calculating appropriate long-acting basal insulin doses for titrating insulin levels based on a clinician-prescribed, individualized titration plan. Currently, there is no published peer-reviewed evidence evaluating MIDS which permits reasonable conclusions regarding impact on health outcomes.

My Dose Coach, Sanofi, Inc.

My Dose Coach is a smartphone application designed to help users diagnosed with type 2 diabetes titrate their basal insulin according to a clinician-prescribed individualized titration plan. Unnikrishnan (2022) and colleagues conducted a retrospective analysis included 2517 active users; 85% of users were from India, none resided in the US. Two weeks of data was analyzed. Just under 50% of users had high MDC usage and 44% (irrespective of usage frequency) achieved their individual fasting blood glucose target. High use was associated with significantly better fasting blood glucose target achievement and less time to achieve that target compared to the moderate- and low-usage groups (p<0.01 for all). There was no significant difference in hypoglycemia incidence among usage groups. This relatively brief (2 weeks) retrospective trial did not include participants from the US, had limited usage amongst participants and lacked a comparison group.

In 2023, Hermanns and colleagues published results from an open-label, RCT which enrolled 236 individuals diagnosed with type 2 diabetes with a BMI ≥25.0 kg/m2 who were on basal insulin therapy or were initiating basal insulin therapy, and had suboptimal glycemic control (HbA1c >7.5%; 58.5 mmol/mol). Completing participants in the intervention group (n=117) titrated their basal insulin dose using My Dose Coach for 12 weeks. Control group participants (n=119) titrated their basal insulin dose according to a written titration chart. The primary outcome was the baseline-adjusted change in HbA1c at 12 weeks. Investigators reported a between-group difference of -0.31% (95% CI: 0.01%-0.69%; p=0.04) in favor of the My Dose Coach group. Study outcomes demonstrated a low-magnitude statistically significant difference but not a clinically significant difference in HbA1c after 12 weeks of My Dose Coach use. Further study is warranted to permit reasonable conclusions regarding My Dose Coach’s impact on health outcomes.

NightWare^™, Apple Watch^®

NightWare is a mobile application that exclusively uses Apple’s smartwatch motion and heart rate data to detect the occurrence of nightmares and arouses the wearer by vibrating with the intention of interrupting the nightmare without waking the sleeper. Davenport and colleagues (2022) conducted a 30-day, RCT to determine the efficacy of NightWare in 65 Veterans (n=30 in active arm; n=35 in control arm) with impaired sleep secondary to trauma-related nightmares. The primary outcome was the Pittsburgh Sleep Quality Index (PSQI). Other measures included self-reported sleep quality, PTSD/depression symptoms, and quality of life. Individuals in both the active and control arms demonstrated statistically significant improvement on all measures relative to their own baseline measures. However, none of the comparisons between arms reached a statistically significant difference. A post hoc analysis that excluded participants with low frequency usage (<50% of nights) demonstrated a statistically significant (p=0.016) improvement in perceived sleep quality (based on the Pittsburg Sleep Quality Index) amongst the remaining 21 participants in the active arm, relative to 27 control participants. However, in this exploratory analysis of high utilizers, the relevant difference (2.2 points on the PSQI) did not reach the relevant MCID (2.5 points). This trial was of short duration, users exhibited low app usage and results did not demonstrate a clinically meaningful difference in the intent-to-treat population.

Oleena^®, Voluntis, Inc.

Oleena received FDA 510K clearance in 2019 as a prescription mobile app designed to help individuals diagnosed with cancer better manage their symptoms as well as enable remote monitoring by care teams. Currently, there is no published peer-reviewed evidence evaluating Canvas Dx which permits reasonable conclusions regarding impact on health outcomes.

Parallel^™, Mahana Therapeutics, Inc.

Parallel (formerly known as Regul8) is a Digital program that uses cognitive behavioral therapy (CBT) to reduce the severity of symptoms for irritable bowel syndrome (IBS). It is intended to be used together with other IBS treatments to treat adults, 22 years or older, for up to 3 months.

The premise behind Parallel (web-based CBT) was evaluated in the Assessing Cognitive behavioural Therapy for IBS (ACTIB) trial, a three-arm, RCT in which 558 participants were enrolled into either a telephone-delivered CBT (TCBT; n=186) group, web-based CBT (WCBT; n=185) group with minimal therapist support, or treatment as usual (TAU, n=187) (Everitt 2019a). Both intervention groups continued to also receive treatment as usual. The primary outcomes of interest were IBS Symptom Severity Score (IBS-SSS) and Work and Social Adjustment Scale (WSAS) at 12 months. At study end, 27% of the TCBT arm, 73% of the WCBT arm, and 30% of the TAU group were lost to follow-up. Of the remaining study participants, compared with TAU, IBS-SSS and WSAS scores were significantly lower in the TCBT group (both scores p<0.001) and the WCBT group (p=0.002 and p=0.001, respectively) at 12 months. There were no serious adverse reactions to any interventions. The study was limited by a substantial loss to follow-up and the dissimilarities between the interventions in the study and the Parallel application. Also, comparison to in-person CBT is lacking.

Everitt and colleagues (2019b) conducted a 24-month follow-up to the ACTIB trial, at which time, 58% (n=323 of the original 558 participants remained). At 24 months the IBS-SSS score was significantly lower in the TCBT group (p=0.002) relative to TAU but the differences in the WCBT group were not sustained (p=0.33). Similarly, the mean WSAS score was lower in the TCBT group (p<0.001) but differences in the WCBT group fell to marginal significance (p=0.036) relative to the TAU group. Given the continued substantial loss to follow-up and loss in significance in the WCBT group (more comparable to the Parallel application software design than TCBT), the efficacy of the application as an intervention for refractory IBS, remains to be established.

Regulora^®, metaMe Health Inc.

Regulora provides gut-directed hypnotherapy for adults 22 years of age and older who have been diagnosed with IBS. Regulora is indicated as a 3-month treatment for individuals with abdominal pain due to IBS and is intended to be used together with other IBS treatments.

In 2023, Berry and colleagues published results of an open-label RCT in which 362 adults with IBS were enrolled to compare the safety and efficacy of Regulora with that of digital muscle relaxation accessed via a mobile app on a smartphone or tablet. The primary endpoint was reduction in self-reported abdominal pain (defined as ≥ 30% reduction from baseline in average daily abdominal pain intensity) during the 4-week follow-up period. Study authors report an improvement in the Regulora group, however no significant difference between the two study groups was found (p=0.54). Further investigation is warranted.

Rejoyn

Rejoyn is a smartphone-based digital therapeutic designed to be used by individuals diagnosed with major depressive disorder (MDD) to administer 6 weeks of CBT and emotion-focused mindfulness therapy (EFMT). Following the initial 6-week treatment period the CBT modules were available for repeat viewing for up to 4 additional weeks. In 2024, Rejoyn received 510K clearance from the FDA for the treatment of MDD as an adjunct to clinician-managed outpatient care for adults ages 22 years and older who are being treated with antidepressant medication (FDA, 2024).

The FDA clearance of Rejoyn was based on unpublished results from the remotely conducted Mirai trial, a multicenter, double-blinded RCT (NCT04770285). The primary objective of Mirai was to evaluate the effectiveness of Rejoyn in reducing depressive symptoms. The study’s primary efficacy endpoint was the change in the Montgomery-Asberg Depression Rating Scale (MADRS) total score at week-6. Report of study outcomes are pending peer-reviewed publication.

SleepCheckRx

SleepCheckRx is a mobile software system that screens adults for the risk of moderate to severe OSA by analyzing breathing and snore sounds recorded on an Apple iPhone. Currently there is no peer-reviewed published data on SleepCheckRx which permits reasonable conclusions regarding impact on health outcomes.

Table 1. Examples of Practitioner-prescribed, FDA cleared or approved, MSAs (not an all-inclusive list)

Mobile application (mobile app): Software application that can be executed (run) on a mobile platform (i.e., a handheld commercial off the-shelf computing platform, with or without wireless connectivity), or a web-based software application that is tailored to a mobile platform but is executed on a server.

Mobile platform: Commercial off-the-shelf (COTS) computing platforms, with or without wireless connectivity, that are handheld in nature (e.g., mobile computers such as smart phones, tablet computers, or other portable computers).

Off-the-self: As purchased or as commonly available, without modification or customization.

Over-the-counter: Non-prescription therapeutic intervention.

Software: A set of instructions, data or programs used to operate a computing device and execute specific tasks; a generic term used to refer to applications, scripts and programs.

Peer Reviewed Publications:

1. Abbas H, Garberson F, Glover E, Wall DP. Machine learning approach for early detection of autism by combining questionnaire and home video screening. J Am Med Inform Assoc. 2018; 25(8):1000-1007.
2. Abbas H, Garberson F, Liu-Mayo S, et al. Multi-modular AI approach to streamline autism diagnosis in young children. Sci Rep. 2020; 10(1):5014.
3. Agarwal P, Mukerji G, Desveaux L, et al. Mobile app for improved self-management of type 2 diabetes: multicenter pragmatic randomized controlled trial. JMIR Mhealth Uhealth. 2019. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6329896/. Accessed on June 28, 2024.
4. Bae H, Shin H, Ji HG, et al. App-based interventions for moderate to severe depression: a systematic review and meta-analysis. JAMA Netw Open. 2023; 6(11):e2344120.
5. Batterham PJ, Christensen H, Mackinnon AJ, et al. Trajectories of change and long-term outcomes in a randomised controlled trial of internet-based insomnia treatment to prevent depression. BJPsych Open. 2017; 3(5):228-235.
6. Beerten SG, Proesmans T, Vaes B. A heart rate monitoring app (FibriCheck) for atrial fibrillation in general practice: pilot usability study. JMIR Form Res. 2021; 5(4):e24461.
7. Bergenstal RM, Johnson M, Passi R, et al. Automated insulin dosing guidance to optimise insulin management in patients with type 2 diabetes: a multicentre, randomised controlled trial. Lancet. 2019; 393(10176):1138-1148.
8. Berry SK, Berry R, Recker D, et al. A randomized parallel-group study of digital gut-directed hypnotherapy vs muscle relaxation for irritable bowel syndrome. Clin Gastroenterol Hepatol. 2023; 21(12):3152-3159.
9. Beukes E, Andersson G, Fagelson M, Manchaiah V. Internet-based audiologist-guided cognitive behavioral therapy for tinnitus: Randomized controlled trial. J Med Internet Res. 2022; 24(2):e27584.
10. Catalá-López F, Hutton B, Núñez-Beltrán A, et al. The pharmacological and non-pharmacological treatment of attention deficit hyperactivity disorder in children and adolescents: A systematic review with network meta-analyses of randomised trials. PLoS One. 2017;12(7):e0180355.
11. Christensen H, Batterham PJ, Gosling JA, et al. Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight Study): a randomised controlled trial. Lancet Psychiatry. 2016; 3(4):333-341.
12. Christensen DR, Landes RD, Jackson L, et al. Adding an Internet-delivered treatment to an efficacious treatment package for opioid dependence. J Consult Clin Psychol. 2014; 82(6):964-972.
13. Davenport ND, Werner JK. A randomized sham-controlled clinical trial of a novel wearable intervention for trauma-related nightmares in military veterans. J Clin Sleep Med. 2023; 19(2):361-369.
14. Everitt HA, Landau S, O'Reilly G, et al. Assessing telephone-delivered cognitive-behavioural therapy (CBT) and web-delivered CBT versus treatment as usual in irritable bowel syndrome (ACTIB): a multicentre randomised trial. Gut. 2019a; 68(9):1613-1623.
15. Everitt HA, Landau S, O'Reilly G, et al. Cognitive behavioural therapy for irritable bowel syndrome: 24-month follow-up of participants in the ACTIB randomised trial. Lancet Gastroenterol Hepatol. 2019b; 4(11):863-872.
16. Franc S, Joubert M, Daoudi A et al. Efficacy of two telemonitoring systems to improve glycaemic control during basal insulin initiation in patients with type 2 diabetes: The TeleDiab-2 randomized controlled trial. Diabetes Obes Metab. 2019; 21(10):2327-2332.
17. Grdinovac K, Robbins DC, Lavenbarg TA, et al. iSage: successful basal insulin titration managed by a prescription-only digital therapy for T2DM [Abstract]. Diabetes. 2019; 68(Suppl. 1).
18. Hermanns N, Ehrmann D, Finke-Groene K, et al. Use of smartphone application versus written titration charts for basal insulin titration in adults with type 2 diabetes and suboptimal glycaemic control (My Dose Coach): multicentre, open-label, parallel, randomised controlled trial. Lancet Reg Health Eur. 2023; 33:100702.
19. Hsia J, Guthrie NL, Lupinacci P, et al. Randomized, controlled trial of a digital behavioral therapeutic application to improve glycemic control in adults with type 2 diabetes. Diabetes Care. 2022; 45(12):2976-2981.
20. Kaplan A, Mannarino AP, Nickell PV. Evaluating the impact of Freespira on panic disorder patients' health outcomes and healthcare costs within the Allegheny Health Network. Appl Psychophysiol Biofeedback. 2020; 45(3):175-181.
21. Kollins SH, Childress A, Heusser AC, Lutz J. Effectiveness of a digital therapeutic as adjunct to treatment with medication in pediatric ADHD. NPJ Digit Med. 2021; 4(1):58.
22. Kollins S, DeLoss D, Canadas E, et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet. 2020. 2(4): e168-e178.
23. Korot E, Pontikos N, Drawnel FM, et al. Enablers and barriers to deployment of smartphone-based Home Vision Monitoring in clinical practice settings. JAMA Ophthalmol. 2022; 140(2):153-160.
24. Kumar A, Ross JS, Patel NA, et al. Studies of prescription digital therapeutics often lack rigor and inclusivity. Health Aff (Millwood). 2023; 42(11):1559-1567.
25. Maricich YA, Bickel WK, Marsch LA, et al. Safety and efficacy of a prescription digital therapeutic as an adjunct to buprenorphine for treatment of opioid use disorder. Curr Med Res Opin. 2021; 37(2):167-173.
26. Maricich YA, Xiong X, Gerwien R, et al. Real-world evidence for a prescription digital therapeutic to treat opioid use disorder. Curr Med Res Opin. 2021; 37(2):175-183.
27. Megerian JT, Dey S, Melmed RD, et al. Evaluation of an artificial intelligence-based medical device for diagnosis of autism spectrum disorder. NPJ Digit Med. 2022; 5(1):57.
28. Narayan S, Shivdare P, Niranjan T, et al. Noncontact identification of sleep-disturbed breathing from smartphone-recorded sounds validated by polysomnography. Sleep Breath. 2019; 23(1):269-279.
29. Ostacher MJ, Fischer E, Bowen ER, et al. Investigation of a capnometry guided respiratory intervention in the treatment of posttraumatic stress disorder. Appl Psychophysiol Biofeedback. 2021; 46(4):367-376.
30. Quinn CC, Shardell MD, Terrin ML, et al. Cluster-randomized trial of a mobile phone personalized behavioral intervention for blood glucose control. Diabetes Care. 2011; 34(9):1934-1942.
31. Ritterband LM, Thorndike FP, Ingersoll KS, et al. Effect of a web-based cognitive behavior therapy for insomnia intervention with 1-year follow-up: A randomized clinical trial. JAMA Psychiatry. 2017; 74(1):68-75
32. Tolin DF, McGrath PB, Hale LR, et al. A multisite benchmarking trial of capnometry guided respiratory intervention for panic disorder in naturalistic treatment settings. Appl Psychophysiol Biofeedback. 2017; 42(1):51-58.
33. Unnikrishnan AG, Viswanathan V, Zhou FL, et al. Impact of My Dose Coach App Frequency of Use on Clinical Outcomes in Type 2 Diabetes. Diabetes Ther. 2022; 13(5):983-993.
34. Wang L, Nielsen K, Goldberg J, et al. Association of wearable device use with pulse rate and health care use in adults with atrial fibrillation. JAMA Netw Open. 2021;4(5): e215821.
35. Weinstein MM, Collins S, Quiroz L, et al. Multicenter randomized controlled trial of pelvic floor muscle training with a motion-based digital therapeutic device versus pelvic floor muscle training alone for treatment of stress-predominant urinary incontinence. Female Pelvic Med Reconstr Surg. 2022; 28(1):1-6.
36. Yarnitsky D, Dodick D, Grosberg BM, et al. Remote electrical neuromodulation (REN) relieves acute migraine: A randomized, double-blind, placebo-controlled, multicenter trial. Headache. 2019; 59(8):1240-1252.

Government Agency, Medical Society, and Other Authoritative Publications:

1. Agency for Healthcare Research and Quality's (AHRQ). May 20, 2022. Evaluation of Mental Health Mobile Applications. Available at: https://effectivehealthcare.ahrq.gov/products/mental-health-apps/report. Accessed on June 28, 2024.
2. American Medical Association. Proposed guidelines aim for safe, effective mobile health apps. January 22, 2018. Available at: https://www.ama-assn.org/practice-management/digital/proposed-guidelines-aim-safe-effective-mobile-health-apps. Accessed on June 28, 2024. 
3. Curio Digital Therapeutics, Inc. Curio Digital Therapy for the Treatment of Post-partum Depression (SuMMER). NCT05958095. Updated July 24, 2023.  Available at: https://classic.clinicaltrials.gov/ct2/show/NCT05958095. Accessed June 20, 2024.
4. Institute for Clinical and Economic Review (ICER). Digital health technologies as an adjunct to medication assisted therapy for opioid use disorder. December 11, 2020. Available at: https://icer.org/wp-content/uploads/2020/08/ICER_Digital_Therapeutics_for_OUD_Evidence_Report.pdf. Accessed on June 28, 2024.
5. Institute for Human Data Science (IQVIA). Digital Health Trends 2021: Innovation, evidence, regulation and adoption. Available at: https://www.iqvia.com/insights/the-iqvia-institute/reports/digital-health-trends-2021. Accessed on June 28, 2024.
6. Otsuka Pharmaceutical Development & Commercialization, Inc. Trial to Evaluate the Effectiveness of a Digital Therapeutics in Adults Diagnosed With Major Depressive Disorder (MIRAI). NCT04770285. Updated May 07, 2024.  Available at: https://classic.clinicaltrials.gov/ct2/show/NCT04770285. Accessed June 20, 2024.
7. Rosenblatt P, McKinney J, Rosenberg RAet al. Evaluation of an accelerometer-based digital health system for the treatment of female urinary incontinence: A pilot study. Neurourol Urodyn. 2019; 38(7):1944-1952.
8. U.S. Food and Drug Administration (FDA) Center for Devices and Radiological Health De Novo Clearance. Nerivio Migra^® (Theranica Bioelectronics ltd.; Philadelphia, PA). No. DEN180059. Summary of Safety and Effectiveness. Rockville, MD: FDA. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf18/DEN180059.pdf. Accessed on June 28, 2024.
9. U.S. Food and Drug Administration (FDA) Center for Devices and Radiological Health 510(k) Premarket Notification Database. Summary of Safety and Effectiveness. Rockville, MD: FDA.
   • AspyreRx^™. (Better Therapeutics, Inc; San Francisco, CA) No. DEN220058. July 07, 2023. Available at: https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/denovo.cfm?id=DEN220058. Accessed on June 28, 2024.
   • BlueStar^® Rx. (WellDoc, Inc; Columbia, MD). No. K162532. January 12, 2017. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf16/k162532.pdf. Accessed on June 28, 2024.
   • CanvasDx^TM. (Cognoa, Inc, Palo Alto, CA). No. DEN200069. June 02, 2021. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf20/DEN200069.pdf. Accessed on June 28, 2024.
   • d-Nav System^®. (Hygieia, Inc.; Livonia, MI). No. k181916. February 04, 2019. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf18/K181916.pdf. Accessed on June 28, 2024.
   • Drowzle^® PRO. (Resonea, Inc.; St. Louis, MO). No. Kl73974. July 14, 2019. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf17/K173974.pdf. Accessed on June 28, 2024.
   • EndeavorRx^™. (Akili Interactive Labs Inc.; Philadelphia, PA). No. 21 CFR 882.5803. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf20/DEN200026.pdf.Accessed on June 28, 2024.
   • FibriCheck^®. (Qompium NV; Chevy Chase Md. ) No K173872. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf17/K173872.pdf. Accessed on June 28, 2024. 
   • Freespira^®. (Palo Alto Health Sciences, Inc.; Palo Alto, CA). No. K180173. August 23, 2018. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf18/K180173.pdf. Accessed on June 28, 2024.
   • Halo^TM AF Detection System. (LIVMOR, Inc., Frisco, Tx). No. K201208. September 23, 2020. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf20/K201208.pdf. Accessed on June 28, 2024.
   • Home Vision Monitor^® (HVM) (Vital Art and Science, LLC.; Richardson, TX). No K121738 July 07, 2017. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf12/K121738.pdf. Accessed on June 28, 2024.
   • Insulia^®. (Voluntis S.A. Suresnes, France). No. K161433. November 9, 2016. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf16/K161433.pdf. Accessed on June 28, 2024.
   • iSageRx. (Amalgam Rx, Inc., Wilmington, DE) No. K161865. March 7, 2017. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf16/K161865.pdf. Accessed on June 28, 2024.
   • MamaLift Plus. (Curio Digital Therapeutics Inc, Princeton, New Jersey). No. K223515. April 22, 2024. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf22/K223515.pdf. Accessed on June 20, 2024.
   • Mobile Insulin Dosing System (MIDS). (Glooko, Palo Alto, CA). No. K171450. January 02, 2018. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf17/K171450.pdf. Accessed on June 28, 2024. 
   • My Dose Coach. (Sanofi, Inc. Dubai, UAE). No. K163099. March 22, 2017. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf16/K163099.pdf. Accessed on June 28, 2024.
   • NightWare^™. (NightWare, Inc.; Minneapolis, MN). No. DEN200033. November 6, 2020. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf20/DEN200033.pdf. Accessed on June 28, 2024.
   • Parallel^TM. (Mahana Therapeutics; San Francisco, CA). No. K211372. June 02, 2021. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf21/K211372.pdf. Accessed on June 28, 2024.
   • Regulora™. (metaMe Health, Inc; Chicago, IL). No. K211463. K211463. November 24, 2021. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf21/K211463.pdf. Accessed on June 28, 2024.  
   • Rejoyn. (Otsuka America Pharmaceutical, Inc., Rockville, MD). No. K231209. March 30, 2024. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf23/K231209.pdf. Accessed on June 28, 2024.
   • SleepCheckRx. (ResApp Health, Ltd., Brisbane, Queensland, Australia). No. K213360. June 10, 2022. Available at: https://www.accessdata.fda.gov/cdrh_docs/pdf21/K213360.pdf. Accessed on June 28, 2024. 
10. U.S. Food and Drug Administration (FDA). Developing a software precertification program: a working model (v1.0). January 2019. Available at: https://www.fda.gov/media/119722/download. Accessed on June 28, 2024.
11. U.S. Food and Drug Administration (FDA). Developing the Software Precertification Program: Summary of learnings and ongoing activities: 2020 Update. September 2022. Available at: https://www.fda.gov/media/142107/download. Accessed on June 28, 2024.
12. U.S. Food and Drug Administration (FDA). Policy for device software functions and mobile medical applications. September 2019. Available at: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/policy-device-software-functions-and-mobile-medical-applications. Accessed on June 28, 2024.
13. US. Food and Drug Administration (FDA). Report on Risks and Benefits to Health of Non-device Software Function. November 2022. Available at: https://www.fda.gov/media/163762/download. June 28, 2024. 
14. US. Food and Drug Administration (FDA). Software Pre-Cert Pilot Program. September 2022. Available at: https://www.fda.gov/medical-devices/digital-health-center-excellence/digital-health-software-precertification-pre-cert-pilot-program. Accessed on June 28, 2024.
15. World Health Organization. Recommendations on digital interventions for health system strengthening. April 2019. Available at: https://apps.who.int/iris/bitstream/handle/10665/311941/9789241550505-eng.pdf?ua=1. Accessed on June 28, 2024.

1. American Psychiatric Association (APA). Mental health apps. Available at: https://www.psychiatry.org/psychiatrists/practice/mental-health-apps.. Accessed on June 28, 2024.
2. Food and Drug Administration (FDA). Examples of device software functions the FDA regulates. Updated September 09, 2022. Available at: https://www.fda.gov/medical-devices/device-software-functions-including-mobile-medical-applications/examples-device-software-functions-fda-regulates. Accessed on June 28, 2024.
3. Pew Research Center. Mobile Fact Sheet. 2021. Available at: https://www.pewresearch.org/internet/fact-sheet/mobile/. Accessed on June 28, 2024.