Due to the cost and practical difficulty of obtaining complete and accurate measurements for every individual, population health studies often involve incomplete and error-prone measurements, with missingness and measurement error varying across heterogeneous subpopulations. Although these problems frequently coexist and interact, they are often addressed separately in existing methods. To address these issues, we propose HTree-VAE, a deep latent-variable framework for joint imputation and denoising. The framework combines pattern-aware latent modeling with a hierarchical tree-routed encoder that enables selective parameter sharing across latent subpopulations through a novel reconvergent routing mechanism. It leverages accurate measurements from a validation subset for denoising and explicitly models observation patterns to accommodate both ignorable and nonignorable missingness. Simulation studies demonstrated substantial improvements in reconstruction accuracy over competing deep generative methods. Ablation studies further demonstrated that tree-based and reconvergent routing improved imputation accuracy. We applied HTree-VAE to data from the National Health and Nutrition Examination Survey to denoise self-reported body mass index and impute missing values. HTree-VAE outperformed competing approaches in imputation and achieved competitive performance in correcting self-reported body mass index. These findings highlight the practical value of jointly addressing missingness and measurement error.
翻译:暂无翻译