Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis

thesis Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis published CHe Mohamed Khaled Ashmawy author 81286 Buse Akay author 88405 Alvaro Balderrama author 741710000-0002-4118-2838 DEP1634 department 44. eCAADe-Konferenz Deploying digital twins across the broader building stock is constrained by a key bottleneck: high-quality 3D content from LiDAR or photogrammetry remains labor-intensive and difficult to scale. We introduce Generative Twins (GT), a workflow that shifts digital twin creation from explicit geometric reconstruction toward probabilistic 3D synthesis. The pipeline takes a single street-level façade photograph, corrects perspective distortion and removes occlusions, uses an instruction-conditioned multimodal image model to synthesise an isometric view of the building, and passes that view to an image-to-3D reconstruction model that leverages learned shape priors to produce a textured mesh without manual modelling. Three image to-3D platforms (Hitem3D, Hyper3D and Hunyuan3D 3.1) are compared on identical isometric inputs and assessed on architectural boundary clarity. We demonstrate GT through two applied cases: (i) reconstruction of ordinary residential streets in Detmold as stimuli for a virtual-reality study of multi sensory urban perception, and (ii) Green Editor, a design-exploration tool in which façade greenery is added or removed at the image layer before mesh generation. Together these cases position Generative Twins as a scalable pathway for the digitization of ordinary building stock, with emphasis on controllability, editability, and iterative design workflows. eCAADe2026Lübeck eng Digital TwinsVirtual Reality (VRArtificial Intelligence (AI)Image-to-3DGenerative Design. eCAADe proceedings 2684-184310.52842/conf.ecaade.2026.1.619 1 M.K. Ashmawy, B. Akay, A. Balderrama, Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis, eCAADe, 2026. Ashmawy, Mohamed Khaled, Buse Akay, and Alvaro Balderrama. Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. ECAADe Proceedings. Vol. 1. eCAADe, 2026. <a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">https://doi.org/10.52842/conf.ecaade.2026.1.619</a>. Ashmawy MK, Akay B, Balderrama A. Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. Vol 1. eCAADe; 2026. doi:<a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">10.52842/conf.ecaade.2026.1.619</a> M.K. Ashmawy, B. Akay, A. Balderrama, Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis, eCAADe, 2026. Ashmawy, M. K., Akay, B., & Balderrama, A. (2026). Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. In eCAADe proceedings (Vol. 1). eCAADe. <a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">https://doi.org/10.52842/conf.ecaade.2026.1.619</a> Ashmawy MK, Akay B, Balderrama A. Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. Vol. 1, eCAADe proceedings. eCAADe; 2026. M. K. Ashmawy, B. Akay, and A. Balderrama, Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis, vol. 1. eCAADe, 2026. doi: <a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">10.52842/conf.ecaade.2026.1.619</a>.

Ashmawy, Mohamed Khaled, Buse Akay und Alvaro Balderrama. 2026. Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. eCAADe proceedings. Bd. 1. eCAADe. doi:<a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">10.52842/conf.ecaade.2026.1.619</a>, .

Ashmawy, Mohamed Khaled, et al. “Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis.” ECAADe Proceedings, vol. 1, eCAADe, 2026, <a href="https://doi.org/10.52842/conf.ecaade.2026.1.619">https://doi.org/10.52842/conf.ecaade.2026.1.619</a>. Ashmawy, Mohamed Khaled/Akay, Buse/Balderrama, Alvaro: Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis, Bd. 1, o. O. 2026. Ashmawy MK, Akay B and Balderrama A (2026) Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. eCAADe.

Ashmawy, Mohamed Khaled ; Akay, Buse ; Balderrama, Alvaro: Towards Generative Twins: An AI Based Pipeline from Explicit 3D Reconstruction to Probabilistic Synthesis. Bd. 1 : eCAADe, 2026

140702026-09-30T10:14:15Z2026-10-01T14:28:23Z