Diffusion tensor imaging (DTI) is a non-invasive technique for analyzing the movement of water in the brain. However, the precision of measurements required for tracking white matter pathways can lead to long scan times, which can be challenging for some patient populations such as pediatric patients. To address this issue, researchers have been experimenting with deep learning techniques for faster estimation of DTI parameters, which are helpful in neurological diagnosis, of diffusion-weighted images. Our proposed solution is a transformer neural network-based approach for fast estimation of diffusion tensor parameters using sparse measurements. While there have been attempts to address this problem, our proposed model handles both scalable and generalized estimation of DTI parameters using multiple sparse measurements. Through experimentation on the Human Connectome Project (HCP) Young Adult benchmark dataset, our proposed model demonstrated state-of-the-art results in terms of fractional anisotropy (FA), axial diffusivity (AD), and mean diffusivity (MD) when compared to traditional linear least square (LLS) fitting and 3D U-Net model with input size (3D U-Net16).