Multi-wavelength scattered light imaging of debris disks may inform dust properties including typical size and mineral composition. Existing studies have investigated a small set of individual systems across a variety of imaging instruments and filters, calling for uniform comparison studies to systematically investigate dust properties. We obtain the surface brightness of dust particles in debris disks by post-processing coronagraphic imaging observations, and compare the multi-wavelength reflectance of dust. For a sample of resolved debris disks, we perform a systematic analysis on the reflectance properties of their birth rings. We reduced the visible and near-infrared images of 23 debris disk systems hosted by A through M stars using two coronagraphs onboard the Hubble Space Telescope: the STIS instrument observations centering at 0.58um, and the NICMOS instrument at 1.12um or 1.60um. For proper recovery of debris disks, we used classical reference differential imaging for STIS, and adopted non-negative matrix factorization with forward modeling for NICMOS. By dividing disk signals by stellar signals to take into account of intrinsic stellar color effects, we systematically obtained and compared the reflectance of debris birth rings at ~90{deg} scattering angle. Debris birth rings typically exhibit a blue color at ~90{deg} scattering angle. As the stellar luminosity increases, the color tends to be more neutral. A likely L-shaped color-albedo distribution indicates a clustering of scatterer properties. The observed color trend correlates with the expected blow-out size of dust particles. The color-albedo clustering likely suggests different populations of dust in these systems. More detailed radiative transfer models with realistic dust morphology will contribute to explaining the observed color and color-albedo distribution of debris systems.