We use CEERS JWST/NIRCam imaging to measure rest-frame near-IR light profiles of 435 M*>10^10^M_{sun}_ galaxies in the redshift range of 0.5<z<2.3. We compare the resulting rest-frame 1.5-2{mu}m half-light radii (RNIR) with stellar half-mass radii (R_M*_) derived with multicolor light profiles from CANDELS Hubble Space Telescope imaging. In general agreement with previous work, we find that RNIR and R_M*_ are up to 40% smaller than the rest-frame optical half-light radius Ropt. The agreement between RNIR and R_M*_ is excellent, with a negligible systematic offset (<0.03dex) up to z=2 for quiescent galaxies and up to z=1.5 for star-forming galaxies. We also deproject the profiles to estimate R_M*,3D_, the radius of a sphere containing 50% of the stellar mass. We present the R-M* distribution of galaxies at 0.5<z<1.5, comparing Ropt, R_M*_, and R_M*,3D_. The slope is significantly flatter for R_M*_ and R_M*,3D_ compared to Ropt, mostly due to downward shifts in size for massive star-forming galaxies, while R_M*_ and R_M*,3D_ do not show markedly different trends. Finally, we show rapid evolution of the size (R{propto}(1+z)^-1.7+/-0.1^) of massive (M*>10^11^M_{sun}_) quiescent galaxies between z=0.5 and z=2.3, again comparing Ropt, R_M*_, and R_M*,3D_. We conclude that the main tenets of the evolution of the size narrative established over the past 20yr, based on rest-frame optical light profile analysis, still hold in the era of JWST/NIRCam observations in the rest-frame near-IR.