We present deep near-infrared Js-, H-, and Ks-band imaging of a field around MS 1054-03, a massive cluster at z=0.83. The observations were carried out with the ISAAC instrument at the ESO Very Large Telescope (VLT) as part of the Faint Infrared Extragalactic Survey (FIRES). The total integration time amounts to 25.9hr in Js, 24.4hr in H, and 26.5hr in Ks, divided nearly equally between four pointings covering 5.5'x5.3'. The 3 total limiting AB magnitudes for point sources from the shallowest to the deepest pointing are J^tot^_s,AB_=26.0-26.2, H^tot^_AB_=25.5-25.8, and K^tot^_s,AB_=25.3-25.7mag. The effective spatial resolution of the co-added images has FWHM=0.48", 0.46", and 0.52" in Js, H, and Ks, respectively. We complemented the ISAAC data with deep optical imaging using existing Hubble Space Telescope WFPC2 mosaics through the F606W and F814W filters and additional U-, B-, and V-band observations we obtained with the VLT FORS1 instrument. We constructed a Ks-band-limited multicolor source catalog down to K^tot^_s,AB_~25mag (~5{sigma} for point sources). The catalog contains 1858 objects, of which 1663 have eight-band photometry. We describe the observations, data reduction, source detection, and photometric measurements method. We also present the number counts, color distributions, and photometric redshifts zph of the catalog sources. We find that our Ks-band counts at the faint end 22<~K_s,AB_<~25, with slope dlogN/dm=0.20, lie at the flatter end of published counts in other deep fields and are consistent with those we derived previously in the Hubble Deep Field-South (HDF-S), the other FIRES field. Spectroscopic redshifts zsp are available for ~330 sources in the MS 1054-03 field; comparison between zph and zsp shows very good agreement, with <|zsp-zph|/(1+zsp)>=0.078. The MS 1054-03 field observations complement our HDF-S data set with a nearly 5 times larger area at ~0.7mag brighter limits, providing more robust statistics for the slightly brighter source populations.