The warm Neptune GJ 3470b transits a nearby (d=29 pc) bright slowly rotating M1.5-dwarf star. Using spectroscopic observations during two transits with the newly commissioned NEID spectrometer on the WIYN 3.5m Telescope at Kitt Peak Observatory, we model the classical Rossiter-McLaughlin effect, yielding a sky-projected obliquity of {lambda}=98_-12_^+15^{deg} and a vsini=0.85_-0.33_^+0.27^km/s. Leveraging information about the rotation period and size of the host star, our analysis yields a true obliquity of {psi}=95_-8_^+9^{deg}, revealing that GJ 3470b is on a polar orbit. Using radial velocities from HIRES, HARPS, and the Habitable-zone Planet Finder, we show that the data are compatible with a long-term radial velocity (RV) slope of \dot{gamma}=-0.0022+/-0.0011m/s/d over a baseline of 12.9yr. If the RV slope is due to acceleration from another companion in the system, we show that such a companion is capable of explaining the polar and mildly eccentric orbit of GJ 3470b using two different secular excitation models. The existence of an outer companion can be further constrained with additional RV observations, Gaia astrometry, and future high-contrast imaging observations. Lastly, we show that tidal heating from GJ 3470b's mild eccentricity has most likely inflated the radius of GJ 3470b by a factor of ~1.5-1.7, which could help account for its evaporating atmosphere.