We present optical and near-infrared searches for afterglow emission from the first four Swift bursts with accurate positions from the X-ray Telescope ( XRT ) . Using telescopes at Las Campanas , Keck , and Palomar observatories we rapidly identified and followed up afterglows for three of the four bursts . The burst positions were also observed with the Very Large Array , but no radio afterglow emission was detected . The optical/NIR afterglows are fainter than about 75 \% of all afterglows detected to date , with GRB 050126 being the faintest , and were identified thanks to accurate and rapid positions from the XRT and rapid response with \gtrsim 1 -m telescopes . This suggests that the fraction of dust-obscured bursts is small , \lesssim 10 \% when combined with afterglows localized by the HETE-2 Soft X-ray Camera . The X-ray fluxes are typical of the known population , with the exception of GRB 050126 which has the faintest X-ray afterglow to date ( normalized to \Delta t = 10 hr ) , and was detected thanks to a response time of only 130 s after the burst . Finally , we find that all three optical/NIR afterglows are located \lesssim 2 arcsec away from the nominal XRT positions , suggesting that the XRT is capable of delivering highly accurate positions , which will revolutionize afterglow studies .