We present NICMOS J _ { 110 } ( rest-frame 1200-2100 Å ) observations of the three z = 5.7 Ly \alpha emitters discovered in the blind multislit spectroscopic survey by ( 44 ) . These images confirm the presence of the two sources which were previously only seen in spectroscopic observations . The third source , which is undetected in our J _ { 110 } observations has been detected in narrowband imaging of the Cosmic Origins Survey ( COSMOS ) , so our nondetection implies a rest frame equivalent width > 146 Å ( 3 \sigma ) . The two J _ { 110 } – detected sources have more modest rest frame equivalent widths of 30-40 Å , but all three are typical of high-redshift LAEs . In addition , the J _ { 110 } - detected sources have UV luminosities that are within a factor of two of L ^ { * } _ { UV } , and sizes that appear compact ( r _ { hl } \sim 0 \farcs 15 ) in our NIC2 images – consistent with a redshift of 5.7 . We use these UV-continuum and Ly \alpha measurements to estimate the i _ { 775 } - z _ { 850 } colors of these galaxies , and show that at least one , and possibly all three would be missed by the i - dropout LBG selection . These observations help demonstrate the utility of multislit narrowband spectroscopy as a technique for finding faint emission line galaxies .