Halifax made a blistering start to the second round tie at St Giles Road, Jason St Juste and Jamie Rainford scoring to put them 2-0 up after 20 minutes.
Shane Hamilton reduced the deficit on the hour before substitute Reece Richards netted Halifax's third five minutes later.
Hamilton finished well to make it 3-2 with two minutes remaining and set-up a tense finish but the visitors held firm to book a third round tie with Guiseley.
Hamilton finished well to make it 3-2 with two minutes remaining and set-up a tense finish but the visitors held firm to book a third round tie with Guiseley.
2 / 2